blacklabelops-legacy/logio

Log.io in a Docker Container

logio's Issues

Harvester crawl doesn't seem to be working?

Hi there,

Trying to get this setup for work we've got quite a few projects, and the harvester crawl seemed to be perfect, however I can't seem to get it working with more than one numerated log:

See below my docker-composer instance:

  logioweb:
    image: 'quay.io/blacklabelops/logio:latest'
    # container_name: logio
    environment:
      - 'LOGIO_ADMIN_USER='
      - 'LOGIO_ADMIN_PASSWORD='
      - LOGIO_CERTIFICATE_DNAME=
    ports:
      - '28778:28778'
    volumes:
      - '/opt/server'
    networks:
      air:
        ipv4_address: 172.10.0.30

  harvester:
    image: 'quay.io/blacklabelops/logio:latest'
    environment:
      - 'DELAYED_START=10'
      - 'LOGIO_HARVESTER_NODENAME=DockerLogs'
      - 'LOGIO_HARVESTER_STREAMNAME=UnifiedLogs'
      - 'LOGIO_HARVESTER_LOGFILES='
      - 'LOGS_DIRECTORIES=/var/lib/docker'
      - 'LOG_FILE_PATTERN=*.log'
      - 'LOGIO_HARVESTER1STREAMNAME=Phoenix_Reborn'
      - 'LOGIO_HARVESTER1LOGSTREAMS=/var/log/eagleeye/phoenix-reborn/'
      - 'LOGIO_HARVESTER1FILEPATTERN=*.log'
      - 'LOGIO_HARVESTER2STREAMNAME=Medusa'                     # When I remove the second addition the first one now then works, but when i add this second one, I get no nodes show up in log.io
      - 'LOGIO_HARVESTER2LOGSTREAMS=/var/log/eagleeye/medusa/'
      - 'LOGIO_HARVESTER2FILEPATTERN=*.log'
    volumes:
      - '/var/lib/docker:/var/lib/docker'
      - './log/:/var/log/eagleeye/'

Any idea what could cause this?

Cheers!

Pass multiple directories to find logs

Is there a way that specify multiple directories that contain logs, i.e. I want to monitor all logs in docker containers as well as /var/log folders. Thank you

Wrongly interpreted line break

The 'n' part from .json is interpreted as line break.

error log:

2016-03-28T14:20:48.748274474Z 
/root/.log.io/harvester.conf:8
".log
^^^^^
SyntaxError: Unexpected token ILLEGAL
    at Module._compile (module.js:439:25)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/usr/lib/node_modules/log.io/bin/log.io-harvester:9:8)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)

Change harvester's server => host and server => port to environment variable values

It would be nice to be able to use exporter's end point via ENV variables which would allow to use harvester's on external nodes as well.

logio_server='logio';
logio_server_port=28777;

if [ -n "${LOGIO_SERVER}" ]; then
  logio_server=${LOGIO_SERVER}
fi
if [ -n "${LOGIO_SERVER_PORT}" ]; then
  logio_server_port=${LOGIO_SERVER_PORT}
fi

Recurring crashes (not sure why)

Hello,

One of my logging directories must be doing something weird (I have no idea what, or which one is causing the issue).

Basically harvester crashes at the exact same time every time. When I do docker logs -f harvester is see this when it crashes.

node: ../deps/uv/src/unix/linux-inotify.c:230: uv__fs_event_close: Assertion `w != ((void *)0)' failed.
/opt/logio/docker-entrypoint.sh: line 16:   101 Aborted                 (core dumped) log.io-harvester

Here is a screencast of my issue so you can see it in action... https://screencast.com/t/D5tEVz0EEn

My question is, how do I determine which logging directory is causing this issue without really cumbersome process of elimination? Any further logs I can inspect?

streaming through TCP API

Hi!

I'm new with log.io, any tip to use the log streaming via TCP.

I'm running your docker-compose.yml and sending some messages to the server but it's not working

I really appreciate your help!

How to use in a subdirectory

Hi, thank you for sharing your great project. I'd like to use this containers inside a subdirectory like http://example.com/logio/ . I'm using haproxy in front of logio like a ProxyPass. Is it possible that logio serves requests as under a directory?