toshihirock/node-elb-log-parser

A basic parser for ELB access logs, strongly inspired by node-clf-parser https://github.com/jfhbrook/node-clf-parser

elb-log-parser

A basic parser for ELB access logs, strongly inspired by node-clf-parser https://github.com/jfhbrook/node-clf-parser.

When I use this npm?

• ELB Access Log(S3)->Lambda->ElasticSearch. Example awslabs/amazon-elasticsearch-lambda-samples
• Analyze ELB Access Log

Install

npm install -g elb-log-parser

Example command-line usage

906058675309_elasticloadbalancing_us-east-1_my-elb_20160420T1700Z_10.0.33.113_115hdtdv.log > elb-log-parser

Outputs JSON which can then be further processed with e.g. something like the json tool.

Example API usage

node-elb-log-parser$node
> var parse = require('./index');
undefined
> parse('2015-05-13T23:39:43.945958Z my-loadbalancer 192.168.131.39:2817 10.0.0.1:80 0.000086 0.001048 0.001337 200 200 0 57 "GET https://mytest-111.ap-northeast-1.elb.amazonaws.com:443/p/a/t/h?foo=bar&hoge=fuga HTTP/1.1" "curl/7.38.0" DHE-RSA-AES128-SHA TLSv1.2')
{ timestamp: '2015-05-13T23:39:43.945958Z',
  elb: 'my-loadbalancer',
  client: '192.168.131.39',
  client_port: '2817',
  backend: '10.0.0.1',
  request_processing_time: '0.000086',
  backend_processing_time: '0.001048',
  response_processing_time: '0.001337',
  elb_status_code: '200',
  backend_status_code: '200',
  received_bytes: '0',
  sent_bytes: '57',
  request: 'GET https://mytest-111.ap-northeast-1.elb.amazonaws.com:443/p/a/t/h?foo=bar&hoge=fuga HTTP/1.1',
  user_agent: 'curl/7.38.0',
  ssl_cipher: 'DHE-RSA-AES128-SHA',
  ssl_protocol: 'TLSv1.2',
  backend_port: '80',
  request_method: 'GET',
  request_uri: 'https://mytest-111.ap-northeast-1.elb.amazonaws.com:443/p/a/t/h?foo=bar&hoge=fuga',
  request_http_version: 'HTTP/1.1',
  request_uri_scheme: 'https:',
  request_uri_host: 'mytest-111.ap-northeast-1.elb.amazonaws.com',
  request_uri_port: '443',
  request_uri_path: '/p/a/t/h',
  request_uri_query: 'foo=bar&hoge=fuga' }
>

You get the idea.

Tests

$npm test

License

WTFPL

node-elb-log-parser's Issues

TypeError: Cannot read property 'split' of undefined

getting these errors calling this npm from the code at
https://github.com/prithviraju/aws-elb-logs-to-elasticsearch/blob/master/index.js

TypeError: Cannot read property 'split' of undefined
at module.exports (/var/task/node_modules/elb-log-parser/index.js:69:45)
at Transform.recordStream._transform (/var/task/index.js:148:25)
at Transform._read (_stream_transform.js:186:10)
at Transform._write (_stream_transform.js:174:12)
at doWrite (_stream_writable.js:397:12)
at writeOrBuffer (_stream_writable.js:383:5)
at Transform.Writable.write (_stream_writable.js:290:11)
at LineStream.ondata (_stream_readable.js:639:20)
at emitOne (events.js:116:13)
at LineStream.emit (events.js:211:7)

happen on line:
parsed['backend_port'] = parsed.backend.split(":")[1];

License Mismatch

Hi there. I wanted to point out that the package.json has an MIT license but the readme has WTFPL. This discrepancy makes it hard for me to use this small but helpful package. Would you consider updating the README to MIT to match package.json so I can use this package?

Thanks!