Fluentd Input/Output plugin to process tweets with Twitter Streaming API.
before use, install dependent library as:
# for RHEL/CentOS
$ sudo yum install openssl-devel
# for Ubuntu/Debian
$ sudo apt-get install libssl-dev
gem install fluent-plugin-twitter
/usr/lib64/fluent/ruby/bin/fluent-gem install fluent-plugin-twitter
<source>
type twitter
consumer_key YOUR_CONSUMER_KEY # Required
consumer_secret YOUR_CONSUMER_SECRET # Required
oauth_token YOUR_OAUTH_TOKEN # Required
oauth_token_secret YOUR_OAUTH_TOKEN_SECRET # Required
tag input.twitter.sampling # Required
timeline sampling # Required (sampling or userstream)
keyword Ruby,Python # Optional
lang ja,en # Optional
output_format nest # Optional (nest or flat or simple[default])
</source>
<match input.twitter.sampling>
type stdout
</match>
$ tail -f /var/log/td-agent/td-agent.log
<source>
type http
port 8888
</source>
<match notify.twitter>
type twitter
consumer_key YOUR_CONSUMER_KEY
consumer_secret YOUR_CONSUMER_SECRET
access_token YOUR_OAUTH_TOKEN
access_token_secret YOUR_OAUTH_TOKEN_SECRET
</match>
$ curl http://localhost:8888/notify.twitter -F 'json={"message":"foo"}'
http://pocketstudio.jp/log3/2012/02/12/how_to_get_twitter_apikey_and_token/
http://qiita.com/items/fe4258b394190f23fece
- support fetching twitter search
- support fetching specific user userstream
patches welcome!
On starting fluentd, appearing alert message below. Please tell me how to fix up.
/usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/eventmachine-1.0.0/lib/eventmachine.rb:1530: warning: already initialized constant EM
Copyright © 2012- Kentaro Yoshida (@yoshi_ken)
Apache License, Version 2.0