metricsgrimoire/ircanalysis

IRC Analysis Tool

IRCAnalysis

IRC Analysis Tool

Usage example:

acs@lenovix:~/devel/IRCAnalysis$ mysqladmin -u root create ircdb
acs@lenovix:~/devel/IRCAnalysis$ ./irc_analysis.py -d ircdb --channel test --format plain --dir=test/data/
...
Total messages: 5552

A table irclog is created in the "ircdb" with all the information parsed from irc channel.

mysql> select count(*) from irclog;
+----------+
| count(*) |
+----------+
|     5552 |
+----------+

ircanalysis's Issues

Error 'NoneType' object has no attribute 'find_all'

I found the following error analyzing these logs: http://irc-logs.puppetlabs.com/

Error parsing puppet/#puppet-2010-02-27.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-02-28.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-03-01.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-03-02.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-03-03.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-03-04.log.html file: 'NoneType' object has no attribute 'find_all'
Error parsing puppet/#puppet-2010-03-05.log.html file: 'NoneType' object has no attribute 'find_all'

Error reading IRC logs of the last two months

Log are correctly parsed until October, where the errors appear.

This is the command used:

/usr/local/bin/irc_analysis.py --db-user="root" --db-password=*** --database="lcanas_irc_puppetlabs_2338" --dir="puppet" --channel="puppet" --format html

And this is the new error:

/usr/local/lib/python2.7/dist-packages/pyircanalysis/database.py:62: Warning: Table 'irclog' already exists
  self.cursor.execute(query)
/usr/local/lib/python2.7/dist-packages/pyircanalysis/database.py:69: Warning: Table 'channels' already exists
  self.cursor.execute(query)

Error parsing puppet/#puppet-2008-03-18.log.html file: 'utf8' codec can't decode byte 0xcf in position 123213: invalid continuation byte
Error parsing puppet/#puppet-2013-10-02.log.html file: 'NoneType' object has no attribute 'replace'
Error parsing puppet/#puppet-2013-10-03.log.html file: 'NoneType' object has no attribute 'replace'
Error parsing puppet/#puppet-2013-10-04.log.html file: 'NoneType' object has no attribute 'replace'
Error parsing puppet/#puppet-2013-10-05.log.html file: 'NoneType' object has no attribute 'replace'
Error parsing puppet/#puppet-2013-10-06.log.html file: 'NoneType' object has no attribute 'replace'
...