last git pull broke twarc

[docnow]

last git pull broke twarc

[edsu]

I guess the problem went away?

[remagio]

Thx Ed, I found weird issues with requirements & genderator. Solved today.
But not clear why at first two full attempt of full upgrade, full unistall and re-install it didn't worked.

[edsu]

Ok, odd. Let me know if you notice any more problems. It changed a fair bit in the past few weeks.

[remagio]

@edsu not sure it's an issues but despite past release it quit very soon, after a few minutes it stop always at same point with (with or without --scrape):

2014-09-05 09:27:23,829 DEBUG rate limit remaining 98
2014-09-05 09:27:23,894 INFO no new tweets with id < 504996982268919809

But I'm sure there are many many more tweets to gather. What does it mean?

[remagio]

@edsu I repeated same query many time using same query, with and without --scrape, and often with --scrape I get:

2014-09-05 10:04:16,751 DEBUG rate limit remaining 86
2014-09-05 10:04:16,783 ERROR got error when fetching https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360 sleeping 10 secs: {'x-rate-limit-remaining': '0', 'status': '429', 'content-length': '56', 'set-cookie': 'guest_id=v1%3A140991145675505805; Domain=.twitter.com; Path=/; Expires=Sun, 04-Sep-2016 10:04:16 UTC', 'strict-transport-security': 'max-age=631138519', 'server': 'tfe_b', '-content-encoding': 'gzip', 'x-rate-limit-reset': '1409911525', 'date': 'Fri, 05 Sep 2014 10:04:16 UTC', 'x-rate-limit-limit': '180', 'content-type': 'application/json;charset=utf-8'} - {"errors":[{"message":"Rate limit exceeded","code":88}]}
2014-09-05 10:04:26,793 DEBUG fetching https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360
2014-09-05 10:04:26,794 ERROR unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360 - too many tries!
2014-09-05 10:04:26,794 ERROR unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360: unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360 - too many tries!
2014-09-05 10:04:26,794 DEBUG fetching https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360
2014-09-05 10:04:26,795 ERROR unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360 - too many tries!
2014-09-05 10:04:26,795 ERROR unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360: unable to fetch https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360 - too many tries!
2014-09-05 10:04:26,795 DEBUG fetching https://api.twitter.com/1.1/statuses/show.json?id=507608008927375360
2014-09-05 10:04:27,796 DEBUG rate limit remaining 85