Query TweetScraper

[jonbakerfish]

Query TweetScraper

[manvapatel]

Hi, I am also having the same problem. Only the first 20 results are scraped, whereas about a few weeks ago it was working perfectly. Any help would be appreciated. Thanks!

[shiwenThu]

Maybe my solution will work. Try to replace the '+' in the min_position with '%2B', it will continue to load the next page. It worked for me, however it still finished working after getting 8000 tweets, and I am still looking for the reason. If anybody face this problem but get it solved, please contact me! May it help you ~ At 2018-11-01 17:57:06, "manvapatel" <[email protected]> wrote: Hi, I am also having the same problem. Only the first 20 results are scraped, whereas about a few weeks ago it was working perfectly. Any help would be appreciated. Thanks! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

[adrianhp97]

Maybe my solution will work. Try to replace the '+' in the min_position with '%2B', it will continue to load the next page. It worked for me, however it still finished working after getting 8000 tweets, and I am still looking for the reason. If anybody face this problem but get it solved, please contact me! May it help you ~ At 2018-11-01 17:57:06, "manvapatel" [email protected] wrote: Hi, I am also having the same problem. Only the first 20 results are scraped, whereas about a few weeks ago it was working perfectly. Any help would be appreciated. Thanks! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

Where can i find the '+' in min_postition? which file?

[ganeshknr]

Maybe my solution will work. Try to replace the '+' in the min_position with '%2B', it will continue to load the next page. It worked for me, however it still finished working after getting 8000 tweets, and I am still looking for the reason. If anybody face this problem but get it solved, please contact me! May it help you ~ At 2018-11-01 17:57:06, "manvapatel" [email protected] wrote: Hi, I am also having the same problem. Only the first 20 results are scraped, whereas about a few weeks ago it was working perfectly. Any help would be appreciated. Thanks! — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

I also started facing the same issue from few days. Thanks @shiwenThu for providing your solution. By replacing + in min_position with %2B I am able to crawl the data. And I'm not facing the issue which you mentioned (Crawling stopping after 8000 tweets), Today i tested with this and i am able to crawl more than 30,000 tweets (and it is still running), Are you still facing the same?

[jonbakerfish]

Fixed in 7c8b707