woluxwolu/twint

twint's Issues

It's just not getting all the tweets...

Hey guys

I am just running twint -s "word" --since 2022-12-29" and it just stops even before reaching to 29th. It stops after 100 tweets at 13:45:00 2022-12-30 when it should continue scrapping..

Would you mind fixing this woluxlulu ?

Thanks

AttributeError: 'Config' object has no attribute 'Utc'

Not sure whether this is due to the archiving. Are you able to still get results?

CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs

Command Ran

c = twint.Config()
c = twint.Config()

c.Utc = True
c.Full_text = True
c.Username = "realDonaldTrump"
c.Search = "great"

Run

twint.run.Search(c)

Description of Issue

Data isn't getting fetching and it flashes this sleeping error. Has Twitter banned Twint?

Environment Details

Running this on Jupyter & Colab but facing same issue.

CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects'

I have been receiving "CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects' sleeping for 0 secs" for 3 days, when checking the browser with the same search that I generated in twint, the browser does return results

Has anyone had this same problem? and have you solved it?

No Data

I keep getting CRITICAL:root:twint.run:Twint:Feed:noData'data' recently. I haven't encountered this problem since last year and I can't seem to fix it. I tried to do the upgrade and it keeps giving me that

Code:
import twint
import datetime
import nest_asyncio

current_date=datetime.date.today()
previous_date=current_date-datetime.timedelta(days=1)

nest_asyncio.apply()
c.Search = srch
c.Lang='tl OR en'
c.Since=previous_date.strftime("%Y-%m-%d %H:%M:%S")
c.Until=current_date.strftime("%Y-%m-%d %H:%M:%S")
twint.run.Search(c)

Content in user_business_profile_state shows "none" even if user has a professionnal category such as "Entrepreneur

Hey guys, I am facing an issue

So when I am scrapping some users, "user_business_profile_state" indicates "none" but the thing is that the user has a business profile like this one here :

It should not be "none" but something like "true" idk, if someone already fixed that ? Would you mind telling me ?

Content in "Show additional replies, including those that may contain offensive content"

Hello,

Firstly, thanks for the fork.

I would like if it's possible to get the hidden replies (Show additional replies, including those that may contain offensive content) ?
Thank you

Doesn't get retweets

Hi, thank you for forking and fixing this!

I was scraping tweets based off their username and noticed everything under the retweet column is false, meaning no retweets have been scrapped