woluxwolu/twint

twint's Issues

It's just not getting all the tweets...

Hey guys

I am just running twint -s "word" --since 2022-12-29" and it just stops even before reaching to 29th. It stops after 100 tweets at 13:45:00 2022-12-30 when it should continue scrapping..

Would you mind fixing this woluxlulu ?

Thanks

No Data

I keep getting CRITICAL:root:twint.run:Twint:Feed:noData'data' recently. I haven't encountered this problem since last year and I can't seem to fix it. I tried to do the upgrade and it keeps giving me that

Code:
import twint
import datetime
import nest_asyncio

current_date=datetime.date.today()
previous_date=current_date-datetime.timedelta(days=1)

nest_asyncio.apply()
c.Search = srch
c.Lang='tl OR en'
c.Since=previous_date.strftime("%Y-%m-%d %H:%M:%S")
c.Until=current_date.strftime("%Y-%m-%d %H:%M:%S")
twint.run.Search(c)

Doesn't get retweets

Hi, thank you for forking and fixing this!

I was scraping tweets based off their username and noticed everything under the retweet column is false, meaning no retweets have been scrapped

Content in "Show additional replies, including those that may contain offensive content"

Hello,

Firstly, thanks for the fork.

I would like if it's possible to get the hidden replies (Show additional replies, including those that may contain offensive content) ?
Thank you

AttributeError: 'Config' object has no attribute 'Utc'

Not sure whether this is due to the archiving. Are you able to still get results?

CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs

Command Ran

c = twint.Config()
c = twint.Config()

c.Utc = True
c.Full_text = True
c.Username = "realDonaldTrump"
c.Search = "great"

Run

twint.run.Search(c)

Description of Issue

Data isn't getting fetching and it flashes this sleeping error. Has Twitter banned Twint?

Environment Details

Running this on Jupyter & Colab but facing same issue.

Content in user_business_profile_state shows "none" even if user has a professionnal category such as "Entrepreneur

Hey guys, I am facing an issue

So when I am scrapping some users, "user_business_profile_state" indicates "none" but the thing is that the user has a business profile like this one here :

It should not be "none" but something like "true" idk, if someone already fixed that ? Would you mind telling me ?

twint.token.RefreshTokenException: Could not find the Guest token in HTML

Issue Template

Please use this template!

Initial Check

If the issue is a request please specify that it is a request in the title (Example: [REQUEST] more features). If this is a question regarding 'twint' please specify that it's a question in the title (Example: [QUESTION] What is x?). Please only submit issues related to 'twint'. Thanks.

Make sure you've checked the following:

• [] Python version is 3.6 or later;
• [] Updated Twint with pip3 install --user --upgrade -e git+https://github.com/minamotorin/twint.git@origin/master#egg=twint;
• [] I have searched the issues and there are no duplicates of this issue/question/request (please link to related issues of twintproject/twint for reference).

Command Ran

Please provide the exact command ran including the username/search/code so I may reproduce the issue.

Description of Issue

Please use as much detail as possible.

Environment Details

Using Windows, Linux? What OS version? Running this in Anaconda? Jupyter Notebook? Terminal?

CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects'

I have been receiving "CRITICAL:root:twint.run:Twint:Feed:noData'globalObjects' sleeping for 0 secs" for 3 days, when checking the browser with the same search that I generated in twint, the browser does return results

Has anyone had this same problem? and have you solved it?