Comments (3)
There should be options for limiting recursion depth and only recursing on the top N
replies to each tweet. The code also needs to avoid unnecessary requests by checking the reply counter on each tweet discovered; tweets without replies can be skipped entirely, and tweets with one reply can be skipped if that reply is also in the stream already.
from snscrape.
Hola: saben si con snscrape se puede encontrar el texto del twit y no sólo la dirección?
Se puede encontrar los seguidores de un usuario?
Gracias
from snscrape.
As beginner tried to write a selenium crawler for the answers. Unfortunately, it was far too inefficient. The tweet ids of the answers can be found as follows. After you opened the relevant tweet.
tweet = driver.find_elements_by_css_selector("div[data-testid='tweet']")
tweet_id = tweet.find_element_by_css_selector("a[href*='status']")
tweet_id = tweet_id.get_attribute('href').split("/")[-1]
maybe that is helpful for somebody who is able to scroll down the complete page and then use an html parser
from snscrape.
Related Issues (20)
- Cannot get tweets HOT 1
- List members of a Facebook group HOT 1
- vkontakte-user scrapes get redirected to badbrowser.php HOT 1
- Error scraping mastodon-profile HOT 1
- Twitter comment download HOT 1
- Instagram change something! index Error. HOT 1
- Question about the future of snscrape HOT 18
- AttributeError: 'FileFinder' object has no attribute 'find_module' HOT 3
- always 429 rate limit error HOT 1
- Twitter is not working HOT 1
- AttributeError: 'FileFinder' object has no attribute 'find_module' HOT 3
- AttributeError: 'FileFinder' object has no attribute 'find_module HOT 1
- How to use it on VM ParrotOS HOT 4
- module 'snscrape.utils' has no attribute 'TwitterSearch' HOT 1
- what modules are working
- Instagram index problem creating index error
- Error when start HOT 1
- CRITICAL:snscrape.base:Errors: blocked (404), blocked (404), blocked (404), blocked (404) HOT 2
- Cannot import snscrape as library when installed using pip. HOT 2
- Repository
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from snscrape.