pratikpv/reddit_scraper_and_sentiment_analyzer

Download reddit posts based on keywords and perform sentiment analysis on the posts.

reddit_scraper_and_sentiment_analyzer's Issues

How to download the comments from a reddit thread in addition to the starting post?

First of all this is such a nice and easy to use script. My only issue is that it only downloads the starting post of a thread. How would one go about downloading all the comments of that thread?

SentimentIntensityAnalyzer' is not defined

in reddit_post_sentiment_analysis.py line sid = SentimentIntensityAnalyzer() is only declared but the function is not coded. Please advice if you have the code for it.

Thank you,
Vishal

On some dates I get the following error:JSONDecodeError: Expecting value

I get the error below on some dates. Why that is and how can I fix it? Thank you :/

  File "C:\Users\apavl\reddit\download_data_from_reddit.py", line 95, in <module>
    data = get_pushshift_data(key_word, after, before, sub_reddit)

  File "C:\Users\apavl\reddit\download_data_from_reddit.py", line 15, in get_pushshift_data
    data = json.loads(r.text)

  File "C:\Users\apavl\anaconda3\envs\reddit\lib\json\__init__.py", line 348, in loads
    return _default_decoder.decode(s)

  File "C:\Users\apavl\anaconda3\envs\reddit\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())

  File "C:\Users\apavl\anaconda3\envs\reddit\lib\json\decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None

JSONDecodeError: Expecting value