nilmolne/text-mining-the-new-york-times-articles

Provides the tools needed to mine text from The New York Times online articles by using Python and a dictionary text mining technique, given a time range and country of interest.

text-mining-the-new-york-times-articles's Issues

AttributeError: 'DataFrame' object has no attribute 'atype'

Hi
Thank you for you work, it's very helpful.

But I'm receiving this error and I'm not sure what to do about it ?
`Retrieving articles URL...

AttributeError Traceback (most recent call last)
in ()
3
4 # Get Article URL List
----> 5 articles_df = get_articles_url(api, country, start_year, end_year)
6 articles_df.tail()

1 frames
/usr/local/lib/python3.6/dist-packages/textminingnyt.py in get_articles_url(api, country, start_year, end_year)
93
94 # Make sure we filter out non-news articles and remove 'atype' column
---> 95 articles_df = articles_df.drop(articles_df[articles_df.atype != 'News'].index)
96 articles_df.drop('atype', axis = 1, inplace = True)
97

/usr/local/lib/python3.6/dist-packages/pandas/core/generic.py in getattr(self, name)
5272 if self._info_axis._can_hold_identifiers_and_holds_name(name):
5273 return self[name]
-> 5274 return object.getattribute(self, name)
5275
5276 def setattr(self, name: str, value) -> None:

AttributeError: 'DataFrame' object has no attribute 'atype'

I hope you can help me
Thanks`

Working with the NYT API and get_articles_url() function.

Some pages requested to the API will return a 'No JSON object could be decoded' and its articles will be left out of analysis. ASAP I will take care of this issue by looping through the troublesome pages until the content is retrieved successfully.