Shelve corruption

[isaacmg]

Shelve corruption

[isaacmg]

   return DbfilenameShelf(filename, flag, protocol, writeback)                                   
 File "/opt/conda/lib/python3.6/shelve.py", line 227, in __init__                                
   Shelf.__init__(self, dbm.open(filename, flag), protocol, writeback)                           
 File "/opt/conda/lib/python3.6/dbm/__init__.py", line 94, in open                               
   return mod.open(file, flag, mode)                                                             
AttributeError: module 'dbm.gnu' has no attribute 'open'                                          
                                                          

[isaacmg]

Bug is hopefully fixed by changing ln of fb_scrapper to

with shelve.open(path) as d:
            if page_id in d:
                time_opened = d[page_id]
                pageStamp = str(time_opened)
                print("Scraping since unix time " + pageStamp)

[isaacmg]

This should have been fixed with the migration to postgresql