mathiastj/orsted-price-scraper

orsted-price-scraper's Issues

Returned prices should be ordered by date

Add simple scrape mutex

Add a simple database mutex such that another scraper cannot start while one is ongoing.

Fails to load west prices on Heroku

It looks like o-geo-knot.left from: https://github.com/mathiastj/orsted-price-scraper/blob/master/src/scraper.js#L39 does not exist ever when run on Heroku.

Therefore I only get the prices from the East region.

Could reproduce locally before setting in the sleep on line 38. Maybe up the sleep timer a lot more? Or use another way to indicate east/west.
I can't wait for the knot to appear since it might not, if we are on east.

Chrome suddenly won't launch

2019-06-23T20:22:08.404843+00:00 app[web.1]: 'Error: Failed to launch chrome!\n\n(chrome:22): Gtk-WARNING **: 20:22:08.380: cannot open display: \n\n\nTROUBLESHOOTING: https://github.com/GoogleChrome/puppeteer/blob/master/docs/troubleshooting.md\n\n    at onClose (/app/node_modules/puppeteer/lib/Launcher.js:342:14)\n    at ChildProcess.helper.addEventListener (/app/node_modules/puppeteer/lib/Launcher.js:332:60)\n    at ChildProcess.emit (events.js:203:15)\n    at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)',
2019-06-23T20:22:08.404845+00:00 app[web.1]: msg:
2019-06-23T20:22:08.404850+00:00 app[web.1]: 'Failed to launch chrome!\n\n(chrome:22): Gtk-WARNING **: 20:22:08.380: cannot open display: \n\n\nTROUBLESHOOTING: https://github.com/GoogleChrome/puppeteer/blob/master/docs/troubleshooting.md\n'