stuartpb/achewatr

achewatr's Issues

Express should be updated

This should be fairly painless.

Links to 'shop.php' should be changed to point to a definite shop endpoint

Since the location of the shop is up in the air a lot, this would best be rewritten to '/shop', which would then be implemented as a route that redirects (currently) to http://achewood.myshopify.com/

Jade should be updated

Site / blogs should be crawled automatically and regularly

Now that Achewood is updating again, I should design this to crawl the site in real-time. That probably means a huge refactor for the crawlers to take the pages that have already been processed.

MongoDB should be replaced with RethinkDB

For a number of reasons, not the least of which is that MongoDB, last time I checked, struggles with some of the basic queries we need (like getting a random comic).

Links to prints and posters

It would be pretty cool if individual comics pointed to the page to buy their print / poster on http://achewood.myshopify.com/collections/comics

Modernize site approach

I've learned a lot in the year since I made this: lots of the stuff I originally wrote should be refactored.

• mongo -> mongoskin. Among other things, fixes the entire app being in one butt-ugly callback.
• envigor.
• Just generally updating package.json

xml-stream should be replaced with feedparser

https://github.com/danmactough/node-feedparser

Specifically designed to provide a much more hands-off, uniform interface to RSS feeds - and it's maintained, with more stars (first google result for "node rss").

Engines should be updated

We're now 2 major revisions of Node behind, and all kinds of lagged for npm. Also worth investigating: using io.js?

Integrate Twitter

Now that the characters are tweeting (as well as blogging), it would be cool if those tweets could be integrated somehow. I'm thinking maybe have a "Tweets after this comic was posted" approach.

Remove Blogger JS when parsing

As seen at http://orezscu.blogspot.com/2007/03/foto-quiz-no-2.html

XDate should be replaced with Moment

XDate is no longer maintained in favor of Moment.

Also, Moment (IIRC) has better support for time zones, which might make some time-zone-related hacks in the code less hacky.

Parsing should use Cheerio instead of jsdom

Cheerio is lighter weight and better suited to the kind of things the DOM is being used for in crawling, and it doesn't require a deep dive into its guts to use a better parser (admittedly newer jsdom may have fixed this as well).