jchristi/syndicat

A fast feed reader

WARNING: WORK IN PROGRESS! NOTHING HERE ACTUALLY WORKS YET!

SyndiCat

A fast RSS parser and reader based on Tiny-Tiny-RSS

Installation

Currently no working installation.

Feature Ideas

A few features that may be implemented in the future:

• full article fetching
• find hidden feeds (by guessing common feed URL patterns) - DONE
• embedded spritzing for fast, easy article reading. Doesn't work well for articles with tables or images (See also: Glance, Squirt)
• Pluggable feed entry exporters (ie. "send to" / "share")
• Feed aggregator+filter: http://dai-shi.github.io/rss-pipes/
• Article content compression in database BLOB field (Snappy, EXI, or Fast Infoset)
  • Snappy - node-snappy
  • EXI - exificient.js
  • MariaDB page compression
• Aggregate similar or duplicate / linked articles
  • use LDA algorithm for similarity
• Smart ranking and filtering
  • Popularity score via Twitter, Alexa, etc.
• Non-RSS sources, scrapper plugins to convert HTML pages to feeds
  • YouTube
  • Twitter
  • Google+
  • Google Groups
  • GitHub
  • Twitch.tv
  • Mailing Lists
  • Hacker News
• Masquerade user-agent string 1, 2
• Use of AWS services (or IBM or Azure or other clouds):
  • AWS Lambda + Serverless Aurora or DynamoDB + Fargate for very cheap hosting
  • Amazon Comprehend - analysis of articles for sentiment, keywords, topics, etc
  • Amazon Polly - text to speech
  • Amazon Transcribe - speech to text (podcasts, youtube videos, etc)
  • Amazon Neptune - graph database (see alos wikidata.org)
• Discover similar sites/feeds
  • Alexa.com find similar sites
    • alexa.com/siteinfo/whatever.com
  • TopSimilarSites.com - pretty good (might use alexa)
  • moreofit.com - very good
  • SimilarSites.com
  • SimilarSiteSearch - doesnt work as of Mar 2018
  • SimilarPages.com - not very good
  • Google.com search "related:whatever.com"
  • Google.com search "link:whatever.com -site:whatever.com" (sites that link to whatever.com)
  • Crawl full text of all posts and look for commonly linked sites
• Automatically determine your favorite feeds and score them higher
• Allow comments to be added to feeds and articles
• See Flipboard for ideas. Also engineering.flipboard.com
• Similar/Related articles
  • Mark related/similar articles as read
• Dead feed finder/notifier719288
• Fetch entire history of a website
• Historical stats on a feed (like Trends) including how often it is read by you
• Slider to show from "Only most important articles" to "All and more" for a category or view
• Automatic detection of blog categories and provide UI for selecting which categories to subscribe to

Contributing

Contributions welcome. Please include mocha tests with all PRs.

Misc

Strict Mode

Why you should use strict mode everywhere: https://stackoverflow.com/a/23765454

Useful Resources

• Node Feature Support Chart

syndicat's Issues

global.getTestDB() needs to be moved

global.getTestDB is currently defined for each test. This needs to be moved into an index.js file and removed from each test.