nirtsruya/rsscrawler

This is a simple RSS crawler spring boot application.

A simple UI is implemented using angular.

In order to run it simply

git clone https://github.com/nirtsruya/rsscrawler.git

mvn package

run the rsscrawler-1.0.jar file from target.

Paths: / The homepage you will see the crawled posts being added to a table

GET /posts

will return a list of the crawled posts

To add new urls to crawl, use the POST /crawl api.

POST /crawl
{
    "url" : "http://rss"
}

On startup the application will start a thread that will start crawling on a sample rss feed.

The homepage will auto refresh and display the list of the current urls that were crawled.