rahulk789/devops

The solution to the assignment question given to me.

The following repository caters to the following instructions:

1. Scrap tabular data from given URL(https://mcxlive.org/)
2. Store data in database of your choice(postgres/mongo dB)
3. Generate API from stored data ( json Response)
4. Run scheduler(cron job) for above scrapper(every 1 hour)
5. Design CI/CD pipeline

The execution of cronjob is done by the following commands:
crontab -e 0 * * * * cron projects/DevOps/cron.sh
enter crontab -l to see the added cron job.\

Json output after scraping:

Output on django server after retrieving stored data in postgresql.