Giter Site home page Giter Site logo

an7ar35 / covid19-fr-gouv-fetcher Goto Github PK

View Code? Open in Web Editor NEW
0.0 2.0 0.0 9.04 MB

Fetcher for the official french government webpage for the Covid19 information (inc. forms)

License: MIT License

Shell 2.38% HTML 97.62%
covid19-france covid19 page-scraper coronavirus fetcher

covid19-fr-gouv-fetcher's Introduction

French governemnt Covid19 information and form fetcher script

ENG

The official french governement page for the coronavirus is a good place to keep informed but (a) it's long and (b) doesn't indiquate what exactly has changed... So I wrote this little shell script (BASH) to fetch the page and the 2 forms that are required when going outside lest you end up with a rather hefty fine. The script just compares the HTML and the txt version of the forms with any previously downloaded ones and signals if there are any changes between the two versions.

This way you can diff the content when it does actually change and you don't have to re-read the entire thing over.

A cron-job or adding version control actions to the script is possible if you care to contribute. It's a quick and mildly dirty solution to a problem that will hopefully come to pass sooner rather than later.

Stay safe people.

Instruction: Just clone the repo and run the fetch.sh script from within. You could also make a cron job so that it does it regularly (every 6h for example).

Update: I've added my daily snapshots (/snapshots) of the different scraped files for archival and historical value.

FR

La page officielle du gouvernement français pour le coronavirus est un bon endroit pour se tenir informé mais (a) c'est un texte long et (b) n'indique pas ce qui a changé exactement ... J'ai donc écrit ce petit script shell (BASH) pour aller chercher la page et les 2 formulaires nécessaires pour sortir. Le script compare simplement le HTML et la version txt des formulaires avec ceux précédemment téléchargés et signale s'il y a des changements entre les deux versions.

De cette façon, vous pouvez diff (différencier) le contenu lorsqu'il change et vous n'avez pas à relire la totalité.

Un cron-job ou l'ajout d'actions git au script est possible si vous souhaitez contribuer. C'est une solution rapide et faîte sur le tas à un problème qui, espérons-le, finira plus tôt que tard.

Restez tous en bonne santé.

Instruction: il suffit de cloner le "repo" et d'exécuter le script fetch.sh dans le dossier. Vous pouvez également faire un cron job pour qu'il le fasse régulièrement (toutes les 6h par exemple).

Mise à jour: j'ai ajouté mes instantanés quotidiens (/snapshots) des différents fichiers récupérés à des fins d'archivage et d'historique.

covid19-fr-gouv-fetcher's People

Contributors

an7ar35 avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.