- Selenium module can automatically analyze and crawl selected data.
- Node mailer can be used to dynamically fetch data, if there is information update on the selected web page, it will send an email to notify you in time.
- 'Weibo hot news crawler' is a practice of data crawling.
Selenium, node-mailer, cheerio
-
Folder of node-mailer test_Gmail
- before install the packages, you need to setup your own Gmail authorization in nodemailer.js
npm install node nodemailer.js
-
Folder of Selenium Automated crawler
- Attention: the version of chromedriver.exe depends on your own Chrome version. If version mismatch, go http://chromedriver.storage.googleapis.com/index.html to update chromedriver.exe.
node autoControl.js (auto search and write files) Or node autoPage.js (auto print results)
-
Folder of Weibo hot news crawler
npm install node app.js
1.Node Mailer