- This project is based on Scrapy(https://doc.scrapy.org/en/1.3/).
- This project has a proxy pool based on SSDB(http://ssdb.io/zh_cn/).
- This project supports distribute crawl use Redis(http://www.redis.cn/).
neo-101-zz / py_house_spider Goto Github PK
View Code? Open in Web Editor NEWThis project forked from lxs137/py_house_spider
A distribute crawl project