This project forked from martin2877/findlinks
crawl links from a website
License: GNU General Public License v3.0
Author：木禾
自己用python2写的一个爬页面工具，效果还不错。
1、通过a、frame标签，爬取页面链接。
2、可以设置爬取的级别。
3、具有去重功能。（你也可以在代码里去掉）
findlinks
│ 1.bat # 打开cmd
│ batch.py # 批量：批量域名爬取起始文件
│ findlinks.py # 核心脚本，单域名爬取
│ findlinks.pyc
│ LICENSE
│ README.md
│ urls.txt # 批量：将被爬的的地址
│ urls_old.txt # 批量：已爬的的地址
│
└─Results # 存放爬取结果python findlinks.py http://localhost/
先把域名写入在urls.txt中，然后执行：
python batch.py
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.