WebScrapeSite (abbreviated wss) is a powerful and user-friendly web scraping tool written in python3. It provides a convenient and efficient way to extract data and insights from websites quickly. Whether you're a data analyst, researcher, developer or hacker, wss can help you gather the information you need from websites with one command. It can efficiently categorize and recover various web components such as hyperlinks, image links, JavaScript resources, stylesheet references, email addresses, whois records and much more, all with remarkable speed and accuracy.
It is equipped with flexible data export options, making it easy to save collected data in either CSV or JSON format. By default, it stores data in a CSV file, a widely accepted and human-readable format. Alternatively, you can choose to export data in JSON, a more structured format preferred by developers and applications. This adaptability ensures that you can seamlessly integrate the collected data into your analysis, research, development or attack workflows while catering to your specific requirements.
works on linux, windows & android (termux)
git clone https://github.com/s41r4j/wss/; cd wss; pip install -r requirements.txt
prerequisite: python3, pip, git, internet connection
| help menu | demo target |
|---|---|
|
|
python3 wss.py -h |
python3 wss.py -u google.com |
collocted data is automatically stored in a file (filename in yellow)
- 🗒️ examples:
python3 wss.py -u example.com
python3 wss.py -u example.com/example -f json
python3 wss.py -u https://example.com/ -a
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent