arghya721 / pysitecrawler Goto Github PK
View Code? Open in Web Editor NEWPySiteCrawler is a Python library for web crawling and data extraction. It's designed for exploring web pages, extracting text, and managing links efficiently. You can easily store scraped data in .txt files for analysis. Future updates will add more traversal strategies.
Home Page: https://pypi.org/project/PySiteCrawler/