ankitaggarwal011/emailcrawler

An email crawler written in python.

Email crawler

This python code simply crawls the given web addresses for potential emails and saves those in a text file. Web URLs have to be specified in a text file separated by newline.

Motivation

This can be helpful script to automate the task of finding relevant email addresses provided one knows the associated web URLs.

Dependencies

The python modules are needed in order to use this library.

sys
urllib

Usage

Clone the repository and use the following code. Run the command directly from the console with command line arguments to the file emailcrawler.py. The command line arguments are explained as:

emailcrawler.py [filename]

For example,

$ python emailcrawler.py example.txt

example.txt contains newline separated web URLs on which the email addresses are to be located and saved. This command saves three text files, namely, email_addresses.txt (containing email addresses found), email_addresses_withurl.txt (contains email addresses mapped with associated urls) and info.txt (general information on number of pages crawled and number od emails found).

Contributors

Author: Ankit Aggarwal

License

MIT License

emailcrawler's Issues

Does not crawl https

I think the SSL library needs to be added to make it crawl most https sites