lhongjum/data_jobs_data

This was a project to understand the Data Science/Engineer/Analyst job market in June 2020.

See my visualization of this data, including some basic data mining (association analysis)

Scraped Job Data

Download the CSV you want, or scrape your own data.

See my analysis of this dataset here

Thank you to:

• Selenium - A tool designed for QA testing, but that actually works great for making these types of bots
• Beautiful Soup - A tool to scrape HTML/XML content (that saved be big time with this project)
• Kenarapfaik

Installation

1. Install ChromeDriver (or an alternatie driver for your browser of choice):
2. Install Selenium: pip install selenium
3. Install BeautifulSoup: pip install beautifulsoup4

Usage

1. Use keyword to control which jobs you want to get, and loc for the location. get_jobs will get these jobs.
2. Use page_limit, which is a workaround for the page limit that only allows you to get 1000 jobs from each category if you are looking for more data.

License

This project is licensed under the MIT License - see the LICENSE.md file for details.