henrylin03/job-scraper

Python web-scraper for job postings

Hi, I'm Henry 👋

Portfolio | LinkedIn

💻 I'm a self-taught programmer with a love for designing simple UX, and bringing them to life with code.

📖 I'm currently learning HTML, CSS, and vanilla (no framework) JavaScript through, primarily, The Odin Project's "Full Stack JavaScript" course.

job-scraper's Issues

seek: unable to locate elements

job attributes are hidden between ::before and ::after:

This is raising exception:
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":".//a[@data-automation="jobTitle"]"}

Attempted an explicit wait with expected condition of the first job title being visible:

    WebDriverWait(DRIVER, 5).until(
        EC.visibility_of_element_located(
            (By.XPATH, './/a[@data-automation="jobTitle"]')
        )
    )
    for j in jobs:
        title = j.find_element(By.XPATH, './/a[@data-automation="jobTitle"]').text

But this did not resolve the exception being raised on the title variable line of code