andrewmishchenko/yelp-parser

Example of parsing(crawling)

Example of parsing(crawling) yelp.com site

Installation:

• Download the latest version of Chromedriver
• Unzip and put chromedriver into project directory
• Go to the yelp.com and enter your query in the search bar
• Copy current url
• Change domain (in main.py) to current url
• Save main.py
• type pip3 install -r requirements.txt
• python3 main.py and wait :)

Features!

• Save extracted data into result.xls file in the project directory
• Multiprocessing

- result.xls format

company_name	url	website_url	rating	city_and_state	phone
Flat Price Moving & Auto Shipping	https://www.yelp.com/biz/flat-price-moving-and-auto-shipping-san-francisco?osq=Movers	flatpriceautotransport.com	4.5	San Francisco, CA 94123	[phone]

yelp-parser's Issues

Error: no such element: Unable to locate element

Hi,
I tried to use your lib.
When I launch the script python3 main.py

I got a error:

`Message: no such element: Unable to locate element: {"method":"css selector","selector":"a.next"}
  (Session info: chrome=79.0.3945.79)

Done!
Traceback (most recent call last):
  File "main.py", line 147, in <module>
    hrefs = get_saved_links()
  File "main.py", line 96, in get_saved_links
    with open('hrefs.txt', 'r') as doc:
FileNotFoundError: [Errno 2] No such file or directory: 'hrefs.txt'`

How can I solve this problem?
Thanks