Giter Site home page Giter Site logo

mirusu400 / pinterest-infinite-crawler Goto Github PK

View Code? Open in Web Editor NEW
44.0 3.0 7.0 2.94 MB

An infinite Pinterest crawler/scraper. Crawl image with inifnite-scroll!

License: MIT License

Python 99.77% Batchfile 0.23%
crawler scraper python selenium scraping pinterest pinterest-downloader hacktoberfest

pinterest-infinite-crawler's Issues

Is your crawl normal?

Is your crawl normal? It seems to be stuck in the log-in. It may be restricted by anti-crawler

image

Configuration option to specify the path of Chrome binary

Hi,

Nice work, I tested the app and after debugging some problems it works perfectly well.

The issue is that I really don't use Chrome, so I have just a portable version from portableapps.

To try to make your code work I installed Chrome Beta, but it didn't work.

My guess is that is using the default path for Windows so I changed the folder name from
C:\Program Files\Google\Chrome Beta\Application\chrome.exe
to
C:\Program Files\Google\Chrome\Application\chrome.exe

And now it's working

I tried to make this work with another Chrome Binary but I get lost
for what I was reading must be a Selenium setting but I didn't find the right place to add this

from selenium.webdriver.chrome.options import Options
options = Options()
options.binary_location = "c:\myproject\chromeportable\chrome.exe"
# you may need some other options
#options.add_argument('--no-sandbox')
#options.add_argument('--no-default-browser-check')
#options.add_argument('--no-first-run')
#options.add_argument('--disable-gpu')
#options.add_argument('--disable-extensions')
#options.add_argument('--disable-default-apps')
driver = webdriver.Chrome("c:\myproject\driver\chromedriver.exe",
            options=options)

https://stackoverflow.com/questions/49234703/python3-selenium-and-chrome-portable

If you tell me how I can try to add the settings, options and other stuff myself.

Many thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.