Name: Fraser Baillie
Type: User
Company: Data Engineer, Python Programmer
Bio: I'm a Data Engineer at heart and my main focus is building web scrapers and data pipelines that scale with Python.
Twitter: cyclehacker
Location: Viseu, Portugal
Blog: http://cyclehacker.com
Fraser Baillie's Projects
Basic category crawler for Asos
Baierl crawler using scrapy-splash
Testing out flask
Basic linked in crawler
Linux kernel source tree
Ruby Kroans install
Scrapy middleware to handle javascript pages using selenium
This merges scrapy_selenium (https://github.com/clemfromspace/scrapy-selenium) middleware with undetected_chromedriver (https://github.com/ultrafunkamsterdam/undetected-chromedriver) to provide an undetectable chromedriver within the scrapy_selenium middleware.
Custom Selenium Chromedriver up to v84 | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome)