moreorover/pricer-application-backend

pricer-application-backend's Issues

Watch Shop

Watch Shop store implementation.
URL samples:

• https://www.watchshop.com/ladies-watches.html?show=200&page=1
• https://www.watchshop.com/mens-watches.html?show=200&page=1

John Lewis store

John Lewis store implementation for watches. Fragrance scraping is related to issue #1

Debenhams parser error

Debenhams parser crashes on findElements() method.

Look Fantastic

Look Fantastic Store implementation.

The Fragrance Shop

Write implementation for The Fragrance Shop.
Sample urls:

• https://www.thefragranceshop.co.uk/womens/l?pageNumber=1
• https://www.thefragranceshop.co.uk/mens/l?pageNumber=1

AMJ Watches website rework

The website has received a complete rework. Not it dynamicly fetches the items to display using secured API endpoints.

Solution http client which loads JS

Debenhams Store

Debenhams Store implementation.
Sample Urls:

• https://www.debenhams.com/women/accessories/watches?shipToCntry=GB
• https://www.debenhams.com/men/watches?shipToCntry=GB

Logger typo

Pricer-Application-Backend/src/main/java/martin/dev/pricer/scraper/ParserHandler.java

Line 41 in 2371e9a

log.warn("Parsed only " + parsedItemDtos.size() + "Ads. Out of total: " + e.size());

All Beauty Store

All Beauty Store uses a lot of javascript to dynamically load page content. To implement support of this store a client is required to load the page, however, the scraping time would increase.

Simpkins Jewellers

Simpkins Jewellers implementation required.

Sample URLs:

• https://simpkinsjewellers.co.uk/watches/seiko
• https://simpkinsjewellers.co.uk/watches/bulova

AMJ Watches Store

AMJ Watches store implementation.

Sample urls:

• https://amjwatches.co.uk/mens.html?page=1
• https://amjwatches.co.uk/ladies.html?page=1

Creation Watches Store

Creation Watches Store implementation.

• https://www.creationwatches.com/products/seiko-75/

Fetch URL to scrape

Fetch ur to scrape function finds any first URL that is older than given timeframe.
Expected behavior:
method fetches oldest URL which is older than the given date.