opakalex/parser-docker

api-cucumbers

Install:

• npm install
• docker-compose up
• CITY=Rome ./node_modules/cucumber/bin/cucumber.js features/parse.feature

Details

All parser contains 2 part, first one it's parsion all urls for hotels in tripadvisor system, and next part - get details about each hotel

This is means, you can run first parsing all hotels with urls to file:

• CITY=Rome ./node_modules/cucumber/bin/cucumber.js features/parse.feature:8

Then you can run detail parsing per hotel:

• CITY=Rome ./node_modules/cucumber/bin/cucumber.js features/parse.feature:12

System has some log information, if parser find error, you can restart from position:

• HOTEL_INFO_INDEX=10 CITY=Rome ./node_modules/cucumber/bin/cucumber.js features/parse.feature:12

You can tell system how many hotels you want parse:

• HOTELS_COUNT=6 CITY=Rome ./node_modules/cucumber/bin/cucumber.js features/parse.feature:12