ldtalent/anupt-flightscraper

anupt-flightscraper's Issues

More than one flight cost is coming in flightcost tag

For every flight box MMT is showing two price and because of which flight cost is not scrapping correctly. For example: The length of all tags are as:

baseDataUrl = https://www.makemytrip.com/flight/search?tripType=O&itinerary=COK-MAA-30/03/2020&paxType=A-1_C-0_I-0&cabinClass=E&sTime=1584701522034&forwardFlowRequired=true

            print(len(spanFlightName))  - 36
            print(len(pFlightCode)) - 36
            print(len(pFlightStop)) - 36
            print(len(divDeptTime))-36
            print(len(pDeptCity))-36
            print(len(pFlightDuration))-36
            print(len(pArrivalTime))-36
            print(len(pArrivalCity))-36
            **print(len(spanFlightCost))-    102** Problem is with this tag

Corresponding tag is:
spanFlightCost = soupBody.findAll("span", class_= "actual-price")
Now above tag leads to two different Xpath

/html/body/div[1]/div/div[2]/div[2]/div[2]/div[1]/div[3]/div/div[2]/div[3]/div[1]/div[2]/div[2]/div/p/span
/html/body/div[1]/div/div[2]/div[2]/div[2]/div[1]/div[3]/div/div[2]/div[3]/div[2]/div[2]/div[2]/div/p/span

Problem is with the bold div. Request you to check and advise the way to sort this out.