Hello!
I created this project to scrape from the following starting URL: https://www.topuniversities.com/university-rankings/world-university-rankings/2016
I works fine for every information I need except for " Overall Score", "Academic Reputation" and " Employer Reputation" which are never extracted, although they are presented on the website in the extact same way of other informatiion that are properly scraped, I do not understand why. Could you please help me to fix this?
Here below you find the project and a data sample attached
Thank you!
Federica
Hi Federica,
The action in page navigation must be, Javascirpt/Ajax > Synchronous.
See attached.
Best regards,
Hello!
I changed the xpath as you suggested but it still scrape the first page only
Regards,
Federica
Hi Federica,
The number associated with the xpath changes every time you access the page. I simplify the xpath to adapt the changes.
Best regards,
Thank you!
It is now taking all data
But it just scraped the first page, although the Page Navigation Template (Next Page Link) should be fine
Best regards,
Federica
Hi Federica,
This should be the xpath of your pagenavigation, //A[@id='qs-rankings_next']
Best regards,
Hello!
You can find the data I would like to extract at this link: https://www.topuniversities.com/universities/stanford-university#wurs.
I need all those scores related to the bar chart, but " Overall Score", "Academic Reputation" and " Employer Reputation" do not appear in the excel file while the other yes
Thank you!!
Federica
Hi Federica,
There could be some problems in the xpath, but I'm not quite sure where is the data you want to extract.
Best regards,