Latest Inquiries - Data Extraction Software

Some data not extracted

Submitted: 3/24/2017

Hello!


I created this project to scrape from the following starting URL: https://www.topuniversities.com/university-rankings/world-university-rankings/2016


I works fine for every information I need except for " Overall Score", "Academic Reputation" and " Employer Reputation" which are never extracted, although they are presented on the website in the extact same way of other informatiion that are properly scraped, I do not understand why. Could you please help me to fix this?


Here below you find the project and a data sample attached

Thank you!


Federica

QS_World_Ranking_2017.xls
QS_World_Ranking_2017.rip

Replied: 3/31/2017 3:22:16 AM

Hi Federica,

The action in page navigation must be, Javascirpt/Ajax > Synchronous. 

See attached.

Best regards,

QS_World_Ranking_2017.rip

Replied: 3/30/2017 9:00:43 AM

Hello!

I changed the xpath as you suggested but it still scrape the first page only


Regards,

Federica

QS_World_Ranking_2017_CS.rip

Replied: 3/28/2017 4:16:17 AM

Hi Federica,

The number associated with the xpath changes every time you access the page. I simplify the xpath to adapt the changes.

Best regards,


QS_World_Ranking_2017.rip

Replied: 3/28/2017 11:15:28 AM

Thank you!

It is now taking all data

But it just scraped the first page, although the Page Navigation Template (Next Page Link) should be fine


Best regards,

Federica

Replied: 3/30/2017 6:56:36 AM

Hi Federica,

This should be the xpath of your pagenavigation, //A[@id='qs-rankings_next']

Best regards,

Replied: 3/27/2017 10:11:07 AM

Hello!


You can find the data I would like to extract at this link:  https://www.topuniversities.com/universities/stanford-university#wurs.

I need all those scores related to the bar chart, but " Overall Score", "Academic Reputation" and " Employer Reputation" do not appear in the excel file while the other yes


Thank you!!


Federica



Replied: 3/27/2017 9:27:40 AM

Hi Federica,

There could be some problems in the xpath, but I'm not quite sure where is the data you want to extract.

Best regards,