Latest Inquiries - Data Extraction Software

Page Navigation Problem

Submitted: 4/3/2017

Hi,

I was scraping the website "https://www.11880-heizung.com/heizung/deutschland" suddenly the agent stops at page number 185 and now i want to start scraping from page 186. I guess page transformation has to be done. Could you please help me to fix this issue ASAP. I have attached the rip file for your reference. 

Thanks in Advance!

11880-heizung.rip

Replied: 4/5/2017 8:03:56 AM

Hi,

You can delete the page navigation and use the list of page links as start url in Project Options > Start URLs tab.


Replied: 4/5/2017 8:09:31 AM
How do we find the url of page 186 ? There is no clue in the url. 
Replied: 4/7/2017 8:17:46 AM

Hi,

Unfortunately, it's not possible to do this, because the website uses AJAX pagination, so there's no direct link to a specific page.