Latest Inquiries - Data Extraction Software

Page Navigation Problem

Submitted: 4/3/2017


I was scraping the website "" suddenly the agent stops at page number 185 and now i want to start scraping from page 186. I guess page transformation has to be done. Could you please help me to fix this issue ASAP. I have attached the rip file for your reference. 

Thanks in Advance!

Replied: 4/5/2017 8:03:56 AM


You can delete the page navigation and use the list of page links as start url in Project Options > Start URLs tab.

Replied: 4/5/2017 8:09:31 AM
How do we find the url of page 186 ? There is no clue in the url. 
Replied: 4/7/2017 8:17:46 AM


Unfortunately, it's not possible to do this, because the website uses AJAX pagination, so there's no direct link to a specific page.