Latest Inquiries - Data Extraction Software

The scraping process stops at the same point consistently without completing the whole extraction

Submitted: 3/30/2016
Hello,

My project seems to be running well for the first 7 pages of the website that I want to extract data from. However, it always stop on the 8th page while I want it to complete all the pages. 

I am not sure what's the problem with my project. Can you please help me?

Thank you.
Myhoom.rip

Replied: 3/30/2016 4:02:43 AM
Hi JoongKi,

I have set the XPath manually to //CENTER/A[@][position()!=last()] for the pagenav template
but this error message popped out: " Error parsing xpath: Expected a node test, found ']'. "

I want to extract until the last page in the list. The pagenav template is to extract from the list of links from 1 to 30 while the next template is to click on next '>>' to continue from 31 to 60.

Thank you.
Replied: 3/30/2016 3:29:47 AM

Hello.

I have checked the project file then found out the x-Path for pagination template set to 2.

I am wondering that you want to extract until second page? Otherwise, I changed the x-Path for pagination template so please check the attached project file then let me know if I am misunderstood about it.

x-Path for pagination template:

//CENTER/A[@][position()!=last()]

Best Regards:

Joongki.

Myhoom.rip

Replied: 3/30/2016 6:21:57 AM

Hello.

Please check the attached project file and run it on your end. The project file is working properly on my end.

However, the x-Path for pagination template is:

//CENTER/A[@][position()!=last()]

In some how, @class is missing.

Best Regards:

Joongki.