Latest Inquiries - Data Extraction Software

pagination

Submitted: 1/26/2016

Hello

Pagination works if I click through step by step.

When I let run the scraper pagination does not work. I did it with xpath...

No idea why.


Thx for help.

pagination.rip

Replied: 1/27/2016 3:09:29 AM
16-01-27 09:58:02 Navigation error (Direct URL). Stop signal. Url: http://www.auktionshaus-bossard.de/de/objekte?aid=9&Lstatus=1
16-01-27 09:58:13 Deleting old data...
16-01-27 09:58:13 Error creating internal database for project pagination. The table pagination already exists. All templates in your project must have unique names.
16-01-27 09:58:13 Starting export...

When running your project, it raises errors as above, guess the name ' pagination' has been used internally by VWR, I've change to another name - 'next page', it raises error fruther:

10:01 Navigation error (Click). Timeout waiting for browser to navigate. Action: http://www.auktionshaus-bossard.de/de/objekte?aid=9&Lstatus=1&Accid=12&pagenumber=2
10:01 Error activating page navigation click: http://www.auktionshaus-bossard.de/de/objekte?aid=9&Lstatus=1&Accid=12&pagenumber=2
10:01 Processing PageNavigation template next page (page 2)
10:01 Navigation error (Click). Timeout waiting for browser to navigate. Action: http://www.auktionshaus-bossard.de/de/objekte?aid=9&Lstatus=1&Accid=12&pagenumber=2
10:01 Error activating page navigation click: http://www.auktionshaus-bossard.de/de/objekte?aid=9&Lstatus=1&Accid=12&pagenumber=2
10:01 Processing PageNavigation template next page (page 2)

I noticed that you set 'Web crawler' agent individually for page navigation template, thought it's good wihtout any problem , but normally, web cralwer agent still uses 'Webbrowser compibility' parser (Project > project options > advanced tab > Web crawler section), it might still execute javascript on page navigation and being failure. to resolve this issue, I've set an empty link transformation scripts for page navigation template for avoiding to execute javascript on click, it works fine at run-time.

pagination.rip