Latest Inquiries - Data Extraction Software

Page Navigation Error

Submitted: 2/7/2016

To whom it may concern,

I am having difficulty in creating a Next Page command. Whenever I click the arrow button on the webpage, the "Next Page" content is displayed correctly. But once I click "New" (Template)  the captured element is defined as a Link. (On some of the tutorials I've seen, VWR is able to detect that the content is a "Next Page" attribute) When I change the definition from Link to PageNavigation, New Capture Element disappears for a moment and returns with the url www.cars.com. This bug replaces the original "Next Page" url with www.cars.com. I am unable to change the url back to the original "Next Page" url even if I copy and paste the link into the Content Capture window. Please help me out with this bug. Amazing program nevertheless. 

Thank you

Carscom.rip

Replied: 2/21/2016 8:46:08 AM

See the attached new project.

I've further revised the xpath for page navigation template that it make sure to select '>' page link always: (see below)

//DIV[@class='pagination']/A[@id='nxtLowerLink' and @class='right']

And you should set 'Next page' option instead of "list of page links' option for page navigation template.

I'm not quite sure exactly what 'preview' images are you talking about, is it the 'CVPicture' element you created?

For MySQL data export, you don't have to specify certain charset , it's optional unless you have non-english string text(e.g, Chinese, Japan..etc) that you would like to export, then you need to specify 'UTF8' as better (or UTF8mb4 as a super-utf8 charset that latest Mysql provided), the view of point couldn't be fully documented with in online manual, it's the past experience as I encountered.


Carscom.rip

Replied: 2/8/2016 5:57:37 AM

Hello Hunter.

I have manually changed the x-Path for pagination template. In some how, you need to do it manually, otherwise, as you mentioned, it will open another page.

Please check the attached project file then let me know if you need anything.

Best Regards:

Joongki

Carscom.rip

Replied: 2/18/2016 8:29:27 AM

Hey Joongki,

I tried using your version of the .rip file. The Next Page command only seemed to work on the first page. Then the ripped data exports at the end of the second page. I was curious if you could help me out again, is it an issue with the x-Path? I've also decided that I want to rip the "preview" images on the main listing page. So I'll include a newer version of your .rip file that I have added to. 

Also, I'm having some difficulty with exporting the data to a specific MySQL table I'm going to use for other projects. Does the Charset need to be used if I'm saving data to a specific table? VWR generates a table for me with the same name as my project. I've been trying to find the answer to my question through the forms and manual, but I'm without luck.

Thanks again, you guys are awesome!

Hunter

Carscom.rip