Latest Inquiries - Data Extraction Software

Inconsistent order when outputting to SqlServer

Submitted: 5/26/2017

I have a project where I extract table data for several columns and all rows for those columns via multiple lists (one for each column of data I need).  This creates an output tab for each column of data and a corresponding SqlServer table upon output.  If I go to "View Data", the data for each column is in the exact same order it appears on the webpage.  The problem is that the data is not maintaining this order when it outputs to the SqlServer table so there's no way to match the data in the different columns back up.

I'd REALLY like this to just extract the desired elements for each row and then iterate through all the rows of the table.  I have a PageArea that encompasses the entire table, but when I try it that way I only get the first row.  I can't, for the life of me, get VWR to keep going, row-by-row, until it hits the end of the PageArea.

I can make this project work with a solution to either of the above two problems, but I'd prefer a solution to the second one as it would save me from having to cobble the columns back together after output to recreate the rows.

I feel like it's important to note that the table is set up as a grid.  Clicking on a "row" will actually just highlight a single cell, much the same way it would in Excel.  There doesn't appear to be any way to select an entire row as a single element so the following will NOT work:

From the Creating Lists tutorial:

1. Select the first element in the list in the web browser. This selection must select the first element exactly. For example, if you are creating a list that selects all the rows in a table, the selection should select one full table row.

I've attached my project file with a few different attempts I've made at getting the PageArea/List right.  Thank you in advance for any help you may be able to provide!


xDiv Scrape2.rip

Replied: 5/31/2017 3:31:23 PM

Hi Ken,

This is a default when you saved data in SQL: it doesn't guarantee particular order when saving in SQL. You can create a numbering system in your agent for your output. With this, you can sort them in SQL in particular order based on the numbering system you created.

Best regards,

Replied: 5/31/2017 6:27:02 PM

That sounds like it might work!  Can you point me to an area in the manual?  I did a quick search, but didn't find anything specific to what you are suggesting.

Kind regards,

Ken

Replied: 5/30/2017 12:23:08 PM

Hi, 

it's hard to see what is the expected result in that output. SQL Server doesn't guarantee any particular order unless you actually order.

Best regards,

Replied: 6/2/2017 5:44:43 AM

Hi Ken,

I closely examine your agent and found that there is something wrong in your structure of capture. Please try attached agent and see if it fixe your problem. 

xDiv Scrape2.rip

Replied: 5/30/2017 2:18:12 PM

I don't know how much more clear I could possibly be than the multi-paragraph explanation I gave you with an attached project!  Your one sentence "answer" does not even address my problem much less solve it.  If you can't understand what I'm talking about then can you please direct me to someone who can? I'm hoping you have a better support option than basically submitting forum posts!

Regards,

Ken