Latest Inquiries - Data Extraction Software

finding a range from numbers search and update into another table

Submitted: 10/22/2017
Hi there

I am having an issue on how to go about this,

I have a sql table called names with columns name, numbers.

I have another sql table called result that has the same name data and a empty priority column. (main scraping bot)

Im trying to find a range and insert a value into priority column as it scrapes for name and numbers by reading the other table data.

in c it would be search and match name + read numbers if numbers 0 to 1000 = 1 insert into priority, 1000 to 2000 = 2 insert into priority , 2000 to 3000 insert into priority. etc

Not sure what to do without some kind of coding or can it be done with sql search queries?

Replied: 10/27/2017 11:01:38 AM
name,small numbers = search table 1 names on extraction then insert the row that contains a name match to small numbers.

I am after an example because this would really be helpful to understand how to do this. Then can learn what you can and cannot do in C within visual web ripper.
Replied: 10/26/2017 6:30:06 AM
Not sure if I get your explanation right. If you need perform an action or get the data from the page only if the value in your table name or number is present, yes you can do it using XPath transformation in C#. Can give me a documentation with screenshots of what you're trying to accomplish?
Replied: 10/26/2017 11:31:43 AM
just to add... bot scrapes names then searches table 2 names + numbers. then inserts the numbers into priority.
Replied: 10/31/2017 4:45:53 AM
Since your data is in the SQL server, you need to write a transformation script using C# in the priority column to use the name in the bot 1 as a parameter to make SQL search in bot 2 database and retrieve the data from the number column. 
Replied: 10/26/2017 11:35:33 AM
bot 1  name and priority
bob, 780 becomes 1
frank, 1800 becomes 2
steve, 2300 becomes 3

bot 2 has a table filled with names and numbers
bob,780
frank 1800
steve 2300
etc etc

using some c scripting to find the ranges 0 - 1000 = insert number 1 into table one priority, 1000-2000 insert number 2 into priority, etc
Replied: 10/26/2017 11:29:26 AM
Main bot scrapes names and has an empty column called priority
I have a seperate bot in a seperate table that scapes the same names and their numbers from another website with another column called numbers.

Im trying to get the second table names to match the first table names and insert numbers from the second table 2.

The second bot updates weekly, but the first bot is every hour. Why i have kept them seperate. Would be a waste of bandwith otherwise

table 1 bot
names - priority

table 2
names - numbers

i need to match names in table 1 with names in table 2 then insert the matched numbers into priority.

I;ve tried so many ways... cant figure it out.

Any help would be very appreciated

Replied: 10/23/2017 12:34:12 AM
Ive used the input to select the table name,number. Ive tried to search on extract to match and view the numbers in priority fixed value. So ideally both the name the bot extracts from a page and name from the other table should match as a test (at least i know its working). all i get is the same name regardless.

input ->input database (priority - fixed value)
select name,numbers from names where name in (select name from result)

not working for some reason




Replied: 10/27/2017 8:30:57 AM

You can create a third column in Bot 2 that can automatically transform the number into priority number using C#.  


Replied: 10/27/2017 10:59:05 AM
ok but how do you fetch the data from numbers to this new column in c? its the confusing part!

Then once that is done... How i match names,small numbers from table 2 insert that into table 1's priority ?