Latest Inquiries - Data Extraction Software

using inputs to submit to google formfield

Submitted: 10/19/2017
Hi

I have a list of keywords i would like to submit to a google search or to take the words from the database and regex google URL paramenters around it

input
cards
trucks
buses

regex to convert to urls then loop through each one and extract certain content

https://www.google.com.tr/search?dcr=0&q=(.*)
$1

Can this be done? It would save another column of data from the input database if its possible to do!.

Thanks
Replied: 10/19/2017 1:02:58 PM
ok sussed i used the link transformation in advanced options. Now reads from an input, regex google url. generates the start urls fine. Awesome!

Cheers
Replied: 10/19/2017 12:42:23 PM

Hi Brian,

Go to Project > Project Options > Start URLs tab then put your keywords in the List of Start URL. Then go to Advanced tab > Start URLs section > Link transformation and you can apply your regex there.

Best regards,

Replied: 10/19/2017 12:31:52 PM
select distinct 'https://www.google.com.tr/search?dcr=0&q=' + source from keywords where source is not null

Now how do i loop through the output from this input?

Thanks