Latest Inquiries - Data Extraction Software

loop within a loop

Submitted: 1/28/2016
Hi guys,
I'm a heavy user on your product and it has been extremly helful ( :
I'm now planning to extract some data from product pages in http://www.bhphotovideo.com/
in many product pages there are quit a lot of selection options and i wish to iterate through all option combination.

For example i wish to go over all selection options in this pages:
http://www.bhphotovideo.com/c/product/1122062-REG/samsung_un48j5200afxza_j5200_48_class_full_hd.html
http://www.bhphotovideo.com/c/product/1190467-REG/apple_z0sc_mk48228_bh_27_imac_with_retina.html

The first one is very easy to do in a simple list, but how do i make the robot deal with the second page aswell?

I think I might need a recursive solution.
Any ideas?
Should I use the RepeatParent option?

Tnx,
Matt
Replied: 2/1/2016 7:23:43 AM

Please check the attached demo project, I created link templates to iterate through all options. hope it helps.

Bhphotovideo_demo.rip

Replied: 1/31/2016 3:51:29 PM
Yes thats exacly what iI meant.
i can create link templetas however it's not enough. In the example I showed there are over a 100 purchuse options and i wish to go through all of them automaticaly.
for example:
R9M395X +  8gb and 1T flash storage + 3.2 GHz i5 + no protection plan.

Each page has different number of options and I'm sure there is an easy and elegant way to do this for all pages in a single robot.

Tnx,
Matt

Replied: 1/29/2016 2:47:55 AM

I'm not quite sure exactly what specific options are you talking about, I'm guesisng that you 're asking these options in dropdown for example page url:

http://www.bhphotovideo.com/c/product/1190497-REG/apple_z0sc_mk48258_bh_27_imac_with_retina.html

You mean that you want to select different Graphics cards, RAM+Storage, Protections plans ? then extracting certain results ? can you please give me one example for explain again?

I'm guessing can you simply create link templates or form submit templates then extracting those different results?

Replied: 1/28/2016 3:55:54 PM
Or maybe i should use a script?