Latest Inquiries - Data Extraction Software

Contact Information Scraper

Submitted: 9/26/2013
I am trying to build a project that will search business names from a list in the free search field on www.hoovers.com.  I would like to return the name as it appears on hoovers, the complete address, and phone number.  Often times there are multiple results, and I would like to capture all of them.

If I can build this project I will know that I can also build similar projects for other websites, such as Manta or Bloomberg Businessweek.

Thanks for your help!
Visual Web Scraper Test.xls

Replied: 10/2/2013 4:42:12 PM
Select 'Search Within' and create 'FormField' content and you can see the values showing in capture window. 
On the right site, 'Design Time Value' option you can select the value by drop down menu and it will show the selected value when you submit it.
Click 'Edit' tp change the value of it.
When you run the project, VWR go though all value in 'Search Within' and find all search result and extract data.

Asic.rip

Replied: 9/27/2013 7:52:38 AM
Thank you.  This is great but is there a demo video of how you made this?  I am interested in being able to replicate on my own.
Replied: 10/1/2013 7:38:59 PM
Is there anything we can do?  I have been able to extract from this website using different products as recently as last week.
Replied: 9/26/2013 1:10:55 PM
Please disregard the above.  Could you please build a demo of the following:

Check the box for "Firm"
Search the keyword, i.e. vonwin
Capture the full legal entity name i.e. "Vonwin Asset Management, LLC"
Capture the Main Office Address
Capture the View Summary link.  Will be either "Investment Advisor Firm" or "Brokerage Firm"
If it says "FINRA - Inactive" (will only appear if the company is inactive.  As an example please search ”P. Schoenfeld Asset Management LLC”)

If the result is an Investment Advisor Firm, click on the link
Click the SEC link
Capture the telephone number under F(3)
Click on schedule A, capture the records under FULL LEGAL NAME as well as their statuses
Click on Schedule D, capture the address and telephone (if it exists) under section F1 "Other Offices"
Under section 7.B.(1) capture number 11 "Current Gross Asset Value of the Private Fund"

Attached are some examples.  Also please note that in many cases there will be more than 1 result for keyword.  If this is the case, I would like to capture all results.  Thanks again for your help!



Visual Web Ripper FINRA Example Names.xls

Replied: 10/1/2013 9:09:40 PM
need to send the E-mail or give them a call for a message showing web site with Reference number. I guess that is only one option. I turned on cookies for that specific web site in 3 different browsers but it was not working.
Replied: 10/1/2013 4:45:07 PM
We checked the web site but it is not working. It is not problem with VWR, problem with web site.

Replied: 9/27/2013 3:08:17 PM
Also, am I able to combine projects into single procedures, i.e. scrape a website using one project and then automatically move onto another one?

Finally, is Visual Web Ripper able to pass through a Captcha?
Replied: 9/30/2013 6:55:25 PM
Visual Web Ripper can accept cookies by default. However, if you let us know what kind problem you have with cookies then we can provide the specific answers for you.

Replied: 10/1/2013 6:38:15 AM
Great thanks.  How do I make the Web Ripper accept cookies?
Replied: 10/1/2013 6:43:33 AM
When I try to use the below URL in a project, I get an error on the website saying "Your browser must accept cookies from companieshouse.gov.uk to be able to use".


I purchased the full version yesterday.
Replied: 9/30/2013 4:07:10 PM
Great thanks.  How do I make the Web Ripper accept cookies?
Replied: 10/2/2013 1:50:12 PM
Thanks for looking into it.  I was able to get around this.

Can the web ripper make a selection from a drop down menu?  For the below website, I am trying to search a set of keywords and select Organzation & Business Names under the "Search Within" menu.
Replied: 9/26/2013 6:58:55 PM
Please check the attached demo project.

You need to place the project file in default projects folder, then run this project in VWR program.

I don't seem to find the as you mentioned "section 7.B.(1)" , however, this demo project should already give you a good starting.
Adviserinfo.rip

Replied: 9/27/2013 6:58:51 PM
You can view the online demo videos where has teach you how to create a project.

Also, am I able to combine projects into single procedures, i.e. scrape a website using one project and then automatically move onto another one?
==================================
You can write a windows batch file to execute command line to run each project one by one.

F.Y.I:
Command line utility

F.Y.I:

CAPTCHA Protection