Latest Inquiries - Data Extraction Software

CSV File

Submitted: 3/5/2017

Hi guys,

If you can just provide a hint of insight on this.... Im not actually looking to extract data from a webpage, but fire up a web page so it downloads the data to a CSV file.   This link will automatically fire a popup window saying what do you want to do with this file (Save, save as, cancel)... All i want to do is say Save.     I can feed VWR with about 50 urls with different symbols, but cant get it to save locally.    No need to create a solution, but guidance on how to do would be great. 


Thanks in advance!

Mark

Here is the link:

http://download.finance.yahoo.com/d/quotes.csv?s=A+AAAP+AAC+AADR+AAL+AAMC+AAME+AAN+AAOI+AAON+AAP+AAPC+AAPL+AAT+AAU+AAV+AAWW+AAXJ+AB+ABAC&f=sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7



Replied: 3/7/2017 7:25:58 AM
You're welcome. Enjoy your scraping!
Replied: 3/15/2017 2:39:47 PM

Hi,

Use this site, http://www.rapidlinkr.com/ 

Paste you links

Click the "Submit Links" button

Then you can now download the files.


Best regards,

Replied: 3/6/2017 3:11:38 AM

Hi Mark,

Yes, you can do that. there are actually many ways how to feed your url in the agent to download the data. Attached is the example.

Best regards,


Sequentum.rip

Replied: 3/6/2017 3:41:05 AM
Well done gents!  So simple, that i feel stupid.... thought it was some template function... Cheers!
Replied: 3/13/2017 8:59:36 PM

Hi,

Does that matter? I added it to this rip file and it still doesnt cycle through.   It has challenges loading a url that has "download" in it.   Any insight or demo project that handles multiple files to download would be helpful.  thanks. !

SequentumEx1.rip

Replied: 3/13/2017 2:19:22 PM

Hi,

Your start url is set to List of URLs, but it is empty.

Best regards,


Replied: 3/22/2017 8:30:14 AM

Hi,

As I said, there were many ways to feed your link data, and that could be a better way because you can actually paste a lot of URL simultaneously.

If you are looking inside VWR, you can do that also, but you have to add a script to feed and download your links. However, writing script is beyond the scope of our free support. We can write a code for you but with a fee. So I am giving the best option and can only give you an idea or sample for you to continue.

See attached agent.


Best regards,

Sequentum.rip

Replied: 3/12/2017 2:08:16 PM
Although, im sure you dont need to see it in action to answer the question, the rip file where i replace the URL is attached.
SequentumEx.rip

Replied: 3/16/2017 2:27:46 PM

You lost me there... I need these on a nightly basis.  the option you specify is outside your application.  Although it works, i would have to do this every night, which defeats the purpose of your system.    I must be missing something. 


Mark 

Replied: 3/12/2017 1:16:21 PM

Well... maybe i spoke a tad too soon.... ;-)

When i replace my url originaly given to you with a much longer one, it doesnt download the file... quite frusterating because I am simply replacing the UR so i must be missing somehting obvious.

And rotating through multiple URLs from a database seems to be a challenge as well since its not running off a template but a content transformation.  Not the end of the world, since I think i can just add 35 multiple elements to download all the symbols but it would be nice to pull from SQL.

Here is an example of the longer strings.... Any additional assistance, is greatly appreciated... Cheers!

http://download.finance.yahoo.com/d/quotes.csv?s=AIII+AIMC+AIMT+AIN+AINC+AIQ+AIR+AIRI+AIRM+AIRR+AIRT+AIT+AIV-A+AIW+AIY+AJG+AJRD+AJX+AKAM+AKAO+AKBA+AKER+AKO.A+AKO.B+AKP+AKR+AKRX+AKTX+ALB+ALCO+ALDR+ALDW+ALDX+ALE+ALEX+ALFA+ALG+ALGN+ALGT+ALIM+ALJ+ALJJ+ALK+ALKS+ALL-A+ALL-B+ALL-C+ALL-D+ALL-E+ALL-F+ALLT+ALLY+ALN+ALNY+ALOG+ALOT+ALP-O+ALQA+ALR+ALR-B+ALRM+ALSK+ALSN+ALTS+ALTY+ALX+ALXN+AMAG+AMBA+AMBC+AMBCW+AMBR+AMCN+AME+AMED+AMFW+AMG+AMGN+AMH-A+AMH-B+AMH-C+AMH-D+AMID+AMJ+AMJL+AMKR+AMLP+AMNB+AMOT+AMOV+AMPE+AMRB+AMRC+AMRI+AMRK+AMRN+AMRS+AMS+AMSC+AMSF+AMSWA+AMT+AMT-A+AMT-B+AMTD+AMTX+AMU+AMWD+AMX+AMZA+AN+ANAT+ANCB+ANCX+AND+ANDAW+ANDE+ANF+ANFI+ANGI+ANGL+ANGO+ANH-A+ANH-C+ANIK+ANIP+ANSS+ANTH+ANTM+ANTX+ANW+ANY+AOA+AOD+AOI+AOK+AOM+AOR+AOS+AOSL+AP+APA+APAM+APB+APC+APD+APDN+APDNW+APEI+APF+APHB+APLE+APLP+APO+APOG+APPF+APPS+APRI+APT+APTO+APTS+APU+APWC+AQMS+AQXP+ARA+ARAY+ARC+ARCB+ARCI+ARCW+ARCX+ARDC+ARDM+ARDX+ARE+ARE-A+ARE-D+ARE-E+ARES+ARGS+ARGT+ARH-C+ARI-A+ARII+ARIS+ARKG+ARKK+ARKQ+ARKR+ARKW+ARL+ARLP+ARLZ+ARMK+ARNA+AROW+ARQL+ARR-A+ARR-B&f=sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7


http://download.finance.yahoo.com/d/quotes.csv?s=BSFT+BSJH+BSJI+BSJJ+BSJK+BSJL+BSJM+BSJN+BSL+BSM+BSMX+BSPM+BSQR+BSRR+BST+BSTC+BSTG+BSV+BTA+BTAL+BTE+BTN+BTO+BTT+BTX.W+BTZ+BUFF+BUI+BUR+BURL+BUSE+BUZ+BV+BVN+BVSN+BVX+BVXV+BVXVW+BW+BWA+BWEN+BWFG+BWG+BWINB+BWL.A+BWLD+BWV+BWX+BWXT+BWZ+BX+BXC+BXMT+BXMX+BXP+BXP-B+BYBK+BYD+BYFC+BYLD+BYM+BZF+BZH+BZM+BZQ+BZUN+C+C-C+C-J+C-K+C-L+C-N+C-P+C-S+C.A+CA+CAA+CAAS+CAB+CABO+CAC+CACB+CACC+CACI+CACQ+CADC+CAE+CAF+CAFD+CAFE+CAG+CAH+CAI+CAJ+CAKE+CAL+CALA+CALD+CALI+CALL+CALM+CALX+CAMP+CAMT+CANE+CANF+CAPE+CAPL+CAPN+CAPNW+CAPR+CAPX+CAR+CARA+CARB+CARO+CART+CARV+CARZ+CASC+CASH+CASI+CASM+CASS+CASY+CAT+CATB+CATH+CATM+CATO+CATY+CAVM+CAW+CB+CBA+CBAK+CBAN+CBAY+CBB+CBB-B+CBD+CBF+CBFV+CBG+CBIO+CBK+CBL-D+CBL-E+CBLI+CBM+CBMG+CBMX+CBMXW+CBND+CBOE+CBON+CBPO+CBPX+CBRL+CBS.A+CBSH+CBSHP+CBT+CBU+CBZ+CCA+CCBG+CCC+CCCL+CCCR+CCD+CCE+CCF+CCI+CCIH+CCJ+CCK+CCL+CCLP+CCM+CCMP+CCNE+CCO+CCOI+CCP+CCRC+CCRN+CCS+CCU+CCUR+CCV+CCXI+CDC+CDE+CDI+CDK+CDL+CDNA+CDNS+CDOR&f=sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7sd1nt1ghovc1pxs7j4r1r5r6r7t8yep5p6qrdb4f6j1g4j5j6kk5m3m4m5m6m7m8wg3jp2i5e1t7