Latest Inquiries - Data Extraction Software

Magic Card Prices

Submitted: 4/6/2012

Hi - I am looking to scrap magic card data from this website.  The information that I want is found in the data rows like this:

Lost in the Woods [DKA]                            0.018     0.03      ComparePrices[1] pisiiki2[2]
The data I want captured is as follows using the above as an example:
Card Name: Lost in the Woods
Card Set: DKA
Buy Price: 0.018
Sell Price: 0.03
Bot1 Name: ComparePrices
Bot1 Quantity: 1
Bot2 Name: pisiiki2
Bot3 Quantity: 2
If the buy or sell price is not populated, I want there to be a null value.
I do not want any header rows or separator rows (e.g. ========).  Hoping to store in an access
database.
Replied: 4/9/2012 1:03:20 AM
Please extract the Access MDB file from Supernovabots.zip, since this enquire system doesn't allow to upload the file as MDB extension.
Replied: 4/9/2012 1:00:25 AM
Attached is the project file and the sample data in Access format(you can extract this MDB file from Supernovabots.zip), also, I added a spreadsheet in Excel format(XLS file).

You can put the project file in Default Visual Web Ripper projects folder, then run this project, after done, it will export XLS file in output folder, then you can further import the XLS in to the Access MDB file again.

Basically, there is a 'New Element' element to transform that raw text page into a HTML table, then processing to export specific columns..

I just transformed <= max 100 magic card raw lines for the demo project as running quickly, you can edit 'New Element' in Content tab, then go to click on Transformation script' in right 'Transformation' tab, you can find this line as below:

for (int i = 0; i < 100; ++i)

then you change to :

for (int i = 0; i < lines.Length; ++i)

this will iterate all of magic card records from raw txt page, and it will be slow down when you running project, because of that project is iterating / transforming more records, be patience if you do this change. of course, you would only get max 100 final records if you 're a trial user.


Best regards.
Simon



Supernovabots.xls
Supernovabots.rip
Supernovabots.zip