Latest Inquiries - Data Extraction Software

PageArea less elements

Submitted: 2/28/2017

Hi

first I have to scroll - that works - 119 elements found but only 12 are scraped. Then the scraper jumps to the second catalogue and the same happens.

After the first element the error message "PageArea pagearea2 contained less elements after navigating back to the PageArea." appears. 


Don't know how to fix that. Thanks for help.


12:07 Deleting old data...
12:07 Extracting data with web browser agent v2.
12:07 Processing start URL http://wannenesgroup.com/it/auction-calendar/
12:07 Deleted 1 cookies
12:07 Processing PageArea template pagearea (1 of 13)
12:07 Processing Link template openlink catalogues (1 of 1). Text: Ceramiche e Vetri 7 marzo 2017. URL: http://wannenesgroup.com/it/auctions/ceramics-and-glassessfebruary-2017/
12:07 Switching to new web browser instance.
12:07 Processing Link template scroll (1 of 1). Text: 1. URL: http://wannenesgroup.com/it/lots/305-10-ciotola-in-maiolica-smaltata-spagna-valenza-manizes-xvii-xviii-secolo/
12:08 Processing PageArea template pagearea2 (1 of 119)
12:08 Processing Link template openlink detail pages (1 of 1). Text: 1. URL: http://wannenesgroup.com/it/lots/305-10-ciotola-in-maiolica-smaltata-spagna-valenza-manizes-xvii-xviii-secolo/
12:08 No content found for limage2
12:08 No content found for limage3
12:08 No content found for limage4
12:08 No content found for limage5
12:08 PageArea pagearea2 contained less elements after navigating back to the PageArea.
12:08 Processing PageArea template pagearea2 (2 of 119)
12:08 Processing Link template openlink detail pages (1 of 1). Text: 2. URL: http://wannenesgroup.com/it/lots/305-20-grande-piatto-in-maiolica-compendiaria-a-decoro-araldico-fornace-del-xvii-xviii-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (3 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 3. URL: http://wannenesgroup.com/it/lots/305-30-piatto-in-maiolica-policroma-manifattura-di-pavia-inizio-del-xviii-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (4 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 4. URL: http://wannenesgroup.com/it/lots/305-40-due-piatti-di-servizio-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii...
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (5 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 5. URL: http://wannenesgroup.com/it/lots/305-50-ciotola-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (6 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 6. URL: http://wannenesgroup.com/it/lots/305-60-otto-piatti-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (7 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 7. URL: http://wannenesgroup.com/it/lots/305-70-rinfrescabicchieri-in-porcellana-policroma-manifattura-ginori-a-doccia-seconda-meta-del-x...
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (8 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 8. URL: http://wannenesgroup.com/it/lots/305-80-coppia-di-marescialle-in-porcellana-policroma-manifattura-ginori-a-doccia-circa-1770/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (9 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 9. URL: http://wannenesgroup.com/it/lots/305-90-quattro-piatti-in-porcellana-policroma-manifattura-ginori-a-doccia-circa-1770/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (10 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 10. URL: http://wannenesgroup.com/it/lots/305-100-figura-in-biscuit-manifattura-di-napoli-fine-del-xviii-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (11 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 11. URL: http://wannenesgroup.com/it/lots/305-110-figura-in-terracotta-manifattura-giustiniani-napoli-1829-1830/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (12 of 119)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 12. URL: http://wannenesgroup.com/it/lots/305-120-nove-piatti-in-porcellana-bianca-e-oro-manifattura-dagoty-parigi-circa-1810/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea (2 of 13)
12:09 Processing Link template openlink catalogues (1 of 1). Text: Arredi Sculture e Oggetti d’Arte 7-8 marzo 2017. URL: http://wannenesgroup.com/it/auctions/arredi-sculture-oggetti-dartefebbraio-2017/
12:09 Switching to new web browser instance.
12:09 Skipping template scroll
12:09 Processing PageArea template pagearea2 (1 of 12)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 29. URL: http://wannenesgroup.com/it/lots/308-290-orologio-dappoggio-in-legno-ebanizzato-xix-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (2 of 12)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 30. URL: http://wannenesgroup.com/it/lots/308-300-orologio-da-appoggio-in-bronzo-a-patina-oro-xix-xx-secolo/
12:09 No content found for limage2
12:09 No content found for limage3
12:09 No content found for limage4
12:09 No content found for limage5
12:09 Processing PageArea template pagearea2 (3 of 12)
12:09 Processing Link template openlink detail pages (1 of 1). Text: 31. URL: http://wannenesgroup.com/it/lots/308-310-orologio-a-torre-in-legno-laccato-inghilterra-xviii-xix-secolo/
12:09 Navigation error (JavaScript Click). Timeout waiting for browser after a JavaScript call. Action: http://wannenesgroup.com/it/auctions/arredi-sculture-oggetti-dartefebbraio-2017/
12:09 Error performing AJAX call: openlink detail pages. Timeout waiting for browser after a JavaScript call
12:09 Updating error reporting...
12:09 Starting export...
12:09 Generating export data...
12:09 Data extraction partly completed

Wannenesgroup.com.rip

Replied: 3/6/2017 9:24:16 AM
Any news?
Replied: 3/1/2017 8:29:31 AM

Hi,

Please see attached file. 

Best regards,

Wannenesgroup.com.rip

Replied: 3/2/2017 2:17:55 PM

Hello

nothing changed. Perhaps I badly described my problem. So I will do it better... see below

But some questions before:

1.) What did you change? Can you please write this shortly ("See attached file" has no learning aspect.)

2.) Is Simon available? He knows the kind of scraper.


Thank you.

__________

Problem description:

Attached the new log file withe the same "PageArea less elements". I quote here the important lines of the log file:

14:04 PageArea pagearea2 contained less elements after navigating back to the PageArea.

and - that is my problem ... The scraper does not proceed after 12 of 119 and jumps in the next catalogue. There also only 12 articles ares scraped.

14:05 Processing PageArea template pagearea2 (12 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-120-nove-piatti-in-porcellana-bianca-e-oro-manifattura-dagoty-parigi-circa-1810/. URL: http://wannen...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea (2 of 13)
14:05 Processing Link template openlink catalogues (1 of 1). Text: Arredi Sculture e Oggetti d’Arte 7-8 marzo 2017. URL: http://wannenesgroup.com/it/auctions/arredi-sculture-oggetti-dartefebbraio-2017/
14:05 Switching to new web browser instance.
14:05 Skipping template scroll
14:05 Processing PageArea template pagearea2 (1 of 12)


================ LogFile

14:03 Deleting old data...
14:03 Extracting data with web browser agent v2.
14:03 Processing start URL http://wannenesgroup.com/it/auction-calendar/
14:03 Deleted 1 cookies
14:03 Processing PageArea template pagearea (1 of 13)
14:03 Processing Link template openlink catalogues (1 of 1). Text: Ceramiche e Vetri 7 marzo 2017. URL: http://wannenesgroup.com/it/auctions/ceramics-and-glassessfebruary-2017/
14:03 Switching to new web browser instance.
14:03 Processing Link template scroll (1 of 1). Text: 1. URL: http://wannenesgroup.com/it/lots/305-10-ciotola-in-maiolica-smaltata-spagna-valenza-manizes-xvii-xviii-secolo/
14:04 Processing PageArea template pagearea2 (1 of 119)
14:04 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-10-ciotola-in-maiolica-smaltata-spagna-valenza-manizes-xvii-xviii-secolo/. URL: http://wannenesgroup...
14:04 No content found for limage2
14:04 No content found for limage3
14:04 No content found for limage4
14:04 No content found for limage5
14:04 PageArea pagearea2 contained less elements after navigating back to the PageArea.
14:04 Processing PageArea template pagearea2 (2 of 119)
14:04 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-20-grande-piatto-in-maiolica-compendiaria-a-decoro-araldico-fornace-del-xvii-xviii-secolo/. URL: htt...
14:04 No content found for limage2
14:04 No content found for limage3
14:04 No content found for limage4
14:04 No content found for limage5
14:04 Processing PageArea template pagearea2 (3 of 119)
14:04 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-30-piatto-in-maiolica-policroma-manifattura-di-pavia-inizio-del-xviii-secolo/. URL: http://wannenesg...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (4 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-40-due-piatti-di-servizio-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii-secolo/...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (5 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-50-ciotola-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii-secolo/. URL: http://w...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (6 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-60-otto-piatti-in-porcellana-policroma-manifattura-ginori-a-doccia-fine-del-xviii-secolo/. URL: http...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (7 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-70-rinfrescabicchieri-in-porcellana-policroma-manifattura-ginori-a-doccia-seconda-meta-del-xviii-sec...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (8 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-80-coppia-di-marescialle-in-porcellana-policroma-manifattura-ginori-a-doccia-circa-1770/. URL: http:...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (9 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-90-quattro-piatti-in-porcellana-policroma-manifattura-ginori-a-doccia-circa-1770/. URL: http://wanne...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (10 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-100-figura-in-biscuit-manifattura-di-napoli-fine-del-xviii-secolo/. URL: http://wannenesgroup.com/it...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (11 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-110-figura-in-terracotta-manifattura-giustiniani-napoli-1829-1830/. URL: http://wannenesgroup.com/it...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea2 (12 of 119)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/305-120-nove-piatti-in-porcellana-bianca-e-oro-manifattura-dagoty-parigi-circa-1810/. URL: http://wannen...
14:05 No content found for limage2
14:05 No content found for limage3
14:05 No content found for limage4
14:05 No content found for limage5
14:05 Processing PageArea template pagearea (2 of 13)
14:05 Processing Link template openlink catalogues (1 of 1). Text: Arredi Sculture e Oggetti d’Arte 7-8 marzo 2017. URL: http://wannenesgroup.com/it/auctions/arredi-sculture-oggetti-dartefebbraio-2017/
14:05 Switching to new web browser instance.
14:05 Skipping template scroll
14:05 Processing PageArea template pagearea2 (1 of 12)
14:05 Processing Link template openlink detail pages (1 of 1). Text: http://wannenesgroup.com/it/lots/308-290-orologio-dappoggio-in-legno-ebanizzato-xix-secolo/. URL: http://wannenesgroup.com/it/lots/308-29...
14:06 Starting export...
14:06 Generating export data...
14:06 Data extraction partly completed



Replied: 3/6/2017 8:21:27 PM

This is what I see every time i have gone to this website. Is this what you see? If so what are the page areas you are trying to capture? A screenshot of the pages your trying to follow, and the data you want to scrape. Would expedite this issue greatly. 


Best Wishes


Kyle Correia

Replied: 3/7/2017 9:30:36 AM

Hello

Maybe you should change your IP. I see the website perfect - see both scrennshots. But I remember that I had sometimes this problem, too. Some days later it was running perfectly. I changed nothing in the VWR, so the only thing what changed was my IP.


Regards

wannenes.jpg
wannenes2.jpg

Replied: 3/3/2017 4:57:32 AM

Hi

I will take a look at this tomorrow, it is late here the website looks like it is currently doing some mantience, please see screenshot http://prntscr.com/efdoba

Best Wishes

Kyle Correia

Replied: 3/10/2017 2:13:40 PM

Hi,

I think the website has changed and it can give you an oppurtunity to avoid your problem.

The agent encountered an error before because of the website was heavily "javascripted". 

Best regards,