I am scraping the data from the website "https://www.11880.com/suche/Pflegedienst/deutschland" . After scraping few pages i.e 34th pages I am getting an error "*** Maximum memory usage reached (1027 MB). Restarting web browser... *** " and the agent is getting restarted. Again the page is starting from page2, page 3, etc. Once it comes to 35th-page the same error pops out and its keep on looping.
I have attached the log file and RIP file for your reference. Please help me to find the best way to scrape all those 400 pages data.
Thanks in Advance!