I am trying to pull all of the products from the category chemicals and solutions on this page: There are 1053 products and my project only pulled back 396. I have ran this twice and each time the amount does not equal 1053. I am not getting any errors and the project is saying it ran complete. How do I determine why this is happening? The other issue is the project is taking a long time to run. 9 hours to pull back 396 products.
You have to put a delay, at least 10sec, to the page navigation because the products info load for some time and without it, the agent prematurely click the page navigation over and over again without loading the product info.