I would like to do a checking on a column and make sure that it is not empty before inserting into database, for ex: CompanyName.
After the crawl, at the exporting script(or any other option), I would like to check if CompanyName is empty for all the rows in the internal table.
My plan is to do a select statement that where companyname = '' and compare the count with the total row count at the internal table.
If the count is the same, all the data will not be inserted into the database.
Any other option that you could suggest?
Or is there anyway to set a condition script when the website changed their template/xpath?