Skip to main content

How are product URLs maintained up to date?

There is a well-structured and automated process in place that manages the so-called "Product URLs Maintenance"

This is a very core mechanism where all tracked products for all the relevant eRetailers are being checked and updated every two weeks, creating in fact an automated data pipeline between eRetailers' website data and eRetail Content platform. 

On every production data release, the "crawlers" will visit the updated product pages to get the necessary information. This mechanism runs every second and fourth week of every month. It is worth noting that the product URLs data extraction flow is based on sophisticated crawling services, enhanced where needed with product XML feeds, RPA (Robotic Process Automation), offline files, and manual research.