Skip to main content

Retailer Commitment

Written by Bryan Nye

MetaLocator drives highly qualified traffic directly to retailer Web sites.  To do this, we require structured data from the retailer, and that may involve crawling a product directory, or obtaining data from a retailer provided API.  MetaLocator is committed to performing data acquisition in alignment with the content owner's rights, preferences and rules.  To that end, the following practices are observed:

  • Opt-out: Retailers may opt-out of participation at will.  Requests to be removed are honored without question.

  • Robots.txt: MetaLocator crawlers respect robots.txt rules

  • No-Circumvention: MetaLocator will not attempt to circumnavigate crawler-prevention methods such as captcha codes, content protection networks or similar

  • User-Agent: MetaLocator will represent itself accurately in the User Agent string of the crawler.

Questions regarding our crawler or these policies can be directed to support@metalocator.com.

Did this answer your question?