Amazonbot
Operated by Amazon · Trains a model · Builds a search index
If you block it
Your content is not used by Amazon’s products, including model training.
What Amazon says it is for
Improves Amazon’s products and services, and Amazon says the content may be used to train Amazon AI models.
Published details
- robots.txt
- Says it respects robots.txt“Automated crawling from these listed user agents respects the Robots Exclusion Protocol”
- robots.txt caching
- Amazon says changes take up to 30 days to take effect, because its crawlers use a cached copy.
- User agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36Match on the prefixAmazonbot/rather than the whole string: operators version these, and an exact match stops working on the next release.- Verification
- Published address list: https://developer.amazon.com/amazonbot
Source: https://developer.amazon.com/amazonbot Read .