meta-externalagent
Operated by Meta · Trains a model
If you block it
Your content is not collected for training Meta’s models.
What Meta says it is for
Meta’s page describes this one as crawling to train foundation AI models, or to index content directly to improve products.
Published details
- robots.txt
- Operator publishes no documentation
- robots.txt caching
- Meta says changes take up to 24 hours to take effect, because its crawlers use a cached copy.
- User agent
- Not published as a full string. Meta publishes only the token.Match on the prefix
meta-externalagentrather than the whole string: operators version these, and an exact match stops working on the next release. - Verification
- No published method.
Not addressed in the documentation
- As of , Meta’s documentation does not address whether it respects robots.txt — the page neither states it nor lists this one among its exceptions.
Source: https://developers.facebook.com/docs/sharing/webmasters/web-crawlers Read .