Meta commercial terms Oct. 30: Meta can crawl your site to train AI
Meta's new commercial terms, live Oct. 30, let it crawl, cache and train AI on business websites. No opt-out. Check robots.txt and your gated pages now.
If your business runs ads or a page on Facebook or Instagram, Meta's new commercial terms give it written permission to crawl your website and train AI on what it finds. The updated Meta Commercial Terms take effect October 30, 2026. You accept them by using Meta's business tools. There is no checkbox to decline. Nieman Lab reported on October 15 that legal experts read the clause as a broad training license. Meta says nothing changes. The contract text is what you sign.
What actually happened
We read the preview of the terms on Meta's own legal page. The licensing section says:
- Automated access. You authorize Meta, and anyone acting for Meta, to use crawlers, bots and similar tools on domains, pages and URLs "associated with" your products or services. The terms do not define that phrase.
- What the bots can do. Access, index, cache, analyze, collect, retrieve and crawl that content, and pull updates periodically.
- Test credentials. Meta may create test credentials to get that access. Cornell law professor James Grimmelmann told Nieman Lab this could let Meta sign up as a user to get past registration walls.
- Training. Meta may use the content to develop, improve, research and train its products and features.
- No robots.txt. The terms do not mention robots.txt.
Meta spokesperson Andy Stone called the reports false and said there is no change to how Meta uses web crawlers. He said the update helps Meta pull accurate product information from third-party sites, and that site owners can still use robots.txt. Whether a contract clause overrides a robots.txt block is untested in court.
Why Meta's commercial terms matter for your business
For a store, "pull accurate product information" is not the scary part. That is how catalog ads work. The scary part is scope. The clause covers caching, training and test logins on any domain tied to your business, and you agree to it by running ads or a business page.
What we would do before October 30:
- Decide your crawler policy, per bot. Meta's crawler docs list
meta-externalagentfor AI training andmeta-externaladsfor ads. Block the first if you do not want training. Keep the second if you run catalog ads. Meta says robots.txt can be cached for up to 24 hours. - Audit what sits behind a login. Wholesale price lists, B2B portals, customer order pages. If a test account could see it, assume Meta's bots could too. Put real authorization on it, not only a signup form.
- Log the bots. Check your server or CDN logs for Meta user agents after October 30. Then you know if your robots.txt is respected.
- Read your other platform terms. Meta will not be the last vendor to put crawl rights in a business agreement.
Key takeaways
- Meta's updated Commercial Terms take effect October 30, 2026
- They let Meta crawl, cache and train AI on domains associated with your business, with test credentials
- The terms do not mention robots.txt, and there is no opt-out short of leaving Meta's business tools
- Meta says crawler behavior is not changing; the contract language is still broader than that
- Block meta-externalagent if you do not want training, and lock down gated content with real auth
We set up stores so you decide who reads them. Per-bot crawler rules, real authorization on wholesale and B2B pages, and bot logs you can actually check. Talk to us before October 30.
Sources: Meta Commercial Terms (preview), Nieman Lab, Meta web crawler docs.
- #meta
- #ai-training
- #web-crawlers
- #robots-txt
- #facebook-ads
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
Google Universal Cart launches in the US: your feed is the store
Google Universal Cart is live in US Search and Gemini, with UCP checkout, price-drop alerts and Google Pay. Your product feed is now the storefront.
Read itShopify Shop skill: personal AI agents now accept your policies
Shopify's Shop skill lets personal AI agents like OpenClaw and Hermes buy with Shop Pay, even within a set budget. Your return policy is now the contract.
Read it