Google backs shared robots.txt control for AI training opt-outs
A proposed cross-provider robots.txt signal could simplify AI-training opt-outs for publishers and creators, with Google targeting support in 2027.
In this brief: 3 sections 1 min read
The planned policy token would let a site express an AI-training preference once for participating providers instead of maintaining separate vendor rules. Google says an opt-out would be interpreted like a Google-Extended disallow when Google-Extended is not explicitly specified.
The change is relevant to anyone managing machine-readable permissions for web content, especially creators currently maintaining separate AI crawler or training controls. Existing company-specific controls will remain available alongside the shared signal.
Keep existing Google-Extended and other vendor-specific rules in place for now. Revisit robots.txt policy when Google and participating AI providers publish implementation details; Google currently targets support in 2027.