Content Signals are a plain way, added to your robots.txt file, to tell AI crawlers what they may and may not do with your content after they read it, for example whether it may be used to train a model or to build a search answer. Cloudflare introduced the format so site owners could state a preference in words a bot understands.
For a small business, this is about staying in control as AI reads the web. Rather than silently allowing everything or blocking everything, you can make a considered choice. Very few sites have made any choice at all: about 1 in 25 of the web’s 200,000 busiest sites tells AI what it may do with their content (Cloudflare, 2026). Most are simply silent.
This works hand in hand with which AI crawlers you let in by name, and it is one of the checks behind a site’s agent readiness level.
I set a clear, considered policy on every build rather than leaving your site silent. Stating your preference does not force any assistant’s hand, but a site that has spoken is a site that has decided. See what else goes into a readable build.