The problem: Is your website invisible to the future?
Search is evolving. Fast.
Once, your SEO strategy revolved around Google rankings, click-through rates, and crawling rules like robots.txt. But that landscape is shifting. People aren’t just searching, they’re conversing. They’re asking questions directly to large language models (LLMs) like ChatGPT, Claude, and Gemini.
In this AI-powered world, your content may still influence answers, without ever earning a click or link. And that means being part of the dataset matters more than ever.
So here’s the question: Should your website raise its hand and say, “Yes, you can learn from me”?
The solution: A small file with a big role. Meet llms.txt
That’s the premise behind llms.txt. Think of it as a new kind of robots.txt, but instead of guiding search engine crawlers, it signals to AI models. This proposed web standard allows site owners to say whether or not their content can be used for training LLMs.
- It’s a text file you add to your root domain.
- It’s not a firewall. It’s a flag.
- It lets you opt in or out of being included in AI training datasets.
In short: it’s your voice in how the next generation of machines learn.
Why say yes (or no)?
If your website offers insight, value, or authority, why wouldn’t you want that to be part of the conversation AI tools are having with your audience?
By saying “yes,” you’re not just giving permission, you’re staking a claim in how your content shapes AI-generated knowledge.
And that opens doors. Because when LLMs understand your brand, your values, and your expertise, you’re not just being discovered, you’re being remembered.
But what about saying “no”?
That’s valid, too.
You might choose to opt out if:
- You want more control over how your content is used or interpreted
- Your site includes sensitive or proprietary information
- You’re waiting for clearer governance or guarantees about how LLMs use and store training data
Saying “no” isn’t about fear. It’s about alignment, ensuring your participation fits with your goals, your values, or your brand’s comfort with AI’s current direction.
Either way, llms.txt lets you make that choice. And in a future where machines will talk about you either way, having a voice is power.
From signal to strategy
Now, the reality: adoption is inconsistent (at this time).
Google says it doesn’t use public web content for training, yet. OpenAI hasn’t confirmed if it honours llms.txt. Other models may ignore it altogether.
So, is it worth bothering? Yes, but not in isolation.
Because llms.txt is not a strategy. It’s a starting point. Here’s what really makes the difference:
- Clear, structured content: LLMs interpret patterns, structure, and hierarchy.
- Semantic clarity: Use plain language, meaningful headers, and well-linked internal pages.
- AI-optimised formatting: Think beyond keyword density, think context, relevance, and narrative flow.
Adding llms.txt is the technical handshake. But it’s the quality and clarity of your site that determines what’s remembered, and repeated, by AI.
Future-ready SEO: transforming your search strategy
At Us, we help brands become AI-visible, not just SEO-optimised. That means:
- Reframing SEO through an AI-first lens
- Helping content become both readable and learnable
- Future-proofing your site for a world where visibility means influence, not just ranking
Because in this new world, it’s not about clicks. It’s about being part of the answer.
