The LLMS.txt is still new, but it's quickly gaining traction as a way to inform large language models (LLMs) on how to interpret a site. It's sort of similar to a robots.txt, but instead its for AI. Instead of crawling rules for search engines, this file helps LLMs understand your content, it's purpose, and how you’d like it to be used.

If you've already created your LLMs.txt file, next you'll want to ensure it is visible in the llms.txt directory. At the moment to be listed you'll need to contribute to the repository on github to include your website in the directory. Once submitted it can take a few days for it to be reviewed and ultimately added.

It's a quick process, should only take 5-15 minutes. Here’s how to do it.

What You’ll Need

Before you start:

• Create a GitHub account if you don't have one.
• It's helpful to get a basic understanding of how github works, but if you want to skip that, our LLMS.txt Assistant Custom GPT should be able to help you if you get stuck or have questions.
• Generate your llms.txt and push it live on your site
  
  

Add Your Website to the Official Directory

1. Fork the Repository

Head to the llmstxt-site GitHub repo and click the Fork button in the top-right corner. This creates a copy of the repo so you can edit it without changing the main one directly.

2. Clone the Repo Locally

Once forked, open up your terminal and run:

bash
CopyEdit
git clone https://github.com/<your-username>/llmstxt-site.git

Replace <your-username> with your GitHub handle. Then:
bash
CopyEdit
cd llmstxt-site

This command puts you inside the folder where you’ll be making the edits.

3. Edit the data.json File

Open the data.json file in the root of the project directory with your favorite code editor. It contains an array of entries. Scroll to the end (but before the closing ]) and add your entry.

Here’s an example:

‍

json
CopyEdit
{
    "product": "Company Name",
    "website": "https://companyname.com/",
    "llms-full-txt": "",
    "llms-txt": "https://www.companyname.com/llms.txt"
}

Make sure it’s properly formatted JSON. If you're adding this as the last item, no comma at the end. If it's in the middle, add a comma after the curly brace.

4. Stage, Commit, and Push Your Changes

Back in your terminal, run:

bash
CopyEdit
git add data.json
git commit -m "Add [Company Name] llms.txt entry"
git push origin main

‍

This sends your update to your GitHub fork.

5. Submit a Pull Request

Now go to your forked repo on GitHub. You should see a button that says Compare & pull request, click it.

Fill out:

• Title: Add [Company Name] llms.txt entry
• Description: A quick note like: "Added LLMS.txt directory entry for [Company Name]."
  
  

Then hit Create pull request.

That’s it. You’ve submitted your entry for review. Once approved, it becomes part of the shared directory.

Remember:

• Double-check your JSON syntax. A missing bracket or comma can create errors.
• Keep your llms.txt file updated as your site evolves.
• This file and idea is experimental, but being part of it now enables any early adopters to effectively understand your website.

Have questions about this process or need help creating your file in general? We’re here to help, drop us a line and lets get started.

‍