> The full list of bisica's docs pages is at https://docs.bisica.com/llms.txt

# Make your site readable by AI

Guides for your web team. Let AI crawlers in and give them pages they can read.

- [AI crawlers and robots.txt: which to allow](https://docs.bisica.com/make-your-site-readable/ai-crawlers-and-robots-txt/index.md): To appear in AI answers, let the crawlers that read pages for answers into your site. For OpenAI that is OAI-SearchBot and ChatGPT-User, for Anthropic Claude-SearchBot and Claude-User, for Perplexity PerplexityBot and Perplexity-User. Keeping training crawlers out is a separate choice.
- [Make your pages readable before any script runs](https://docs.bisica.com/make-your-site-readable/pages-without-javascript/index.md): Put your page’s words in the HTML your server sends. A crawl study by Vercel and MERJ found that none of the major AI crawlers ran JavaScript, OpenAI’s and Anthropic’s included. Words that appear only after a script runs can be invisible to them.
- [llms.txt and plain-text copies of your pages](https://docs.bisica.com/make-your-site-readable/llms-txt-and-plain-text-copies/index.md): llms.txt is a proposed file that lists a website’s pages in plain text for AI tools. A plain-text copy is a page’s words in markdown with the layout taken out. Both are cheap to add on top of pages AI crawlers can already read.

---

Source: https://docs.bisica.com/make-your-site-readable/ · Updated November 2, 2026