Feature: Add LLM-friendly content endpoints#104
Draft
neoskx wants to merge 7 commits into
Draft
Conversation
Generate llms.txt, llms-full.txt, and per-page raw markdown files
(/{slug}/index.md) so LLMs and users can access source markdown
alongside rendered pages. The generator runs as a GitHub Action during
deploy and locally via `npm run start:local`.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Both files use the BASE_URL env var so they point to localhost in development and https://luau.org in production. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Consistent with the existing llms.txt and llms-full.txt templates. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Starlight already generates sitemap.xml at build time via @astrojs/sitemap. Use a static robots.txt in public/ instead of generating it. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Astro/Starlight generates sitemap-index.xml, not sitemap.xml. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
The action needs Node.js available for npm ci and tsx. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Motivation
LLM agents and tools increasingly look for
llms.txtto discover documentation in a machine-readable format. Serving raw markdown alongside rendered pages lets both LLMs anddevelopers access structured content without scraping HTML.
What's included
.github/actions/generate-llm-content/llms.txt,llms-full.txt, and copies raw markdown topublic/{slug}/index.md.github/workflows/deploy.yaml.gitignorepublic/package.jsongenerate:llmsscriptLocal development
Test plan
npm run start:localgenerates 22 files without errorsllms.txtlinks all use correct base URLllms.txtresolves to an existing file inpublic//{slug}/index.mdmatches source file exactly (including frontmatter)