Answer engine optimization
llms.txt is a hedge, not a ranking lever
CommentHunter publishes a curated /llms.txt (llmstxt.org) so coding agents and assistants can find docs, APIs, and buy-intent pages. Independent research suggests major chatbots often skip the file. Treat it as brand clarity + agent docs — invest more in crawlable HTML, robots access, and citations.
What we ship
- llms.txt — curated greatest hits (Product, Docs, Buy-intent, Optional)
- llms-full.txt — expanded API / operations reference
- robots.txt — Allow for GPTBot, OAI-SearchBot, ClaudeBot, Google-Extended
- sitemap.xml — full URL inventory for search engines
- Markdown mirrors (
.md) for docs and programmatic SEO pages - Static HTML shells so key pages have H1 text without running React
Checklist that actually matters
- Do not block AI crawlers in robots.txt or at the CDN.
- Money and guide pages must expose headings in raw HTML (no empty
#rootonly). - Keep llms.txt short; link to markdown, not the entire sitemap.
- Redirect AI-hallucinated paths to canonical exporters.
- Validate: open
/llms.txtand confirmContent-Type: text/plainand H1# CommentHunter.
Live files
https://commenthunter.click/llms.txt
https://commenthunter.click/llms-full.txt
https://commenthunter.click/robots.txt
https://commenthunter.click/openapi.json