Feeds & AI crawlers
RSS, sitemaps and llms.txt out of the box.
Every article hub ships syndication endpoints so search engines and AI crawlers can discover your content. They are generated automatically from published articles, with no extra setup.
Endpoints
- GET /api/v1/page-articles/{pageKey}/rss.xml: an RSS feed of the latest 50 articles
- GET /api/v1/page-articles/{pageKey}/sitemap.xml: a sitemap of article URLs
- GET /api/v1/page-articles/{pageKey}/llms.txt: a content map for AI crawlers (text/plain)
What the feeds include
Like the public API, feeds include only published, public articles. If the headless page does not exist or is inactive, llms.txt returns 404.
Wiring feeds into your site
- 1Fetch each endpoint from your public site's server and serve it from your own URLs. llms.txt is usually served at the site root (/llms.txt).
- 2Advertise the RSS feed URL in your site's head or as a subscribe link.
- 3Submit the sitemap in Google Search Console.
bash
# Check that a feed responds and see its cache headers
curl -I "https://tixigen.com/api/v1/page-articles/$PAGE_KEY/rss.xml"
curl -I "https://tixigen.com/api/v1/page-articles/$PAGE_KEY/llms.txt"If the headless page has a public API key, the feeds need it too. Crawlers cannot send the key, so fetch the feeds server-side with the key and serve them from your own site.
Caching
Feeds are served with Cache-Control: public, s-maxage=600, stale-while-revalidate=86400, so new articles can take a little while to appear.