What it does
It generates a spec-compliant llms.txt and llms-full.txt for any website in one click — crawling your sitemap or site, extracting titles, descriptions and full Markdown content, and outputting ready-to-upload files that make your site visible to ChatGPT, Claude, Perplexity and other AI search engines.
📦 What data you get
Every run returns these fields per record, exportable as CSV, JSON or Excel.
🎯 Who uses it
Publish llms.txt so AI search engines can read and cite your site correctly.
Turn your whole site into clean Markdown for AI discovery in one run.
Generate llms.txt files for client sites with zero manual work.
🚀 How to run it
- Create a free Apify account
Click "Run this actor on Apify" above and sign up — you get $5 of credit instantly, no credit card required.
- Enter your input
Paste the target URL or search terms into the actor's input form in the Apify console.
- Set a result limit and click Run
The limit controls your cost. Pagination, rotating proxies and anti-bot handling all happen in the cloud.
- Export or automate
Download JSON, CSV or Excel, or connect a webhook, schedule or the API to push results into your own workflow.
💵 What it costs
❓ Questions about LLMs.txt & llms-full.txt Generator for Any Website
What is llms.txt?
A standard file that tells AI search engines like ChatGPT, Claude and Perplexity what your site contains, improving how they read and cite you.
What does it output?
Both a concise llms.txt and a full llms-full.txt with titles, descriptions and full Markdown content, ready to upload.
How does it find my pages?
It crawls your sitemap or site automatically — no manual URL list needed.
🔗 Often used together
Try it with your own URL
Open the actor, paste a link, and run it on the $5 free credit before you decide.