---
title: "Generate llms.txt and llms-full.txt for any website"
slug: "generate-llms-txt-for-any-website"
type: "apify-task-example"
url: "https://automationbyexperts.com/apify/examples/generate-llms-txt-for-any-website"
actor: "LLMs.txt & llms-full.txt Generator for Any Website"
actor_url: "https://automationbyexperts.com/apify/llms-txt-generator"
apify_url: "https://apify.com/fayoussef/llms-txt-generator/examples/generate-llms-txt-for-any-website?fpr=youssef&fp_sid=abe_ex_generate-llms-txt-for-any-website"
price: "$0.004"
price_unit: "per result"
---

# Generate llms.txt and llms-full.txt for any website

Paste a homepage and the Actor finds the sitemap, picks the 50 most important pages, and writes a spec compliant llms.txt index plus an llms-full.txt with the complete Markdown content of every page, ready to upload to your site root so ChatGPT, Claude and Perplexity read what you want them to.

**Run it:** [Generate llms.txt and llms-full.txt for any website on Apify](https://apify.com/fayoussef/llms-txt-generator/examples/generate-llms-txt-for-any-website?fpr=youssef&fp_sid=abe_ex_generate-llms-txt-for-any-website)  
**Actor:** [LLMs.txt & llms-full.txt Generator for Any Website](https://automationbyexperts.com/apify/llms-txt-generator)  
**Pricing:** $0.004 per result

## The input this task runs with

```json
{
  "websiteUrl": "https://books.toscrape.com",
  "maxPages": 50,
  "includeFullText": true
}
```

## What every run returns

- `llms.txt file`
- `llms-full.txt file`
- `Page title`
- `Page description`
- `Full Markdown content`
- `Source URL`
- `Pages-crawled count`

## How to run it

1. Open the task on Apify. New accounts get $5 of free credit.
2. Check the pre-filled input above and change anything you need.
3. Click Run. Pagination, proxies and anti-bot handling are automatic.
4. Export CSV, JSON or Excel, or save it as your own task and schedule it.

## Other LLMs.txt & llms-full.txt Generator for Any Website tasks

- [Build an llms-full.txt for a documentation site](https://automationbyexperts.com/apify/examples/llms-full-txt-for-documentation-site): Crawls up to 200 pages of a docs site, limited to the platform and API sections, and produces a single llms-full.txt with every page as clean Markdown. Point AI coding assistants and support bots at one file instead of hundreds of pages. Schedule weekly so it never goes stale.

---

Part of [AutomationByExperts](https://automationbyexperts.com) - see [all example tasks](https://automationbyexperts.com/apify/examples) or [request a new one](https://automationbyexperts.com/suggest).