ChimeraMiND Data
Home / Tools / llms.txt Generator (Website to llms.txt & llms-full.txt)
AI & LLM data

llms.txt Generator (Website to llms.txt & llms-full.txt)

Turn any website or docs site into an llms.txt (sectioned links with one-line descriptions) and llms-full.txt (every page as clean Markdown) for AI assistants, RAG and AI search. Plain HTTP, sitemap-aware, robots.txt-friendly.

Run llms.txt Generator (Website to llms.txt & llms-full.txt) on Apify →

Read the step-by-step guide

Pricing

Apify planPer pagePer 1,000
Free plan$0.001$1
Starter$0.0008$0.80
Scale$0.0007$0.70
Business$0.0006$0.60
Enterprise$0.0006$0.60
Enterprise+$0.0006$0.60

Primary event rates from a catalog snapshot; this is not the total price of a run. Additional charge events and Actor Start fees may apply; start fees can scale with memory. Check the Actor's Pricing tab on Apify for all events, conditions and current plan-specific rates, and set a maximum run budget before starting.

Sample output

Archived example · 15 days old. This is a snapshot, not current data.run 9DhgEi2uzqJqRSlKv · 2026-10-03
{
  "site": "crawlee.dev",
  "url": "https://crawlee.dev/js/docs/quick-start",
  "title": "Quick Start",
  "description": "With this short tutorial you can start scraping with Crawlee in a minute or two. To learn more, read the Introduction.",
  "section": "Docs",
  "wordCount": 1484,
  "tokens": 4413,
  "markdown": "Version: 3.18\n\n# Quick Start\n\nWith this short tutorial you can start scraping with Crawlee in a minute or two. To learn in-depth how Crawlee works, read the [Introduction](https://crawlee.dev/js/docs/introduction), which is a comprehensive step-by-step guide for creating your …"
}

Call from code

Use the existing catalog input below as a starting point. Review the tool's input form on Apify before running it.

import json
import os
from apify_client import ApifyClient

client = ApifyClient(os.environ["APIFY_TOKEN"])
run = client.actor("webdatatools/llms-txt-generator").call(run_input=json.loads("{\n    \"startUrls\": [\n        {\n            \"url\": \"https://crawlee.dev/js/docs/quick-start\"\n        }\n    ],\n    \"maxPages\": 50,\n    \"maxDepth\": 3\n}"))

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)
import { ApifyClient } from 'apify-client';

const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('webdatatools/llms-txt-generator').call({
    "startUrls": [
        {
            "url": "https://crawlee.dev/js/docs/quick-start"
        }
    ],
    "maxPages": 50,
    "maxDepth": 3
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);
curl -X POST "https://api.apify.com/v2/acts/webdatatools~llms-txt-generator/run-sync-get-dataset-items" \
  -H "Authorization: Bearer $APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"startUrls":[{"url":"https://crawlee.dev/js/docs/quick-start"}],"maxPages":50,"maxDepth":3}'

Related tools

Workflows