generate_llms_txt

Active

declared in 0.1.0

Generate a production-ready llms.txt file for any URL so AI crawlers (ChatGPT, Claude, Perplexity) can index the site cleanly. Fetches the page, extracts title/description/key links, and emits the standard llms.txt markdown format. Output is a single text blob ready to drop at site-root/llms.txt. Useful for: getting a client's site indexed by AI, drafting llms.txt for your own project, or auditing how an AI crawler would see a competitor.

Parameters schema

{
  "type": "object",
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "description": "Full URL of the site to summarize, e.g. \"https://example.com\" or a specific landing page."
    },
    "max_links": {
      "type": "number",
      "description": "Maximum number of link entries to include (default 25, max 50)."
    }
  }
}

What this tool wraps· 1 endpoint

min confidence0.70 0.50

Data resourceSemantic Scholar API
Allen Institute for AI · research
name mention0.70

Parent server

mcp-semanticscholar

https://github.com/pipeworx-io/mcp-semanticscholar

2/7 registries

View full server →