You're viewing a demo portfolio

Join the waitlist
PRSM
This tool is no longer present in the server's latest manifest. Showing the last observed version (server version 1.28.0).

onyx_robots_check

Inactive

Tool of onyx-paid-mcp

declared in 1.28.0

Fetch a domain's robots.txt and report whether a given path is allowed for a given user-agent. Returns the raw robots.txt text, the matched rule, the crawl-delay if specified, and a clean allow/disallow verdict. Use when an agent does web scraping and wants to be polite — saves bans, saves CAPTCHAs, saves drama. ~50-200ms. (price: $0.001 USDC, tier: metered)

Parameters schema

{
  "type": "object",
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "description": "Any URL on the target domain"
    },
    "user_agent": {
      "type": "string",
      "default": "*",
      "description": "UA string to test"
    }
  }
}

What this tool wraps· 1 endpoint

min confidence0.700.50

Parent server

onyx-paid-mcp

https://github.com/dimitrilaouanis-tech/onyx-mcp

2/7 registries
View full server →