You're viewing a demo portfolio

Join the waitlist
PRSM

llm_output_validator

Active

Tool of IA-QA — 130+ QA & Dev Tools for AI Agents

declared in 1.0.0

Validate an LLM response against QA criteria: format checks (JSON, code, markdown), content rules (must-include, must-not-include), length constraints, language detection, and safety patterns. Essential for QA testing LLM-powered features.

Parameters schema

{
  "type": "object",
  "required": [
    "output"
  ],
  "properties": {
    "output": {
      "type": "string",
      "description": "The LLM output text to validate"
    },
    "max_length": {
      "type": "number",
      "description": "Maximum character length for the output"
    },
    "min_length": {
      "type": "number",
      "description": "Minimum character length for the output"
    },
    "check_safety": {
      "type": "boolean",
      "description": "Check for PII patterns (emails, phones, SSN), profanity signals, and prompt leakage"
    },
    "must_include": {
      "type": "string",
      "description": "Comma-separated strings that MUST appear in the output"
    },
    "expected_format": {
      "enum": [
        "json",
        "markdown",
        "code",
        "plain",
        "any"
      ],
      "type": "string",
      "description": "Expected output format"
    },
    "must_not_include": {
      "type": "string",
      "description": "Comma-separated strings that must NOT appear (e.g. \"TODO, FIXME, undefined, NaN\")"
    },
    "check_json_schema": {
      "type": "string",
      "description": "If expected_format is JSON, provide required keys as comma-separated list to validate the structure"
    },
    "expected_language": {
      "type": "string",
      "description": "Expected language of the output (en, fr, es, de…). Checks for common words."
    }
  }
}

What this tool wraps· 0 endpoints

min confidence0.700.50

No endpoints wrapped at confidence ≥ 0.50.

Parent server

IA-QA — 130+ QA & Dev Tools for AI Agents

https://github.com/jcjamet/ia-qa

1/7 registries
View full server →
llm_output_validator — IA-QA — 130+ QA & Dev Tools for AI Agents — PRSM MCP