llm_output_validator
ActiveTool of IA-QA — 130+ QA & Dev Tools for AI Agents
Validate an LLM response against QA criteria: format checks (JSON, code, markdown), content rules (must-include, must-not-include), length constraints, language detection, and safety patterns. Essential for QA testing LLM-powered features.
Parameters schema
{
"type": "object",
"required": [
"output"
],
"properties": {
"output": {
"type": "string",
"description": "The LLM output text to validate"
},
"max_length": {
"type": "number",
"description": "Maximum character length for the output"
},
"min_length": {
"type": "number",
"description": "Minimum character length for the output"
},
"check_safety": {
"type": "boolean",
"description": "Check for PII patterns (emails, phones, SSN), profanity signals, and prompt leakage"
},
"must_include": {
"type": "string",
"description": "Comma-separated strings that MUST appear in the output"
},
"expected_format": {
"enum": [
"json",
"markdown",
"code",
"plain",
"any"
],
"type": "string",
"description": "Expected output format"
},
"must_not_include": {
"type": "string",
"description": "Comma-separated strings that must NOT appear (e.g. \"TODO, FIXME, undefined, NaN\")"
},
"check_json_schema": {
"type": "string",
"description": "If expected_format is JSON, provide required keys as comma-separated list to validate the structure"
},
"expected_language": {
"type": "string",
"description": "Expected language of the output (en, fr, es, de…). Checks for common words."
}
}
}No endpoints wrapped at confidence ≥ 0.50.
Parent server
IA-QA — 130+ QA & Dev Tools for AI Agents
https://github.com/jcjamet/ia-qa
1/7 registries