hallucination_check

Active

Tool of IA-QA — 130+ QA & Dev Tools for AI Agents

declared in 1.0.0

Word-overlap based hallucination check: verifies if an LLM answer's words and numbers appear in the provided source/context. Fast, deterministic, no API key needed. Limitations: not semantic — does not understand synonyms or paraphrases. For true semantic grounding, use run_semantic_tests with embedding mode. Essential for quick RAG accuracy testing.

Parameters schema

{
  "type": "object",
  "required": [
    "answer",
    "context"
  ],
  "properties": {
    "answer": {
      "type": "string",
      "description": "The LLM-generated answer to verify"
    },
    "strict": {
      "type": "boolean",
      "description": "If true, every sentence in the answer must be supported (default: false)"
    },
    "context": {
      "type": "string",
      "description": "The source/reference text that should ground the answer"
    }
  }
}

What this tool wraps· 0 endpoints

min confidence0.70 0.50

No endpoints wrapped at confidence ≥ 0.70.

Parent server

IA-QA — 130+ QA & Dev Tools for AI Agents

https://github.com/jcjamet/ia-qa

1/7 registries

View full server →