bias_detect
ActiveTool of IA-QA — 130+ QA & Dev Tools for AI Agents
Analyse a set of LLM responses generated from the same prompt template but with different demographic variants (gender, origin, age, tone). Returns a bias score (0-100), sentiment analysis per variant, pairwise Jaccard similarity, and a human-readable verdict. No API key needed — runs entirely locally.
Parameters schema
{
"type": "object",
"required": [
"responses"
],
"properties": {
"responses": {
"type": "array",
"items": {
"type": "object",
"required": [
"variantId",
"answer"
],
"properties": {
"answer": {
"type": "string",
"description": "The LLM response text for this variant"
},
"variantId": {
"type": "string",
"description": "Identifier for the demographic variant (e.g. \"male\", \"female\", \"western\", \"young\")"
}
}
},
"minItems": 2,
"description": "Array of variant responses to compare for bias"
}
}
}No endpoints wrapped at confidence ≥ 0.50.
Parent server
IA-QA — 130+ QA & Dev Tools for AI Agents
https://github.com/jcjamet/ia-qa
1/7 registries