You're viewing a demo portfolio

Join the waitlist
PRSM

bias_detect

Active

Tool of IA-QA — 130+ QA & Dev Tools for AI Agents

declared in 1.0.0

Analyse a set of LLM responses generated from the same prompt template but with different demographic variants (gender, origin, age, tone). Returns a bias score (0-100), sentiment analysis per variant, pairwise Jaccard similarity, and a human-readable verdict. No API key needed — runs entirely locally.

Parameters schema

{
  "type": "object",
  "required": [
    "responses"
  ],
  "properties": {
    "responses": {
      "type": "array",
      "items": {
        "type": "object",
        "required": [
          "variantId",
          "answer"
        ],
        "properties": {
          "answer": {
            "type": "string",
            "description": "The LLM response text for this variant"
          },
          "variantId": {
            "type": "string",
            "description": "Identifier for the demographic variant (e.g. \"male\", \"female\", \"western\", \"young\")"
          }
        }
      },
      "minItems": 2,
      "description": "Array of variant responses to compare for bias"
    }
  }
}

What this tool wraps· 0 endpoints

min confidence0.700.50

No endpoints wrapped at confidence ≥ 0.50.

Parent server

IA-QA — 130+ QA & Dev Tools for AI Agents

https://github.com/jcjamet/ia-qa

1/7 registries
View full server →