Contenido

Moderación de contenido

Clasifica UGC como permitido, revisión o bloqueado con Jev.

Choice + Score + Noul

Moderación de contenidoSeguridadHuman-in-the-loop
Moderation queue

UGC · pending review

Request sent to Jev

Clicking run posts this JSON to POST /api/playground. Sign in to run.

POST /api/playground
{
  "state": "This seller is a scam!!! They stole my money and threatened me in DMs. Everyone avoid @shopXYZ — report them NOW.",
  "questions": {
    "action": {
      "type": "choice",
      "instructions": "What moderation action should the platform take?",
      "criteria": {
        "allow": "Safe to publish",
        "review": "Queue for human review",
        "block": "Block or remove"
      }
    },
    "confidence": {
      "type": "score",
      "instructions": "Confidence in the recommended moderation action",
      "criteria": [
        "Low — ambiguous or context missing",
        "Medium — reasonable but not definitive",
        "High — clear policy alignment"
      ]
    },
    "human_review_required": {
      "type": "noul",
      "instructions": "Should a human moderator confirm before enforcing the action?",
      "criteria": {
        "true": "Safety, legal, or reputational risk needs human eyes",
        "false": "Automated enforcement is acceptable"
      }
    }
  }
}