Pluralis v0.1: Towards a Multicultural, Multimodal, Multilingual Benchmark for AI Risk and Reliability

Pluralis, part of the MLCommons AILuminate effort, is a culture-first benchmark of 6,448 image-text prompts across six Asia-Pacific locales and eight languages. Each prompt pairs innocuous text with a benign image that together trigger a local legal or cultural violation, exposing failures that globally averaged metrics hide.

I am India lead with Dr. Sunayana Sitaram. CeRAI led benchmark design, curation and validation for English, Hindi and Tamil.