Skip to content
Shonin
Soon

AfroEval

Test your agent in Pidgin, Yoruba, Hausa, Igbo, Swahili and Twi before your customers do.

The split

LLM writes
Proposes candidate tasks for native speakers to verify
System One decides
Grades answers against rubrics
Code executes
Runs suites, repeats, computes cost and accuracy

Engine

Task suites written with native speakers; repeated runs for consistency; cost tracked per task, so results read as accuracy per dollar.

Rulebook

What correct means here, and the mistakes we've already caught. It grows one job at a time.

  1. R01Native speakers write and verify every task.
  2. R02Report accuracy per dollar, not just accuracy.
  3. R03Publish the method; keep test sets private so nobody trains on them.

Intake

  • Agent endpoint
  • Target languages
  • Task types
UNIT
One agent evaluated across a language suite
REVIEW LAYER
Native-speaker reviewers score a sample of every run.
DELIVERY
A scorecard per language and task, with failing examples.
TURNAROUND
1–2 weeks

How we find buyers

  • Model labs and startups expanding into Africa
  • Language coalition partners
  • Published results via Griot

More like this