Evaluating Multilingual LLMs at Scale
For Microsoft Research, Karya completed one of the largest multilingual human evaluations of LLMs within three weeks.
Rocket Learning, a leader in early childhood education, utilises its innovative WhatsApp-based platform to distribute digital learning content to nearly 1.5 million children across India.
372K
Images Annotated
800
kinds of Worksheets
1.5M
Children Positively Impacted
97%
ML Accuracy Rate
By sending homework worksheets focused on literacy and numeracy, Rocket Learning aims to enhance educational engagement. However, the lack of timely feedback on these worksheets has been a significant challenge. To address this issue, Rocket Learning partnered with Karya to develop a machine learning model that grades children's worksheet responses, thereby improving educational outcomes and fostering a more effective learning environment.
For Microsoft Research, Karya completed one of the largest multilingual human evaluations of LLMs within three weeks.
Collecting and validating conversational speech data across multiple domains in 11 languages for Microsoft