Registration
You can register using this form: Registration link.
Maximum number of participants in a team: 4 (including tutor/supervisor). An individual cannot be part of multiple teams.
Dataset access and submission instructions: To be Announced.
Benchmark and Evaluation Metrics
This shared task evaluates LLMs using three value-based datasets, each split into 20% development and 80% test sets:
- Chinese (4,000 instances): Multiple-choice daily scenarios testing 158 universal values against a single gold answer.
- Indonesian (1,834 instances): Multiple-choice news-based scenarios testing five national values based on Pancasila, scored against human consensus.
- Sri Lankan (1,000 instances in Sinhala): Evaluates two statements (labeled A, B, Both, or None) grounded in 40 survey-derived societal values.
Submission format, delivery, and scoring details: To be Announced
Leaderboard
To be Announced