Lexin Zhou
@lexinzhou.bsky.social
Research Intern at Microsoft | Working on AI Evaluation, Social Computing and NLP | Incoming PhD candidate for Fall 2025
https://lexzhou.github.io
https://lexzhou.github.io
Active updates of the platform will occur continuously (including the scales, battery, results, blogposts, tutorials, etc), underpinning the reliable deployment of AI with both explanatory and predictive power in the years to come.
Contributions and feedback are welcome!
Contributions and feedback are welcome!
March 14, 2025 at 3:37 AM
Active updates of the platform will occur continuously (including the scales, battery, results, blogposts, tutorials, etc), underpinning the reliable deployment of AI with both explanatory and predictive power in the years to come.
Contributions and feedback are welcome!
Contributions and feedback are welcome!
Reposted by Lexin Zhou
To better understand why this matters in high-stakes contexts, you can also check out our previous work. We discuss why predicting model performance (e.g., failures on out-of-distribution languages in machine translation) remains essential in legal contexts.
March 11, 2025 at 8:07 PM
To better understand why this matters in high-stakes contexts, you can also check out our previous work. We discuss why predicting model performance (e.g., failures on out-of-distribution languages in machine translation) remains essential in legal contexts.
19/ To end off, huge thanks to Serina Chang, Miri Zilka, Jianxun Lian and Chengzu Li for their valuable help and feedback at certain stages of the project!
March 11, 2025 at 6:36 PM
19/ To end off, huge thanks to Serina Chang, Miri Zilka, Jianxun Lian and Chengzu Li for their valuable help and feedback at certain stages of the project!
18.2/ Kexin Jiang Chen, Pablo A. M. Casares, Jiyun Zu, John Burden, Behzad Mehrbakhsh, David Stillwell, Manuel Cebrian, Jindong Wang, @peterhenderson.bsky.social l, @sherrytswu.bsky.social , Patrick C. Kyllonen, @lucycheke.bsky.social , Xing Xie, José Hernández-Orallo
March 11, 2025 at 6:35 PM
18.2/ Kexin Jiang Chen, Pablo A. M. Casares, Jiyun Zu, John Burden, Behzad Mehrbakhsh, David Stillwell, Manuel Cebrian, Jindong Wang, @peterhenderson.bsky.social l, @sherrytswu.bsky.social , Patrick C. Kyllonen, @lucycheke.bsky.social , Xing Xie, José Hernández-Orallo
18.1/ Tagging my wonderful collaborators who have been highly constructive in this work:
Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García, ...
Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García, ...
March 11, 2025 at 6:35 PM
18.1/ Tagging my wonderful collaborators who have been highly constructive in this work:
Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García, ...
Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García, ...
17/ Paper: arxiv.org/pdf/2503.06378
Newsletters: If you are drawn to everything relevant to AI Evaluation and want to stay informed, please subscribe to our monthly AI Evaluation Digest newsletter! (aievaluation.substack.com)
Newsletters: If you are drawn to everything relevant to AI Evaluation and want to stay informed, please subscribe to our monthly AI Evaluation Digest newsletter! (aievaluation.substack.com)
The AI Evaluation Substack | Substack
A monthly digest of the latest developments, research trends and key initiatives in the realm of AI evaluation. Click to read The AI Evaluation Substack, a Substack publication with hundreds of subscr...
aievaluation.substack.com
March 11, 2025 at 6:31 PM
17/ Paper: arxiv.org/pdf/2503.06378
Newsletters: If you are drawn to everything relevant to AI Evaluation and want to stay informed, please subscribe to our monthly AI Evaluation Digest newsletter! (aievaluation.substack.com)
Newsletters: If you are drawn to everything relevant to AI Evaluation and want to stay informed, please subscribe to our monthly AI Evaluation Digest newsletter! (aievaluation.substack.com)
16/ Future work to improve our methodology and thus AI evaluation:
- Analyse multimodal systems and embodied AI
- Turn the demand level 5+ into 5-10
- Enhance the coverage of instances at demand level 5+
- We encourage collaborative efforts on extending our methodology. Contact: jh2135@cam.ac.uk
- Analyse multimodal systems and embodied AI
- Turn the demand level 5+ into 5-10
- Enhance the coverage of instances at demand level 5+
- We encourage collaborative efforts on extending our methodology. Contact: jh2135@cam.ac.uk
March 11, 2025 at 6:29 PM
16/ Future work to improve our methodology and thus AI evaluation:
- Analyse multimodal systems and embodied AI
- Turn the demand level 5+ into 5-10
- Enhance the coverage of instances at demand level 5+
- We encourage collaborative efforts on extending our methodology. Contact: jh2135@cam.ac.uk
- Analyse multimodal systems and embodied AI
- Turn the demand level 5+ into 5-10
- Enhance the coverage of instances at demand level 5+
- We encourage collaborative efforts on extending our methodology. Contact: jh2135@cam.ac.uk
15/ The scales, rubrics, battery, and results presented here mark a major step for AI evaluation, underpinning the reliable deployment of AI in the years ahead. It will be instrumentalised through a platform in the coming years, ready to explain and predict the performance and safety of AI systems.
March 11, 2025 at 6:29 PM
15/ The scales, rubrics, battery, and results presented here mark a major step for AI evaluation, underpinning the reliable deployment of AI in the years ahead. It will be instrumentalised through a platform in the coming years, ready to explain and predict the performance and safety of AI systems.
14/ Takeaways on our novel methodology:
- General scales (stable to SOTA/frontiers in AI, no saturation!)
- AI benchmarks and systems become commensurate!
- Explanatory power (demand profiles, ability profiles)
- Predictive power at instance level (especially OOD!)
- Fully automated procedure
- General scales (stable to SOTA/frontiers in AI, no saturation!)
- AI benchmarks and systems become commensurate!
- Explanatory power (demand profiles, ability profiles)
- Predictive power at instance level (especially OOD!)
- Fully automated procedure
March 11, 2025 at 6:28 PM
14/ Takeaways on our novel methodology:
- General scales (stable to SOTA/frontiers in AI, no saturation!)
- AI benchmarks and systems become commensurate!
- Explanatory power (demand profiles, ability profiles)
- Predictive power at instance level (especially OOD!)
- Fully automated procedure
- General scales (stable to SOTA/frontiers in AI, no saturation!)
- AI benchmarks and systems become commensurate!
- Explanatory power (demand profiles, ability profiles)
- Predictive power at instance level (especially OOD!)
- Fully automated procedure
13/ Even better, we build a Random Forest (RF) classifier fed with the 18 demand levels to predict the performance of LLMs at instance-level. This yields high predictive power (high AUROC and nearly perfect calibration!) in-distribution and out-of-distribution, outperforming black-box predictors.
March 11, 2025 at 6:26 PM
13/ Even better, we build a Random Forest (RF) classifier fed with the 18 demand levels to predict the performance of LLMs at instance-level. This yields high predictive power (high AUROC and nearly perfect calibration!) in-distribution and out-of-distribution, outperforming black-box predictors.
12/ On predictive power: We can map these interpretable ability profiles with the demand profiles of benchmarks or individual instances, to anticipate the performance of LLMs on them: the larger the supremacy of (model) abilities over (task) demands is, the more likely the model will succeed.
March 11, 2025 at 6:25 PM
12/ On predictive power: We can map these interpretable ability profiles with the demand profiles of benchmarks or individual instances, to anticipate the performance of LLMs on them: the larger the supremacy of (model) abilities over (task) demands is, the more likely the model will succeed.
11/ Takeaways from ability profiles:
-Newer LLMs have higher abilities than older ones, but this is NOT monotonic for all abilities
-Knowledge scales are limited by model size and distillation processed
-Reasoning, learning and abstraction, and social capabilities, are boosted in ‘reasoning’ models
-Newer LLMs have higher abilities than older ones, but this is NOT monotonic for all abilities
-Knowledge scales are limited by model size and distillation processed
-Reasoning, learning and abstraction, and social capabilities, are boosted in ‘reasoning’ models
March 11, 2025 at 6:23 PM
11/ Takeaways from ability profiles:
-Newer LLMs have higher abilities than older ones, but this is NOT monotonic for all abilities
-Knowledge scales are limited by model size and distillation processed
-Reasoning, learning and abstraction, and social capabilities, are boosted in ‘reasoning’ models
-Newer LLMs have higher abilities than older ones, but this is NOT monotonic for all abilities
-Knowledge scales are limited by model size and distillation processed
-Reasoning, learning and abstraction, and social capabilities, are boosted in ‘reasoning’ models
10/ Beyond SCCs, we can summarise SCCs by computing the ability score for each dimension, defined as the x-value where success probability is 0.5 (the point with the maximum slope/information in a SCC) following the tradition in psychometrics. This yields many insights under our new evaluation:👇
March 11, 2025 at 6:21 PM
10/ Beyond SCCs, we can summarise SCCs by computing the ability score for each dimension, defined as the x-value where success probability is 0.5 (the point with the maximum slope/information in a SCC) following the tradition in psychometrics. This yields many insights under our new evaluation:👇
9/ The SCCs of certain dimensions are steep, which explains (and predicts) success very well for instances in the low and high ranges. In contrast, SCCs of other dimensions are flatter and show strong differences between LLMs, i.e., lower discrimination power to differentiate success and failures
March 11, 2025 at 6:21 PM
9/ The SCCs of certain dimensions are steep, which explains (and predicts) success very well for instances in the low and high ranges. In contrast, SCCs of other dimensions are flatter and show strong differences between LLMs, i.e., lower discrimination power to differentiate success and failures
8/ To evaluate abilities, we show the subject characteristic curve (SCC) for each dimension: the probability of success as a logistic function of demand levels. We use dominant slicing: for level k of the target dimension, all other dimensions<=k.
Here's an example SCC, but next post has all SCCs.
Here's an example SCC, but next post has all SCCs.
March 11, 2025 at 6:20 PM
8/ To evaluate abilities, we show the subject characteristic curve (SCC) for each dimension: the probability of success as a logistic function of demand levels. We use dominant slicing: for level k of the target dimension, all other dimensions<=k.
Here's an example SCC, but next post has all SCCs.
Here's an example SCC, but next post has all SCCs.
7/ With our demand levels, we can additionally infer the actual ability profiles of LLMs. This is robust to changing the difficulty distribution of test instances, unlike brittle benchmark averages scores (e.g. one model achieves 80% accuracy on MATH but yields only 20% accuracy on AIME).
March 11, 2025 at 6:19 PM
7/ With our demand levels, we can additionally infer the actual ability profiles of LLMs. This is robust to changing the difficulty distribution of test instances, unlike brittle benchmark averages scores (e.g. one model achieves 80% accuracy on MATH but yields only 20% accuracy on AIME).
6/ Surprisingly, by inspecting demand levels: All these 20 benchmarks from recent top AI/NLP conferences lack construct validity: not measuring what they claim to measure (lacking specificity) or tend to only include intermediate difficulties for the target ability scale (lacking sensitivity)
March 11, 2025 at 6:19 PM
6/ Surprisingly, by inspecting demand levels: All these 20 benchmarks from recent top AI/NLP conferences lack construct validity: not measuring what they claim to measure (lacking specificity) or tend to only include intermediate difficulties for the target ability scale (lacking sensitivity)
5/ We annotate demand levels of 18 dimensions for 16K instances sampled from 63 tasks on 20 benchmarks. This forms the Annotated-Demand-Levels (ADeLe) battery, which elegantly places task instances of many different benchmarks in the same commensurate space!
March 11, 2025 at 6:18 PM
5/ We annotate demand levels of 18 dimensions for 16K instances sampled from 63 tasks on 20 benchmarks. This forms the Annotated-Demand-Levels (ADeLe) battery, which elegantly places task instances of many different benchmarks in the same commensurate space!
4/ For example, in the natural sciences knowledge (KNn) rubric, we use education levels to represent the demand levels from 0 to 5+
A demand level of 0 means KNn is not required to solve the task, while 5+ means graduate level or beyond.
Similar/related principles are applied to other rubrics.
A demand level of 0 means KNn is not required to solve the task, while 5+ means graduate level or beyond.
Similar/related principles are applied to other rubrics.
March 11, 2025 at 6:17 PM
4/ For example, in the natural sciences knowledge (KNn) rubric, we use education levels to represent the demand levels from 0 to 5+
A demand level of 0 means KNn is not required to solve the task, while 5+ means graduate level or beyond.
Similar/related principles are applied to other rubrics.
A demand level of 0 means KNn is not required to solve the task, while 5+ means graduate level or beyond.
Similar/related principles are applied to other rubrics.
3/To address these issues, we craft 18 novel rubrics to annotate demand levels (0 to 5+) for 18 general scales from a taxonomy of cognitive abilities, focusing on LLMs:
Primordial: 11 cognitive capabilities
Knowledge: 5 branches of knowledge
Extraneous: 2 other elements making task difficult
Primordial: 11 cognitive capabilities
Knowledge: 5 branches of knowledge
Extraneous: 2 other elements making task difficult
March 11, 2025 at 6:16 PM
3/To address these issues, we craft 18 novel rubrics to annotate demand levels (0 to 5+) for 18 general scales from a taxonomy of cognitive abilities, focusing on LLMs:
Primordial: 11 cognitive capabilities
Knowledge: 5 branches of knowledge
Extraneous: 2 other elements making task difficult
Primordial: 11 cognitive capabilities
Knowledge: 5 branches of knowledge
Extraneous: 2 other elements making task difficult
2/ Motivation: Current AI evaluation paradigm has struggles:
- Can’t robustly explain and predict where an AI can be deployed reliably and safely
- Can’t precisely explain what benchmarks really measure
- Incomparable aggregate scores between benchmarks
- Benchmark saturation
- Changing scales
- …
- Can’t robustly explain and predict where an AI can be deployed reliably and safely
- Can’t precisely explain what benchmarks really measure
- Incomparable aggregate scores between benchmarks
- Benchmark saturation
- Changing scales
- …
March 11, 2025 at 6:14 PM
2/ Motivation: Current AI evaluation paradigm has struggles:
- Can’t robustly explain and predict where an AI can be deployed reliably and safely
- Can’t precisely explain what benchmarks really measure
- Incomparable aggregate scores between benchmarks
- Benchmark saturation
- Changing scales
- …
- Can’t robustly explain and predict where an AI can be deployed reliably and safely
- Can’t precisely explain what benchmarks really measure
- Incomparable aggregate scores between benchmarks
- Benchmark saturation
- Changing scales
- …