Sotabase

Career

· Director Of Research, Leverhulme Centre for the Future of Intelligence2025–
· Professor (partial Leave), Universitat Politècnica de València (UPV)2025–
· Research Professor, University of Cambridge2025–
· Research Affiliate, Centre for the Study of Existential Risk, University of Cambridge2021–2025
· Senior Research Fellow, valgrAI2021–
· Professor, VRAIN - Valencian Research Institute for Artificial Intelligence2021–
· Senior Research Fellow, Leverhulme Centre for the Future of Intelligence2017–2025
· Professor, Universitat Politècnica de València (UPV)1996–2025

Publications (304)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
arXiv.org · 2022
2,201
cited
An experimental comparison of performance measures for classification
Pattern Recognition Letters · 2009
839
cited
Learning Decision Trees Using the Area Under the ROC Curve
International Conference on Machine Learning · 2002
347
cited
A Coherent Interpretation of AUC as a Measure of Aggregated Classification Performance
International Conference on Machine Learning · 2011
273
cited
Volume under the ROC Surface for Multi-class Problems
European Conference on Machine Learning · 2003
207
cited
Foundational Challenges in Assuring Alignment and Safety of Large Language Models
arXiv.org · 2024
201
cited
Measuring universal intelligence: Towards an anytime intelligence test
Artificial Intelligence · 2010
180
cited
Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement
Artificial Intelligence Review · 2017
174
cited
Inductive programming meets the real world
Communications of the ACM · 2015
172
cited
Proceedings of the 28th International Conference on Machine Learning
2011
159
cited
The Measure of All Minds: Evaluating Natural and Artificial Intelligence
2017
149
cited
ROC curves for regression
Pattern Recognition · 2013
132
cited
Quantification via Probability Estimators
2010 IEEE International Conference on Data Mining · 2010
130
cited
A unified view of performance metrics: translating threshold choice into expected classification loss
Journal of machine learning research · 2012
119
cited
Item response theory in AI: Analysing machine learning classifiers at the instance level
Artificial Intelligence · 2019
115
cited
A Unified View of Performance Metrics: Translating Threshold Choice into Expected Classification Loss C` Esar Ferri
2012
111
cited
Rethink reporting of evaluation results in AI
Science · 2023
107
cited
Improving the AUC of Probabilistic Estimation Trees
European Conference on Machine Learning · 2003
103
cited
Brier Curves: a New Cost-Based Visualisation of Classifier Performance
International Conference on Machine Learning · 2011
96
cited
Delegating classifiers
International Conference on Machine Learning · 2004
96
cited
Sotabase
José Hernández-Orallo | Researcher Profile | Sotabase | Sotabase