Sotabase

Career

· Research Scientist, Google DeepMind2023–
· Research Scientist, Google (Current)2017–
· Researcher, Microsoft2011–2017
· Doctor of Philosophy (Ph.D.), Computer Science, University of Illinois at Urbana-Champaign2005–2011
· PhD, University of Illinois at Urbana-Champaign2005–2011
· Master of Science (M.S.), Computer Science, National Taiwan University2001–2003
· Bachelor of Science (B.S.), Computer Science, National Taiwan University1997–2001

Publications (212)

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
North American Chapter of the Association for Computational Linguistics · 2019
109,563
cited
Natural Questions: A Benchmark for Question Answering Research
Transactions of the Association for Computational Linguistics · 2019
4,208
cited
REALM: Retrieval-Augmented Language Model Pre-Training
International Conference on Machine Learning · 2020
2,659
cited
BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions
North American Chapter of the Association for Computational Linguistics · 2019
2,094
cited
Latent Retrieval for Weakly Supervised Open Domain Question Answering
Annual Meeting of the Association for Computational Linguistics · 2019
1,124
cited
Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
Annual Meeting of the Association for Computational Linguistics · 2015
811
cited
Well-Read Students Learn Better: On the Importance of Pre-training Compact Models
2019
738
cited
Load Forecasting Using Support Vector Machines: A Study on EUNITE Competition 2001
IEEE Transactions on Power Systems · 2004
724
cited
The Value of Semantic Parse Labeling for Knowledge Base Question Answering
Annual Meeting of the Association for Computational Linguistics · 2016
623
cited
A Knowledge-Grounded Neural Conversation Model
AAAI Conference on Artificial Intelligence · 2017
584
cited
Large Dual Encoders Are Generalizable Retrievers
Conference on Empirical Methods in Natural Language Processing · 2021
575
cited
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding
International Conference on Machine Learning · 2022
382
cited
Promptagator: Few-shot Dense Retrieval From 8 Examples
International Conference on Learning Representations · 2022
304
cited
Zero-Shot Entity Linking by Reading Entity Descriptions
Annual Meeting of the Association for Computational Linguistics · 2019
274
cited
Question Answering Using Enhanced Lexical Semantic Models
Annual Meeting of the Association for Computational Linguistics · 2013
266
cited
Driving Semantic Parsing from the World’s Response
Conference on Computational Natural Language Learning · 2010
262
cited
Search-based Neural Structured Learning for Sequential Question Answering
Annual Meeting of the Association for Computational Linguistics · 2017
262
cited
Guiding Semi-Supervision with Constraint-Driven Learning
Annual Meeting of the Association for Computational Linguistics · 2007
241
cited
Well-Read Students Learn Better: The Impact of Student Initialization on Knowledge Distillation
arXiv.org · 2019
240
cited
ASQA: Factoid Questions Meet Long-Form Answers
Conference on Empirical Methods in Natural Language Processing · 2022
237
cited
Sotabase