Sotabase

Career

· Assistant Professor, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)2023–
· Affiliated Faculty, NYU Steinhardt2021–
· Affiliated Faculty, NYU Center for Data Science2020–
· Assistant Professor, NYU Shanghai2017–2023
· Assistant Research Professor, NYU Tandon School of Engineering2017–
· Neukom Postdoc Fellow, Dartmouth College2016–2017
· Research Assistant, Carnegie Mellon University2013–2016
· PhD Student, Carnegie Mellon University2010–2016
· B.S. (Minor), Peking University2006–2010

Publications (178)

MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
International Conference on Learning Representations · 2023
237
cited
POP909: A Pop-Song Dataset for Music Arrangement Generation
International Society for Music Information Retrieval Conference · 2020
168
cited
Transformer VAE: A Hierarchical Model for Structure-Aware and Interpretable Music Representation Learning
IEEE International Conference on Acoustics, Speech, and Signal Processing · 2020
95
cited
ChatMusician: Understanding and Generating Music Intrinsically with LLM
Annual Meeting of the Association for Computational Linguistics · 2024
92
cited
Learning Interpretable Representation for Controllable Polyphonic Music Generation
International Society for Music Information Retrieval Conference · 2020
76
cited
Deep Music Analogy Via Latent Representation Disentanglement
International Society for Music Information Retrieval Conference · 2019
73
cited
PIANOTREE VAE: Structured Representation Learning for Polyphonic Music
International Society for Music Information Retrieval Conference · 2020
62
cited
Music Style Transfer: A Position Paper
2018
55
cited
MARBLE: Music Audio Representation Benchmark for Universal Evaluation
Neural Information Processing Systems · 2023
49
cited
YuE: Scaling Open Foundation Models for Long-Form Music Generation
arXiv.org · 2025
49
cited
Foundation Models for Music: A Survey
arXiv.org · 2024
47
cited
MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
International Joint Conference on Artificial Intelligence · 2024
44
cited
MuseBERT: Pre-training Music Representation for Music Understanding and Controllable Generation
International Society for Music Information Retrieval Conference · 2021
38
cited
Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls
International Society for Music Information Retrieval Conference · 2023
36
cited
A unified model for zero-shot music source separation, transcription and synthesis
International Society for Music Information Retrieval Conference · 2021
35
cited
AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer
International Society for Music Information Retrieval Conference · 2021
32
cited
Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention
International Society for Music Information Retrieval Conference · 2022
29
cited
Large-vocabulary Chord Transcription Via Chord Structure Decomposition
International Society for Music Information Retrieval Conference · 2019
29
cited
Content-based Controls For Music Large Language Modeling
International Society for Music Information Retrieval Conference · 2023
27
cited
COSMIC: A Conversational Interface for Human-AI Music Co-Creation
New Interfaces for Musical Expression · 2021
27
cited
Sotabase