I am a second year PhD student at Carnegie Mellon University, where I am doing research in Natural Language Processing. I am very grateful to be advised by Professor Graham Neubig. Previously, I worked closely with Xiang Yue. I also pursued a BS/MS at CMU, with a dual degree in Computer Science and Statistics and Machine Learning.
I work on agents, especially AI4Science, generalist agentic evaluation and training, and LLM for robotics. I am currently funded by the Meta AIM Fellowship. I am also open to exploring interesting new directions. For more details, please check my CV or hit me up on my email :)
News
- Oct 2026Started the Meta AIM Fellowship!
- Jul 2026Invited talk on PACE at Fiddler AI.
- Jun 2026FieldWorkArena is accepted to ICPR 2026.
- May 2026Started an internship at Microsoft, working on leveraging user actions for proactive agent support.
- May 2026VisualPuzzles is accepted to ICML 2026!
- Jan 2026Agent Data Protocol is accepted to ICLR 2026 as an oral!
- Nov 2025Invited talks on Agent Data Protocol at Microsoft, Apple, Fujitsu, and NICE.
- Aug 2025Started my PhD at CMU LTI!
- Aug 2025Two papers accepted to EMNLP 2025, one as an oral.
- May 2025Two papers accepted to ACL 2025.
- Apr 2025Invited talk on VisualPuzzles at OpenCompass, ModelScope, and other organizations.
- Mar 2025Joining CMU LTI NeuLab as a PhD student starting from 2025 Fall!
- Jan 2025Pangea and OpenHands are accepted to ICLR 2025!
- Jan 2025Invited talk on Pangea at TikTok; Pangea is on CMU news!
- Dec 2024Invited talk on API-Based Agent at CAMEL-AI (video).
- Nov 2024Our work on image transcreation won the Best Paper Award at EMNLP 2024!
- Aug 2024Started research at CMU NeuLab as a BS/MS student! :)
Scroll for more ↓
Publications
Learning from Use: Test-Time Learning in Large Language Models and Agents
Weihao Xuan, Qingcheng Zeng, Jiarui Liu, Rui Yang, Yunze Xiao, Yinxi Li, Zeqi Zhou, Weiwei Sun, Heli Qi, Leyang Cui, Tianhao Ma, Hanqun Cao, Junjue Wang, Tianyu Liu, Weihua Du, Yueqi Song, Jiayi Geng, Matthew Yu Heng Wong, Rob Voigt, Chuan Hong, Xiang Yue, Jen-tse Huang, Xuhai Xu, Yifan Peng, Pheng-Ann Heng, Yiming Yang, Bernhard Schölkopf, Zhijing Jin, Nan Liu, Naoto Yokoya, Mona Diab
Preprint
PDFAbstract
PACE: A Proxy for Agentic Capability Evaluation
Yueqi Song, Lintang Sutawika, Jiarui Liu, Lindia Tjuatja, Jiayi Geng, Yunze Xiao, Daniel Lee, Aditya Bharat Soni, Vincent Lo, Xiang Yue, Graham Neubig
Under Review
PDFAbstractCodeDataset
Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
Yueqi Song, Ketan Ramaneti, Zaid Sheikh, Ziru Chen, Boyu Gou, Tianbao Xie, Yiheng Xu, Danyang Zhang, Apurva Gandhi, Fan Yang, Joseph Liu, Tianyue Ou, Zhihao Yuan, Frank Xu, Shuyan Zhou, Xingyao Wang, Xiang Yue, Tao Yu, Huan Sun, Yu Su, Graham Neubig
ICLR 2026 (Oral)
PDFAbstractWebsiteCodeDataset
Say Something Else: Rethinking Contextual Privacy as Information Sufficiency
Yunze Xiao, Wenkai Li, Xiaoyuan Wu, Ningshan Ma, Yueqi Song, Weihao Xuan
Under Review
PDFAbstract
IndoorR2X: Indoor Robot-to-Everything Coordination with LLM-Driven Planning
Fan Yang, Soumya Teotia, Shaunak A Mehta, Prajit KrisshnaKumar, Quanting Xie, Jun Liu, Yueqi Song, Wenkai Li, Atsunori Moteki, Kanji Uchino, Yonatan Bisk
Under Review
PDFAbstract
Grounding Multilingual Multimodal LLMs With Cultural Knowledge
Jean de Dieu Nyandwi, Yueqi Song, Simran Khanuja, Graham Neubig
EMNLP 2025 (Oral)
PDFAbstract
Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics
Jiarui Liu, Yueqi Song*, Yunze Xiao*, Mingqian Zheng*, Lindia Tjuatja, Jana Schaich Borg, Mona Diab, Maarten Sap
EMNLP 2025
PDFAbstract
FieldWorkArena: Agentic AI Benchmark for Real Field Work Tasks
Atsunori Moteki, Shoichi Masui, Fan Yang, Yueqi Song, Yonatan Bisk, Graham Neubig, Ikuo Kusajima, Yasuto Watanabe, Hiroyuki Ishida, Jun Takahashi, Shan Jiang
ICPR 2026
PDFAbstract
VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge
Yueqi Song*, Tianyue Ou*, Yibo Kong†, Zecheng Li†, Graham Neubig, Xiang Yue
ICML 2026
PDFAbstractLeaderboardCode
SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skills
Boyuan Zheng*, Michael Y Fatemi*, Xiaolong Jin*, Zora Zhiruo Wang, Apurva Gandhi, Yueqi Song, Yu Gu, Jayanth Srinivasa, Gaowen Liu, Graham Neubig, Yu Su
Under Review
PDFAbstract
Beyond Browsing: API-Based Web Agents
Yueqi Song, Frank Xu, Shuyan Zhou, Graham Neubig
ACL 2025 (Findings)
PDFAbstractProject Website
Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia
Samuel Cahyawijaya, Holy Lovenia, Joel Ruben Antony Moniz, Tack Hwa Wong, Mohammad Rifqi Farhansyah, Thant Thiri Maung, Frederikus Hudi, David Anugraha, Muhammad Ravi Shulthan Habibi, Muhammad Reza Qorib, Amit Agarwal, Joseph Marvin Imperial, Hitesh Laxmichand Patel, Vicky Feliren, Bahrul Ilmi Nasution, Manuel Antonio Rufino, Genta Indra Winata, Rian Adam Rajagede, Carlos Rafael Catalan, Mohamed Fazli Imam, Priyaranjan Pattnayak, Salsabila Zahirah Pranida, Kevin Pratama, Yeshil Bangera, Adisai Na-Thalang, Patricia Nicole Monderin, Yueqi Song, Christian Simon, Lynnette Hui Xian Ng, et al.
ACL 2025
PDFAbstract
Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages
Xiang Yue*, Yueqi Song*, Akari Asai, Seungone Kim, Jean de Dieu Nyandwi, Simran Khanuja, Anjali Kantharuban, Lintang Sutawika, Sathyanarayanan Ramamoorthy, Graham Neubig
ICLR 2025
PDFAbstractProject WebsiteModelDemoTrain DataBenchmark
OpenHands: An Open Platform for AI Software Developers as Generalist Agents
Xingyao Wang, Boxuan Li, Yufan Song, Frank F. Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, Hoang H. Tran, Fuqiang Li, Ren Ma, Mingzhang Zheng, Bill Qian, Yanjun Shao, Niklas Muennighoff, Yizhe Zhang, Binyuan Hui, Junyang Lin, Robert Brennan, Hao Peng, Heng Ji, Graham Neubig
ICLR 2025
PDFAbstractCode
What Is Missing in Multilingual Visual Reasoning and How to Fix It
Yueqi Song, Simran Khanuja, Graham Neubig
NAACL 2025 Findings
PDFAbstract
🏆 Best Paper
An image speaks a thousand words, but can everyone listen?
On translating images for cultural relevance
Simran Khanuja, Sathyanarayanan Ramamoorthy, Yueqi Song, Graham Neubig
EMNLP 2024 (Best Paper Award)
PDFAbstractProject WebsiteCode
GlobalBench: A Benchmark for Global Progress in Natural Language Processing
Yueqi Song, Catherine Cui, Simran Khanuja, Pengfei Liu, Fahim Faisal, Alissa Ostapenko, Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Yulia Tsvetkov, Antonios Anastasopoulos, Graham Neubig
EMNLP 2023
PDFAbstract
Service
Area Chair: NeurIPS E&D Track
Reviewer: ACL, EMNLP, ICLR, ACL Student Research Workshop, NAACL Student Research Workshop, AfricaNLP Workshop, NeurIPS TS4H Workshop