I am currently a research assistant at GAIR Lab at Shanghai Jiao Tong University, working with Professor Pengfei Liu. I received my B.E. in Electronic Engineering from Tsinghua University and my M.S. in Electrical and Computer Engineering from Carnegie Mellon University, where I worked with Professor Graham Neubig.

Publications

-OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
Zhen Huang, Zengzhi Wang, Shijie Xia, Xuefeng Li, Haoyang Zou, Ruijie Xu, Run-Ze Fan, Lyumanshan Ye, Ethan Chern, Yixin Ye, Yikai Zhang, Yuqing Yang, Ting Wu, Binjie Wang, Shichao Sun, Yang Xiao, Yiyuan Li, Fan Zhou, Steffi Chern, Yiwei Qin, Yan Ma, Jiadi Su, Yixiu Liu, Yuxiang Zheng, Shaoting Zhang, Dahua Lin, Yu Qiao, Pengfei Liu
Submitted to NeurIPS 2024 Track Datasets and Benchmarks

-InFoBench: Evaluating Instruction Following Ability in Large Language Models
Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, Pengfei Liu, Dong Yu
Accepted by the ACL Findings 2024

-T5SCORE: Discriminative Fine-tuning of Generative Evaluation Metrics
Yiwei Qin, Weizhe Yuan, Graham Neubig, Pengfei Liu
In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 15185–15202, Singapore.

-Searching for Effective Tuning Strategies for Multilingual Summarization
Yiwei Qin, Graham Neubig, Pengfei Liu
Preprint

-Automating Claim Construction in Patent Applications: The CMUmine Dataset
Ozan Tonguz, Yiwei Qin, Yimeng Gu, Hyun Hannah Moon
In Proceedings of the Natural Legal Language Processing Workshop 2021, pages 205–209, Punta Cana, Dominican Republic.