Weiyan Shi

Recent Preprints

• Can Aha Moments Be Fake? Identifying True and Decorative Thinking Steps in Chain-of-Thought

  Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song

  arXiv, 2025 [pdf]

• SocialFusion: Addressing Social Degradation in Pre-trained Vision-Language Models

  Hamza Tahboub, Weiyan Shi, Gang Hua, Huaizu Jiang

  arXiv, 2025 [pdf]

• PolySkill: Learning Generalizable Skills Through Polymorphic Abstraction

  Simon Yu, Gang Li, Weiyan Shi, Peng Qi

  arXiv, 2025 [pdf]

• Gem: A Gym for Agentic LLMs

  Zichen Liu, Anya Sims, Keyu Duan, Changyu Chen, Simon Yu, Xiangxin Zhou, Haotian Xu, Shaopan Xiong, Bo Liu, Chenmien Tan, Chuen Yang Beh, Weixun Wang, Hao Zhu, Weiyan Shi, Diyi Yang, Michael Shieh, Yee Whye Teh, Wee Sun Lee, Min Lin

  Scaling Environments for Agents Workshop, NeurIPS 2025 [pdf] [code]

  Outstanding Paper, SEA@NeurIPS 2025

• Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity

  Jiayi Zhang*, Simon Yu*, Derek Chong*, Anthony Sicilia, Michael R. Tomz, Christopher D. Manning, Weiyan Shi

  (*equal contribution)

  arXiv, 2025 [pdf] [X thread] [blog] [code] [colab] [gallery] [homepage]

  Selected Organic Media Coverage

  [Forbes] [TLDR AI] [Yahoo News] [VentureBeat] [Neuron Daily] [AI in Education Daily Podcast] [AI Papers Podcast Daily] [Analytics Vidhya]

• SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learning

  Bo Liu*, Leon Guertler*, Simon Yu*, Zichen Liu*, Penghui Qi, Daniel Balcells, Mickel Liu, Cheston Tan, Weiyan Shi, Min Lin, Wee Sun Lee, Natasha Jaques

  arXiv, 2025 [pdf]

• Labeling messages as AI-generated does not reduce their persuasive effects

  Isabel O Gallegos, Chen Shani, Weiyan Shi, Federico Bianchi, Izzy Gainsburg, Dan Jurafsky, Robb Willer

  arXiv, 2025 [pdf]

• Towards Social AI: A Survey on Understanding Social Interactions

  Sangmin Lee, Minzhi Li, Bolin Lai, Wenqi Jia, Fiona Ryan, Xu Cao, Ozgur Kara, Bikram Boote, Weiyan Shi, Diyi Yang, James M. Rehg

  arXiv, 2024 [pdf]

Publications [Google Scholar] [Show Selected] [Show All]

• LLMs Encode Harmfulness and Refusal Separately

  Jiachen Zhao, Jing Huang, Zhengxuan Wu, David Bau, Weiyan Shi

  NeurIPS, 2025 [pdf] [code] [project page] [blog]

• Distilling an End-to-End Voice Assistant Without Instruction Training Data

  William Held, Yanzhe Zhang, Minzhi Li, Weiyan Shi, Michael J Ryan, Diyi Yang

  ACL, 2025 [pdf]

• NewsInterview: a Dataset and a Playground to Evaluate LLMs' Ground Gap via Informational Interviews

  Michael Lu, Hyundong Justin Cho, Weiyan Shi, Jonathan May, Alexander Spangher

  ACL, 2025 [pdf]

• Proactive Conversational Agents with Inner Thoughts

  Xingyu Bruce Liu, Shitao Fang, Weiyan Shi, Chien-Sheng Wu, Takeo Igarashi, Xiang Anthony Chen

  CHI, 2025 [pdf]

• PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action

  Yijia Shao, Tianshi Li, Weiyan Shi, Yanchen Liu, Diyi Yang

  NeurIPS D&B, 2024 [pdf]

• Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval

  Kazuaki Furumai, Roberto Legaspi, Julio Vizcarra, Yudai Yamazaki, Yasutaka Nishimura, Sina J Semnani, Kazushi Ikeda, Weiyan Shi, Monica S Lam

  EMNLP Findings, 2024 [pdf]

• CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

  Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Chunhua yu, Raya Horesh, Rogério Abreu de Paula, Diyi Yang

  EMNLP Findings, 2024 [pdf]

• Dialoging Resonance in Human-Chatbot Conversation: How Users Perceive and Reciprocate Recommendation Chatbot's Self-Disclosure Strategy

  Kai-Hui Liang, Weiyan Shi, Yoo Jung Oh, Hao-Chuan Wang, Jingwen Zhang, Zhou Yu

  CSCW, 2024 [pdf]

• A Safe Harbor for AI Evaluation and Red Teaming

  Shayne Longpre, Sayash Kapoor, Kevin Klyman, Ashwin Ramaswami, Rishi Bommasani, Borhane Blili-Hamelin, Yangsibo Huang, Aviya Skowron, Zheng-Xin Yong, Suhas Kotha, Yi Zeng, Weiyan Shi, Xianjun Yang, Reid Southen, Alexander Robey, Patrick Chao, Diyi Yang, Ruoxi Jia, Daniel Kang, Sandy Pentland, Arvind Narayanan, Percy Liang, Peter Henderson

  ICML, 2024, position paper [pdf]

• Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future

  Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang

  ACL Findings, 2024 [pdf]

• How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

  Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia, Weiyan Shi

  ACL, 2024. [pdf] [project page] [code & data]

  Best Social Impact Paper

• The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

  Myeongseob Ko, Feiyang Kang, Weiyan Shi, Ming Jin, Zhou Yu, Ruoxi Jia

  CVPR, 2024. [pdf]

• The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation

  Rongwu Xu, Brian S Lin, Shujian Yang, Tianqi Zhang, Weiyan Shi, Tianwei Zhang, Zhixuan Fang, Wei Xu, Han Qiu

  ACL, 2024. [pdf] [project page] [code & data]

  Outstanding Paper

• AutoReply: Detecting Nonsense in Dialogue with Discriminative Replies

  Weiyan Shi, Emily Dinan, Adi Renduchintala, Daniel Fried, Athul Jacob, Zhou Yu, Mike Lewis

  EMNLP Findings, 2023. [pdf]

• Controllable Mixed-Initiative Dialogue Generation through Prompting

  Maximillian Chen, Xiao Yu, Weiyan Shi, Urvi Awasthi, Zhou Yu

  ACL, 2023. [pdf]

• Human-level play in the game of Diplomacy by combining language models with strategic reasoning

  Meta Fundamental AI Research Diplomacy Team (FAIR)†, Anton Bakhtin*, Noam Brown*, Emily Dinan*, Gabriele Farina, Colin Flaherty*, Daniel Fried, Andrew Goff, Jonathan Gray*, Hengyuan Hu*, Athul Paul Jacob*, Mojtaba Komeili, Karthik Konath, Minae Kwon, Adam Lerer*, Mike Lewis*, Alexander H Miller*, Sasha Mitts, Adithya Renduchintala*, Stephen Roller, Dirk Rowe, Weiyan Shi*, Joe Spisak, Alexander Wei, David Wu*, Hugh Zhang*, Markus Zijlstra

  (A member of the core research team. Authors listed alphabetically.)

  Science, 2022. [pdf] [code]

  Selected Media Coverage

  [New York Times (front page)] [The Washington Post] [The Economist] [MIT Technology Review] [Forbes] [Meta AI blog post] [Commentary in Science News]

• When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels

  Weiyan Shi, Emily Dinan, Kurt Shuster, Jason Weston, Jing Xu

  NAACL, 2024. [pdf]

• Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks

  Kushal Chawla, Weiyan Shi, Jingwen Zhang, Gale Lucas, Zhou Yu, Jonathan Gratch

  EACL, 2023. [pdf]

• Just Fine-tune Twice: Selective Differential Privacy for Large Language Models

  Weiyan Shi, Ryan Shea, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu

  EMNLP, 2022. [pdf]

• Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue

  Maximillian Chen, Weiyan Shi, Feifan Yan, Ryan Hou, Jingwen Zhang, Saurav Sahay, Zhou Yu

  AACL, 2022. [pdf]

• Selective Differential Privacy for Language Modeling

  Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, Zhou Yu

  NAACL, 2022. [pdf] [code & data] [talk]

• PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation

  Jing Gu, Qingyang Wu, Chongruo Wu, Weiyan Shi, Zhou Yu

  ACL, 2021. [pdf]

• LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing

  Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi, Zhou Yu

  ACL Demo, 2021. [pdf]

• Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration

  Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu

  EMNLP Findings, 2021. [pdf]

• Understanding User Resistance Strategies in Persuasive Conversations

  Youzhi Tian, Weiyan Shi, Chen Li, Zhou Yu

  EMNLP Findings, 2020. [pdf]

• INSPIRED: Toward Sociable Recommendation Dialog Systems

  Shirley Anugrah Hayati, Dongyeop Kang, Qingxiaoyang Zhu, Weiyan Shi, Zhou Yu

  EMNLP, 2020. [pdf]

• Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategies

  Weiyan Shi, Xuewei Wang, Yoo Jung Oh, Jingwen Zhang, Saurav Sahay, Zhou Yu

  CHI, 2020. [pdf]

• End-to-End Trainable Non-Collaborative Dialog System

  Yu Li, Kun Qian, Weiyan Shi, Zhou Yu

  AAAI, 2020. [pdf]

• Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good

  Xuewei Wang*, Weiyan Shi*, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, Zhou Yu

  *Equal Contribution

  ACL, 2019. [pdf] [code & data] [talk]

  Best Paper Nomination

• Unsupervised Dialog Structure Learning

  Weiyan Shi, Tiancheng Zhao, Zhou Yu

  NAACL, 2019. [pdf]

• How to Build User Simulators to Train RL-based Dialog Systems

  Weiyan Shi, Kun Qian, Xuewei Wang, Zhou Yu

  EMNLP, 2019. [pdf]

• Sentiment Adaptive End-to-End Dialog Systems

  Weiyan Shi, Zhou Yu

  ACL, 2018. [pdf]