Weiyan Shi

Recent Preprints

• NewsInterview: a Dataset and a Playground to Evaluate LLMs' Ground Gap via Informational Interviews

  Michael Lu, Hyundong Justin Cho, Weiyan Shi, Jonathan May, Alexander Spangher

  arXiv, 2024 [pdf]

• Towards Social AI: A Survey on Understanding Social Interactions

  Sangmin Lee, Minzhi Li, Bolin Lai, Wenqi Jia, Fiona Ryan, Xu Cao, Ozgur Kara, Bikram Boote, Weiyan Shi, Diyi Yang, James M. Rehg

  arXiv, 2024 [pdf]

Publications [Google Scholar] [Show Selected] [Show All]

• Proactive Conversational Agents with Inner Thoughts

  Xingyu Bruce Liu, Shitao Fang, Weiyan Shi, Chien-Sheng Wu, Takeo Igarashi, Xiang Anthony Chen

  CHI, 2025 [pdf]

• PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action

  Yijia Shao, Tianshi Li, Weiyan Shi, Yanchen Liu, Diyi Yang

  NeurIPS D&B, 2024 [pdf]

• Zero-shot Persuasive Chatbots with LLM-Generated Strategies and Information Retrieval

  Kazuaki Furumai, Roberto Legaspi, Julio Vizcarra, Yudai Yamazaki, Yasutaka Nishimura, Sina J Semnani, Kazushi Ikeda, Weiyan Shi, Monica S Lam

  EMNLP Findings, 2024 [pdf]

• CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies

  Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Chunhua yu, Raya Horesh, Rogério Abreu de Paula, Diyi Yang

  EMNLP Findings, 2024 [pdf]

• Dialoging Resonance in Human-Chatbot Conversation: How Users Perceive and Reciprocate Recommendation Chatbot's Self-Disclosure Strategy

  Kai-Hui Liang, Weiyan Shi, Yoo Jung Oh, Hao-Chuan Wang, Jingwen Zhang, Zhou Yu

  CSCW, 2024 [pdf]

• A Safe Harbor for AI Evaluation and Red Teaming

  Shayne Longpre, Sayash Kapoor, Kevin Klyman, Ashwin Ramaswami, Rishi Bommasani, Borhane Blili-Hamelin, Yangsibo Huang, Aviya Skowron, Zheng-Xin Yong, Suhas Kotha, Yi Zeng, Weiyan Shi, Xianjun Yang, Reid Southen, Alexander Robey, Patrick Chao, Diyi Yang, Ruoxi Jia, Daniel Kang, Sandy Pentland, Arvind Narayanan, Percy Liang, Peter Henderson

  ICML, 2024, position paper [pdf]

• Social Intelligence Data Infrastructure: Structuring the Present and Navigating the Future

  Minzhi Li, Weiyan Shi, Caleb Ziems, Diyi Yang

  ACL Findings, 2024 [pdf]

• How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs

  Yi Zeng, Hongpeng Lin, Jingwen Zhang, Diyi Yang, Ruoxi Jia, Weiyan Shi

  ACL, 2024. [pdf] [project page] [code & data]

  Best Social Impact Paper

• The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

  Myeongseob Ko, Feiyang Kang, Weiyan Shi, Ming Jin, Zhou Yu, Ruoxi Jia

  CVPR, 2024. [pdf]

• The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversation

  Rongwu Xu, Brian S Lin, Shujian Yang, Tianqi Zhang, Weiyan Shi, Tianwei Zhang, Zhixuan Fang, Wei Xu, Han Qiu

  ACL, 2024. [pdf] [project page] [code & data]

  Outstanding Paper

• AutoReply: Detecting Nonsense in Dialogue with Discriminative Replies

  Weiyan Shi, Emily Dinan, Adi Renduchintala, Daniel Fried, Athul Jacob, Zhou Yu, Mike Lewis

  EMNLP Findings, 2023. [pdf]

• Controllable Mixed-Initiative Dialogue Generation through Prompting

  Maximillian Chen, Xiao Yu, Weiyan Shi, Urvi Awasthi, Zhou Yu

  ACL, 2023. [pdf]

• Human-level play in the game of Diplomacy by combining language models with strategic reasoning

  Meta Fundamental AI Research Diplomacy Team (FAIR)†, Anton Bakhtin*, Noam Brown*, Emily Dinan*, Gabriele Farina, Colin Flaherty*, Daniel Fried, Andrew Goff, Jonathan Gray*, Hengyuan Hu*, Athul Paul Jacob*, Mojtaba Komeili, Karthik Konath, Minae Kwon, Adam Lerer*, Mike Lewis*, Alexander H Miller*, Sasha Mitts, Adithya Renduchintala*, Stephen Roller, Dirk Rowe, Weiyan Shi*, Joe Spisak, Alexander Wei, David Wu*, Hugh Zhang*, Markus Zijlstra

  (A member of the core research team. Authors listed alphabetically.)

  Science, 2022. [pdf] [code]

  Selected Media Coverage.

  [New York Times (front page)] [The Washington Post] [The Economist] [MIT Technology Review] [Forbes] [Meta AI blog post] [Commentary in Science News]

• When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels

  Weiyan Shi, Emily Dinan, Kurt Shuster, Jason Weston, Jing Xu

  NAACL, 2024. [pdf]

• Social Influence Dialogue Systems: A Survey of Datasets and Models For Social Influence Tasks

  Kushal Chawla, Weiyan Shi, Jingwen Zhang, Gale Lucas, Zhou Yu, Jonathan Gratch

  EACL, 2023. [pdf]

• Just Fine-tune Twice: Selective Differential Privacy for Large Language Models

  Weiyan Shi, Ryan Shea, Si Chen, Chiyuan Zhang, Ruoxi Jia, Zhou Yu

  EMNLP, 2022. [pdf]

• Seamlessly Integrating Factual Information and Social Content with Persuasive Dialogue

  Maximillian Chen, Weiyan Shi, Feifan Yan, Ryan Hou, Jingwen Zhang, Saurav Sahay, Zhou Yu

  AACL, 2022. [pdf]

• Selective Differential Privacy for Language Modeling

  Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, Zhou Yu

  NAACL, 2022. [pdf] [code & data] [talk]

• PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation

  Jing Gu, Qingyang Wu, Chongruo Wu, Weiyan Shi, Zhou Yu

  ACL, 2021. [pdf]

• LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing

  Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi, Zhou Yu

  ACL Demo, 2021. [pdf]

• Refine and Imitate: Reducing Repetition and Inconsistency in Persuasion Dialogues via Reinforcement Learning and Human Demonstration

  Weiyan Shi, Yu Li, Saurav Sahay, Zhou Yu

  EMNLP Findings, 2021. [pdf]

• Understanding User Resistance Strategies in Persuasive Conversations

  Youzhi Tian, Weiyan Shi, Chen Li, Zhou Yu

  EMNLP Findings, 2020. [pdf]

• INSPIRED: Toward Sociable Recommendation Dialog Systems

  Shirley Anugrah Hayati, Dongyeop Kang, Qingxiaoyang Zhu, Weiyan Shi, Zhou Yu

  EMNLP, 2020. [pdf]

• Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategies

  Weiyan Shi, Xuewei Wang, Yoo Jung Oh, Jingwen Zhang, Saurav Sahay, Zhou Yu

  CHI, 2020. [pdf]

• End-to-End Trainable Non-Collaborative Dialog System

  Yu Li, Kun Qian, Weiyan Shi, Zhou Yu

  AAAI, 2020. [pdf]

• Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good

  Xuewei Wang*, Weiyan Shi*, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, Zhou Yu

  *Equal Contribution

  ACL, 2019. [pdf] [code & data] [talk]

  Best Paper Nomination

• Unsupervised Dialog Structure Learning

  Weiyan Shi, Tiancheng Zhao, Zhou Yu

  NAACL, 2019. [pdf]

• How to Build User Simulators to Train RL-based Dialog Systems

  Weiyan Shi, Kun Qian, Xuewei Wang, Zhou Yu

  EMNLP, 2019. [pdf]

• Sentiment Adaptive End-to-End Dialog Systems

  Weiyan Shi, Zhou Yu

  ACL, 2018. [pdf]