Towards Human-Centered Explanations of AI Predictions

Add to your list(s) Download to your calendar using vCal

• Chenhao Tan, University of Chicago
• Thursday 01 June 2023, 16:00-17:00
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09.

If you have a question about this talk, please contact Panagiotis Fytas.

Explanations of AI predictions are considered crucial for human-AI interactions. I argue that successful human-AI interactions require two steps: AI explanation and human interpretation. Therefore, effective explanations necessitates the understanding of human interpretation. In this talk, I will present our work to address this challenge through human-centered evaluation and generation of explanations. First, I will discuss the distinction between emulation and discovery tasks, which shapes human interpretation. In emulation tasks, humans provide groundtruth labels and the goal of AI is to emulate human intelligence. While it may seem intuitive that humans can provide valid explanations in this case, I argue that humans may not be able to provide “good” explanations. Caution is thus required to use human explanations for evaluation or as supervision signals despite the growing efforts in building datasets of human explanations. In contrast, in discovery tasks, humans may not necessarily know the groundtruth label. Human-subject experiments show that explanations fail to improve human decisions, namely, human+AI rarely outperforms AI alone. I will highlight the importance of identifying human strengths and AI strengths, and introduce decision-focused summarization. Finally, I will discuss recent work on leveraging explanations to improve AI models.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• https://cam-ac-uk.zoom.us/j/97599459216?pwd=QTRsOWZCOXRTREVnbTJBdXVpOXFvdz09
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.