University of Cambridge > Talks.cam > NLIP Seminar Series > Where did it all go wrong? New Tools for Automatic Error Analysis in NLP

Where did it all go wrong? New Tools for Automatic Error Analysis in NLP

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Tamara Polajnar.

System performance is typically interpreted through metrics, which quantify errors, but do not analyse them. In this talk I will present new tools that automatically analyse system output, giving a linguistically intuitive breakdown of errors.

For parsing I will present results for English and Chinese, showing how error distributions vary between systems, what types of errors are being resolved by re-rankers, and what types are introduced when parsing out-of-domain text. For co-reference resolution I will present some preliminary results, comparing the errors made by systems in a recent shared task.

Jonathan is a PhD candidate at the University of California, Berkeley, advised by Dan Klein

This talk is part of the NLIP Seminar Series series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

 

© 2006-2024 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity