University of Cambridge > Talks.cam > NLIP Seminar Series > A Proposal on Evaluation Measures for RTE

  Browse A-Z

Log in

Cambridge users (raven)details Other usersdetails No account?details

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

A Proposal on Evaluation Measures for RTE

Add to your list(s) Download to your calendar using vCal

If you have a question about this talk, please contact Laura Rimell.

We outline problems with the interpretation of accuracy in the presence of bias, arguing that the issue is a particularly pressing concern for RTE evaluation. Furthermore, we argue that average precision scores are unsuitable for RTE , and should not be reported. We advocate mutual information as a new evaluation measure that should be reported in addition to accuracy and confidence-weighted score.

This talk is part of the NLIP Seminar Series series.

Tell a friend about this talk:

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

Cambridge Conversations in Translation Mackenzie-Stuart Lectures Wolfson-HAT Foundation Annual Symposium Series on Personal Data

Other talks

An approach to the four colour theorem via Donaldson- Floer theory Power to the People – Creating Markets for Supply Security Based on Consumer Choice Surface meltwater ponding and drainage causes ice-shelf flexure Britain, Jamaica and the modern global financial order, 1800-50 Hypergraph Saturation Irregularities Chemical convection and stratification at the top of the Earth's outer core An SU(3) variant of instanton homology for webs The frequency of ‘America’ in America Liver Regeneration in the Damaged Liver A rose by any other name South American Opuntioids
 

© 2006-2024 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity