Optimal Tag Sets for Automatic Image Annotation

Add to your list(s) Download to your calendar using vCal

• Sean Moran (Edinburgh)
• Friday 04 December 2009, 11:00-12:00
• Engineering Department, CBL Room 438.

If you have a question about this talk, please contact Zoubin Ghahramani.

short talk

Automatic Image Annotation seeks to assign relevant words (e.g. ``jungle’’, ``boat’’, ``trees’‘) to images that describe the actual content found in the images without intermediate manual labelling. Current approaches are largely based on categorization, and treat the tags independently, so an annotation (jungle,trees) is just as plausible as (jungle,snow). In this talk I will introduce a new form of the Continuous Relevance Model (the BS-CRM) to capture the correlation between keywords and apply a priority beam search algorithm to find a near optimal set of mutually correlated keywords for an image. This novel approach provides a formal and consistent method for finding an optimal set of tags for an image by considering multiple hypotheses for the identity of the keyword set via the beam search algorithm. Furthermore by limiting the width of the beam, one is able to avoid the combinatorial explosion associated with enumerating and evaluating all possible keyword sets for an image. This approach also makes the contribution of examining the performance gains for the CRM and BS-CRM models under both Gaussian and Laplacian kernels for the representation of the image feature distributions. Extensive evaluation demonstrates the effectiveness of the approach in refining the set of keywords assigned to images.

This talk is part of the Machine Learning @ CUED series.

This talk is included in these lists:

• Seminar
• All Talks (aka the CURE list)
• Biology
• CBL important
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge Neuroscience Seminars
• Cambridge talks
• Chris Davis' list
• Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
• Engineering Department, CBL Room 438
• Featured lists
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Summary
• Information Engineering Division seminar list
• Interested Talks
• Joint Machine Learning Seminars
• Life Science
• Life Sciences
• ML
• Machine Learning @ CUED
• Machine Learning Summary
• Neuroscience
• Neuroscience Seminars
• Neuroscience Seminars
• Required lists for MLG
• Simon Baker's List
• Stem Cells & Regenerative Medicine
• Trust & Technology Initiative - interesting events
• bld31
• dh539
• kt532's list
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.