Graph Convolutional Networks for Natural Language Processing and Relational Modeling

Add to your list(s) Download to your calendar using vCal

• Ivan Titov (Edinburgh)
• Thursday 08 February 2018, 11:00-12:00
• Boardroom, Faculty of English, West Road.

If you have a question about this talk, please contact Dimitri Kartsaklis.

Graph Convolutional Networks (GCNs) is an effective tool for modeling graph structured data. We investigate their applicability in the context of natural language processing (machine translation and semantic role labelling) and modeling relational data (link prediction). For natural language processing, we introduce a version of GCNs suited to modeling syntactic and/or semantic dependency graphs and use them to construct linguistically-informed sentence encoders. We demonstrate that using them results in a substantial boost in machine translation performance and state-of-the-art results on semantic role labeling of English and Chinese. We also experiment with GCNs over latent graphs (i.e. use structure of a sentence as a latent variable). For link prediction, we propose Relational GCNs (RGCNs), GCNs developed specifically to deal with highly multi-relational data, characteristic of realistic knowledge bases. By explicitly modeling neighbourhoods of entities, RGC Ns accumulate evidence over multiple inference steps in relational graphs and yield competitive results on standard link prediction benchmarks.

Joint work with Diego Marcheggiani, Michael Schlichtkrull, Joost Bastings, Thomas Kipf, Wilker Aziz, Max Welling, Khalil Sima’an, Rianna van den Berg and Peter Bloem.

This talk is part of the Language Technology Lab Seminars series.

This talk is included in these lists:

• Boardroom, Faculty of English, West Road
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Guy Emerson's list
• Interested Talks
• Language Sciences for Graduate Students
• Language Technology Lab Seminars
• Simon Baker's List
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.