3D Pre-training improves GNNs for Molecular Property Prediction

Add to your list(s) Download to your calendar using vCal

• Hannes Stark, TU Munich
• Tuesday 12 October 2021, 13:15-14:15
• Zoom.

If you have a question about this talk, please contact Mateja Jamnik.

Join us on Zoom

While it is clear that 3D information is valuable to improve molecular property prediction, there are many molecules for which the geometry is not available. However, in principle, all information about a molecule’s possible 3D configurations is contained in its representation as a molecular graph. Can a Graph Neural Network’s (GNN’s) property predictions be improved if it understands a molecule’s geometry from only the molecular graph?

We show this to be the case. Using methods from self-supervised learning, we 3D pre-train a GNN to generate latent 3D information. During finetuning on molecules with unknown geometry, the GNN still generates implicit 3D information and uses it to inform downstream molecular property predictions, improving their accuracy.

Our 3D pre-training can provide large improvements for a wide range of molecular properties. Crucially, 3D pre-training always improves or performs on par, unlike many prior SSL methods for molecules that suffer from negative transfer for some tasks. Lastly, the learned representations are very generalizable and can be transferred between datasets with vastly different molecules. All these qualities of our method are essential for real-world applications and make it highly interesting for practice.

This talk is part of the Artificial Intelligence Research Group Talks (Computer Laboratory) series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Artificial Intelligence Research Group Talks (Computer Laboratory)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• School of Technology
• Speech Seminars
• Trust & Technology Initiative - interesting events
• Zoom
• bld31
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list
• yk449

Note that ex-directory lists are not shown.