Language based Pre-training for Drug Discovery

Add to your list(s) Download to your calendar using vCal

• Bharath Ramsundar
• Monday 15 November 2021, 16:30-17:00
• https://zoom.us/j/92447982065?pwd=RkhaYkM5VTZPZ3pYSHptUXlRSkppQT09.

If you have a question about this talk, please contact Dr Christoph Schran.

Pretraining has taken the NLP world by storm as ever larger language models have broken successive benchmarks. In this talk, I’ll review some recent work applying pretraining to scientific challenges, and in particular will discuss the challenges of pretraining for molecular machine learning. I’ll introduce our new architecture, ChemBERTa, which explores the use of BERT -style pretraining for machine learning problems inspired by drug discovery applications.

This talk is part of the Lennard-Jones Centre series.

This talk is included in these lists:

• Hanchen DaDaDash
• Lennard-Jones Centre
• https://zoom.us/j/92447982065?pwd=RkhaYkM5VTZPZ3pYSHptUXlRSkppQT09

Note that ex-directory lists are not shown.