Language based Pre-training for Drug Discovery

Add to your list(s) Download to your calendar using vCal

• Bharath Ramsundar
• Saturday 01 January 2022, 16:30-17:30
• tba.

If you have a question about this talk, please contact nobody.

This talk has been canceled/deleted

Pretraining has taken the NLP world by storm as ever larger language models have broken successive benchmarks. In this talk, I’ll review some recent work applying pretraining to scientific challenges, and in particular will discuss the challenges of pretraining for molecular machine learning. I’ll introduce our new architecture, ChemBERTa, which explores the use of BERT -style pretraining for machine learning problems inspired by drug discovery applications.

This talk is part of the Machine learning in Physics, Chemistry and Materials discussion group (MLDG) series.

This talk is included in these lists:

This talk is not included in any other list

Note that ex-directory lists are not shown.