ClimaX: A foundation model for weather and climate

Add to your list(s) Download to your calendar using vCal

• Dr Tung Nguyen, University of California Los Angeles
• Tuesday 20 June 2023, 16:00-17:00
• Drum Building, Madingley Rise Site, West Cambridge and on zoom: https://zoom.us/j/6708259482?pwd=Qk03U3hxZWNJZUZpT2pVZnFtU2RRUT09.

If you have a question about this talk, please contact Annabelle Scott.

Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon at a fine-grained spatial and temporal resolution. Recent data-driven approaches based on machine learning instead aim to directly solve a downstream forecasting or projection task by learning a data-driven functional mapping using deep neural networks. However, these networks are trained using curated and homogeneous climate datasets for specific spatiotemporal tasks, and thus lack the generality of numerical models. We develop and demonstrate ClimaX, a flexible and generalizable deep learning model for weather and climate science that can be trained using heterogeneous datasets spanning different variables, spatio-temporal coverage, and physical groundings. ClimaX extends the Transformer architecture with novel encoding and aggregation blocks that allow effective use of available compute while maintaining general utility. ClimaX is pre-trained with a self-supervised learning objective on climate datasets derived from CMIP6 . The pre-trained ClimaX can then be fine-tuned to address a breadth of climate and weather tasks, including those that involve atmospheric variables and spatio-temporal scales unseen during pretraining. Compared to existing data-driven baselines, we show that this generality in ClimaX results in superior performance on benchmarks for weather forecasting and climate projections, even when pretrained at lower resolutions and compute budgets.

This talk is part of the AI4ER Seminar Series series.

This talk is included in these lists:

• AI4ER Seminar Series
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Drum Building, Madingley Rise Site, West Cambridge and on zoom: https://zoom.us/j/6708259482?pwd=Qk03U3hxZWNJZUZpT2pVZnFtU2RRUT09
• Interested Talks
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.