BART-L: Towards a Foundation Model for Theoretical High-Energy Physics

Add to your list(s) Download to your calendar using vCal

• Yong Sheng Koay (Uppsala University)
• Tuesday 14 October 2025, 14:00-15:00
• DAMTP, MR11.

If you have a question about this talk, please contact Sven Krippendorf.

Transformers excel at natural language tasks, which naturally raises the question of whether they can also learn the mathematical language of particle physics. In this talk, I will introduce BART -L, a transformer-based model designed to generate particle physics Lagrangians from the field content and their symmetry information. Trained on Lagrangians respecting the Standard Model gauge group SU(3)×SU(2)×U(1), BART -L achieves over 90 % accuracy for Lagrangians involving up to six matter fields. Embedding analyses show that the model internalizes concepts such as group representations and conjugation operations, despite not being explicitly trained for them. We further examine its out-of-distribution behavior to identify architectural constraints that limit generalization. Finally, we discuss how this framework provides an early indication of what a foundation model for theoretical high-energy physics might look like, along with its potential capabilities and inherent limitations.

This talk is part of the DAMTP Data Intensive Science Seminar series.

This talk is included in these lists:

• DAMTP Data Intensive Science Seminar
• DAMTP, MR11

Note that ex-directory lists are not shown.