Accelerating Generative AI on Custom Hardware Accelerators - Challenges and Opportunities

Add to your list(s) Download to your calendar using vCal

• Partha Maji (Tenstorrent)
• Tuesday 23 January 2024, 13:00-14:00
• Lecture Theatre 2, Computer Laboratory, William Gates Building.

If you have a question about this talk, please contact Mateja Jamnik.

This presentation will center around the implementation challenges associated with generative AI on emerging spatial computing hardware. A comprehensive examination of the Tensix core architecture, integrated within the flagship Wormhole chips provided by Tenstorrent Inc., will be undertaken. Subsequently, we will assess state-of-the-art Large Language Models (LLMs) and investigate diverse approaches to effectively map these models onto the underlying hardware fabric. The presentation will be concluded by emphasizing various challenges and delineating prospects for further research in the domains of model design and optimization.

Bio: Partha Maji currently serves as Technical Director of ML Hardware Acceleration at Tenstorrent, a US based AI Hardware startup. Preceding this position, he held the position of Head of ML Research at Arm UK. With more than 18 years of industry experience, Partha’s expertise encompasses a diverse spectrum of domains that intersect AI/ML algorithms, software/compilers, and hardware architectures. Partha earned his Doctorate in Computer Science from the University of Cambridge.

You can also join us on Zoom

This talk is part of the Artificial Intelligence Research Group Talks (Computer Laboratory) series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Artificial Intelligence Research Group Talks (Computer Laboratory)
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Computer Science and Technology talks and seminars
• Guy Emerson's list
• Hanchen DaDaDash
• Interested Talks
• Lecture Theatre 2, Computer Laboratory, William Gates Building
• School of Technology
• Speech Seminars
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587
• yk373's list

Note that ex-directory lists are not shown.