The Demikernel Datapath Architecture for Microsecond-scale Datacenter Systems

Add to your list(s) Download to your calendar using vCal

• Irene Zhang, Principal Researcher, Microsoft Research
• Monday 27 January 2025, 14:00-15:00
• Computer Lab, FW26.

If you have a question about this talk, please contact Richard Mortier.

Datacenter systems and I/O devices now run at single-digit microsecond latencies, requiring nanosecond-scale operating systems. Traditional kernel-based operating systems impose an unaffordable overhead, so recent kernel-bypass OSes (e.g., Arrakis, Ix) and libraries (e.g., Caladan, eRPC) eliminate the OS kernel from the I/O datapath. However, these systems do not offer a general-purpose datapath OS replacement that meet the needs of microsecond-scale systems. As a result, while kernel-bypass hardware is widely available in the datacenter, it is not widely used.

This talk summarizes Demikernel, a flexible datapath OS and architecture designed for heterogenous kernel-bypass devices and microsecond-scale datacenter systems. Demikernel supports a variety of kernel-bypass hardware, including DPDK , RDMA, as well as software bypass solutions like io_uring. To support microsecond-scale operation, Demikernel includes a new nanosecond-scale TCP stack, written in Rust and proposes new memory management, CPU scheduling and network abstractions. Demikernel is currently used by Bing and will go into production with Azure services later this year.

Bio: Irene Zhang is a Principal Researcher at Microsoft Research. Her work focuses on datacenter operating systems and distributed systems, especially making new datacenter hardware technologies more widely usable by highly-demanding datacenter applications. Irene completed her PhD in 2017 at the University of Washington, where her PhD thesis focused on distributed systems that span mobile devices and cloud servers. Her thesis work received the ACM SIGOPS Dennis Ritchie doctoral dissertation award and the UW Allen School William Chan Memorial dissertation award. Before her PhD, Irene was a member of the virtual machine monitor group at VMware, where she worked on memory resource management and virtual machine checkpointing.

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Computer Lab, FW26
• Computer Laboratory Systems Research Group Seminar
• Department of Computer Science and Technology talks and seminars
• Interested Talks
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.