HovercRaft: Achieving Scalability and Fault-tolerance for microsecond-scale Datacenter Services

Add to your list(s) Download to your calendar using vCal

• Marios Kogias
• Thursday 07 May 2020, 15:00-16:00
• Webex Meeting number: 140 388 203 Password: ZApmfTb7h56.

If you have a question about this talk, please contact Srinivasan Keshav.

Cloud platform services must simultaneously be scalable, meet low tail latency service-level objectives, and be resilient to a combination of software, hardware, and network failures. Replication plays a fundamental role in meeting both the scalability and the fault-tolerance requirement, but is subject to opposing requirements: (1) scalability is typically achieved by relaxing consistency; (2) fault-tolerance is typically achieved through the consistent replication of state machines. Adding nodes to a system can therefore either increase performance at the expense of consistency, or increase resiliency at the expense of performance. We propose HovercRaft, a new approach by which adding nodes increases both the resilience and the performance of general-purpose state-machine replication. We achieve this through an extension of the Raft protocol that carefully eliminates CPU and I/O bottlenecks and load balances requests. Our implementation uses state-of-the-art kernel-bypass techniques, datacenter transport protocols, and in-network programmability to deliver up to 1 million operations/second for clusters of up to 9 nodes, linear speedup over unreplicated configuration for selected workloads, and a 4X speedup for the YCSBE -E benchmark running on Redis over an unreplicated deployment.

https://meetingsemea10.webex.com/meetingsemea10/j.php?MTID=mf0c350ff1fab96540218f5767c51d098

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Computer Laboratory Systems Research Group Seminar
• Department of Computer Science and Technology talks and seminars
• Interested Talks
• School of Technology
• Trust & Technology Initiative - interesting events
• Webex Meeting number: 140 388 203 Password: ZApmfTb7h56
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.