Turbocharging Serverless Research with vHive

Add to your list(s) Download to your calendar using vCal

• Dmitrii Ustiugov, University of Edinburgh
• Thursday 24 February 2022, 15:00-16:00
• FW11 and https://cl-cam-ac-uk.zoom.us/j/97216272378?pwd=M2diTFhMTnppckJtNWhFVTBKK0REZz09.

If you have a question about this talk, please contact Srinivasan Keshav.

Serverless has emerged as the next dominant cloud architecture and programming paradigm due to its high scalability and flexible, pay-as-you-go billing model. In serverless, developers structure their cloud services as a set of functions connected in a workflow, whereas providers take responsibility for scaling each function’s resources according to traffic changes. This labor division opens great opportunities for systems researchers who seek to innovate in serverless computing. Unfortunately, leading serverless providers, like AWS Lambda and Azure Functions, rely on proprietary infrastructure. While existing in other computer systems domains, the gap between production systems and research prototypes is particularly large for serverless computing, preventing academics from discovering and solving relevant problems in realistic scenarios.

I introduce vHive, an open-source ecosystem for serverless benchmarking and experimentation, with the goal of enabling researchers to study and innovate across the entire serverless stack. vHive includes a holistic performance analysis methodology and a framework that integrates industry-leading components, such as Kubernetes orchestrator and AWS Firecracker hypervisor technologies. To demonstrate vHive’s utility, I analyze the bottlenecks, namely function cold-start and cross-function data communication delays, in the leading commercial clouds. I then present two novel approaches that address each of these problems. First, to reduce the cold-start delays, I find that serverless functions operate over stable working sets – across function invocations – that can be effectively recorded and prefetched. Second, to accelerate data movement, I introduce a serverless-native cross-function data communication fabric that combines high performance with autoscaling capabilities.

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Computer Laboratory Systems Research Group Seminar
• Department of Computer Science and Technology talks and seminars
• FW11 and https://cl-cam-ac-uk.zoom.us/j/97216272378?pwd=M2diTFhMTnppckJtNWhFVTBKK0REZz09
• Interested Talks
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.