PaSh: Scaling out Shell Programs, Automatically

Add to your list(s) Download to your calendar using vCal

• Nikos Vasilakis, Brown University
• Tuesday 18 June 2024, 14:00-15:00
• FW11.

If you have a question about this talk, please contact Ryan Gibb.

Unix / Linux shell programming is ubiquitous, partly due to the simplicity in which it allows combining third-party components (commands) written in any programming language. Unfortunately, this language-agnostic composition hinders automated scaleout of shell programs, often forcing developers that deal with massive datasets to manually rewrite shell programs and their commands in other languages or frameworks designed to scale. In this talk I will present PaSh, a system for automatically scaling out shell programs. PaSh combines a just-in-time compiler that blends static pre-processing with dynamic interposition, a high-level annotation framework for capturing partial command specifications, and a collection of high-performance runtime primitives that support the execution of parallel and distributed shell programs. PaSh achieves order-of-magnitude speedups on unmodified shell programs, all while remaining virtually indistinguishable from (and requiring no modifications to) an underlying shell interpreter like Bash. PaSh is worked on by several institutions, has received multiple awards, and is open-source software available by the Linux Foundation. SHORT BIO : Nikos Vasilakis is an Assistant Professor of Computer Science at Brown University. His research encompasses systems, programming languages, and security — and has been recognized by several distinguished paper awards. His current focus is on automatically transforming systems to add new capabilities such as parallelism, distribution, and security — against a variety of threat models. Nikos is also the chair of the Technical Steering Committee behind PaSh, a shell-script optimization system hosted by the Linux Foundation. More: https://nikos.vasilak.is ~

This talk is part of the Computer Laboratory Systems Research Group Seminar series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• CL's SRG seminar
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge talks
• Chris Davis' list
• Computer Laboratory Systems Research Group Seminar
• Department of Computer Science and Technology talks and seminars
• FW11
• Interested Talks
• School of Technology
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.