LINCC Frameworks - developing software for large-scale analysis of data

Add to your list(s) Download to your calendar using vCal

• Neven Caplar (University of Washington)
• Tuesday 03 October 2023, 11:30-12:00
• Ryle seminar room + online.

If you have a question about this talk, please contact Sandro Tacchella.

LINCC (LSST Interdisciplinary Network for Collaboration and Computing) is an ambitious effort to support the science community by developing cloud-based analysis frameworks for LSST science. The goal is to enable the delivery of critical computational infrastructure and code for petabyte-scale analyses, mechanisms to search for one-in-a-million events in continuous streams of data, and community organizations and communication channels that enable researchers to develop and share their algorithms and software. We are particularly interested in supporting early science and commissioning efforts. The team develops software packages in different areas of interest to LSST ; such as RAIL , a package for photo-z estimation, and KMBOD , a package for detecting slowly moving asteroids. I will also discuss our effort with LSDB and TAPE packages that focus on cross-matching and time-domain analysis. We are currently developing capabilities to: i) efficiently retrieve and cross-match large catalogs ii) facilitate easy color-correction and recalibration on time-domain data from different surveys to enable analysis on long lightcurves ii) provide custom functions that can be efficiently executed on large amounts of data (such as structure function and periodogram calculations) iii) enable large-scale calculation with custom, user-provided functions, e.g., continuous auto-regressive moving average models implemented in JAX . LINCC is already supporting the community through an incubator program and a series of technical talks. I will present these efforts and show our current status, results, and code; and illustrate how we can collaborate and be helpful for your research!

This talk is part of the Galaxies Discussion Group series.

This talk is included in these lists:

• Combined External Astrophysics Talks DAMTP
• Cosmology, Astrophysics and General Relativity
• Galaxies Discussion Group
• Institute of Astronomy Talk Lists
• Kavli Institute for Cosmology Talk Lists
• Ryle seminar room + online

Note that ex-directory lists are not shown.