NRAO_Xue

We support astrophysical research by developing and optimizing automated data processing pipelines for flagship radio interferometer facilities (ALMA, VLA) and large-scale surveys (e.g., VLASS). Currently, these compute- and I/O-intensive pipelines operate as standalone packages with limited parallelization, which restricts overall system utilization. To resolve this, our research will explore modern distributed workflow management systems and APIs to refactor the software, enabling direct integration with workflow/workload managers to maximize efficiency on existing on-premises clusters primarily configured for HPC loads, or highly distributed resources, e.g., OSG. - ALMA: https://www.almaobservatory.org/en/home/ - VLA: https://public.nrao.edu/telescopes/vla/ - VLASS: https://public.nrao.edu/vlass/ - ALMA pipeline: https://almascience.nrao.edu/processing/science-pipeline - VLA pipeline https://science.nrao.edu/facilities/vla/data-processing/pipeline