CHARIZARD: A High-throughput Generic Pipeline for Present and Upcoming Interferometers

Abstract

Radio interferometers now deliver wide bandwidths and high sensitivity, and with them data volumes that are awkward to reduce by hand and slow to reduce automatically. The limit is not always the algorithms themselves but the way the work is laid out across the computing available. We present CHARIZARD, a pipeline that carries a raw measurement set through flagging, cross-calibration, self-calibration and imaging to full-Stokes images, and which is built around distributing that work. The observ…