Software

ASKAP Science Data Processor software - ASKAPsoft Version 0.21.0

Commonwealth Scientific and Industrial Research Organisation
Guzman, Juan ; Whiting, Matthew ; Voronkov, Max ; Mitchell, Daniel ; Ord, Stephen ; Collins, Daniel ; Marquarding, Malte ; Lahur, Paulus ; Maher, Tony ; Van Diepen, Ger ; Bannister, Keith ; Wu, Xinyu ; Lenc, Emil ; Khoo, Jonathan ; Bastholm, Eric
Viewed: [[ro.stat.viewed]] Cited: [[ro.stat.cited]] Accessed: [[ro.stat.accessed]]
ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rfr_id=info%3Asid%2FANDS&rft_id=info:doi10.25919/5b446f22c46fc&rft.title=ASKAP Science Data Processor software - ASKAPsoft Version 0.21.0&rft.identifier=https://doi.org/10.25919/5b446f22c46fc&rft.publisher=Commonwealth Scientific and Industrial Research Organisation&rft.description=ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:\n\n* Calibration\n* Spectral line imaging\n* Continuum imaging\n* Source detection and generation of source catalogs\n* Transient detection\n\nASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).\n\nThe processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.\n\nASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:\n\n* g++\n* gfortran\n* openjdk-7-jdk\n* python-dev\n* flex\n* bison\n* openmpi-bin\n* libopenmpi-dev\n* libfreetype6-dev\n* libpng12-dev\n\nMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.\n\nSource code can be accessed via the links in Related Materials section.\n\n-----\nA large release containing a number of updates to the pipeline scripts\nand to various aspects of the processing tools.\n\nPipeline updates:\n\n * Can use AOflagger instead of cflag.\n * Can use continuum cubes to measure spectral indices of\n continuum components (using Selavy).\n * Bug fix, the CleanModel option of continuum-subtraction was using\n the wrong image name.\n * Allow self-calibration to use the clean model image as the model\n for calibration (in the manner of continuum-subtraction).\n * Improved continuum subtraction Selavy parameterisations, to better\n model continuum components. Selavy parsets are now consistent with\n those used for the continuum cataloguing.\n * Use of an alternative bandpass smoothing task -\n smooth_bandpass.py (instead of plot_caltable.py).\n * Use of an additional bandpass validation script to produce summary\n diagnostic plots for the bandpass solutions.\n * Bug fix, the bandpass table name was not set correctly when the the\n DO_FIND_BANDPASS switch was turned off.\n * Addition of the spectral measurement sets, the continuum-subtraction\n models/catalogues, and the spectral cube beam logs to the list of\n artefacts to be sent to CASDA upon pipeline completion. \n * Changes to some default parameters. See CHANGES file for details.\n\n\nProcessing tasks:\n\n * MPI barrier added to the spectral imager to prevent race conditions.\n * Improved bandpass calibration to fix failures with SVD conversion\n errors.\n * The memory handling within linmos-mpi has been improved to reduce\n its footprint, making it better able to mosaic large spectral\n cubes. \n * Selavy:\n - now reports best component fit, regardless of the chi-squared. If\n poor, a new flag will be set.\n - If the fit fails to converge, can reduce the number of Gaussians\n being fit to try to get a good fit.\n - Bug fix, allow the curvature-map method of identifying components\n to better take into account the weights image associated with the\n image being searched.\n - Bug fix, Selavy, (extraction code) was fixed to allow its use on\n images without spectral or Stokes axes.\n - The SNR image produced by Selavy now has a blank string for the\n pixel units.\n - The implementation of variable threshold calculations in Selavy\n have been streamlined, to improve the memory use.&rft.creator=Guzman, Juan &rft.creator=Whiting, Matthew &rft.creator=Voronkov, Max &rft.creator=Mitchell, Daniel &rft.creator=Ord, Stephen &rft.creator=Collins, Daniel &rft.creator=Marquarding, Malte &rft.creator=Lahur, Paulus &rft.creator=Maher, Tony &rft.creator=Van Diepen, Ger &rft.creator=Bannister, Keith &rft.creator=Wu, Xinyu &rft.creator=Lenc, Emil &rft.creator=Khoo, Jonathan &rft.creator=Bastholm, Eric &rft.date=2018&rft.edition=v1&rft_rights=GPLv3 Licence with CSIRO Disclaimer https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/&rft_rights=Data is accessible online and may be reused in accordance with licence conditions&rft_rights=All Rights (including copyright) CSIRO 2018.&rft_subject=ASKAP&rft_subject=science data processor&rft_subject=pipeline&rft_subject=radio astronomy&rft_subject=software&rft_subject=data reduction&rft_subject=Astronomical sciences not elsewhere classified&rft_subject=Astronomical sciences&rft_subject=PHYSICAL SCIENCES&rft.type=Computer Program&rft.language=English Access the software

Licence & Rights:

Open Licence view details
Gpl

GPLv3 Licence with CSIRO Disclaimer
https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/

Data is accessible online and may be reused in accordance with licence conditions

All Rights (including copyright) CSIRO 2018.

Access:

Open view details

Accessible for free

Contact Information



Brief description

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:

* Calibration
* Spectral line imaging
* Continuum imaging
* Source detection and generation of source catalogs
* Transient detection

ASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).

The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.

ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:

* g++
* gfortran
* openjdk-7-jdk
* python-dev
* flex
* bison
* openmpi-bin
* libopenmpi-dev
* libfreetype6-dev
* libpng12-dev

More information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.

Source code can be accessed via the links in Related Materials section.

-----
A large release containing a number of updates to the pipeline scripts
and to various aspects of the processing tools.

Pipeline updates:

* Can use AOflagger instead of cflag.
* Can use continuum cubes to measure spectral indices of
continuum components (using Selavy).
* Bug fix, the CleanModel option of continuum-subtraction was using
the wrong image name.
* Allow self-calibration to use the clean model image as the model
for calibration (in the manner of continuum-subtraction).
* Improved continuum subtraction Selavy parameterisations, to better
model continuum components. Selavy parsets are now consistent with
those used for the continuum cataloguing.
* Use of an alternative bandpass smoothing task -
smooth_bandpass.py (instead of plot_caltable.py).
* Use of an additional bandpass validation script to produce summary
diagnostic plots for the bandpass solutions.
* Bug fix, the bandpass table name was not set correctly when the the
DO_FIND_BANDPASS switch was turned off.
* Addition of the spectral measurement sets, the continuum-subtraction
models/catalogues, and the spectral cube beam logs to the list of
artefacts to be sent to CASDA upon pipeline completion.
* Changes to some default parameters. See CHANGES file for details.


Processing tasks:

* MPI barrier added to the spectral imager to prevent race conditions.
* Improved bandpass calibration to fix failures with SVD conversion
errors.
* The memory handling within linmos-mpi has been improved to reduce
its footprint, making it better able to mosaic large spectral
cubes.
* Selavy:
- now reports best component fit, regardless of the chi-squared. If
poor, a new flag will be set.
- If the fit fails to converge, can reduce the number of Gaussians
being fit to try to get a good fit.
- Bug fix, allow the curvature-map method of identifying components
to better take into account the weights image associated with the
image being searched.
- Bug fix, Selavy, (extraction code) was fixed to allow its use on
images without spectral or Stokes axes.
- The SNR image produced by Selavy now has a blank string for the
pixel units.
- The implementation of variable threshold calculations in Selavy
have been streamlined, to improve the memory use.

Available: 2018-07-10

Data time period: 2018-07-06 to ..

This dataset is part of a larger collection

Click to explore relationships graph
Subjects

User Contributed Tags    

Login to tag this record with meaningful keywords to make it easier to discover

Identifiers