Software

ASKAP Science Data Processor software - ASKAPsoft Version 0.18.0

Commonwealth Scientific and Industrial Research Organisation
Guzman, Juan ; Whiting, Matthew ; Voronkov, Max ; Mitchell, Daniel ; Ord, Stephen ; Collins, Daniel ; Marquarding, Malte ; Lahur, Paulus ; Maher, Tony ; Van Diepen, Ger ; Bannister, Keith ; Wu, Xinyu ; Lenc, Emil ; Khoo, Jonathan ; Bastholm, Eric
Viewed: [[ro.stat.viewed]] Cited: [[ro.stat.cited]] Accessed: [[ro.stat.accessed]]
ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rfr_id=info%3Asid%2FANDS&rft_id=info:doi10.4225/08/5900982fdfd35&rft.title=ASKAP Science Data Processor software - ASKAPsoft Version 0.18.0&rft.identifier=https://doi.org/10.4225/08/5900982fdfd35&rft.publisher=Commonwealth Scientific and Industrial Research Organisation&rft.description=ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:\n\n* Calibration\n* Spectral line imaging\n* Continuum imaging\n* Source detection and generation of source catalogs\n* Transient detection\n\nASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).\n\nThe processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.\n\nASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:\n\n* g++\n* gfortran\n* openjdk-7-jdk\n* python-dev\n* flex\n* bison\n* openmpi-bin\n* libopenmpi-dev\n* libfreetype6-dev\n* libpng12-dev\n\nMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.\n\nSource code can be accessed via the links in Related Materials section.\n\n-----\n\nNew features and updates:\n\n * Scheduling block state changes, in conjunction with a new TOS release, to \n introduce a new OBSERVED state. Scheduling blocks will now transition from \n EXECUTING to OBSERVED and then through to PROCESSING.\n* Python library updates:\n - numpy, scipy, matplotlib, pywcs, pytz, and APLpy. The current astropy package \n has been added, and pyfits removed. \n - New script Analysis/evaluation/makeThumbnailImage.py, that produces \n grey-scale plots of continuum images, and has the capability to add weights\n contours and/or continuum components.\n * Calibration & Imaging changes:\n - Residual image is now the residual at the end of the last\n major cycle. (was the residual at the beginning of\n the last major cycle.)\n - The residual images now have units of Jy/beam not\n Jy/pixel, and have the restoring beam written to the header.\n - When the restore preconditioner option is used in imaging, the\n residual and psf.image are also written out for this\n preconditioner.\n* Pipeline updates:\n - There is a new pipeline parameter, CCALIBRATOR_MINUV, that allows\n the bandpass calibration to exclude baseline below some value.\n - Minor errors and inconsistencies in some catalogue specifications\n have been fixed, with the polarisation catalogue being updated to\n v0.7.\n - The spectral-line catalogue has been added to the CASDA upload part\n of the pipeline, and has been renamed to incorporate the image name\n (in the line of other data products).\n - There are new pipeline parameters SELFCAL_REF_ANTENNA &\n SELFCAL_REF_GAINS that allow the self-calibration to use a\n reference antenna and/or gain solution.\n - A weights cutoff for Selavy can now be specified via the config\n file using the new parameters SELAVY_WEIGHTS_CUTOFF &\n SELAVY_SPEC_WEIGHTS_CUTOFF (rather than using the linmos cutoff\n value). \n - The new imager is better integrated into the pipeline, with\n DO_ALT_IMAGER parameters for CONT, CONTCUBE & SPECTRAL.\n - It is possible to make use of the direct FITS output in the\n pipeline, by using IMAGETYPE_ parameters for CONT, CONTCUBE &\n SPECTRAL. Note that this is still somewhat of a\n work-in-progress.\n\nVarious bug fixes - See the CHANGES file for details.&rft.creator=Guzman, Juan &rft.creator=Whiting, Matthew &rft.creator=Voronkov, Max &rft.creator=Mitchell, Daniel &rft.creator=Ord, Stephen &rft.creator=Collins, Daniel &rft.creator=Marquarding, Malte &rft.creator=Lahur, Paulus &rft.creator=Maher, Tony &rft.creator=Van Diepen, Ger &rft.creator=Bannister, Keith &rft.creator=Wu, Xinyu &rft.creator=Lenc, Emil &rft.creator=Khoo, Jonathan &rft.creator=Bastholm, Eric &rft.date=2017&rft.edition=v1&rft_rights=GPLv3 Licence with CSIRO Disclaimer https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/&rft_rights=Data is accessible online and may be reused in accordance with licence conditions&rft_rights=All Rights (including copyright) CSIRO 2017.&rft_subject=ASKAP&rft_subject=science data processor&rft_subject=pipeline&rft_subject=radio astronomy&rft_subject=software&rft_subject=data reduction&rft_subject=Astronomical sciences not elsewhere classified&rft_subject=Astronomical sciences&rft_subject=PHYSICAL SCIENCES&rft.type=Computer Program&rft.language=English Access the software

Licence & Rights:

Open Licence view details
Gpl

GPLv3 Licence with CSIRO Disclaimer
https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/

Data is accessible online and may be reused in accordance with licence conditions

All Rights (including copyright) CSIRO 2017.

Access:

Open view details

Accessible for free

Contact Information



Brief description

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:

* Calibration
* Spectral line imaging
* Continuum imaging
* Source detection and generation of source catalogs
* Transient detection

ASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).

The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.

ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:

* g++
* gfortran
* openjdk-7-jdk
* python-dev
* flex
* bison
* openmpi-bin
* libopenmpi-dev
* libfreetype6-dev
* libpng12-dev

More information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.

Source code can be accessed via the links in Related Materials section.

-----

New features and updates:

* Scheduling block state changes, in conjunction with a new TOS release, to
introduce a new OBSERVED state. Scheduling blocks will now transition from
EXECUTING to OBSERVED and then through to PROCESSING.
* Python library updates:
- numpy, scipy, matplotlib, pywcs, pytz, and APLpy. The current astropy package
has been added, and pyfits removed.
- New script Analysis/evaluation/makeThumbnailImage.py, that produces
grey-scale plots of continuum images, and has the capability to add weights
contours and/or continuum components.
* Calibration & Imaging changes:
- Residual image is now the residual at the end of the last
major cycle. (was the residual at the beginning of
the last major cycle.)
- The residual images now have units of Jy/beam not
Jy/pixel, and have the restoring beam written to the header.
- When the "restore preconditioner" option is used in imaging, the
residual and psf.image are also written out for this
preconditioner.
* Pipeline updates:
- There is a new pipeline parameter, CCALIBRATOR_MINUV, that allows
the bandpass calibration to exclude baseline below some value.
- Minor errors and inconsistencies in some catalogue specifications
have been fixed, with the polarisation catalogue being updated to
v0.7.
- The spectral-line catalogue has been added to the CASDA upload part
of the pipeline, and has been renamed to incorporate the image name
(in the line of other data products).
- There are new pipeline parameters SELFCAL_REF_ANTENNA &
SELFCAL_REF_GAINS that allow the self-calibration to use a
reference antenna and/or gain solution.
- A weights cutoff for Selavy can now be specified via the config
file using the new parameters SELAVY_WEIGHTS_CUTOFF &
SELAVY_SPEC_WEIGHTS_CUTOFF (rather than using the linmos cutoff
value).
- The new imager is better integrated into the pipeline, with
DO_ALT_IMAGER parameters for CONT, CONTCUBE & SPECTRAL.
- It is possible to make use of the direct FITS output in the
pipeline, by using IMAGETYPE_ parameters for CONT, CONTCUBE &
SPECTRAL. Note that this is still somewhat of a
work-in-progress.

Various bug fixes - See the CHANGES file for details.

Available: 2017-04-26

Data time period: 2017-03-29 to ..

Subjects

User Contributed Tags    

Login to tag this record with meaningful keywords to make it easier to discover