Software

ASKAP Science Data Processor software - ASKAPsoft Version 0.22.0

Commonwealth Scientific and Industrial Research Organisation
Guzman, Juan ; Whiting, Matthew ; Voronkov, Max ; Mitchell, Daniel ; Ord, Stephen ; Collins, Daniel ; Marquarding, Malte ; Lahur, Paulus ; Maher, Tony ; Van Diepen, Ger ; Bannister, Keith ; Wu, Xinyu ; Lenc, Emil ; Khoo, Jonathan ; Bastholm, Eric
Viewed: [[ro.stat.viewed]] Cited: [[ro.stat.cited]] Accessed: [[ro.stat.accessed]]
ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rfr_id=info%3Asid%2FANDS&rft_id=info:doi10.25919/5c58d803c1374&rft.title=ASKAP Science Data Processor software - ASKAPsoft Version 0.22.0&rft.identifier=https://doi.org/10.25919/5c58d803c1374&rft.publisher=Commonwealth Scientific and Industrial Research Organisation&rft.description=ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:\n\n* Calibration\n* Spectral line imaging\n* Continuum imaging\n* Source detection and generation of source catalogs\n* Transient detection\n\nASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).\n\nThe processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.\n\nASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:\n\n* g++\n* gfortran\n* openjdk-7-jdk\n* python-dev\n* flex\n* bison\n* openmpi-bin\n* libopenmpi-dev\n* libfreetype6-dev\n* libpng12-dev\n\nMore information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.\n\nSource code can be accessed via the links in Related Materials section.\n\n-----\nThis release sees a number of changes & improvements to both the processing software and the pipeline scripts.\n\nPipelines:\n\n * New diagnostic plots produced, esp. for the\n spectral & continuum cubes. \n * Improved ability to specify the number of cores used for the continuum\n imaging.\n * Behaviour of source-finding in the selfcal has changed. Now\n fit the full set of Gaussian parameters, and require contiguous\n pixels for the islands.\n * Small bug fixes.\n * Parameter default changes: \n - DO_MAKE_THUMBNAILS: default true\n - DO_VALIDATION_SCIENCE: new, default true, to run cube validation.\n - Snapshot imaging off by default, better image quality. Also, number of w-planes \n has default value that changes with snapshot option: snapshot imaging has 99, \n non-snapshot imaging has 599.\n - Number of channels in MS tile exposed as a parameter for bandpass & science datasets,\n taking the same default value as previously (54).\n - solver.Clean.solutiontype parameter exposed as a pipeline parameter for all imaging\n jobs.\n - SB_JIRA_ISSUE replaced by JIRA_ANNOTATION_PROJECT for schedblock annotations \n (askapops user only).\n\nApplications:\n\n * Selavy:\n - Improved default values in Selavy HI catalogue,\n and fixed bad NaN values.\n - Fixed occasional dropping of components from the\n catalogue through the application of acceptance criteria. Optional, and off by default.\n - Fixed failing to calculate spectral indices in certain cases.\n - Deconvolved sizes in the components catalogue now\n calculated with better floating-point arithmetic, to avoid NaNs.\n - VOTable catalogue column widths are more tightly\n controlled, in line with the CASDA software.\n * Imaging:\n - Primary beam factory (used by linmos) able to handle elliptical\n Gaussian beams. Not fully implemented within linmos yet.\n - New gridder AltWProjectVisGridder that allows the dumping of\n uvgrids to casa images.\n - Added caching by channel in spectral-line imaging.\n - Spectral-line imager correctly writes the beam log\n when using multiple writers.\n - Fixed issue with failed beam fitting for very elongated beams.\n&rft.creator=Guzman, Juan &rft.creator=Whiting, Matthew &rft.creator=Voronkov, Max &rft.creator=Mitchell, Daniel &rft.creator=Ord, Stephen &rft.creator=Collins, Daniel &rft.creator=Marquarding, Malte &rft.creator=Lahur, Paulus &rft.creator=Maher, Tony &rft.creator=Van Diepen, Ger &rft.creator=Bannister, Keith &rft.creator=Wu, Xinyu &rft.creator=Lenc, Emil &rft.creator=Khoo, Jonathan &rft.creator=Bastholm, Eric &rft.date=2019&rft.edition=v1&rft_rights=GPLv3 Licence with CSIRO Disclaimer https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/&rft_rights=Data is accessible online and may be reused in accordance with licence conditions&rft_rights=All Rights (including copyright) CSIRO 2018.&rft_subject=ASKAP&rft_subject=science data processor&rft_subject=pipeline&rft_subject=radio astronomy&rft_subject=software&rft_subject=data reduction&rft_subject=Astronomical sciences not elsewhere classified&rft_subject=Astronomical sciences&rft_subject=PHYSICAL SCIENCES&rft.type=Computer Program&rft.language=English Access the software

Licence & Rights:

Open Licence view details
Gpl

GPLv3 Licence with CSIRO Disclaimer
https://research.csiro.au/dap/licences/gplv3-licence-with-csiro-disclaimer/

Data is accessible online and may be reused in accordance with licence conditions

All Rights (including copyright) CSIRO 2018.

Access:

Open view details

Accessible for free

Contact Information



Brief description

ASKAPsoft, the ASKAP Science Data Processor, provides data processing functionality, including:

* Calibration
* Spectral line imaging
* Continuum imaging
* Source detection and generation of source catalogs
* Transient detection

ASKAPsoft is developed as a part of the CSIRO Australian Square Kilometre Array Pathfinder (ASKAP) Science Data Processor component. ASKAPsoft is a key component in the ASKAP system. It is the primary software for storing and processing raw data, and initiating the archiving of resulting science data products into the data archive (CASDA).

The processing pipelines within ASKAPsoft are largely written in C++ built on top of casacore and other third party libraries. The software is designed to be parallelised, where possible, for performance.

ASKAPsoft is designed to be built and executed in a standard Unix/Linux environment and core dependencies must be fulfilled by the platform. These include, but are not limited to, a C/C++/Fortran compiler, Make, Python 2.7, Java 7 and MPI. More specific dependencies are downloaded by the ASKAPsoft build system and are installed within the ASKAPsoft development tree. Specific to the Debian platform, after a standard installation of Debian Wheezy (7.x) the following packages will need to be installed with apt-get:

* g++
* gfortran
* openjdk-7-jdk
* python-dev
* flex
* bison
* openmpi-bin
* libopenmpi-dev
* libfreetype6-dev
* libpng12-dev

More information regarding the building, installation and running of the software can be found in the README file in the root of the file structure that forms this collection.

Source code can be accessed via the links in Related Materials section.

-----
This release sees a number of changes & improvements to both the processing software and the pipeline scripts.

Pipelines:

* New diagnostic plots produced, esp. for the
spectral & continuum cubes.
* Improved ability to specify the number of cores used for the continuum
imaging.
* Behaviour of source-finding in the selfcal has changed. Now
fit the full set of Gaussian parameters, and require contiguous
pixels for the islands.
* Small bug fixes.
* Parameter default changes:
- DO_MAKE_THUMBNAILS: default true
- DO_VALIDATION_SCIENCE: new, default true, to run cube validation.
- Snapshot imaging off by default, better image quality. Also, number of w-planes
has default value that changes with snapshot option: snapshot imaging has 99,
non-snapshot imaging has 599.
- Number of channels in MS tile exposed as a parameter for bandpass & science datasets,
taking the same default value as previously (54).
- "solver.Clean.solutiontype" parameter exposed as a pipeline parameter for all imaging
jobs.
- SB_JIRA_ISSUE replaced by JIRA_ANNOTATION_PROJECT for schedblock annotations
(askapops user only).

Applications:

* Selavy:
- Improved default values in Selavy HI catalogue,
and fixed bad NaN values.
- Fixed occasional dropping of components from the
catalogue through the application of acceptance criteria. Optional, and off by default.
- Fixed failing to calculate spectral indices in certain cases.
- Deconvolved sizes in the components catalogue now
calculated with better floating-point arithmetic, to avoid NaNs.
- VOTable catalogue column widths are more tightly
controlled, in line with the CASDA software.
* Imaging:
- Primary beam factory (used by linmos) able to handle elliptical
Gaussian beams. Not fully implemented within linmos yet.
- New gridder AltWProjectVisGridder that allows the dumping of
uvgrids to casa images.
- Added caching by channel in spectral-line imaging.
- Spectral-line imager correctly writes the beam log
when using multiple writers.
- Fixed issue with failed beam fitting for very elongated beams.

Available: 2019-02-05

Data time period: 2018-09-20 to ..

Subjects

User Contributed Tags    

Login to tag this record with meaningful keywords to make it easier to discover

Other Information
Copyright (c) 2018, Commonwealth Scientific and Industrial Research\nOrganisation (CSIRO) ABN 41 687 119 230. All rights reserved.

url : https://bitbucket.csiro.au/projects/CASSSOFT/repos/askapsoft/browse?at=refs%2Ftags%2FCP-0.22.0

Identifiers