Data

Daytime Cloud Mask for Himawari-8/9 (HIM-CLD-Day_Mask)

Terrestrial Ecosystem Research Network
Qin, Yi ; McVicar, Tim R ; Bridgart, Robert ; Prata, Andrew ; Cai, Dejun ; Dino, Aarond ; Van Niel, Thomas G
Viewed: [[ro.stat.viewed]] Cited: [[ro.stat.cited]] Accessed: [[ro.stat.accessed]]
ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rfr_id=info%3Asid%2FANDS&rft_id=http://geonetwork.tern.org.au/geonetwork/srv/eng/catalog.search#/metadata/43e8e458-ea91-478d-9539-ef4d4645af76&rft.title=Daytime Cloud Mask for Himawari-8/9 (HIM-CLD-Day_Mask)&rft.identifier=http://geonetwork.tern.org.au/geonetwork/srv/eng/catalog.search#/metadata/43e8e458-ea91-478d-9539-ef4d4645af76&rft.publisher=Terrestrial Ecosystem Research Network&rft.description=This cloud mask collection was generated for daytime Himawari-8/9 imagery using a newly developed algorithm by CSIRO (Commonwealth Scientific and Industrial Research Organisation), collaboratively among research teams, for the Australian continent and surrounding waters. The product was extensively validated against space-borne LiDAR to ensure its quality. The product is provided here in a regular latitude/longitude grid. It is also available in the original Himawari (geostationary) projection (WGS84, sub-satellite longitude = 140.7°E and satellite altitude = 35785863 meters). Please contact the authors for accessing the data, which is located on the Australian National Computational Infrastructure (NCI). Currently, a near-real-time algorithm/processor is being developed to improve data availability, and to extend production to Himawari-10 (2028-2045).This cloud mask collection was generated using an algorithm independently developed by CSIRO based on a time-series analysis approach. A previous version applied to Advanced Along-Track Scanning Radiometer (AATSR) imagery (European Space Agency, Dual-View polar orbiting scanner) showed good performance (Qin et al., 2015). On this basis, the algorithm was improved and adapted to the Himawari series. The cloud mask data was validated extensively against the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument aboard the CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation) satellite over nearly 6 years with over 200 million match-up samples. The validation demonstrated that the product provided cloud masking at an overall accuracy of 98% for all clouds; See Qin et al. (2019) for full details.  Progress Code: onGoingMaintenance and Update Frequency: annually&rft.creator=Qin, Yi &rft.creator=McVicar, Tim R &rft.creator=Bridgart, Robert &rft.creator=Prata, Andrew &rft.creator=Cai, Dejun &rft.creator=Dino, Aarond &rft.creator=Van Niel, Thomas G &rft.date=2026&rft.edition=1.0&rft.coverage=Australia&rft.coverage=northlimit=-10; southlimit=-45; westlimit=112; eastLimit=154; projection=EPSG:4326&rft_rights=Creative Commons Attribution 4.0 International Licence http://creativecommons.org/licenses/by/4.0&rft_rights=TERN services are provided on an as-is and as available basis. Users use any TERN services at their discretion and risk. They will be solely responsible for any damage or loss whatsoever that results from such use including use of any data obtained through TERN and any analysis performed using the TERN infrastructure. <br />Web links to and from external, third party websites should not be construed as implying any relationships with and/or endorsement of the external site or its content by TERN. <br /><br />Please advise any work or publications that use this data via the online form at https://www.tern.org.au/research-publications/#reporting&rft_rights=Please cite this dataset as {Author} ({PublicationYear}). {Title}. {Version, as appropriate}. Terrestrial Ecosystem Research Network. Dataset. {Identifier}.&rft_subject=climatologyMeteorologyAtmosphere&rft_subject=environment&rft_subject=imageryBaseMapsEarthCover&rft_subject=CLOUD PROPERTIES&rft_subject=EARTH SCIENCE&rft_subject=ATMOSPHERE&rft_subject=CLOUDS&rft_subject=TERRESTRIAL ECOSYSTEMS&rft_subject=BIOSPHERE&rft_subject=Atmospheric Radiation&rft_subject=EARTH SCIENCES&rft_subject=ATMOSPHERIC SCIENCES&rft_subject=Photogrammetry and Remote Sensing&rft_subject=ENGINEERING&rft_subject=GEOMATIC ENGINEERING&rft_subject=Himawari-8&rft_subject=Himawari-9&rft_subject=Advanced Himawari Imager&rft_subject=Cloud-Aerosol Lidar with Orthogonal Polarization&rft_subject=cloud mask (Unitless)&rft_subject=Unitless&rft_subject=1 km - < 10 km or approximately .01 degree - < .09 degree&rft_subject=1 minute - < 1 hour&rft.type=dataset&rft.language=English Access the data

Licence & Rights:

Open Licence view details
CC-BY

Creative Commons Attribution 4.0 International Licence
http://creativecommons.org/licenses/by/4.0

TERN services are provided on an "as-is" and "as available" basis. Users use any TERN services at their discretion and risk. They will be solely responsible for any damage or loss whatsoever that results from such use including use of any data obtained through TERN and any analysis performed using the TERN infrastructure.
Web links to and from external, third party websites should not be construed as implying any relationships with and/or endorsement of the external site or its content by TERN.

Please advise any work or publications that use this data via the online form at https://www.tern.org.au/research-publications/#reporting

Please cite this dataset as {Author} ({PublicationYear}). {Title}. {Version, as appropriate}. Terrestrial Ecosystem Research Network. Dataset. {Identifier}.

Access:

Open view details

unclassified

Contact Information

Street Address:
Terrestrial Ecosystem Research Network
Building 1019, 80 Meiers Rd
QLD 4068
Australia
Ph: +61 7 3365 9097

[email protected]

Brief description

This cloud mask collection was generated for daytime Himawari-8/9 imagery using a newly developed algorithm by CSIRO (Commonwealth Scientific and Industrial Research Organisation), collaboratively among research teams, for the Australian continent and surrounding waters. The product was extensively validated against space-borne LiDAR to ensure its quality. The product is provided here in a regular latitude/longitude grid. It is also available in the original Himawari (geostationary) projection (WGS84, sub-satellite longitude = 140.7°E and satellite altitude = 35785863 meters). Please contact the authors for accessing the data, which is located on the Australian National Computational Infrastructure (NCI). Currently, a near-real-time algorithm/processor is being developed to improve data availability, and to extend production to Himawari-10 (2028-2045).

Notes

Supplemental Information

Binary mask, 0 = cloud absent (clear) and 1 = cloud present. The binary mask is 1 if there is any non-zero amount of cloud in the pixel. A separate confidence variable is provided to specify how confidently the cloud mask is determined. This product is for day time only (when solar zenith angle is less than 75 degrees). (currently defined so that accuracy at cloudy and clear condition is balanced. examples using confidence).

Lineage

This cloud mask collection was generated using an algorithm independently developed by CSIRO based on a time-series analysis approach. A previous version applied to Advanced Along-Track Scanning Radiometer (AATSR) imagery (European Space Agency, Dual-View polar orbiting scanner) showed good performance (Qin et al., 2015). On this basis, the algorithm was improved and adapted to the Himawari series. The cloud mask data was validated extensively against the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) instrument aboard the CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation) satellite over nearly 6 years with over 200 million match-up samples. The validation demonstrated that the product provided cloud masking at an overall accuracy of 98% for all clouds; See Qin et al. (2019) for full details.

 

Progress Code: onGoing
Maintenance and Update Frequency: annually

Notes

Credit
We at TERN acknowledge the Traditional Owners and Custodians throughout Australia, New Zealand and all nations. We honour their profound connections to land, water, biodiversity and culture and pay our respects to their Elders past, present and emerging.

We at the Terrestrial Ecosystem Research Network (TERN) acknowledge the Traditional Owners and Custodians throughout Australia, New Zealand and all nations. We honour their profound connections to land, water, biodiversity and culture and pay our respects to their Elders past, present and emerging.

This work was funded by TERN, an Australian Government NCRIS (National Collaborative Research Infrastructure Strategy) enabled project, and is supported using TERN infrastructure. The research was undertaken at CSIRO (Commonwealth Scientific and Industrial Research Organisation) collaboratively among research units (Environment, Energy, Agriculture and Food). The authors acknowledge the resources and services received from NCI and CSIRO HPC (High Performance Computing). We appreciate the support by Japan Meteorology Agency (JMA) and Australian Bureau of Meteorology (BoM) in providing Himawari data.

 

Purpose

The Himawari satellite series offers a unique opportunity to monitor sub-daily processes on Earth and in its atmosphere over Asia and Oceania, due to its unprecedented 10-minute temporal resolution as well as improved spatial and spectral resolutions compared to the previous generations of Japanese geostationary satellites and sensors (i.e., MTSAT series), which Australian researchers are kindly provided access through a JMA-BoM agreement.

However, almost all applications of optical remote sensing data, such as that of the Himawari series, require reliable cloud masking. This product provides a high-quality cloud mask for daytime Himawari imagery, enabling improved applications of daytime Himawari data. Due to its high temporal frequency, this product can also be used to cloud-mask other optical remote sensing imagery of compatible spatial resolution (i.e., >= 500 m pixel resolutions).

Data Quality Information

Data Quality Assessment Scope
local : dataset
This cloud mask collection was evaluated against space-borne LiDAR CALIPSO (CALIOP 1 km cloud layer version 4.20 dataset) from July 2015 to March 2021, with over 200 million match-up samples.

Cloud cover in the Australian region: Development and validation of a cloud masking, classification and optical depth retrieval algorithm for the Advanced Himawari Imager.
doi : https://doi.org/10.3389/fenvs.2019.00020

Data Quality Assessment Result
local : Quality Result
<p>The overall accuracy is 98% as compared to CALIPSO, for clear sky and all clouds.</p>

Created: 2025-11-24

Issued: 2026-01-11

Modified: 2026-01-11

Data time period: 2015-07-01

This dataset is part of a larger collection

Click to explore relationships graph

154,-10 154,-45 112,-45 112,-10 154,-10

133,-27.5

text: Australia

Other Information
Point-of-truth metadata URL

uri : https://geonetwork.tern.org.au/geonetwork/srv/eng/catalog.search#/metadata/43e8e458-ea91-478d-9539-ef4d4645af76

Qin, Y., Steven, A.D.L., Schroeder, T., McVicar, T.R., Huang, J., Cope, M. and Zhou, S.Z. (2019) Cloud cover in the Australian region: Development and validation of a cloud masking, classification and optical depth retrieval algorithm for the Advanced Himawari Imager. Frontiers in Environmental Science. 7(20)

doi : https://doi.org/10.3389/fenvs.2019.00020