DeepExtremeCubes
Contributing person | Chaonan Ji | |
Contributing person | Miguel Mahecha | |
Contributing person | Guido Kraemer | |
Documentation of the data | - Self-describing Zarr Data - Complete documentation: https://arxiv.org/abs/2406.18179 - see DeepExtremesCubes_Access_v2.ipynb | |
Additional geographical or spatial references | Global | |
References to related material | https://arxiv.org/abs/2410.01770 | |
References to related material | https://arxiv.org/abs/2406.18179 | |
References to related material | https://essd.copernicus.org/preprints/essd-2024-396/ | |
Description of the data | This dataset is tailored to map around these extremes, focusing on persistent natural vegetation, and facilitate biosphere dynamics forecasting in response to the compound heatwave and drought extremes. It comprises over 40,000 globally sampled small data cubes (i.e. minicubes) in zarr format, with a spatial coverage of 2.5 by 2.5 km. Each minicube includes (i) Sentinel-2 L2A images, (ii) ERA5-Land variables and generated extreme event cube covering 2016 to 2022, and (iii) ancillary land cover and topography maps. | |
Type of the data | Dataset | |
Total size of the dataset | 2541048837002 | |
Author | Ji, Chaonan | |
Author | Fincke, Tonio | |
Author | Benson, Vitus | |
Author | Camps-Valls, Gustau | |
Author | Fernández-Torres, Miguel-Ángel | |
Author | Gans, Fabian | |
Author | Kraemer, Guido | |
Author | Martinuzzi, Francesco | |
Author | Montero, David | |
Author | Mora, Karin | |
Author | Pellicer-Valero, Oscar | |
Author | Robin, Claire | |
Author | Söchting, Maximilian | |
Author | Weynants, Melanie | |
Author | Mahecha, Miguel | |
Upload date | 2024-12-19T18:15:30Z | |
Publication date | 2024-12-19T18:15:30Z | |
Data of data creation | 2023 | |
Publication date | 2024-12-19 | |
Abstract of the dataset | With climate extremes' rising frequency and intensity, robust analytical tools are crucial to predict their impacts on terrestrial ecosystems. Machine learning techniques show promise but require well-structured, high-quality, and curated analysis-ready datasets. Earth observation datasets comprehensively monitor ecosystem dynamics and responses to climatic extremes, yet the data complexity can challenge the effectiveness of machine learning models. Despite recent progress in deep learning to ecosystem monitoring, there is a need for datasets specifically designed to analyse compound heatwave and drought extreme impact. Here, we introduce the DeepExtremeCubes database, tailored to map around these extremes, focusing on persistent natural vegetation. It comprises over 40,000 globally sampled small data cubes (i.e. minicubes), with a spatial coverage of 2.5 by 2.5 km. Each minicube includes (i) Sentinel-2 L2A images, (ii) ERA5-Land variables and generated extreme event cube covering 2016 to 2022, and (iii) ancillary land cover and topography maps. The paper aims to (1) streamline data accessibility, structuring, pre-processing, and enhance scientific reproducibility, and (2) facilitate biosphere dynamics forecasting in response to compound extremes. | |
Public reference to this page | https://opara.zih.tu-dresden.de/handle/123456789/1186 | |
Public reference to this page | https://doi.org/10.25532/OPARA-703 | |
Publisher | Universität Leipzig | |
Licence | Attribution 4.0 International | en |
URI of the licence text | http://creativecommons.org/licenses/by/4.0/ | |
Specification of the discipline(s) | 3::34::313::313-01 | |
Specification of the discipline(s) | 2::21::202::202-02 | |
Specification of the discipline(s) | 4::44::409::409-05 | |
Specification of the discipline(s) | 3::34::315 | |
Title of the dataset | DeepExtremeCubes | |
Research instruments | ERA5 | |
Research instruments | Sentinel 2 | |
Research instruments | Landsat | |
Research instruments | ESA CCI | |
Research instruments | Copernicus DEM | |
Underlying research object | Extreme Events | |
Software | Zarr | |
Software | https://github.com/DeepExtremes/minicube-generation | |
Software | python | |
Project abstract | Climate extremes are on the rise, which is one of the most critical manifestations of climate change. Compound events can drive a combination of spatial and/or temporal hazards, and the instantaneous effect and long-term impact on society and the environment are typically much higher than a single event on its own. However, the multi-dimensional nature of compound events leads to a series of methodological challenges. The Deep-Extremes project aims at - Focusing on compound heat and drought events on a global scale, detecting based on long-term climate and land-surface data, combining EO archives and other observation data, with methods tailored to multivariate event detection. - Sampling a subset of large events in the Sentinel era and zooming into the events and in unaffected areas around the event with high-dimensional “mini-cubes”. - Training complementary deep-learning methods for prediction and understanding dynamics in such events. - Implementing the tested and validated workflow in a cloud environment and developing it further based on community feedback. - Engaging with the community via workshops and science discussions to further develop the proposed framework. The project is funded by the European Space Agency (ESA), part of the AI4SCIENCE activity. The first AI4SCIENCE ITT focuses on Extreme Events, Multi-Hazards and Compound Events, and contributes to the ESA Extremes and Natural Disasters Science Cluster. | |
Public project website(s) | https://eo4society.esa.int/projects/deep-extremes/ | |
Public project website(s) | https://rsc4earth.de/project/deepextremes/ | |
Public project website(s) | https://opensciencedata.esa.int/projects/deep-extremes/collection | |
Project title | DeepExtremes |
Files
Original bundle
- Name:
- Africa.zip
- Size:
- 371.19 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in Africa. md5sum 11e6360b65f51adff7dd4be4ca0b4586 Africa.zip
- Name:
- Asia.zip
- Size:
- 519.85 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in Asia. md5sum 805f3022c4d1b2d6924a31b3a19a82ae Asia.zip
- Name:
- DeepExtremesCubes_Access_v2.ipynb
- Size:
- 1 MB
- Format:
- Unknown data format
- Description:
- Example notebook showing how to access the data. md5sum 3d0bd700b2a147b5ded0f6063d1265e8 DeepExtremesCubes_Access_v2.ipynb
- Name:
- Europe.zip
- Size:
- 499.95 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in
- Name:
- example.zip
- Size:
- 67.98 MB
- Format:
- Unknown data format
- Description:
- Contains a single cube for testing access. md5sum 133131eb0192d5482a8746e1392cdaa8 example.zip
- Name:
- mc_registry_v6.csv
- Size:
- 16.66 MB
- Format:
- Comma-Separated Values
- Description:
- Contains extra metadata on the cubes. 58d20476e5533976125bccd3526c5437 mc_registry_v6.csv
- Name:
- North_America.zip
- Size:
- 467.62 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in North America. md5sum 8e456df98a1532d7aa279e7ec738d3a9 North_America.zip
- Name:
- Oceania.zip
- Size:
- 43.25 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in Oceania. md5sum 489e5ed4f430f2405723c02abb779753 Oceania.zip
- Name:
- South_America.zip
- Size:
- 463.9 GB
- Format:
- Unknown data format
- Description:
- Contains all cubes located in South America. md5sum 902c4d0bb4daf62ef86ae28cfe1b92eb South_America.zip
License bundle
- Name:
- license.txt
- Size:
- 4.66 KB
- Format:
- Item-specific license agreed to upon submission
- Description: