You are here: Home / Communication / News archive / Data collections for climate research available at DKRZ

Data collections for climate research available at DKRZ

Mar 26, 2020

DKRZ provides the available ERA5 data as well as core data sets from well-known internationally Coordinated Model Intercomparison Projects such as CMIP or CORDEX for easy access and efficient processing on the parallel file system. As a result, DKRZ users do not need to transfer and store these data collections by themselves - a benefit that might influence the upcoming requests for DKRZ resources.

ERA5 data at DKRZ

In the context of the ERA5 reanalysis project, the European Centre for Medium-Range Weather Forecasts (ECMWF) in Reading, Great Britain, has by now processed the time period from 1979 onwards. In recent years, DKRZ has completely transferred these data to Hamburg. So far, a total of about 690 Terabytes have been transferred, of which about three quarters are accounted for by the parameter values on the 137 model levels. The current state of the ERA5 data transfer can be monitored via https://modvis.dkrz.de/bm0146/ERA5/statusE5.html.

The data itself can be accessed on the supercomputer Mistral (mistral.dkrz.de at /pool/data/ERA5). A total data volume of about 1.3 Petabytes covering the time period from 1950 to today is expected and will be available on the DKRZ file system.

At present, the data transfer from Reading has come to a standstill because the period from 1950 to 1978, whose completion was anounced for autumn 2019, will probably take some more months after all. As soon as the data is available, DKRZ will continue with the transfer.

The data of the previous ECMWF reanalysis projects (ERA40 and ERA Interim) are of course still available. Information on the general availability of ERA data can be found on the DKRZ website: https://www.dkrz.de/up/services/data-management/projects-and-cooperations/era/era.

The EU-funded ERA5 data are not subject to any particular access restrictions. Similarly, there are no concerns regarding the transfer of the data, however, please make sure that the licence text is cited, which can be obtained from the ECMWF: https://apps.ecmwf.int/datasets/licences/copernicus/ (item 5). The licence text is also contained in the README file on the DKRZ file system.

Example of ERA5 data sets: shown is the temperature anomaly of the ERA5 data relative to the period of 1981-2010 (Copyright: ECMWF). The data set is available in the ERA5 data pool at DKRZ.

The CMIP data pool at DKRZ

DKRZ users on the look for easily accessible CMIP, CORDEX or other model comparison project data sets can easily find and efficiently process them at DKRZ. Such data sets are also kept at DKRZ, are constantly updated and made available to DKRZ users via the so-called CMIP data pool. This is a dedicated area on the Mistral file system of approximately 2 Petabytes in size which is accessible to all users – very similar to the ERA5 data pool. Currently, DKRZ holds large-volume collections of standardised CMIP3/5/6, CORDEX and ReKliEs-De data. Further: www.dkrz.de/up/services/data-management/cmip-data-pool/

Example of CMIP data sets: shown is the global mean surface temperature using the MPI model for CMIP5 and CMIP6. The data set is available in the CMIP data pool at DKRZ.

By providing these data via the DKRZ file system, substantially more time can be spent on the actual analysis of the data and a more efficient use of the limited disk space is achieved by avoiding double data storage. The CMIP licences allow the unrestricted access to the published data. The data source has to be appropriately referenced (CC BY, CC BY-SA, creativecommons.org). Further information regarding citation and acknowledgement guidelines are given on the DKRZ webpages (see above).

If you have any questions regarding these data sets, please contact .

Document Actions