Tech Talk: Intake - Taking the pain out of data access
Intake lets users easily load datasets in Python. In this Tech Talk, Aaron Spring from the Max Planck Institute for Meteorology will show how to use intake on the mistral supercomputer for loading locally available and remote data.
- https://www.dkrz.de/up/news-and-events/tech-talks/dkrz-tech-talk-intake-taking-the-pain-out-of-data-access
- Tech Talk: Intake - Taking the pain out of data access
- 2020-09-29T15:15:00+02:00
- 2020-09-29T16:15:00+02:00
- Intake lets users easily load datasets in Python. In this Tech Talk, Aaron Spring from the Max Planck Institute for Meteorology will show how to use intake on the mistral supercomputer for loading locally available and remote data.
- When
- Sep 29, 2020 from 03:15 PM to 04:15 PM (Europe/Berlin / UTC200)
- Add event to calendar
-
iCal
Most climate science workflows start with data access. Especially when working with observations, handling and aligning of metadata is a tedious and repetetive exercise.
In the scientific python ecosystem, intake lets you access datasets from pre-defined catalogs and loads them with xarray and dask. The data handling for a multi-model CMIP6 comparison analysis takes only 5 minutes with intake.
Contents:
- intake-esm on mistral
- intake-xarray for ICDC data: Catalog for Ocean data provided by Remon Sadikni
- intake-xarray for remote sources
Please find the video recording at https://youtu.be/urL17kRUinE
Please find the slides and notebooks to this talk on our gitlab server.
Document Actions