You are here: Home / News & Events / News / DKRZ Tech Talk: Pack'em ESMs! Tools for (un-)archiving Earth system model data

DKRZ Tech Talk: Pack'em ESMs! Tools for (un-)archiving Earth system model data

Oct 20, 2020

Dear users,

it is our great pleasure to announce next week’s Tech Talk. On Tuesday, Oct. 27, at 15:15, Daniel Heydebreck (DKRZ) and Karl-Hermann Wieners (MPI-M) will introduce packems - tools for (un-)archiving Earth system model data.

Archiving large amounts of data files via pftp to the HPSS (tape system) is time consuming and takes some manual work: (a) users have to aggregate small files in tar balls of 10 GB – 100 GB size; (b) operations with pftp are not handy to automatize. Additionally, the retrieval of small individual files, which have been archived via tar balls in the HPSS, is problematic if users do not remember which files was put into which tar ball. Many users might have experienced these issues.


That's why a new set of command line tools called "packems" is now being made available for all DKRZ users. These tools will simplify the archival and retrieval of data files to/from the HPSS – including the creation of tar balls and saving information on where which files are stored. The "packems" tool set is a joint development of the MPI-M and the DKRZ. It will be presented at the Tech Talk and will be available for usage afterwards on mistral via a module.


Please register by taking the poll at https://terminplaner2.dfn.de/dkrz-tech-talk-packems

Find all details at https://www.dkrz.de/up/news-and-events/tech-talks/tech-talk-archiving-with-packems.

A quick outlook:

On November 17, Philipp S Sommer from HzG will introduce the python-based data visualization framework psyplot
https://www.dkrz.de/up/de-news-and-events/de-tech-talks/de-tech-talk-visualizing-unstructured-grids-from-scripts-and-gui-with-psyplot

Future talks will be scheduled based on user requests and availability of speakers. You can find all information on past and upcoming talks at https://www.dkrz.de/p/tech-talks.

Best regards,
DKRZ

Document Actions

Filed under: