Sie sind hier: Startseite / Services / Data Analysis and Visualization / Data Transfer
Info
Alle Inhalte des Nutzerportal sind nur auf Englisch verfügbar.

Data Transfer

Depending on the specific data transfer requirements users can rely on a variety of methods to move data from/to DKRZ systems as well as between DKRZ systems. Below we give a short overview on the recommended data transfer tools and protocols.

The table below lists a selection of data transfer tools available on Mistral and provides links to pages that introduce them in more detail.

ToolDescription
GridFTP GridFTP is a powerful, secure and reliable data transfer protocol optimized for transfer of large data sets. The most popular implementation is being developed as part of the Globus Toolkit, a bundle of tools for grid computing.
rsync Sophisticated tool for data transfer. Rsync is widely used for synchronisation of remote or local directories (e.g. backups, mirroring) and as an enhanced copy command. It employs delta-transfer algorithm to send only differences between source files and existing destination files.
scp, sftp Basic transfer tools that use SSH protocol to copy data between remote machines.
lftp Command line client for file transfer that supports several network protocols (e.g. FTP(S), HTTP(S), SFTP). LFTP provides mirroring capabilities, which can be used to download, upload or update a complete directory tree.
pftp Wrapper script for pftp_client connection to DKRZ HPSS tape archive from mistral.
swift Command line tool to copy data to/from DKRZ Cloud Storage. Particularly suitable for upload and download of large data sets.
wget, curl Tools for client-side URL transfers. Mainly used for recursive download of data from servers over HTTP or HTTPS.

Artikelaktionen