Skip to content

Manage your data using SFTP

SFTP (Secure File Transfer Protocol) is a widely adopted network protocol for secure file transfer and management. It operates over an encrypted communication channel, ensuring safe data exchange between the client and server. With broad compatibility across various environments, SFTP offers a flexible and reliable solution for managing data.

This guide covers how to configure SFTP clients to efficiently manage your data in the Data Store.


Limitations

Using SFTP for File Transfers

SFTP is ideal for transferring small files or small collections of files. While there is no strict size limit, it is not recommended for files larger than 10 GiB due to performance issues.

Alternatives for Large Files

For large files or extensive datasets, consider using GoCommands or iCommands instead. These tools offer better performance and efficiency for handling large data transfers.

For more details on GoCommands and iCommands, visit their respective documentation pages: - GoCommands - iCommands

The SFTP contents page lists the client guides and configuration pages in this section.


Acknowledgments

The SFTP functionality for the Data Store is powered by SFTPGo, an open-source, fully featured, and highly configurable SFTP server created by Nicola Murino. SFTPGo supports various storage backends, including local filesystems, S3 Object Storage, Google Cloud Storage, and Azure Blob Storage. CyVerse extended SFTPGo's capabilities by implementing a new backend module specifically for iRODS, enabling SFTP access to the Data Store. We extend our gratitude to Nicola Murino and the SFTPGo project for making this integration possible.

Under the hood

SFTP access is served by SFTPGo with a custom iRODS storage backend, behind the same data.cyverse.org entry point as the other Data Store services; see Data Store and Data Store administration in the CyVerse Developer Documentation.

Adapted from CyVerse Learning Materials (last source update 2025-09-19), CC BY 4.0. Spotted a problem? Open an issue.