Manage your data using SFTP¶
SFTP (Secure File Transfer Protocol) is a widely adopted network protocol for secure file transfer and management. It operates over an encrypted communication channel, ensuring safe data exchange between the client and server. With broad compatibility across various environments, SFTP offers a flexible and reliable solution for managing data.
This guide covers how to configure SFTP clients to efficiently manage your data in the Data Store.
Limitations¶
Using SFTP for File Transfers
SFTP is ideal for transferring small files or small collections of files. While there is no strict size limit, it is not recommended for files larger than 10 GiB due to performance issues.
Alternatives for Large Files
For large files or extensive datasets, consider using GoCommands or iCommands instead. These tools offer better performance and efficiency for handling large data transfers.
For more details on GoCommands and iCommands, visit their respective documentation pages: - GoCommands - iCommands
The SFTP contents page lists the client guides and configuration pages in this section.
Acknowledgments¶
The SFTP functionality for the Data Store is powered by SFTPGo, an open-source, fully featured, and highly configurable SFTP server created by Nicola Murino. SFTPGo supports various storage backends, including local filesystems, S3 Object Storage, Google Cloud Storage, and Azure Blob Storage. CyVerse extended SFTPGo's capabilities by implementing a new backend module specifically for iRODS, enabling SFTP access to the Data Store. We extend our gratitude to Nicola Murino and the SFTPGo project for making this integration possible.
Under the hood
SFTP access is served by SFTPGo with a custom iRODS storage backend, behind the same data.cyverse.org entry point as the other Data Store services; see Data Store and Data Store administration in the CyVerse Developer Documentation.
Adapted from CyVerse Learning Materials (last source update 2025-09-19), CC BY 4.0. Spotted a problem? Open an issue.