Data Store overview¶
CyVerse Data Store runs the Integrated Rule-Oriented Data System (iRODS) Open Source Data Management Software.
iRODS helps researchers, archivists, and others manage large, geographically dispersed computer files by providing a virtual filesystem, metadata catalog, and a rule engine to automate data management and enforce policies.
The Data Store is designed for storing, managing, and sharing your data throughout its entire lifecycle.
Integrated across all CyVerse platforms, the Data Store has high accessibility and connectivity.
The Data Store's features are aimed at helping you maintain data integrity and value, while making your data more FAIR (Findable, Accessible, Interoperable, and Reusable) with minimal effort.
This guide will walk you through the essential steps to get started, assuming you’ve already created a CyVerse account.
Data Management¶
There are several ways to access the Data Store. These methods vary in speed, flexibility, and technical knowledge required. Different methods may suit your needs for different projects at different times.
| Method | Access Point | OS | Upload/Download | Installation/Setup Required | Account Required | Max File Size |
|---|---|---|---|---|---|---|
| Discovery Environment | Web | Any | Both | No | Yes | 2GB/file upload, no limit for import |
| WebDAV | Web & Command line | Any | Both | No | Yes (No for public data) | No limit |
| GoCommands | Command line | Any | Both | Yes | Yes (No for public data) | No limit |
| iCommands | Command line | Linux & macOS | Both | Yes | Yes (No for public data) | No limit |
| SFTP | Desktop App & Command line | Any | Both | No (Yes for desktop app) | Yes (No for public data) | No limit |
This section covers each of the following data management methods:
- Discovery Environment: A comprehensive web-based platform for data analysis and management
- GoCommands: A lightweight, portable command-line tool for efficient data operations on any OS
- iCommands: A powerful command-line suite for advanced data management tasks on Linux
- SFTP: A secure file transfer protocol accessible via command-line or GUI applications on any OS
- WebDAV: A protocol extending HTTP for collaborative file management over the internet, usable on any OS
Additional resources for managing your data and team collaboration:
- Getting a DOI: Obtain a Digital Object Identifier (DOI) for a permanent and stable link to your data
- Checking Data Usage: Monitor your data usage and storage limits
- Team Access Management: Create and manage teams in the Data Store for collaborative work
The Data Store contents page lists every guide in this section.
Under the hood
The iRODS catalog, the SFTPGo and Apache/davrods (WebDAV) services, and the HAProxy entry point at data.cyverse.org are described in Data Store and Data Store administration in the CyVerse Developer Documentation.
Adapted from CyVerse Learning Materials (last source update 2025-04-01), CC BY 4.0. Spotted a problem? Open an issue.