Skip to content

File Operations

The Data Repository offers a comprehensive and user-friendly interface for managing your data assets. Through the * Actions* menu in the file browser, users can perform a wide range of file and folder operations that support everything from data ingestion and transformation to publishing and cleanup. These operations are designed to be intuitive yet powerful, enabling users of all technical levels to efficiently organize, process, and share their datasets.


Data Repository File Operations


📁 Folder & File Management

  • Add Folder
    Create a new folder in the current directory to organize files and group related datasets. Useful for maintaining a clean, hierarchical structure.

  • Upload Folders
    Upload entire directory trees from your local machine while preserving their internal folder structure. This is especially useful when migrating large datasets or pre-organized project files.

  • Add Files
    Upload one or more files into the selected directory. Supports batch uploads and handles large files seamlessly using the platform’s underlying scalable storage system.


🔁 Data Processing

  • Routines
    Execute predefined data processing routines directly on selected files. These routines can include transformations, validations, or computations, helping to standardize and automate common processing tasks.

  • Jobflows
    Launch complex, multistep workflows that may involve chaining several routines together. Jobflows allow users to model and execute sophisticated data pipelines with minimal manual intervention.


📂 File Organization

  • Move
    Relocate selected files or folders to a new destination within the repository. Ideal for re-structuring your dataset layout or organizing outputs post-processing.

🚀 Publishing and Sharing

  • Release
    Mark files or folders as publicly accessible. Once released, data can be shared with external users through direct links or APIs, enabling open collaboration and transparency.

  • Un-Release
    Revoke public access for previously shared files or folders. This option is useful when content needs to be retracted or made private again for compliance or accuracy.

  • Seal
    Lock a file or folder to prevent further edits, overwrites, or deletions. Sealing is commonly used to preserve finalized outputs, maintain data integrity, or enforce version control policies.

  • Unseal
    Remove the lock from a previously sealed file or folder, allowing changes to be made. This is useful when edits are required on data that was temporarily frozen.

  • Get Links
    Generate secure, shareable URLs for specific files or folders. These links can be distributed via email, embedded in documents, or used in third-party systems to provide direct data access.


🗑️ File Deletion

  • Delete
    Permanently remove one or more selected files or folders from the repository. Use with caution, as this action cannot be undone. Deleted content is irretrievable unless backups or versions exist.

💻 Terminal CLI Operations

In addition to the web interface, you can manage files and folders directly from your terminal using the accli tool.

Downloading (Copying) Data

To copy files or folders from the remote project space to your local machine:

bash
accli copy <remote-path>
  • Example:
    bash
    accli copy biodiversity_project/outputs/results.csv

Uploading Data

To upload files or folders from your local machine to a project space in the Data Repository:

bash
accli upload <project-slug> <local-path> <remote-destination>
  • Example:
    bash
    accli upload biodiversity_project ./my-data/ /data/uploads/