RClone

License: ENT+ (Enterprise Edition or higher)
Plugin Type: File Action
Author: Diskover Data, Inc.

Overview

The RClone File Action provides a powerful framework for moving and copying data between storage systems directly from the Diskover web interface. By integrating with the popular rclone tool, this file action enables seamless transfers between local filesystems, network storage, and cloud providers—all without leaving Diskover.

Key Features

• Multi-Cloud Support — Transfer files to and from S3, Azure Blob Storage, Google Cloud Storage, SFTP, WebDAV, and dozens of other storage backends

• Metadata Preservation — Automatically preserves file ownership, permissions, and timestamps when transferring between compatible storage types

• Real-Time Progress Monitoring — Track transfer progress with percentage completion, bytes transferred, and visual progress bars

• Access Control — Administrators can configure allowlists to restrict which S3 buckets and local directories are available to users

• Batch Operations — Select multiple files and directories to transfer in a single operation

Use Cases

Data Administrators & IT Operations

• Migrate data from on-premises storage to cloud providers (S3, Azure, GCS) as part of cloud adoption initiatives

• Create backup copies of critical files to remote storage locations

• Archive infrequently accessed data to cold storage tiers

Media & Content Professionals

• Distribute large media files across multiple storage locations or geographic regions

• Move completed project files from working storage to long-term archive

General Business Users

• Copy important documents to approved backup locations

• Transfer files between departmental storage systems

Understanding Storage Remotes

The RClone file action works with pre-configured "remotes"—named connections to storage systems that your administrator has set up. Understanding the different types of remotes helps you know what to expect during transfers.

Common Remote Types

What is Metadata Preservation?

When you copy files between storage systems that support metadata preservation (like local-to-local or local-to-SFTP), the file's original ownership, permissions, and timestamps are maintained at the destination.

When copying to object storage like S3 or Azure Blob, only the file content is preserved—the original POSIX metadata (owner, group, permissions) cannot be stored because object storage systems don't support these attributes.

Requirements

Diskover Requirements

External Service Requirements

The RClone file action requires the rclone daemon service to be running on your Diskover task worker nodes. This is configured by your system administrator.

Note: If you encounter errors indicating the rclone service is unavailable, contact your system administrator.

Installation & Setup

The RClone file action is installed and configured by your system administrator. As an end user, you do not need to perform any installation steps.

Administrator Resources

System administrators should refer to the following resources for installation and configuration:

• Rclone Installation Guide — Official rclone installation documentation

• Rclone Remote Configuration — How to configure storage remotes

• Rclone Remote Control Setup — Setting up the rclone daemon service

Verifying Access

To confirm the RClone file action is available to you:

1. Log into Diskover and navigate to any indexed storage location

2. Select one or more files or directories

3. Click the File Action menu (or right-click for context menu)

4. Look for the RClone option (may be named "RClone Mover" or a custom name configured by your administrator)

If you don't see the RClone option, contact your administrator to verify:

• The file action is installed and enabled

• Your user account has permission to use this file action

• The rclone daemon service is running

Configuration

The RClone file action is configured by administrators through the Diskover Admin interface. The following settings control the file action's behavior:

Access Restrictions

Your administrator may have configured restrictions on which destinations you can access:

• S3 Bucket Restrictions — You may only see specific buckets that have been approved for your use

• Local Directory Restrictions — When browsing local storage, only approved top-level directories may be visible

If you need access to additional destinations, contact your system administrator.

Usage Guide

Basic Workflow

Follow these steps to transfer files using the RClone file action:

Step 1: Select Files

In the Diskover web interface, navigate to the files or directories you want to transfer. You can select items by:

• Clicking the checkbox next to individual files or directories

• Using Shift+Click to select a range

• Using the "Select All" option for bulk selection

Step 2: Launch the File Action

With your files selected, access the RClone file action:

1. Click the File Action button in the toolbar, or right-click for the context menu

2. Select the RClone option (the exact name depends on your administrator's configuration)

The RClone transfer interface will open, displaying your selected files.

Step 3: Select the Destination Remote

Choose where you want to transfer your files:

1. Use the Remote dropdown to select from available storage destinations

2. Common options include:

   • local — Local filesystem or mounted network storage

   • s3 or named S3 remotes — Amazon S3 or compatible object storage

   • Other remotes configured by your administrator (SFTP, Azure, etc.)

Step 4: Choose the Destination Path

After selecting a remote, specify exactly where the files should be placed:

For S3 and Object Storage:

1. Select the target bucket from the dropdown (only buckets you have access to will appear)

2. Browse or enter the destination path within the bucket

For Local and Filesystem Remotes:

1. Browse the directory structure to find your target location

2. Click folder names to navigate deeper into the hierarchy

3. Use the breadcrumb navigation to move back up

The current destination path is displayed in the path field.

Step 5: Start the Transfer

1. Review your selections:

   • Source files are listed at the top of the interface

   • Destination remote, bucket (if applicable), and path are shown

2. Click Copy (or Submit) to begin the transfer

The system will queue your transfer job and redirect you to the progress monitoring page.

Step 6: Monitor Progress

The Job Status page displays real-time progress for your transfer:

• Progress bars show completion percentage for each item

• Bytes transferred indicates how much data has been copied

• Total size shows the complete size of each transfer

• The page automatically refreshes to show updated progress

Step 7: Review Results

When the transfer completes:

• A success message confirms the operation finished

• Any errors or warnings are displayed

• You can navigate to the destination to verify your files

Common Tasks

Transferring a Single File

1. Select the file in Diskover

2. Launch the RClone file action

3. Choose your destination remote and path

4. Click Copy

Transferring Multiple Files to the Same Destination

1. Select all files you want to transfer (they can be from different directories)

2. Launch the RClone file action

3. All selected files will be listed as sources

4. Choose a single destination—all files will be copied there

5. Click Copy

Copying a Directory Structure

When you select a directory for transfer, the entire directory structure (including all subdirectories and files) is copied to the destination. The directory name becomes a folder at the destination path.

For example: Copying /data/project-alpha/ to destination path /archive/2024/ results in /archive/2024/project-alpha/ containing all the original contents.

Copying to Cloud Storage (S3)

1. Select your files in Diskover

2. Launch the RClone file action

3. Select an S3 remote from the dropdown

4. Choose the target bucket

5. Browse or enter the destination path within the bucket

6. Click Copy

Note: File metadata (owner, permissions) is not preserved when copying to S3 or other object storage—only the file content is transferred.

Troubleshooting

Common Issues

Debug Logging

If you need to report an issue to your administrator, they can find detailed logs in the following locations:

• Diskover Admin logs: /var/log/diskover/diskover-admin.log

• Celery/Task Worker logs: /var/log/celery/worker.log

• Rclone daemon logs: /var/log/rclone/rcd.log

• Web server logs: /var/log/nginx/error.log

Getting Help

If you encounter issues not covered here:

1. Note the exact error message displayed

2. Record what files you were trying to transfer and to which destination

3. Contact your system administrator with this information

Support

• Documentation: https://docs.diskoverdata.com

• Support Portal: https://support.diskoverdata.com

• Rclone Documentation: https://rclone.org/docs/

Last Updated: January 2026
Diskover Data, Inc.