PowerScale | Moving Data Between Storage Locations Without a SmartPools License

A user wants to move specific data from its current location to a different storage pool (implying a distinct node group or tier) within a cluster. However, the system does not have an active SmartPools license, which is required for such policy-driven data movement.

Cause: 
OneFS SmartPools is a licensed software module designed to enable automated, policy-driven data tiering and movement between defined node pools and tiers within a single PowerScale cluster. Without it, OneFS manages all node pools as a single, unified storage pool.

In this unlicensed configuration, policy-based data movement between specific user-defined tiers or node pools based on file attributes is not possible. Instead, all files belong to the default file pool and the default file pool policy governs them.

What Is SetProtectPlus, and How to Run It:
SetProtectPlus job is an internal OneFS job that runs specifically when a SmartPools license is not active. Its purpose is to apply the cluster's default file policy settings. It does not enable manual selection of a target node pool for data migration based on file content or path, as that requires SmartPools. This job ensures that files conform to the cluster's default protection and I/O optimization settings. It does not allow you to specify a particular node pool or tier to move data to; rather, it ensures that data is managed according to the cluster-wide default distribution across all available nodes, which the Auto-Balance job then works to make balanced.

Steps to Run the SetProtectPlus Job:

1. Establish SSH Connection: Connect to any node in your PowerScale cluster by SSH.
2. Check SmartPools License Status (Optional but Recommended for Clarity): Confirm that SmartPools is indeed not licensed.
3. Expected Output Example (SmartPools not listed or status is 'Inactive' ' Unlicensed '):  
4. The isi license list command can show the activation status of various modules, including SmartPools.
5. Review and Configure Default File Pool Policy (If Needed): While SetProtectPlus applies the default policy, it is necessary to understand that the default policy's "disk pool policy" (data storage target) cannot be changed to a specific node pool without a SmartPools license. It always defaults to "anywhere" or similar, meaning data is spread across all available disk pools. You can view its current settings for protection and I/O optimization.
   1. This command displays the current default file pool policy settings: isi filepool default-policy view

6. Start the SetProtectPlus Job:
   1. This command initiates the SetProtectPlus job, which applies the default file policy across the cluster.

isi job start SetProtectPlus 

7. Monitor the Job Progress: To see all running jobs, To view details of the SetProtectPlus job (replace <JobID> with the true job ID from the below command):

isi job view <job ID>

Option 2: Manual Data Copy
Manual Data Copy (File Relocation): This is the most direct way to "move" data to a different logical path within the cluster. This new path might reside on a specific set of nodes if your cluster consists of different hardware types and you have logically organized directory structures (even without SmartPools). When a file is copied, the new copy is written according to the current storage allocation rules of OneFS. Without SmartPools, this means that the data is striped across the entire cluster, and its ultimate physical placement is managed by the Auto-Balance job for even distribution.

Steps for Manual Copy by Command-Line Interface (CLI):

1. Establish SSH Connection: Connect to any node in your PowerScale cluster using a secure shell (SSH) client.
2. Identify Source and Destination Paths: Determine the full path of the data that you intend to move (/ifs/source_data/file.txt) and the full path of the target directory where you want the new copy to reside (/ifs/destination_pool/new_data/).

3. Perform the Copy Operation: Use the cp command to copy the data.

   • For individual files: 

     cp /ifs/source_data/file.txt  /ifs/destination_pool/new_data

   • For directories (including contents): Use the -r (recursive) option 

     cp -r /ifs/source_data/ /ifs/destination_pool/new_data

4. Verify the Copy: After the copy operation completes, verify that the data has been successfully copied and is accessible in the new location.
5. Delete Original Data (Optional, but free space): Once you have thoroughly verified that the data is correctly copied and accurate, and accessible in its new location, you can delete the original data to reclaim the space

Important Considerations and Limitations:

• No Policy-Based Tiering Without SmartPools: The SetProtectPlus job enforces the default file policy across the entire unified storage pool of the cluster. It cannot perform policy-based data tiering or migration to a specific "another data pool" (node pool or tier) based on file attributes or paths. This functionality is exclusive to the SmartPools license.

• Automatic Rebalancing: Without a SmartPools license, the Auto-Balance job (or Multi-Scan) is continually working in the background to spread data evenly across all available nodes and disk pools, ensuring a balanced distribution of data.

• Default Policy Scope: The default file pool policy (applied by SetProtectPlus when SmartPools is unlicensed) allows setting protection and I/O optimization settings, but the disk pool policy (specifying a target node pool) cannot be changed; it targets "anywhere" on the cluster.

• Impact on Performance: While SetProtectPlus is a background job, running any job can consume cluster resources. It is recommended to ensure cluster capacity utilization (hard drive and SSD) remains below 90% for optimal performance and sufficient space to reprotect data in drive failures.

• SmartPools License Value: For organizations with heterogeneous storage requirements that need granular control over data placement, automated tiering, or the ability to separate data onto different types of storage nodes (performance vs. archive tiers), acquiring a SmartPools license is highly recommended. It enables automated data placement based on defined policies, optimizing storage utilization, improving performance, and simplifying long-term data management without the need for manual copy workarounds.

• CloudPools Dependency: CloudPools, which allows tiering data to external cloud storage, is built upon the SmartPools file pool policy framework and thus explicitly requires both a SmartPools and CloudPools license