This blog focuses on CloudPools reporting, specifically:

• CloudPools network stats
• The isi_fsa_pools_usage feature

CloudPools network stats

Dell PowerScale CloudPools network stats collect every network transaction and provide network activity statistics from CloudPools connections to the cloud storage.

Displaying network activity statistics

The network activity statistics include bytes In, bytes Out, and the number of GET, PUT, and DELETE operations. CloudPools network stats are available in two categories:

• Per CloudPools account
• Per file pool policy

Note: CloudPools network stats do not provide file statistics, such as the file list being archived or recalled.

Run the following command to check the CloudPools network stats by CloudPools account:

isi_test_cpool_stats -Q --accounts <account_name>

For example, the following command shows the current CloudPools network stats by CloudPools account:

isi_test_cpool_stats -Q --accounts testaccount
Account Name   Bytes In    Bytes Out   Num Reads   Num Writes   Num Deletes
testaccount    4194896000  4194905034  4000        2001         8001  

Similarly, you can run the following command to check the CloudPools network stats by file pool policy:

isi_test_cpool_stats -Q --policies <policy_name>

And here is an example of current CloudPools network stats by file pool policy:

isi_test_cpool_stats -Q --policies testpolicy
Policy Name    Bytes In       Bytes Out      Num Reads      Num Writes
testpolicy     4154896000     4154905034     4000           2001

Note: The command output does not include the number of deletes by file pool policy.

Run the following command to check the history for CloudPools network stats:

isi_test_cpool_stats -q –s <number of seconds in the past to start stat query>

Use the s parameter to define the number of seconds in the past. For example, set it as 86,400 to query CloudPools network stats over the last day, as in the following example:

isi_test_cpool_stats -q -s 86400
Account          bytes-in     bytes-out    gets   puts   deletes
testaccount    | 4194896000 | 4194905034 | 4000 | 2001 | 8001

You can also run the following command to flush stats from memory to database and get the real-time CloudPools network stats:

isi_test_cpool_stats -f

Displaying stats for CloudPools activities

The cloud statistics namespace with CloudPools is added in OneFS 9.4.0.0. This feature leverages existing OneFS daemons and systems to track statistics about CloudPools activities. The statistics include bytes In, bytes Out, and the number of Reads, Writes, and Deletions. CloudPools statistics are available in two categories:

• Per CloudPools account
• Per file pool policy

Note: The cloud statistics namespace with CloudPools does not provide file statistics, such as the file list being archived or recalled.

You can run these isi statistics cloud commands to view statistics about CloudPools activities:

isi statistics cloud --account <account_name>
isi statistics cloud --policy <policy_name>

The following command shows an example of current CloudPools statistics by CloudPools account:

isi statistics cloud --account s3                    
Account Policy In      Out     Reads   Writes  Deletions       Cloud      Node
s3             218.5KB 218.7KB 1       2       0               AWS        3
s3             0.0B    0.0B    0       0       0               AWS        1
s3             0.0B    0.0B    0       0       0               AWS        2

The following command shows an example of current CloudPools statistics by file pool policy:

isi statistics cloud --policy s3policy        
Account Policy         In      Out     Reads   Writes  Deletions  Cloud       Node
s3      s3policy       218.5KB 218.7KB  1      2       0          AWS         3
s3      s3policy       0.0B    0.0B     0      0       0          AWS         1
s3      s3policy       0.0B    0.0B     0      0       0          AWS         2

The isi_fsa_pools_usage feature

Starting from OneFS 8.2.2, you can run the following command to list Logical Size and Physical Size of stubs in one directory. This feature leverages IndexUpdate and FSA (File System Analytics) jobs. To enable this feature, it requires:

• Scheduling the IndexUpdate job. It’s recommended to run it every four hours.
• Scheduling the FSA job. It’s recommended to run it every day, but not more often than the IndexUpdate job.

isi_fsa_pools_usage /ifs
Node Pool                  Dirs  Files  Streams  Logical Size   Physical Size
Cloud                      0     1       0       338.91k           24.00k
h500_30tb_3.2tb-ssd_128gb  42    300671  0       879.23G            1.20T

Now, you get how to use commands for CloudPools reporting. It’s simple and straightforward. Thanks for reading!

Author: Jason He, Principal Engineering Technologist