PowerScale OneFS 9.8.0.0 Web Administration Guide

System jobs library

OneFS contains a library of system jobs that run in the background to help maintain your PowerScale cluster.

By default, system jobs are categorized as either manual or scheduled. You can run any job manually, and you can create a schedule for most jobs according to your workflow. Some jobs are automatically started by other services in OneFS, like the snapshotdelete job. Typically such jobs have mandatory input arguments, such as the Treedelete job. In addition, OneFS starts some jobs automatically when particular system conditions arise. For example, FlexProtect or FlexProtectLin start when a drive is smartfailed and there is no down device, to allow the job to reprotect the data.

The lower the priority value, the higher the job priority. For example, a job with priority value 1 has a higher priority than a job with priority value 2 or higher.

The default protection, +2:+1, enables all jobs to run during a scan if there is no more than one failed device in each disk pool. (FlexProtect ad FlexProtectLin continue to run even if there are failed devices.) OneFS does not check file protection. If you have files with no protection setting, the job can fail.

Table 1. System job libraryLists the available system jobs
Job name	Description	Exclusion Set	Impact Policy	Priority	Operation
AutoBalance AutoBalanceLin	Rebalances disk space usage in a disk pool. OneFS checks the jobs.common.lin_based_jobs setting to determine whether to run AutoBalance (FALSE) or AutoBalanceLin (TRUE). JobEngine starts a rebalance job if there is an imbalance of 5% of more between any two drives in the same disk pool. If MultiScan is enabled, AutoBalance or AutoBalanceLin are run as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster. If none of these jobs are enabled, no rebalancing is done. AutoBalance is most efficient in clusters that contain only hard disk drives (HDDs). AutoBalanceLin is most efficient in clusters when file system metadata is stored on solid state drives (SSDs).	Restripe	Low	4	Manual
AVScan	Performs an anti-virus scan on all files using an external anti-virus server, such as a CAVA anti-virus server. Scans are scheduled independently by the AV system, or run manually.	None	Low	6	Manual
ChangelistCreate	Creates a list of changes between two snapshots with matching root paths. You can specify these snapshots from the CLI.	None	Low	5	Manual
CloudPoolsLin	Performs a LIN-based scan for files that are managed by CloudPools. If a CloudPools policy matches a given LIN, it either archives or recalls the cloud files.	None	Low	6	Manual
CloudPoolsTreewalk	Performs a treewalk scan on a given file path to identify files to be managed by CloudPools.	None	Low	6	Manual
Collect	Reclaims free space from previously unavailable nodes or drives. Collect is a "mark and sweep" garbage collector: it marks valid blocks in the first two phases of its run, then reclaims all blocks that are marked in-use but not marked. Runs as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster.	Mark	Low	4	Manual
ComplianceStoreDelete	Scan for, and unlink, expired files in compliance stores. By default, runs on the second Saturday of each month at 12am. This job can also be run manually.	None	Low	6	Scheduled
Dedupe*	Scans a directory for redundant data blocks and deduplicates all redundant data that is stored in the directory. Available only if you activate a SmartDedupe license.	Dedupe Restripe	Low	4	Manual
DedupeAssessment	Scans a directory for redundant data blocks and reports an estimate of the amount of space that could be saved by deduplicating the directory.	Dedupe Restripe	Low	6	Manual
DomainMark	Associates a path, and the contents of that path, with a domain.	None	Low	5	Manual
DomainTag	Performs policy domain updates.	Restripe	Low	6	Manual
FilePolicy	Updates the file policies so that SmartPools jobs can move the files where they should be.	Restripe FilePolicy Index	Low	5
FlexProtect FlexProtectLin	Scan the file system after a device failure to ensure that all files remain protected. OneFS checks the jobs.common.lin_based_jobs setting to determine whether to run FlexProtect or FlexProtectLin. FlexProtect and FlexProtectLin continue to run even if there are failed devices, but not devices that are down. Depending on the size of your dataset, this process can last for an extended period. The cluster is said to be in a degraded state until FlexProtect (or FlexProtectLin) finishes its work. If other system jobs cannot be started or have been paused, run the isi job status command to see if a "Cluster Is Degraded" message appears. FlexProtect is most efficient on clusters that contain only HDDs. FlexProtectLin is most efficient when file system metadata is stored on SSDs. NOTE: Unlike HDDs and SSDs that are used for storage, when an SSD used for L3 cache fails, the drive state should immediately change to REPLACE without a FlexProtect job running. An SSD drive that is used for L3 cache contains only cache data that does not have to be protected by FlexProtect. After the drive state changes to REPLACE, you can pull and replace the failed SSD.	Restripe	Medium	1	Manual
FSAnalyze*	Gathers and reports information about all files and directories beneath the /ifs path. This job requires you to activate an InsightIQ license. Reports from this job are used by InsightIQ users for system analysis purposes. For more information, see the PowerScale InsightIQ User Guide.	None	Low	1	Scheduled
IndexUpdate	Updates the file index which the FSA and FilePolicy jobs digest. This job should be run periodically, before running any other jobs.	None	Low	5	Manual
IntegrityScan	Verifies file system integrity.	Mark	Medium	1	Manual
MediaScan	Locates and clears media-level errors from disks to ensure that all data remains protected. This job is scheduled to run the first Saturday of every month, at 12 a.m.	Restripe	Low	8	Scheduled
MultiScan	Performs the work of the AutoBalanceLin and Collect jobs. Runs automatically on group changes, including storage changes, when a device comes back online or was added to the cluster. The job engine evaluates if there are unbalanced disk pools, or if the cluster would benefit from a garbage collector. If either of these conditions are true, MultiScan automatically starts. Multiscan runs the Collect job part only when started manually, or after a certain amount of time after the last garbage collector, and when there is a high probability that OneFS leaked blocks. MultiScan always rebalances.	Restripe Mark	Low	4	Manual
PasswordMigration	When OneFS is upgraded from an older version, this job migrates passwords from the less secure to the more secure database.	None	Low	3	Automatic after upgrade is committed.
PermissionRepair	Uses a template file or directory as the basis for permissions to set on a target file or directory. The target directory must always be subordinate to the /ifs path. This job must be manually started.	None	Low	5	Manual
QuotaScan*	Updates quota accounting for domains created on an existing file tree. Available only if you activate a SmartQuotas license. This job should be run manually in off-hours after setting up all quotas, and whenever setting up new quotas.	None	Low	6	Manual
SetProtectPlus	This job applies a default file policy across the cluster. Runs only if a SmartPools license is not active.	Restripe	Low	6	Manual
ShadowStoreDelete	Frees up space that is associated with shadow stores. Shadow stores are hidden files that are referenced by cloned and deduplicated files.	None	Low	2	Scheduled
ShadowStoreProtect	Protects shadow stores that are referenced by a logical i-node (LIN) with a higher level of protection.	Restripe	Low	6	Scheduled
SmartPools*	Enforces SmartPools file pool policies. Available only if you activate a SmartPools license. This job runs on a regularly scheduled basis, and may automatically run after a change is made. For example, after creating a compatibility that merges node pools.	Restripe	Low	6	Scheduled
SmartPoolsTree*	Enforce SmartPools file policies on a subtree. Available only if you activate a SmartPools license.	Restripe	Medium	5	Manual
SnapRevert	Reverts an entire snapshot back to head.	None	Low	5	Manual
SnapshotDelete	Creates free space that is associated with deleted snapshots. Triggered by the system when you mark snapshots for deletion.	None	Medium	2	Manual
TreeDelete	Deletes a specified file path in the /ifs directory. TreeDelete is equivalent to rm -rf but scales cluster-wide.	None	Medium	4	Manual
Undedupe	Undedupe undoes the work that the dedupe job performed, potentially increasing disk space usage.	Dedupe Restripe	Medium	6	Manual
Upgrade	Upgrades the file system after a OneFS upgrade. NOTE:The Upgrade job should be run only when you are updating your cluster with a major software version. For complete information, see the PowerScale OneFS Upgrade Planning and Process Guide.	Restripe	Medium	3	Manual
WormQueue	Processes the WORM queue, which tracks the commit times for WORM files. After a file is committed to WORM state, it is removed from the queue.	None	Low	6	Scheduled
* Available only if you activate an additional license.

Welcome

Welcome to Dell

PowerScale OneFS 9.8.0.0 Web Administration Guide

System jobs library

Rate this content