- Notes, cautions, and warnings
- Introduction to this guide
- PowerScale scale-out NAS
- General cluster administration
- General cluster administration overview
- User interfaces
- Connecting to the cluster
- Licensing
- Certificates
- Cluster identity
- Cluster date and time
- SMTP email settings
- Configuring the cluster join mode
- File system settings
- Security hardening
- Cluster monitoring
- Monitoring cluster hardware
- Events and alerts
- Cluster maintenance
- SRS Summary
- Access zones
- Authentication
- Authentication overview
- Authentication provider features
- Security Identifier (SID) history overview
- Supported authentication providers
- Active Directory
- LDAP
- NIS
- Kerberos authentication
- File provider
- Local provider
- Multi-factor Authentication (MFA)
- Multi-instance active directory
- LDAP public keys
- Managing Active Directory providers
- Managing LDAP providers
- Managing NIS providers
- Managing MIT Kerberos authentication
- Managing file providers
- Managing local users and groups
- Administrative roles and privileges
- Identity management
- Home directories
- Home directories overview
- Home directory permissions
- Authenticating SMB users
- Home directory creation through SMB
- Home directory creation through SSH and FTP
- Home directory creation in a mixed environment
- Interactions between ACLs and mode bits
- Default home directory settings in authentication providers
- Supported expansion variables
- Domain variables in home directory provisioning
- Data access control
- File sharing
- File sharing overview
- SMB security
- SMB shares in access zones
- SMB Multichannel
- SMB share management through MMC
- SMBv3 encryption
- SMB server-side copy
- SMB continuous availability
- SMB file filtering
- Symbolic links and SMB clients
- Anonymous access to SMB shares
- Managing SMB settings
- Managing SMB shares
- Create an SMB share
- Modify SMB share permissions, performance, or security
- Delete an SMB share
- Limit access to /ifs share for the Everyone account
- Configure anonymous access to a single SMB share
- Configure anonymous access to all SMB shares in an access zone
- Add a user or group to an SMB share
- Configure multi-protocol home directory access
- NFS security
- FTP
- HTTP and HTTPS security
- File filtering
- Auditing
- Snapshots
- Snapshots overview
- Data protection with SnapshotIQ
- Snapshot disk-space usage
- Snapshot schedules
- Snapshot aliases
- File and directory restoration
- Best practices for creating snapshots
- Best practices for creating snapshot schedules
- File clones
- Snapshot locks
- Snapshot reserve
- Writable snapshots
- SnapshotIQ license functionality
- Creating snapshots with SnapshotIQ
- Managing snapshots
- Restoring snapshot data
- Managing snapshot schedules
- Managing snapshot aliases
- Managing with snapshot locks
- Configure SnapshotIQ settings
- Set the snapshot reserve
- Managing changelists
- Deduplication with SmartDedupe
- Data replication with SyncIQ
- SyncIQ data replication overview
- Replication policies and jobs
- Replication snapshots
- Data failover and failback with SyncIQ
- Recovery times and objectives for SyncIQ
- Replication policy priority
- SyncIQ license functionality
- Replication for nodes with multiple interfaces
- Restrict SyncIQ source nodes
- Creating replication policies
- Managing replication to remote clusters
- Initiating data failover and failback with SyncIQ
- Performing disaster recovery for older SmartLock directories
- Managing replication policies
- Managing replication to the local cluster
- Managing replication performance rules
- Managing replication reports
- Managing failed replication jobs
- Data Encryption with SyncIQ
- Data layout with FlexProtect
- Large file size support
- NDMP backup and recovery
- NDMP backup and recovery overview
- NDMP two-way backup
- NDMP three-way backup
- Support for NDMP sessions on Generation 6 hardware
- Setting preferred IPs for NDMP three-way operations
- NDMP multi-stream backup and recovery
- Snapshot-based incremental backups
- NDMP backup and restore of SmartLink files
- NDMP protocol support
- Supported DMAs
- NDMP hardware support
- NDMP backup limitations
- NDMP performance recommendations
- Excluding files and directories from NDMP backups
- Configuring basic NDMP backup settings
- Managing NDMP user accounts
- NDMP environment variables overview
- Managing NDMP contexts
- Managing NDMP sessions
- Managing NDMP Fibre Channel ports
- Managing NDMP preferred IP settings
- Managing NDMP backup devices
- NDMP dumpdates file overview
- NDMP restore operations
- Sharing tape drives between clusters
- Managing snapshot based incremental backups
- Managing cluster performance for NDMP sessions
- Managing CPU usage for NDMP sessions
- File retention with SmartLock
- SmartLock overview
- Compliance mode
- Enterprise mode
- SmartLock directories
- Replication and backup with SmartLock
- SmartLock license functionality
- SmartLock considerations
- Set the compliance clock
- View the compliance clock
- Creating a SmartLock directory
- Managing SmartLock directories
- Managing files in SmartLock directories
- Set a retention period through a UNIX command line
- Set a retention period through Windows Powershell
- Commit a file to a WORM state through a UNIX command line
- Commit a file to a WORM state through Windows Explorer
- Override the retention period for all files in a SmartLock directory
- Delete a file committed to a WORM state
- View WORM status of a file
- Protection domains
- Data-at-rest-encryption
- Data-at-rest encryption overview
- Self-encrypting drives
- Data security on self-encrypting drives
- Data migrations and upgrades to a cluster with self-encrypting drives
- Enabling external key management
- Migrate nodes and SEDs to external key management
- Chassis and drive states
- Smartfailed drive REPLACE state
- Smartfailed drive ERASE state
- S3 Support
- SmartQuotas
- SmartQuotas overview
- Quota types
- Default quota type
- Usage accounting and limits
- Disk-usage calculations
- Quota notifications
- Quota notification rules
- Quota reports
- Creating quotas
- Managing quotas
- Managing quota notifications
- Email quota notification messages
- Managing quota reports
- Basic quota settings
- Advisory limit quota notification rules settings
- Soft limit quota notification rules settings
- Hard limit quota notification rules settings
- Limit notification settings
- Quota report settings
- Storage Pools
- Storage pools overview
- Storage pool functions
- Autoprovisioning
- Node pools
- Virtual hot spare
- Spillover
- Suggested protection
- Protection policies
- SSD strategies
- Other SSD mirror settings
- Global namespace acceleration
- L3 cache overview
- Tiers
- File pool policies
- Managing node pools in the web administration interface
- Managing L3 cache from the web administration interface
- Managing tiers
- Creating file pool policies
- Managing file pool policies
- Configure default file pool protection settings
- Default file pool requested protection settings
- Configure default I/O optimization settings
- Default file pool I/O optimization settings
- Modify a file pool policy
- Prioritize a file pool policy
- Create a file pool policy from a template
- Delete a file pool policy
- Monitoring storage pools
- Pool-based tree reporting in FSAnalyze (FSA)
- System jobs
- Networking
- Networking overview
- About the internal network
- About the external network
- Configuring the internal network
- Managing groupnets
- Managing external network subnets
- Managing IP address pools
- Managing SmartConnect Settings
- Managing network interface members
- Managing node provisioning rules
- Managing routing options
- Managing DNS cache settings
- Managing TCP ports
- NFS3oRDMA
- Partitioned Performance Monitoring
- Antivirus
- Antivirus overview
- On-access scanning
- ICAP Antivirus policy scanning
- Individual file scanning using ICAP
- WORM files and antivirus
- Antivirus scan reports
- ICAP servers
- CAVA servers
- ICAP threat responses
- CAVA threat responses
- Configuring global antivirus settings
- Managing ICAP servers
- Managing CAVA servers
- Add and connect to a CAVA server
- List or view CAVA servers
- Modify CAVA connection settings
- Disable connection to a CAVA server
- Delete connection to a CAVA server
- Add a job to a CAVA server
- View an IP pool in a CAVA server
- Create an Active Directory authentication provider for the AvVendor access zone
- Update the role in the access zone
- Scan CloudPool files in a CAVA server
- Create an antivirus policy
- Managing ICAP antivirus policies
- Managing antivirus scans
- Managing antivirus threats
- Managing antivirus reports
- File System Explorer
PowerScale OneFS Web Administration Guide
System jobs library
OneFS contains a library of system jobs that run in the background to help maintain your PowerScale cluster.
By default, system jobs are categorized as either manual or scheduled. You can run any job manually, and you can create a schedule for most jobs according to your workflow. Some jobs do not accept a schedule. Typically such jobs have mandatory input arguments, such as the Treedelete job. In addition, OneFS starts some jobs automatically when particular system conditions arise. For example, FlexProtect or FlexProtectLin start when a drive is smartfailed and there is no down device, to allow the job to re-protect the data.
The lower the priority value, the higher the job priority. For example, a job with priority value 1 has higher priority than a job with priority value 2 or higher.
The default protection, +2:+1, enables all jobs to run during a scan if there is no more than one failed device in each disk pool. (FlexProtect ad FlexProtectLin continue to run even if there are failed devices.) OneFS does not check file protection. If you have files with no protection setting, the job can fail.
| Job name | Description | Exclusion Set | Impact Policy | Priority | Operation |
|---|---|---|---|---|---|
| AutoBalance
AutoBalanceLin |
Rebalances disk space usage in a disk pool.
OneFS checks the jobs.common.lin_based_jobs setting to determine whether to run AutoBalance (FALSE)or AutoBalanceLin (TRUE). JobEngine starts a rebalance job if there is an imbalance of 5% of more between any two drives.If MultiScan is enabled, AutoBalance or AutoBalanceLin are run as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster. If none of these jobs are enabled, no rebalancing is done.AutoBalance is most efficient in clusters that contain only hard disk drives (HDDs). AutoBalanceLin is most efficient in clusters when file system metadata is stored on solid state drives (SSDs). |
Restripe | Low | 4 | Manual |
| AVScan | Performs an antivirus scan on all files using an external antivirus server, such as a CAVA antivirus server. Scans are scheduled independently by the AV system or run manually. | None | Low | 6 | Manual |
| ChangelistCreate | Creates a list of changes between two snapshots with matching root paths. You can specify these snapshots from the CLI. | None | Low | 5 | Manual |
| CloudPoolsLin | Performs a LIN-based scan for files to be managed by CloudPools. If a CloudPools policy matches a given LIN, it either archives or recalls the cloud files. | None | Low | 6 | Manual |
| CloudPoolsTreewalk | Performs a treewalk scan on a given file path to identify files to be managed by CloudPools. | None | Low | 6 | Manual |
| Collect | Reclaims free space from previously unavailable nodes or drives. Collect is a "mark and sweep" garbage collector: it marks valid blocks in the first two phases of its run, then reclaims all blocks that are flagged in-use but not marked. Runs as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster. | Mark | Low | 4 | Manual |
| ComplianceStoreDelete | Scan for, and unlink, expired files in compliance stores. By default, runs on the second Saturday of each month at 12am. Can also be run manually. | None | Low | 6 | Scheduled |
| Dedupe* | Scans a directory for redundant data blocks and deduplicates all redundant data stored in the directory. Available only if you activate a SmartDedupe license. | Dedupe
Restripe |
Low | 4 | Manual |
| DedupeAssessment | Scans a directory for redundant data blocks and reports an estimate of the amount of space that could be saved by deduplicating the directory. | Dedupe
Restripe |
Low | 6 | Manual |
| DomainMark | Associates a path, and the contents of that path, with a domain. | None | Low | 5 | Manual |
| DomainTag | Performs policy domain updates. | Restripe | Low | 6 | Manual |
| FlexProtect
FlexProtectLin |
Scan the file system after a device failure to ensure that all files remain protected.
OneFS checks the jobs.common.lin_based_jobs setting to determine whether to run FlexProtect or FlexProtectLin. FlexProtect and FlexProtectLin continue to run even if there are failed devices. Depending on the size of your data set, this process can last for an extended period. The cluster is said to be in a degraded state until FlexProtect (or FlexProtectLin) finishes its work. If you notice that other system jobs cannot be started or have been paused, you can use the isi job status command to see if a "Cluster Is Degraded" message appears. FlexProtect is most efficient on clusters that contain only HDDs. FlexProtectLin is most efficient when file system metadata is stored on SSDs. NOTE Unlike HDDs and SSDs that are used for storage, when an SSD used for L3 cache fails, the drive state should immediately change to REPLACE without a FlexProtect job running. An SSD drive used for L3 cache contains only cache data that does not have to be protected by FlexProtect. After the drive state changes to REPLACE, you can pull and replace the failed SSD.
|
Restripe | Medium | 1 | Manual |
| FSAnalyze* | Gathers and reports information about all files and directories beneath the /ifs path. This job requires you to activate an InsightIQ license. Reports from this job are used by InsightIQ users for system analysis purposes. For more information, see the PowerScale InsightIQ User Guide. | None | Low | 1 | Scheduled |
| IntegrityScan | Verifies file system integrity. | Mark | Medium | 1 | Manual |
| MediaScan | Locates and clears media-level errors from disks to ensure that all data remains protected.
This job is only useful on HDD drives. If the cluster is all flash, you can disable this job. This job is scheduled to run every 1st Saturday of every month at 12 a.m. |
Restripe | Low | 8 | Scheduled |
| MultiScan | Performs the work of the AutoBalanceLin and Collect jobs. Runs automatically on group changes, including storage changes. Multiscan runs only if there is any unbalanced diskpool or if it determines that a drive has been down for a long enough period that running the Collect process to reclaim free space is worthwhile. | Restripe
Mark |
Low | 4 | Manual |
| PermissionRepair | Uses a template file or directory as the basis for permissions to set on a target file or directory. The target directory must always be subordinate to the /ifs path. This job must be manually started. | None | Low | 5 | Manual |
| QuotaScan* | Updates quota accounting for domains created on an existing file tree. Available only if you activate a SmartQuotas license. This job should be run manually in off-hours after setting up all quotas, and whenever setting up new quotas. | None | Low | 6 | Manual |
| SetProtectPlus | Applies a default file policy across the cluster. Runs only if a SmartPools license is not active. | Restripe | Low | 6 | Manual |
| ShadowStoreDelete | Frees up space that is associated with shadow stores. Shadow stores are hidden files that are referenced by cloned and deduplicated files. | None | Low | 2 | Scheduled |
| ShadowStoreProtect | Protects shadow stores that are referenced by a logical i-node (LIN) with a higher level of protection. | Restripe | Low | 6 | Scheduled |
| SmartPools* | Enforces SmartPools file pool policies. Available only if you activate a SmartPools license. This job runs on a regularly scheduled basis, and can also be started by the system when a change is made (for example, creating a compatibility that merges node pools). | Restripe | Low | 6 | Scheduled |
| SmartPoolsTree* | Enforce SmartPools file policies on a subtree. Available only if you activate a SmartPools license. | Restripe | Medium | 5 | Manual |
| SnapRevert | Reverts an entire snapshot back to head. | None | Low | 5 | Manual |
| SnapshotDelete | Creates free space associated with deleted snapshots. Triggered by the system when you mark snapshots for deletion. | None | Medium | 2 | Manual |
| TreeDelete | Deletes a specified file path in the /ifs directory. TreeDelete is equivalent to rm -rf but scales cluster-wide. | None | Medium | 4 | Manual |
| Undedupe | Undedupe undoes the work that the dedupe job performed, potentially increasing disk space usage. | Dedupe
Restripe |
Medium | 6 | Manual |
| Upgrade | Upgrades the file system after a software version upgrade.
NOTE The Upgrade job should be run only when you are updating your cluster with a major software version. For complete information, see the
PowerScale
OneFS Upgrade Planning and Process Guide.
|
Restripe | Medium | 3 | Manual |
| WormQueue | Processes the WORM queue, which tracks the commit times for WORM files. After a file is committed to WORM state, it is removed from the queue. | None | Low | 6 | Scheduled |
| * Available only if you activate an additional license | |||||
Please provide ratings (1-5 stars).
Please provide ratings (1-5 stars).
Please provide ratings (1-5 stars).
Please select whether the article was helpful or not.
Comments cannot contain these special characters: <>()\