Data Domain: Commvault Configure Data Domain Boost on Disk Libraries using Dell Data Domain

NOTE: The following instructions to configure Data Domain Boost (DD Boost) on Disk Libraries using Dell Data Domain are deprecated. We recommend that you follow the instructions as mentioned in the Commvault Data Domain Boost Storage Library
 

Can I configure Data Domain Boost (DD Boost) on Disk Libraries using Dell Data Domain?

Commvault Data Domain Boost Storage Library feature is an integration between the Commvault data protection software and Dell Data Domain and PowerProtect DD deduplication storage systems. Commvault is a Dell DD Boost ecosystem partner and has incorporated the DD Boost software development kit (SDK) into the Commvault platform. This now allows advanced levels of integration and feature support with no additional software or plug-ins required.

Library Types

Data Domain Boost Access Library

The Commvault Data Domain Boost Access library type provides a direct connection to the device through the SDK and writes data in the native Commvault format. Data can be written in Commvault deduplicated format (recommended) or nondeduplicated format and is further deduplicated by the Dell Data Domain device. Keeping the data formats the same gives customers, using Dell Data Domain today with network shares or BoostFS, an upgrade path to take advantage of the integration without having to worry about data expansion on the storage due to any data format changes.

This library type is intended to give customers that are already using a Dell Data Domain device as a library today with network shares or BoostFS, an upgrade path to take advantage of the integration without having to worry about data expansion on the storage due to any data format changes. It can also be used to keep data in the native Commvault format for specific use cases and provide efficient use of storage and cost savings across all storage types.

This feature is available with Commvault Platform Release 2023 (Feature Release 30) and later.
 

Features:

• Direct communication with Dell Data Domain device using the integrated Dell Boost SDK
• Data is written in native Commvault format with deduplication and compression supported
• Supports WORM mode (DD Retention Lock) for immutable storage

General Best Practices when using a Data Domain with Commvault:

• Enable Commvault deduplication and compression. This provides the benefit of client-side deduplication to reduce network load between clients and MediaAgents, and allows DASH copies and DASH Full backups which reduce the amount of data read-off the Data Domain during these operations. The Data Domain still further deduplicates any data written to it on the device side.
• Do not enable encryption on backups in Commvault. This prevents the Data Domain from further deduplicating the data written on the device-side. If you must use encryption of the data at rest, enable this feature on the Data Domain.
• Consider using MTree replication instead of auxiliary copy jobs if the dataset is large and must be copied between two Data Domain devices. This may be more efficient than performing auxiliary or DASH copies.

Configuration - Linux

Use the following steps to ensure that the device is mounted in the MediaAgent, before configuring the library.

1. Install the FUSE File system and its dependencies on the MediaAgent.
2. Install the DD Boost file system RPM on the MediaAgent.
3. You can verify the installation from the following location:

/opt/emc/boostfs

4. Run the following commands from the following location:

/opt/emc/boostfs/bin

Set the lock box between the Data Domain storage unit and MediaAgent using the following command: 

boostfs lockbox set -s <Storage-unit> -d <data-domain-system> -u <storage-unit-username>

Mount this storage unit on the MediaAgent using the following command: 

boostfs mount -d <data-domain-system> -s <Storage-unit> <mount-point>

5. Commvault Configure a disk library  using the above storage unit mount point as the mount path for the library.

Configuration - Windows

Use the following steps to ensure that the device is mounted in the MediaAgent, before configuring the library.

1. Install the BoostFS on the MediaAgent.
2. Run the following commands to configure the lock box:

boostfs lockbox set -u sysadmin -d <DD Boost-IP> -s <Storage-unit> -l <lock-box-location>

C:\Windows\system32>boostfs lockbox set -u sysadmin -d 111.11.11.11 -s MyStorage -l
C:\Boostfs\Lockbox\boostfs.lockbox Enter storage unit user password:
nter storage unit user password again to confirm: Lockbox entry set

3. Run the following command to mount the Storage Unit from Dell.    

boostfs mount -d <DD Boost-IP> -s <Storage-unit> -l <lock-box-location> 

C:\Windows\system32>boostfs mount -d 111.11.11.11 -s MyStorage -l
C:\Boostfs\Lockbox\boostfs.lockbox

4. Commvault Configure a disk library  using the storage unit mount point as the mount path for the library.

Best Practices if using BoostFS

If you are using BoostFS to access the Data Domain library, you should schedule and size the backup jobs and limit device streams such that the MediaAgent does not exceed the maximum connections (256) of BoostFS.
 

Best Practices if using NFS Shares

If you are using NFS shares to access the Data Domain library, we recommend using NFS version 3 (NFSv3) over version 4 (NFSv4). When using NFSv4, there is a maximum file open limit of 8K.
 

Converting from NFSv4 to NFSv3

1. Install Maintenance release (version 11.26.35 or later) and set the following additional setting on the MediaAgent Client group: 

MediaAgent\NFSCheckLocalLockOptions 0 

2. Stop all services on the MediaAgent.
3. Unmount the current 4.0 mount on the MediaAgent.
4. Change the Data Domain export to NFSv3 using Data Domain interface.
5. Change fstab to use NFSv3 for the mount. Use the following option in the mount options. 

local_lock=none

6. Run the following command to mount this entry in the fstab.

mount -a

7. Run mount and verify whether output shows the mount with correct options.
8. Repeat the above steps for all MediaAgents that are configured for the Data Domain library.
9. Run the following script to set a MediaAgent from the list of all MediaAgents that are configured for the Data Domain library, as the MediaAgent which runs data pruning on that library.

qoperation execscript -sn setLibraryProperty -si <LibName> -si EnableSinglePrunerMA -si 1 -si <MAName>

Recommended Block Size

When using Dell Data Domain with DD Boost, we recommend a default deduplication block size of 512 K B for all datatype backups. Also, ensure that the block size is set to 512 KB on storage pools used for making copies on an Auxiliary Copy operation.

Deduplication block size can be modified using the Block level Deduplication factor option available in the Commvault Storage Policy Properties  tab.
 

Known Issues

The following issues have been identified:

• The post compression space is reported incorrectly when backing up data to the Data Domain Virtual Edition.
• SE Linux enabled MediaAgents cannot be used with BoostFS due to incompatibilities with the FUSE File system.