Data Domain: System Memory Requirements and Expanded Storage Configurations
Summary: This document serves as a guide for expected Data Domain (DD) model configurations relating to Capacity and Memory options. Failure to comply with prescribed configurations may result in the file system being disabled or hardware upgrades failing. ...
Symptoms
If the wrong configuration is used or there is not enough memory to support the configuration, the following symptoms can occur:
-
Unable to expand storage or add an expansion shelf
-
File system does not start
- Usable storage is less than expected
- System misconfigured alerts
Cause
- More storage was added to a Data Domain system without upgrading the memory (shelf memory kit was not included).
- A chassis swap procedure has occurred, and the memory was not moved over to the new chassis.
- A Dual In-line memory module (DIMM) has failed or not been installed incorrectly (such as not seated or misplaced)
- File system does not start with Alert "Memory size (xKB) goes below the configured size (nKB)."
- Data Domain systems boot into the kernel logger.
- Required licenses have not been added or updated
Resolution
#system show meminfo #system show ports #system show hardware #enclosure show memory #enclosure show misconfiguration ( #filesys show space #enclosure show topology #storage show all #elicense show all // license show (depending on licencing type used)
Compare the outputs gathered from Data Domain System with the expected configuration documented below:
|
DATA DOMAIN SYSTEM |
Memory Requirements - RAW Storage Capacity - Max or Min Expansion Shelf Count |
|
DD160 |
6 GB for up to 6 TB storage |
|
DD620 |
8 GB for up to 12 TB storage |
| DD990 EOSL: 31-December-2020 |
128GB of memory installed (Base Config):
2x 8GB DIMMs in each of 8x Memory Risers (Total = 16x 8GB DIMMs = 128GB)
Minimum Shelves = 4
Up to 12x 30 TB shelves or 8x 45 TB shelves Max 360 TB RAW or 285 TB Usable storage 3x SAS Cards
256GB of memory installed (Expanded Config):
4x 8GB DIMMs in each of 8x Memory Risers (Total = 32x 8GB DIMMs =258GB)
Up to 24x 30 TB shelves or 16x 45 TB shelves
Max 720 TB Raw or 570 TB Usable storage 3x SAS Cards
DD990 controller with DD Extended Retention (256GB)
Up to 56 ES20/ES30 shelves (1 TB, 2 TB, or 3 TB disks)
Max 1440 TB Raw or 1.1 PB Usable storage (Active or Archive Tier RAW Max = 720 TB Each) 4x SAS Cards DD990 controller with DD Cloud Tier (256GB) 4x ES30 - 45 TB Shelves (no DS60 support) for Metadata = Total 180 TB Max 1440 TB Cloud capacity 4x SAS Cards |
| DD2200-4TB |
8GB (2x 4GB) of memory installed (Entry): |
| DD2200-14/24TB |
16GB (4x 4GB) of memory is installed. |
| DD2500 |
32GB (4x 8GB) of memory installed (Base configuration) |
| DD4200 |
128GB (16x 8GB) of memory installed (Base Config): |
DD4500 |
192 GB (8x 16GB + 8x 8GB) of memory installed (Base Config): |
| DD7200 |
128GB (8x 16GB) of memory installed (Base Config): |
| DD6300 |
48GB (6x 8GB) of memory installed (Base configuration): |
| DD6800 |
192GB (8x 16GB + 8x8GB) of memory installed (Base Config)
16GB DIMMs in slots: 0, 2, 5, 7, 8, 10, 13, and 15 (the remainder is populated by 8GB DIMMs) Minimum shelves = 2 Up to 6x 30 TB shelves OR 4x 45 TB shelves OR 3x 60 TB shelves Maximum Active Tier Capacity = 180 TB RAW or 144 Usable External capacity Metadata on Flash (MDoF) = 2x 3.5" 800GB SSDs (Cache Tier on FS15 shelf) 192GB (8x 16GB + 8x8GB) of memory installed (Expanded Config) Up to 12x 30 TB shelves OR 8x 45 TB shelves OR 6x 60 TB shelves Max Capacity Active OR Archive Tier = 360 RAW or 288 TB (576 TB Total) Usable External capacity Max Capacity Cloud Tier = 576 TB Max Connectivity = 28x Shelves for Extended Retention (not exceeding Usable capacity limits) DD Cloud Tier requires two ES30 shelves fully populated with 4 TB drives to store DD Cloud Tier metadata. Metadata on Flash (MDoF) = 4x 3.5" 800GB SSDs (Cache Tier on FS15 shelf) |
| DD9300 |
192GB (4x 32GB + 4x 16GB) of memory installed (Base Config)
32GB DIMMs populate slots: 5, 7, 8, and 10 16GB DIMMs populate slots: 0, 2, 13, and 15 Minimum shelves = 3 2x SAS I/O Modules (Slots 2 and 7) Up to10x 45 TB shelves OR 8x 60 TB shelves Max Active Tier Capacity = 480 RAW or 384 TB Usable External capacity Metadata on Flash (MDoF) = 5x 3.5" 800GB SSDs (Cache Tier on FS15 shelf) 384GB (8 x32 GB + 8 x 16GB) of memory installed (Expanded Config) 32GB DIMMs populate slots: 0, 2, 5, 7, 8, 10, 13, and 15 16GB DIMMs populate slots: 1, 3, 4, 6, 9, 11, 12, and 14 2x SAS I/O Modules (Slots 2 and 7) Max Shelves = 28 (without exceeding capacity limits) Max Active / Archive Tier Capacity = 900 TB RAW or 720 TB Usable External capacity Max Capacity Cloud Tier = 1440 TB Usable (4x 60 TB Metadata shelves or packs required) Metadata on Flash (MDoF) = 8x 3.5" 800GB SSDs (Cache Tier on FS15 shelf) |
| DD9500 | 256GB (32 x 8GB) of memory installed (Base Config): See attached DD9500/DD9800 DIMM Guide for DIMM locations (p.4/5) Minimum shelves = Any combination of ES30/DS60 to a minimum of 4x Shelves or Packs Maximum 540 TB RAW storage OR 432 TB Usable 3x SAS I/O Modules (Slots 2, 3, and 6) Metadata on Flash (MDoF) = 8x 3.5" 800GB SSDs (a.k.a Cache Tier on FS15 shelf) 512GB (32x 8GB + 16x 16GB) of memory installed (Expanded Config) See attached DIMM/Memory Guide for DIMM locations (p.4/5) Any combination of ES30/DS60 to a maximum of 1080 TB (RAW) / 864 TB Usable 3x SAS I/O-Modules (Slots 2, 3, and 6) Max Shelves = 30 Metadata on Flash (MDoF/FS15) = 15x 3.5" 800GB SSDs (a.k.a Cache Tier) DD9500 with DD Extended Retention (512GB) Any combination of ES30/DS60 to a maximum of 2160 TB (RAW) / 1728 TB Usable 4x SAS I/O-Modules (Slots 2, 3, 6, and 9) Max Active / Archive Tier Capacity = 1080 TB RAW or 864 TB Usable External capacity Max connectivity with ER = 56 ES30/Mix OR 12x DS60 Metadata on Flash (MDoF/FS15) = 15x 3.5" 800GB SSDs (a.k.a Cache Tier) DD9500 with DD Cloud Tier (512GB) Any combination of ES30/DS60 to a maximum of 1080 TB (RAW) / 864 TB Usable on Active Tier Max Capacity Cloud Tier = 1728 TB Usable (2x Active Tier) 5x 60 TB (300 TB) Metadata shelves or packs required (ES30 or DS60) 4x SAS I/O-Modules (Slots 2, 3, 6, and 9) Metadata on Flash (MDoF/FS15) = 15x 3.5" 800GB SSDs (a.k.a Cache Tier) |
| DD9800 |
256GB (32 x 8GB) of memory installed (Base Config):
See attached DD9500/DD9800 DIMM Guide for DIMM locations. Minimum shelves = Any combination of ES30/DS60 to a minimum of 450 TB Raw capacity Maximum storage = 630 TB Raw storage OR 504 TB Usable 3x SAS I/O Modules (Slots 2, 3, and 6) Metadata on Flash (MDoF) = 8x 3.5" 800GB SSDs (Cache Tier) 768GB (32x 8GB + 32x 32GB) of memory installed (Expanded): See attached DD9500/DD9800 DIMM Guide for DIMM locations. Any combination of ES30/DS60 to a maximum of 1260 TB Raw / 1008 TB Usable 3x SAS I/O Modules (Slots 2, 3, and 6) Metadata on Flash (MDoF) = 15x 3.5" 800GB SSDs (Cache Tier) DD9800 with DD Extended Retention (768GB) Any combination of ES30/DS60 to a maximum of 2520 TB (RAW) / 2016 TB Usable Max Active OR Archive Tier Capacity = 1260 TB RAW or 1008 TB Usable External capacity Max connectivity = 56 ES30/Mix OR 14x DS60 + 1x FS15 for Cache 4x SAS I/O Modules (Slots 2, 3, 6, and 9) Metadata on Flash (MDoF/FS15) = 15x 3.5" 800GB SSDs (a.k.a Cache Tier) DD9800 with DD Cloud Tier (768GB) Any combination of ES30/DS60 to a maximum of 1260 TB (RAW) / 1008 TB Usable Max Appliance Capacity = 1008 TB on site + 2x in the Cloud (Total = 3024 TB Usable) Max Capacity Cloud Tier = 2016 TB Usable 5x 60 TB (300 TB) Metadata shelves or packs required (ES30 or DS60) 4x SAS I/O-Modules (Slots 2, 3, 6, and 9) Metadata on Flash (MDoF/FS15) = 15x 3.5" 800GB SSDs (a.k.a Cache Tier) |
| PowerProtect DD3300 |
There are 3x variants of DD3300:
- 4 TB, 16 TB & 32 TB of Usable capacity
- 4 TB can be expanded to 16 TB.
- 16 TB can be expanded to 32 TB. - A system that is initially 4 TB cannot be expanded to 32 TB. - No External storage can be added. - Max SSD Cache Tier is 1% of the Active Tier capacity (on 16 TB & 32 TB models) DD3300-4TB: - 16GB (2x 8GB DIMMs) of installed memory - Memory Installed in Slots: A1 and A2 - 4x 4 TB HDDs in Front slots - 4 TB Usable Active Tier capacity - 8 TB Usable Cloud Tier capacity - 1 TB for DD Cloud Tier metadata - No SSD in Rear slot DD3300-16TB: - 48GB (6x 8GB DIMMs) of installed memory - Memory Installed in Slots: A1, A2, A3, A4, A5, and A6 - 10x 4 TB HDDs in Front slots - 16 TB Usable Active Tier capacity - 32 TB Usable Cloud Tier capacity - 2x 1 TB for DD Cloud Tier metadata - 1x 480GB SSD (Rear slot) for NVRAM and SSD Cache Tier (160GB) DD3300-32TB: - 64GB (8x 8GB DIMMs) of installed memory - Memory Installed in Slots: A1, A2, A3, A4, A5, A6, A7, and A8 - 12x 4 TB HDDs in Front slots + 4x 4 TB HDDs in Middle slots (Under the lid) - 32 TB Usable Active Tier capacity - 64 TB Usable Cloud Tier capacity - 4x 1 TB for DD Cloud Tier metadata - 1x 480GB SSD (Rear slot) for NVRAM and SSD Cache Tier (320GB) |
| PowerProtect DD6900 | DD6900: - 288GB RAM (12 x 8GB + 12 x 16GB DIMMS) - SAS Shelves ONLY (SATA shelves are NOT supported) - Supported disks/shelves: *3 TB (ES30) | 4 TB (ES30/ES40/DS60)
- * 3 TB only supported on Controller (headswap) upgrades - not fresh install (or # filesys create)
- Minimum 1x 60 TB Shelf required- Ships with 4 TB ES40|DS60 - Partial Shelf Licensing is available for this model - use ES40 with 4 TB drives (43.6 TiB) at 50% utilization (21.8 TiB) in the active tier if the available licensed capacity is exactly 21.8 TiB. - Active Tier: Any combination of supported shelves to a MAXIMUM capacity of 360 TB Raw || 288 TB Usable - Max capacity = 288 TB (Active Tier) + 2x Cloud Tier (578TBu) = 866TBu - Cache Tier = 2 drives (2x 1.92 TB SSD internal |or| 2x 3.84 TB SSD external - in FS25, if HA) - Cloud Tier = 2x 60 TB shelves for Cloud Tier Metadata |
| PowerProtect DD9400 | DD9400: - 576GB RAM (12 x 32GB + 12 x 16GB) - SAS Shelves ONLY (SATA shelves are NOT supported) - Supported disks/shelves: *3 TB (ES30) | *4 TB (ES30/ES40/DS60) | 8 TB (ES40/DS60)
- *3|4 TB only supported on Controller (headswap) upgrades - not fresh install (or # filesys create)
- Minimum 4x 60 TB Shelf required (240 TB Raw)- Ships with 8 TB ES40|DS60 - Active Tier: Any combination of supported shelves to a MAXIMUM capacity of 960 TB Raw || 768 TB Usable - Max Capacity = 768 TB (Active Tier) + 2x Cloud Tier (1536TBu) = 2304TBu - Cache Tier = 5 drives (5x 1.92 TB SSD internal |or| 5x 3.84 TB SSD external - in FS25, if HA) - Cloud Tier = 4x 60 TB shelves for Cloud Tier Metadata - Over-Provisioning = 2x 60 TB Shelves |
| PowerProtect DD9900 | DD9900: - 1152GB RAM (24 x 32GB + 24 x 16GB) - SAS Shelves ONLY (SATA shelves are NOT supported) - Supported disks/shelves: *3 TB (ES30) | *4 TB (ES30/ES40/DS60) | 8 TB (ES40/DS60)
- *3|4 TB only supported on Controller (headswap) upgrades - not fresh install (or # filesys create)
- Minimum 6x shelves AND more than 720 TB Raw Capacity - Ships with 8 TB ES40|DS60 - Active Tier: Any combination of supported shelves to a MAXIMUM capacity of 1920 TB Raw || 1248 TB Usable - Max Capacity = 1248TBu (Active Tier) + 2x Cloud Tier (2496TBu) = 3744TBu - Cache Tier = 10x 3.84 TB SSD external in FS25 shelf (on its OWN SAS Chain) - Cloud Tier = 5x 60 TB shelves for Cloud Tier Metadata - Over-Provisioning = 2x 60 TB Shelves |
Additional Information
References:
- Data Domain: PowerProtect Hardware: Features and Specifications
- Data Domain DD9500 and DD9800 Systems DIMM and Riser Card Replacement and Memory Upgrade
- Data Domain Operating System Documentation and Guides
- Data Domain DD990 DIMM Replacement and Upgrade
- Data Domain DD4200, DD4500, and DD7200 Hardware Guide
- Data Domain DS60 Shelf Expansion Hardware Guide
- Data Domain ES30 Expansion Shelf and FS15 SSD Shelf Hardware Guide
- Troubleshooting Adding a Shelf
Note:
- ALL capacity figures are quoted in Base10 for simplicity, for example 1000MB = 1GB = 0.001 TB
- Base2 (MiB, GiB, or TiB) figures can generally be found in the capacity sections of the related system hardware guides, for example, 4 TB disk = 3.63 TiB