Using Dell PowerMax with VMware Cloud Foundation 9.0 - Implementation Guide
This document provides guidance for implementing Dell PowerMax as Principal Storage for both Management and Workload Domains in VMware Cloud Foundation (VCF) 9.0.
VMware Cloud Foundation 9.0, or VCF, is a complete software-defined infrastructure platform that encompasses all the required components to run a private, public, or hybrid cloud. VCF 9.0 focuses specifically on the private cloud experience using VCF Operations as the central control hub. From VCF Operations, the user can control all aspects of the VCF environment, from day-to-day troubleshooting to new workload deployments. The other components of the VCF platform include vSphere for compute, vSAN for storage, NSX for networking, SDDC Manager, and VCF Automation.
VCF uses the concept of domains. There are two: Management and Workload. The management domain is the heart of the VCF implementation and requires NFS, VMFS on FC, or vSAN storage to deploy. It is responsible for hosting the many management plane VMs, but it can also host customer VMs when employing a consolidated architecture without a separate workload domain. A workload domain is designed specifically to run customer workloads. A single vCenter Server instance manages a workload domain and can consist of one or more vSphere clusters. In VCF 9.0, the workload domain can be deployed on all the same storage options as the management domain. The flexibility in storage options in VCF 9.0 permits the use of more robust storage array solutions like the PowerMax without the need for vSAN in the solution.
This paper provides an overview of how to implement a VCF 9.0 environment on a PowerMax platform using VMFS on FC for principal storage. It covers deployment of both the management and workload domains, including PowerMax storage provisioning.
Note: While the wizard in VCF 9.0 still offers Virtual Volumes (vVols) as a viable option for deployment of a workload domain, vVols are deprecated as of this release. Broadcom will provide support on a case-by-case basis if a customer still desires to use them on the PowerMax. In such circumstances, contact your Broadcom representative.
Document purpose
This guide provides configuration details for implementing VMware Cloud Foundation on Dell servers and PowerMax storage. It demonstrates the use of VMFS on FC as principal storage for both management and workload domains, removing the reliance on vSAN.
Note: Examples that are provided in this guide cover performing various VMware vSphere activities using PowerMax systems and Dell software. These examples were developed for laboratory testing and may need tailoring to suit other operational environments. Any procedures that are outlined in this guide should be thoroughly tested before implementation in a production environment.
Note: The contents of this document are valid for the software and hardware versions described. For information about updated configurations for newer software and hardware versions, contact your VMware or Dell Technologies sales representative.
Audience
This document is intended for use by storage administrators, system administrators, and VMware vSphere administrators.
Readers of this document are expected to be familiar with the following topics:
Dell PowerMax system operation
Dell software including the following: Unisphere for PowerMax, SRDF, and TimeFinder
General storage concepts
VMware Cloud Foundation, including vSphere, NSX, and VCF Operations
VMware vSphere products and their operations
Revision history
Table 1. Revision history
Part number
Release date
Description
H04548
August 2025
Initial release
Wizard walkthroughs
Users are expected to be familiar with the products and technologies that are covered in the guide. Therefore, not every step of each wizard has an associated image. The steps are always documented, however.
Terminology
The following table provides definitions for some of the terms that are used in this document.
Table 2. Terminology
Term
Definition
BOM
Bill of Materials
FC
Fibre Channel
HCI
Hyperconverged Infrastructure
ITOM
IT Operational Management
LCM
Life-Cycle Management – automation of updating and upgrades of VCF
NIC
Network Interface Controllers
SRDF
Symmetrix Remote Data Facility
SRP
Storage Resource Pool
VCF
VMware Cloud Foundation
VCF Fleet
A VCF fleet refers to an environment managed by the same VCF Operations instance and consisting of one or more VCF instances and standalone vCenters.
VDS
vSphere Distributed Switch (defined and managed by vCenter)
VI
Virtual Infrastructure – used regarding a workload domain
VLSR
VMware Live Site Recovery
VM
Virtual Machine
VMFS
VMware File System
Product overview
Product overview
PowerMax
The PowerMax family represents the flagship products of the Dell Technologies enterprise storage business. It is designed with a multi-node, active/active scale-out architecture using industry standard, end-to-end NVMe components. The platform features inline, global deduplication and compression, providing customers with high storage efficiency even as the system scales. The PowerMax family also provides what many consider to be the gold standard in data services, proven high availability and resiliency, and advanced security that adheres to stringent government regulations and corporate compliance requirements, such as FIPS 140-2 and FIPS 140-3. A core strength of the PowerMax family is its ability to consolidate workloads. One can use a single PowerMax system to consolidate from one-to-many types of workloads, and both block and file storage services.
PowerMax systems are modular, enabling them to expand to meet the future needs of the customer. The PowerMax family of arrays has four models:
PowerMax 2500 with a maximum capacity of 8 PBe (Petabytes effective)
PowerMax 2000 with a maximum capacity of 1.2 PBe
PowerMax 8500 with a maximum capacity of 18 PBe
PowerMax 8000 with a maximum capacity of 4.5 PBe
Each PowerMax is configured at the factory with a single Storage Resource Pool, or SRP, which is comprised of the physical disks in the array, managed as data pools. These collections of data pools are used for capacity and performance management. All host devices are part of an SRP.
PowerMax for Open Systems provides support for the following protocols:
Fiber-Channel (FC) and NVMe over FC (NVMe/FC) with speeds of 8 Gb/s, 16 Gb/s, or 32 Gb/s
iSCSI and NVMe over TCP (NVMe/TCP) with speed of 10 Gb/s or 25 Gb/s
SRDF over FC with speed of 8 Gb/s, 16 Gb/s, or 32 Gb/s
SRDF over IP with speed of 10 Gb/s or 25 Gb/s
PowerMaxOS operating system
PowerMaxOS is the advanced operating system that powers Dell PowerMax storage arrays, delivering a software-defined, performance-optimized platform designed for mission-critical enterprise workloads. It is a modern architecture that is modular, container-based, and tightly integrated with end-to-end NVMe hardware to offer ultra-low latency, high throughput, and automated efficiency.
Built with intelligent machine learning, PowerMaxOS dynamically analyzes I/O patterns to optimize data placement and resource usage in real time. It supports inline compression and de-duplication, ensuring space efficiency. With native encryption, secure snapshots, and multi-tenancy features, PowerMaxOS also ensures strong data protection and isolation.
PowerMax replication
PowerMax local replication includes TimeFinder/SnapVX (snapshots) and TimeFinder/Clone (clones), and PowerMax remote replication includes the SRDF product line. TimeFinder provides point-in-time local replication and data protection, and SRDF provides continuous local replication and data protection.
PowerMax local and remote replication are integrated so that remote snapshots or clones can be easily taken from or restored to SRDF target devices. One benefit of this integration is that it allows the creation of remote copies of the source application without interrupting remote replication. If the source application data is corrupted, the remote snapshot (or clone) and SRDF can restore the data in parallel to the source volumes. Both PowerMax local and remote replication send only changed data when applicable, except when an initial full sync of SRDF is required.
Unisphere for PowerMax
Unisphere for PowerMax is an HTML5 web-based application that enables you to provision, operate and maintain PowerMax, VMAX All Flash, and VMAX storage systems.
Unisphere for PowerMax 10.2.0.x supports:
Storage systems (PowerMax 2500 and PowerMax 8500) running PowerMaxOS 10 (6079)
Storage systems (PowerMax 2000, PowerMax 8000, VMAX 250F, VMAX 450F, VMAX 850F, and VMAX 950F) running PowerMaxOS 5978
Storage systems (VMAX 100K, VMAX 200K, VMAX 400K, VMAX 250F, VMAX 450F, VMAX 850F, and VMAX 950F) running HYPERMAX OS 5977
A Representational State Transfer (REST) API is also built into Unisphere for PowerMax. The REST API allows you to access diagnostic, performance, and configuration data, as well as perform provisioning operations on the storage system through interfaces like the CSI driver. Full documentation for the Unisphere for PowerMax REST API is available at developer.dell.com or from the Help menu within the Unisphere for PowerMax User Interface.
Solutions Enabler
Solutions Enabler (SE) is a powerful command-line interface (CLI) tool designed for managing, automating, and monitoring Dell PowerMax storage systems. It provides granular control over a wide range of storage operations, including those that are unavailable in Unisphere for PowerMax. SE is especially well-suited for advanced users who require scriptable, reliable, and automation-friendly interfaces for enterprise-scale storage environments. Administrators can use SE to provision storage, manage replication (including SRDF and SnapVX), configure access control using masking views, and pull real-time performance and health metrics.
Installed on a Windows, Linux, or UNIX management host, SE can communicate with arrays using either in-band (over HBA) or out-of-band (over IP) connections. It is frequently used in automated workflows, batch jobs, and integrations with orchestration platforms such as Ansible.
VMware Cloud Foundation
VMware Cloud Foundation (VCF) is a complete software-defined management solution that consists of VMware vSphere, VMware NSX Data Center, VMware vSAN, and VCF Automation and Operations. VMware Cloud Foundation Installer drives the installation of VCF. The various components serve the following roles:
VMware Cloud Foundation Installer: A virtual appliance that the user deploys that automates the building of the management domain of VCF. Subsequent domains are provisioned through the SDDC Manager within VCF Operations.
SDDC Manager: Automates the life cycle management of VCF. It enables updating and upgrades, firmware application, and the general day-to-day operation of VCF.
VMware vSphere: Virtualizes the bare-metal servers using the ESXi software and aggregates them in the vCenter Server.
VMware NSX Data Center: Provides the networking for the VCF solution along with security and automation. NSX is designed for both private and public clouds.
VMware vSAN: An optional component that aggregates local or direct-attached storage in a single pool that can be shared across all ESXi hosts in the VCF environment.
VMware Cloud Foundation Automation: Empowers IT to deliver self-service cloud experience for AI, Kubernetes, and VM-based applications. It provides a platform for deploying and managing applications and services, enabling end-users to consume and manage resources in a self-service fashion.
VMware Cloud Foundation Operations: Provides a unified interface and set of capabilities to help organizations build, operate, and secure their cloud infrastructures built on VCF.
VMware portrays the high-level VCF implementation as depicted in the following figure .
Figure 1. VMware Cloud Foundation
Environment and system requirements
Environment and system requirements
Introduction
The following sections cover the requirements for implementing VCF on a PowerMax array using VMFS on FC as principal storage for both the management and workload domains.
Prerequisites
You must meet the following prerequisites before implementing VCF on PowerMax using VMFS on FC as principal storage. Storage provisioning is detailed in a later section.
Server requirements for VCF management and workload domains are as follows:
A minimum of four Dell servers with sufficient networking, memory, CPU, and local storage to satisfy the requirements of the VCF management domain.
A minimum of two Dell servers with sufficient networking, memory, CPU, and local storage to satisfy the requirements of a VCF workload domain running on VMFS on FC.
Storage requirements for VCF management and workload domains are as follows:
An installed PowerMax 2500 or 4500 array with embedded Unisphere for PowerMax.
At least four (4) front-end ports zoned to each VCF server, preferably in one-to-one zoning to two (2) dual-ported HBAs.
A two (2) TB volume for the management domain masked to the four management domain hosts.
A two (2) TB volume for the workload domain masked to a minimum of two workload domain hosts.
Licenses must be obtained for the VCF solution. A default evaluation license is in place for 90 days.
VCF components
VCF 9.0 includes a Bill of Materials (BOM) which dictates the versions for each component of the solution. VMware offers no ability to substitute. For example, even if there is a newer update for ESXi at the time of installation, VMware requires the version in the BOM. The versions for the primary components used in the solution in this paper are shown in the following table. The complete list is available at Broadcom Tech Docs Portal.
Table 3. Bill of Material
Software Component
Version
Build Number
VCF Installer
9.0.0.0
24755599
VMware ESX
9.0.0.0
24755229
VMware vCenter
9.0.0.0
24755230
VMware NSX
9.0.0.0
24733065
SDDC Manager
9.0.0.0
24703748
VMware NSX
9.0.0.0
24105817
VMware Cloud Foundation Automation
9.0.0.0
24701403
VMware Cloud Foundation Operations
9.0.0.0
24695812
Network topology
For the environment in this paper the following network exists. At the physical layer, two Top of Rack (TOR) switches are used for redundancy and load-balancing purposes. There are two connections from each Dell host NIC used in the solution, one to TOR A and one to TOR B. VCF requires two NICs (min 10 GbE) to form the vSphere Distributed Switch (VDS).
The following table shows the different VLANs that are configured for this solution.
Table 4. Network VLANs
Network type
VLAN ID
Management
105
VM
105
vMotion
150
In addition, a domain controller, DNS, and NTP server were built prior to VCF deployment.
VCF nodes
The VCF environment detailed in this paper consists of seven servers:
Four (4) for the management domain.
Three (3) for the workload domain.
Although the specifications of all servers are the same, they are listed below in the following table for completeness.
Table 5. VCF server configurations
VCF server configurations
VCF Fleet
A VCF fleet is a concept in version 9.0 that includes all the infrastructure components: VCF Operations, VCF Automation, vCenter, NSX Manager, vSphere Cluster, SDDC Manager, and management and workload domains. A fleet only has a single implementation of VCF Operations and Automation but can be comprised of multiple VCF instances. The following figure is a visual representation of a VCF fleet.
Figure 2. VCF Fleet
Domains
A domain is part of a fleet and is comprised of the vCenter, NSX Manager, vSphere Cluster (hosts and storage), and SDDC Manager. There are two types of domains in VCF: Management and Workload. The management domain is the set of resources that runs VCF and is the control center of the environment, responsible for hosting the management plane VMs. There is one management domain per VCF instance, though there can be multiple per VCF fleet.
Note: Prior to VCF 9, the SDDC Manager was the central management tool. While it is possible to continue to use SDDC Manager for some tasks, it is not recommended as it is deprecated and will be removed in a future release. VCF Operations is the new interface.
Workload domains are deployed from VCF Operations inventory and consist of the same components as the management domains; however, they have no management VMs. They are part of the VCF instance. These workload domains are typically used to run the applications for a business. The number of workload domains in a VCF instance is limited to 24.
The management and workload domains are usually comprised of separate hardware. For customers with fewer server resources or who want a smaller footprint or a POC lab, the management domain can also be a workload domain. This configuration is known as a consolidated architecture and can host customer workloads.
Storage
In VCF there are two distinct categories of storage, each serving a separate function in the solution. These categories are designated: Principal and Supplemental. Principal storage is what is required to deploy a management or workload domain or to deploy a new cluster into an existing workload. Supplemental storage, on the other hand, is storage that can be added to any existing management or workload domain post-deployment. Principal storage is restricted to four types: vSAN, VMFS on FC, vVols, or NFS v3. The management domain only supports vSAN, VMFS on FC, or NFS v3. The fourth type, vVols, can be used on workload domains, however. Supplemental storage supports all principal storage types as well as iSCSI and NVMe/TCP. The storage options are shown in the following figure.
Figure 3. VCF 9.0 storage options
It is important to understand that vSAN is the only storage VCF can completely control as part of the life cycle of an instance. If storage is presented using another protocol from an array like Dell PowerMax, the administrator has the responsibility of managing it. If a datastore needs expansion on the PowerMax, for example, the administrator would use Unisphere for PowerMax to expand the device and then expand the datastore in vCenter or the vSphere Client. This can be accessed through VCF Operations.
Vendor storage support
VMware does not publish storage support for VCF by vendor, rather they rely on the VMware Compatibility Guide for Storage/SAN. If the vendor is listed as supporting the protocol for the version of ESXi in the BOM, then it is supported with VCF.
Life cycle management
VCF has an integrated life cycle management function that facilitates the automation of upgrades to new versions. Because each version of VCF has a specific bill of materials, it is essential to use this function to maintain compliance. The interface is shown in the following figure.
Figure 4. Life cycle management
Deploying a VCF management domain on PowerMax FC
Deploying a VCF management domain on PowerMax FC
Introduction
The following sections detail the installation of the VCF management domain using the VMware Cloud Foundation Installer.
VCF installation
Although VCF consists of multiple software releases, it does not require that each of these components be installed independently. The installation of the base component of VCF, or management domain is accomplished using the VMware Cloud Foundation Installer which includes all the necessary software.
There are three steps to installation.
Prepare the environment. Preparation can be achieved through the Planning and Preparation Workbook that VMware provides. The worksheet is optional but helps guide the user on all the necessary information to complete the deployment wizard.
Image all servers with the ESXi version that is listed in the Bill of Materials. This installation is straightforward, choosing among the available methods, and then minor post installation modifications. ESXi is the only software that the VMware Cloud Foundation Installer does not install.
Install VMware Cloud Foundation and download or upload the BOM software releases. This installation requires first deploying the VMware Cloud Foundation Installer appliance which is a wizard-driven application used to create the management domain.
The next section covers the installation of the management domain, including the prerequisites.
ESXi installation
Each host used in the VCF deployment for the management domain must be imaged with the correct release of 9.0 referenced in the BOM (build 24755229 for GA release). Be sure to use the same root password for all hosts. Once installed complete these additional tasks.
VCF requires that there is a single vSwitch on the host (default configuration) on one of the NICs you will use when you deploy. (The environment in this paper uses two 10 GbE NICs as the installer will fail unless that minimum speed is used.)
Set both the IP, network information, and hostname post-installation.
Login to the vSphere Host Client and enable SSH. Regenerate the certificates so that they match the hostname. To regenerate the certificates, login to the host as root and run /sbin/generate-certificates. Then reboot the host. Technically, only hostd and vpxa require restart, but in testing that has not always been effective. A reboot guarantees success. The VCF installer will validate the hostname and certificate during deployment and if this is not done beforehand, validation will fail.
Set and start the NTP server on each ESXi host. This is an additional check the installer will do, though it will only produce a warning if it fails, which can then be skipped.
Note: The VCF installer requires the root password to be the same for all ESXi hosts for the management domain. The workload domain does not have this requirement.
PowerMax as VMFS on FC
To deploy the VCF management or workload domain on FC, each ESXi host in the cluster must see the same datastore using FC connectivity. VMware refers to this storage type as VMFS on FC. During the VCF validation step, VMware queries each ESXi host for the datastore the user provides. Therefore, after the ESXi installation is done, proceed with storage provisioning.
Note: Although the following sections refer to the management domain only, the exact same process is followed when deploying the workload domain.
FC connectivity
Each ESXi host should have two, two-port HBAs (32 Gb min) with connectivity to the PowerMax array. Zone each HBA port to an FA port on the array such that a single HBA is zoned to two different directors as in the following figure (switches are implied). Connectivity should be spread over multiple engines in larger arrays. Be sure to note the HBA WWNs which will be required in the next section.
Figure 5. FC connectivity for a single engine PowerMax
Storage provisioning
After zoning is complete, you can provision the device from the PowerMax array to serve as the storage for the management domain. Follow these steps.
Host creation
Begin by logging into Unisphere for PowerMax as a storage administrator.
Navigate through the menu on the left-hand side to Hosts > Hosts > Create > Create Host as demonstrated in the following figure.
Figure 6. Step 1 – Host creation
Enter in a Host Name for the first ESXi host then using the checkboxes on the left-hand panel.
Check each HBA initiator in the host and click the right-hand arrow in the middle of the panels to move the initiators over to the left-hand panel. Click Run Now to complete the wizard in the following figure.
Figure 7. Step 2 – Host creation
Repeat step 2 for each host in the management domain cluster. In this example there are four.
Create a host group so that all ESXi hosts will see the device/datastore.
Return to the screen in step 1 above and click Create Host Group. Enter in a host group name. In the left-hand panel, use the checkboxes to select each management domain host and click the right-hand arrow in the middle of the panels to move the hosts over. Click Run Now to complete the creation in the following figure.
Figure 8. Step 3 – Host creation
After host group creation, use the provisioning wizard in Unisphere to create and map the device to the management domain hosts.
Storage provisioning
Return to the Hosts page in the following figure and check the box next to the newly created host group. Next click the Provision Storage To Host to start the wizard.
Figure 9. Step 1 - Storage provisioning
Type in a Storage Group Name, select a Service Level, enter 1 for the Volumes, and then a Volume Capacity of at least 2 TB. Here 3 is used. Click Next.
Figure 10. Step 2 – Storage provisioning
In this step in the following figure create a port group. The Port Group Name will default, but it can be changed. Use the checkboxes to select the ports that were zoned to the HBA initiators. Click Next.
Figure 11. Step 3 – Storage provisioning
In the final step in the following figure, keep or change the Masking View name then click Run Now to complete the wizard.
Figure 12. Step 4 – Storage provisioning
The summary screen displays in the following figure showing the objects creations.
Figure 13. Storage provisioning summary screen
Once the storage is provisioned, the next step is to create the datastore for the management domain.
Datastore creation
Datastore creation is done on only one of the management domain ESXi hosts. Since each ESXi host sees the same device, it is only necessary to access one host, create the datastore, and then rescan the HBAs on the other hosts to discover the new datastore.
To create the datastore, begin by selecting one of the ESXi hosts and navigation to the IP address which will bring up the vSphere Client login screen.
Login as root as in the following figure.
Figure 14. Step 1 – Datastore creation
In the client, navigate to Storage > New datastore to start the wizard.
Be sure that the device created previously is shown in the list. If you do not see it, run a rescan on the HBAs.
Figure 15. Step 2 - Datastore creation
Type in a name for the datastore and be sure to record it somewhere for use during the VCF installation.
The VCF installer will not query the ESXi host to validate the datastore name until the very end of the wizard, so it is important to type it correctly at the appropriate step. Click NEXT.
Figure 16. Step 3 - Datastore creation
Highlight the previously created device from the list.
There should be only one device available in the following figure unless you created additional devices. Click NEXT.
Figure 17. Step 4 - Datastore creation
The datastore wizard in the next step allows the user to set a partition size for the datastore that is something smaller than the entire device.
This is not recommended. Select all free space in the following figure and click NEXT.
Figure 18. Step 5 - Datastore creation
Review the summary screen in the following figure and click FINISH to create the datastore.
Figure 19. Step 6 - Datastore creation
The datastore should now be available in the following figure. Be sure to log in to the other ESXi hosts and check that they also see the new datastore. Rescan the adapters if necessary until it appears as below.
Figure 20. VCF datastore
You may now proceed with the VCF installation wizard.
VMware Cloud Foundation Installer
The VMware Cloud Foundation Installer is a virtual appliance with a UI that guides the user through either a VMware vSphere Foundation or VCF installation. Prior to this release, the installer (aka Cloud Builder) relied on the use of an Excel spreadsheet. The spreadsheet itself still exists for the purpose of planning the installation as previously noted. It is named vcf-9.0-planning-and-preparation-workbook.xls and can be found at this link VCF Planning and Preparation Workbook. It is useful for recording all the information necessary to complete the wizard.
Note: While the VMware Cloud Foundation Installer is the preferred method for a VCF installation, there is a VCF CLI which can be used. The major difference between the UI and CLI is the ability to highly customize a CLI installation. Environments with unique networking requirements, for example, may require the use of the CLI.
The appliance is best deployed on an existing ESXi host or vCenter with access to the networking of the VCF environment.
Once deployed, log in as the admin@local user.
The screen in the following figure appears. Unlike the previous VCF installer, this one requires the user to either download (online depot) or upload (offline) the software products for the chosen deployment type.
Figure 21. VMware Cloud Foundation Installer
Click the DEPOT SETTINGS button to configure the depot and download the components for the chosen install.
The following figure demonstrates an online depot configuration and an active process of downloading the VCF software.
Figure 22. Depot settings for VCF installer
When the downloads are completed for the product, the white box currently indicating Partially downloaded in the VMware Cloud Foundation Installer figure above will turn green and show Downloaded. At that point, the deployment can begin.
In the Deploy box on the right, use the drop-down menu of the DEPLOYMENT WIZARD and select VMware Cloud Foundation.
Prior to starting the installation, the user must select whether this is a new VCF Fleet or an installation into an existing VCF implementation. The following figure presents the two options. Use the radio buttons to choose the appropriate installation. This paper documents a new installation and thus the radio button is left at the default. Click CONTINUE to start the wizard in earnest.
Figure 23. VCF fleet deployment options
VMware Cloud Foundation Wizard
The VCF wizard consists of thirteen steps in this implementation, though not all require user input. The steps follow the order of the boxes in , beginning with VCF Operations. Helpfully, the installer saves your steps as you proceed so you can leave the process at any point and return to where you left off. This section walks through those steps. The images are included as it is likely future releases of the installer will change.
Select Existing Components.
Even if you select to deploy a new VCF fleet, you can choose to incorporate existing software, specifically CF Operations or VMware vCenter. If you select VMware vCenter you will be prompted with a checkbox for a second product, NSX Manager. Select that also if appropriate. The following figure shows these checkboxes selected and note on the right-hand side that the VCF Fleet image adds Existing boxes to those components. See also that the number of steps is reduced from thirteen to eight. There are no existing components here so clear the boxes and click NEXT to continue.
Figure 24. Step 1 – Existing Components
General Information
In Step 2 the version defaults to GA. Then supply the VCF instance and management domain names. Be aware that the management domain name is going to be used in all vCenter objects, so it is best to use a descriptive one. Choose whether you want VCF Operations and Automation to use a different network than the rest of the install. If you plan on multiple VCF instances in your fleet, you may wish to do that.
Next, select a deployment model. Unless this is a test environment, you should use the HA option. Depending on the selected deployment model steps 3, 4, and 6 will appear differently. The HA option is going to need more hosts (FQDN) names since there are three nodes, not one, for VCF Operations, VCF Automation, and NSX Manager. Finally supply the DNS and NTP information. Remember that in this environment a server with these components was built prior to running the installer. Click NEXT.
Figure 25. Step 2 - General information
VCF Operations
There are four sections to enter in step 3: VCF Operations Appliance, Load Balancer (optional), Fleet Management Appliance, and Operations Collector Appliance. Use the checkboxes, if desired, to set all appliances to the same passwords as VCF Operations. Click NEXT.
Figure 26. Step 3 – VCF Operations
VCF Automation
While in step 1 you could choose to use an existing VCF Operations instance. In step 4 you can bypass installing VCF Automation and connect one later. Otherwise, supply the necessary FQDN and IPs. In the image on the right, a white checkmark in a green circle appears for each step as you move through the wizard. Click NEXT.
Figure 27. Step 4 – VCF Automation
vCenter
For the vCenter supply the FQDN, an appliance compute (CPU/memory) and storage size, the SSO domain name, and passwords. The data center and cluster names will default, using the domain name set in step 2 as the prefix. You can change them, however. Click NEXT to continue.
Figure 28. Step 5 - vCenter
NSX Manager
The NSX Manager requires an appliance size and four FQDNs. Dell Technologies recommends setting the appliance size to the same as that used for the vCenter. Input all necessary passwords and click NEXT.
Figure 29. Step 6 – NSX Manager
Storage
At the storage step, use the radio button to select VMFS on Fibre Channel (FC) and type in the name of the datastore previously created in the section Datastore creation. Double-check the spelling as the installer will not validate it until step 13. Click NEXT.
Figure 30. Step 7 - Storage
Hosts
Here, in the following figure, enter the root password and the FQDN of at least four ESXi hosts previously configured in ESXi installation. You can confirm the fingerprints of each host individually, or all at once using the CONFIRM ALL FINGERPRINTS button. If one or more fingerprints fail to confirm, there is a mismatch between the entered FQDN and the certificate on the host. This typically occurs because the certificates were not re-generated. Review the ESXi installation section, regenerate the certificates, and try to confirm the fingerprints again. Click NEXT when complete.
Figure 31. Step 8 - Hosts
The next two steps deal with networking.
Networks
In step 9 enter in the required information for the ESXi management, VM management, and vMotion networks. By using the checkbox, you can set the VM management network to the ESXi management network as was done in the following figure. Be sure the gateway address is available since it will be validated in step 13. Click NEXT.
Figure 32. Step 9 - Networks
Distributed Switch
In the following figure, decide whether to use the default configuration for the distributed switch or a custom one. Although this environment is not very complicated, even minor changes necessitated a custom solution. There is greater flexibility in VCF 9 than previous releases. Here you can configure multiple distributed switches. If your storage environment separates the data and management paths, that can be achieved. In this setup there is a single distributed switch with two 10 Gb/E NICs. Each component is assigned to a port group. The NSX-Overlay was configured with an IP pool, rather than DHCP. Click NEXT.
Figure 33. Step 10 – Distributed Switch
SDDC Manager
The last input screen is for the SDDC Manager. Provide an FQDN and the necessary passwords in the following figure.
Figure 34. Step 11 - SDDC Manager
Review
In Step 12 in the following figure, review your answers. If anything is incorrect, you can go back and change it in that step and return to this screen. You will not have to travel all the steps again. If you want, download the JSON spec. This is highly recommended because if you must re-install or start over you can supply the JSON and then edit in the wizard without inputting again. When ready hit NEXT.
Figure 35. Step 12 - Review
Validate and Deploy
The final screen runs an automatic validation of the previous input values. Any warnings can be acknowledged, while errors must be resolved. Network errors are common – inability to reach DNS or a gateway. If you misspelled your FC datastore it will be noted here. An example of a warning would be if the NTP server is not set properly on the VCF Installer as in the following figure. You can bypass it by acknowledging it after verifying it is set properly.
Figure 36. NTP warning
If you have no issues, or resolve them all, you seethee following screen . When ready click DEPLOY to start the process.
Figure 37. Step 13 – Validate & Deploy
Once you click DEPLOY, you will be presented with the progress screen in where you can actively watch the installation and the current task.
Figure 38. VCF installation progress screen
The deployment time varies according to the environment and is measured in hours. Any errors during installation must be resolved, and the deployment attempted again. There is no cleanup or reset. Troubleshooting information is available from Broadcom here.
Upon successful completion, you are directed in the right-hand panel in the following figure to log in to VCF Operations to add your licensing information. If you are just evaluating, no further step is required.
Figure 39. VCF successful deployment
VCF Operations
VCF Operations is the heart of VCF 9.0, taking the place of SDDC Manager as the primary management tool. The UI login is in the following figure.
Figure 40. VCF Operations login
Once accessed, the various screens and sub-screens are shown on the left-hand menu in VCF Operations. If you navigate to Infrastructure Operations > VCF Health in the following figure , it provides an overall summary of the VCF instance. All aspects of the environment are available for monitoring, including the collection of metrics. There is an option to deploy a log appliance if desired.
Figure 41. VCF health
This completes the management domain deployment. The next chapter will cover adding a workload domain.
Deploying a VCF workload domain on PowerMax FC
Deploying a VCF workload domain on PowerMax FC
Introduction
The following sections detail the installation of the VCF workload domain from within VCF Operations.
ESXi installation
Any node that is part of a VCF deployment requires the user to install the ESXi version as listed on the bill of materials. This includes the workload domain. Therefore, before creation of a workload domain, the user must install ESXi on at least two nodes, the minimum for VMFS on FC (each principal storage type has a minimum number of nodes). The ESXi image must be the 9.0 release referenced in the BOM (build 24755229 for GA release). The workload domain does not require the same root password on each host, unlike the management domain. Once installed, complete these additional tasks.
VCF requires that there is a single vSwitch on the host (default configuration) on one of the NICs you will use when you deploy. The workload domain requires the other physical NIC is free. The environment in this paper uses two 10 GbE NICs, the minimum required amount and speed.
Set both the IP, network information, and hostname post-installation.
Log in to the vSphere Host Client and enable SSH. Regenerate the certificates so that they match the hostname. To regenerate the certificates, login to the host as root and run /sbin/generate-certificates. Then reboot the host. Technically, only hostd and vpxa require restart, but in testing that has not always been effective. The VCF installer will validate the hostname and certificate during deployment and if this is not done beforehand, validation will fail.
Finally, set and start the NTP server on each ESXi host. This is an additional check the installer will do, though it will only produce a warning which can be skipped.
Storage
For VMFS on FC, you will need a minimum 2 TB datastore masked to each ESXi host. Storage provisioning was covered in section PowerMax as VMFS on FC so it will not be repeated here. There is no difference between presenting a PowerMax device to ESXi hosts for the management domain versus the workload domain. Zone the workload domain hosts and then create the host groups, port group, device, and masking view. Log in to one of the ESXi hosts and create the datastore in the following figure with your desired name.
Figure 42. VCF_WKLD_POWERMAX datastore for the workload domain
vMotion network pool
A workload domain requires the creation of a static network pool for vMotion. Follow the steps below.
Log in to the management domain vCenter
Click the hamburger menu in the left-hand corner of the client.
Navigate to Global Inventory Lists > Resources > Hosts.
Click the Network Pools tab in the right-hand panel.
Click + CREATE NETWORK POOL in the following figure.
Figure 43. Step 1 - Create network pool
Enter the required information for the network pool.
The vMotion box is checked and is the only required Network Type for VMFS on FC. When setting the IP range, be sure to set enough addresses for the number of hosts in the workload domain. You can add multiple address ranges or add more in the future.
Figure 44. Step 2 - Create network pool
The new pool in will be available and assigned during the commissioning of the ESXi hosts which is covered next.
Figure 45. vMotion pool
Click SAVE to complete.
Commission hosts
To deploy a workload domain, regardless of storage protocol, the user must first commission ESXi hosts. Essentially these hosts are added as inventory which is then available for deployment. Principal storage must be assigned to the hosts to create a new workload domain. Here, once again, VMFS on FC is used on PowerMax. Hosts must be prepared for commissioning in the same way they were for the VCF base installation. As noted, VCF requires a minimum of two hosts for VMFS on FC. This environment is deployed using three.
From the same screen in Step 1 - Create network pool, select the Unassigned Hosts tab in the following figure. Select COMMISSION HOSTS.
Figure 46. Step 1 - Commission hosts
The first screen that appears is a checklist that the user is required to validate before proceeding. Although VMware calls it a checklist, it is merely a list of prerequisites. This list is not as extensive as the list for VCF but is nevertheless important to validate. Be sure that all items are completed before selecting the PROCEED button as in the following figure.
For each host in the workload domain, type in the Host FQDN, use the radio button to highlight the Storage Type VMFS on FC, use the dropdown box to select the Network Pool Name previously created in the section vMotion network pool, and enter a User Name and Password. Then click ADD in the following figure.
Figure 48. Step 3 - Commission hosts
Complete the addition of all the hosts in the following figure.
Figure 49. Step 4 - Commission hosts
With the hosts added, click the Confirm all Finger Prints and then click VALIDATE ALL in the following figure.
A message should appear at the top that the hosts are validated. If any of the hosts fail to validate, check that the certificates on the ESXi host were regenerated as the failure usually indicates a mismatch between the FQDN and certificate. Click NEXT to continue to the summary page.
Figure 50. Step 5 - Commission hosts
Before selecting the COMMISSION button in the following figure, review the validated hosts. Despite the hosts passing validation in the previous step, there is still a chance that a host fails to commission. To that end, VMware offers a toggle at the top which lets the wizard skip failed hosts. Though unlikely, for example a network failure before commission, it is best to leave it set on. A failed host can be repaired and then commissioned again afterwards. The commissioning process does take some time to complete. Click COMMISSION to complete the wizard.
Figure 51. Step 6 - Commission hosts
Upon completion, the new hosts are displayed in the Unassigned Hosts panel in the following figure, and can now be used for the workload domain.
Figure 52. Unassigned hosts
Workload wizard
Initiate the workload wizard by navigating in VCF Operations to Inventory > VCF Instances > <instance name>.
After highlighting the instance, the ADD WORKLOAD DOMAIN menu appears in the right-hand panel.
Use the dropdown box in the following figure and select Create New….
Figure 53. Initiate workload domain creation
This initiates the wizard. Unlike the management domain installation, there is an initial prerequisite checklist like that seen when commissioning hosts. You must acknowledge all items in the following figure to proceed.
Figure 54. Workload Domain Prerequisites
There are a total of ten steps in the workload domain installation for VMFS on FC. Initially only nine will be present in the images until the Storage stage is passed. They follow here.
General Information.
Begin the wizard by providing the required information in the following figure:
Workload Domain Name
SSO Domain Name
SSO Administration Password
Confirm Administration Password
Both Enable vSphere Supervisor and Password Creation are checked on by default. In this implementation they are off. If you choose to use the vSphere Supervisor (containers) you will be required to provide additional networking information. It can be enabled later if desired instead. Click NEXT.
Figure 55. General Information
vCenter.
Enter in a vCenter unique FQDN, vCenter Root Password, and the confirmation. If you want to confirm the DNS lookup information, click the eye next to Show IP Configuration as has been done in the following figure. Click NEXT to continue.
Figure 56. vCenter
Cluster.
Type in a Cluster Name for the workload domain. Unlike the management domain, the name is not generated from the workload domain name. Click NEXT.
Figure 57. Cluster
Image.
This next step is one of the prerequisites. In a new implementation there will be a single image listed, the one used in the management domain. The user may elect to create a new one and then REFRESH, or as here simply select it in the following figure and click NEXT to move forward.
Figure 58. Image
NSX Manager.
In the following figure, choose whether you want to join an existing NSX Manager setup or do a new deployment (default). If you create a new instance, choose a Deployment Size. High-Availability is recommended and selected below. Then fill out the following fields. The appliance IP addresses are generated from the FQDN automatically. Issues with DNS will be apparent if the required lookup fails:
Appliance Size
Appliance 1 FQDN
Appliance 2 FQDN
Appliance 3 FQDN
Appliance Cluster FQDN
Administrator Password and confirmation
Auditor Password and confirmation
Finally, select the type of connectivity. Centralized Connectivity is the default and recommended and thus chosen here.
Figure 59. NSX Manager
Storage.
Use the radio buttons to select VMFS on FC and click NEXT in the following figure. Once selected, an additional step appears for FC Storage which is configured next.
Figure 60. Storage
FC Storage.
A new datastore should have been created as part of the perquisites from the Storage section. Enter this newly created datastore in the Datastore Name field. Recall that the wizard will not validate this name until the end of the process.
Note: The VMs created as part of a workload domain, unlike the management domain, are not stored in the datastore used for the deployment. The VMFS assigned to the workload domain will still be empty post-installation. The VMs for the vCenter and NSX are stored in the management domain VMFS. The resources of the workload domain hosts, therefore, are fully available to service application workloads.
Figure 61. FC Storage
Hosts.
If you commissioned the hosts properly in , then they are available for selection in the following figure. Though there are three hosts here, the wizard reports in parentheses that only 2+ hosts required.
Figure 62. Hosts
Distributed Switch.
When configuring the distributed switch, you can select the Default configuration which is a preconfigured profile or create a custom switch configuration. A custom switch configuration allows greater flexibility than the default. For example, with a custom switch, a user could separate the data and management paths if they intend on using iSCSI or NVMe/TCP with PowerMax as supplemental storage. The options are in the following figure. The ESXi hosts for the workload domain in this implementation were built like the management domain and therefore the Default configuration is acceptable.
Figure 63. Step 9a – Distributed Switch
After selecting the default configuration, you will be prompted to set up a Transport VLAN. Use the Edit button in the following figure to set the Transport VLAN.
Figure 64. Step 9b – Distributed Switch
After clicking Edit, scroll down in the screen and type in the Transport VLAN. Click SAVE CHANGES.
Figure 65. Step 9c – Distributed Switch
Once complete, the NEXT button is available in the following figure. Click it.
Figure 66. Step 9d – Distributed Switch
Review.
The last screen shows all the step information entered. Review carefully and if anything requires change, you can click back to any step and fix it. When ready click FINISH in the following figure which initiates both the validation and the workload domain creation.
Figure 67. Review
You can view the progress of the creation by clicking VIEW SDDC MANAGER TASKS in the dialog in the previous figure or, if you clicked CLOSE, then navigate to Fleet Management -> Tasks in VCF Operations as shown in the following figure.
Figure 68. Tasks – workload domain creation
When the workload domain creation is complete, you can view it in Infrastructure Operations -> VCF Health in the following figure.
Figure 69. PowerMax-Workload Domain
The domain is now ready for VM deployment of your chosen workloads.
Supplemental Storage
Supplemental Storage
Introduction
This chapter explains how to present supplemental storage to a workload domain using the NVMe/TCP protocol.
Supplemental storage
Supplemental storage is any storage that is presented to a management or workload domain after initial deployment. It is still considered supplemental storage even if it is the same principal storage type used during the installation. The PowerMax supports all supplemental storage except vSAN as that is a proprietary VMware solution. To demonstrate the flexibility of the PowerMax, the following sections detail provisioning supplemental storage, using the NVMe/TCP protocol, to the previously created workload domain. Furthermore, a different PowerMax array is employed for this purpose.
NVMe/TCP
NVMe/TCP is a storage protocol that allows NVMe-based flash storage to be accessed over standard TCP/IP networks, offering high performance without the need for specialized hardware like Fibre Channel or RDMA. When used with SAN storage like the PowerMax, NVMe/TCP provides a scalable, low-latency alternative to traditional protocols like iSCSI, making it well-suited for all-flash environments and software-defined infrastructure. In VCF environments, NVMe/TCP enables ESXi hosts to connect to NVMe-capable PowerMax arrays over standard 10/25/100 GbE networks, combining the performance advantages of NVMe with the simplicity and flexibility of IP networking. It integrates with VMware’s native multipathing and supports VMFS and vVols.
NVMe/TCP PowerMax configuration
NVMe/TCP is an emulation that is configured on a PowerMax director. Once setup and cabled, you can configure the IP interfaces so that the ESXi hosts can attach to the storage controllers. The NVMe/TCP configuration is driven by a wizard in Unisphere for PowerMax. What follows is an example of configuring one of the ports on the array.
NVMe/TCP Configuration Wizard
Log in to Unisphere for PowerMax and navigate to System > iSCSI + NVMe in the left-hand menu and then select the NVMe tab.
On the right-hand Actions menu click NVMe/TCP Configuration Wizard.
Figure 70. NVMe/TCP configuration screen
NVMe/TCP Endpoint
Use the drop-down menu and select an available Director in the following figure. In this array there are two NVMe/TCP ports, and as OR-1C is already configured, select OR-2C. Enter a Network ID. This value can be any number (not in use), however if you need IP routes, then the same Network ID is used there. In this example the fourth octet is used, 248. The TCP Port should be 4420. Though you can provide an Endpoint Name, Dell Technologies recommends letting it default. Click Next.
Figure 71. Step 1 – NVMe/TCP Endpoint
IP Interface
Use the drop-down menu to select the Dir:Port. If you only have one port on the chosen director, it will default. Enter in an IP Address, Prefix Length, VLAN ID and the Max Trans Unit. The MTU should match what you use in vSphere, which is 9000 by default. Check the Use Jumbo Frames box if appropriate and select the Centralized Discovery Controller. Normally leave it at the default of Auto Discovery of CDC IP Address. Click Next.
Figure 72. Step 2 - IP Interface
Summary
Review the Summary and if necessary, adjust. When ready, click Run Now.
Figure 73. Step 3 – Summary
Now both IP interfaces are available in the following figure.
Figure 74. NVMe/TCP configuration with two ports
Now configure vSphere for NVMe/TCP.
Network
In a customer environment, the NVMe/TCP storage network might be on a separate switch than the management. If that is the case, during the initial network deployment you could create a second distributed switch if desired. In this example, however, the NVMe/TCP network uses the same VDS but on a different VLAN, 100. Therefore, we need to create a new distributed port group with the proper VLAN on the distributed switch.
NVMe/TCP distributed port group
To create a new distributed port group, you must use login directly to the vCenter. VCF Operations has limited capabilities around network administration and cannot be used to create the group.
Log in to the workload domain vCenter as the administrator and navigate to the workload domain distributed network switch in the left-hand screen. In the right-hand screen click ACTIONS > Distributed Port Group > New Distributed Port Group. This navigation is shown in the following figure.
Figure 75. Add a new distributed port group
Name and location.
Enter a new port group Name for NVMe/TCP. Dell Technologies recommends using a name that references the function. In this example, the name used in the following figure is pmax-wkld-clus-vds-01-pg-nvmetcp. The Location cannot be changed since it was already selected for object creation. Click NEXT.
Figure 76. Step 1 – Name and location
Configure settings.
In the Configure settings step, use the dropdown for VLAN type and select VLAN. Then enter a VLAN ID. Click NEXT to continue.
Figure 77. Step 2 – Configure settings
Ready to complete.
Review the summary page and if correct, click FINISH.
Figure 78. Step 3 - Ready to complete
Load balancing and failover
The NVMe over TCP adapter does not support such NIC teaming features as failover and load balancing. Instead, it relies on storage multipathing for these functions. Because both NICs are active in the VCF VDS configuration, it is necessary to set one of the uplinks to Unused in the distributed port group.
Before editing the distributed port group, determine the association of physical NIC to uplink. This is critical because when you add the NVMe/TCP adapter to vSphere you must specify a physical NIC, and you must select the one with the active uplink and not the unused uplink.
Uplink NIC association
In vCenter, navigate to one of the ESXi hosts in the left-hand screen, then on the right-hand screen select Configure > Networking > Virtual switches. View the VDS and expand the uplinks in the right-hand side of the diagram. Each uplink is associated with a physical NIC. In vCenter, this example in the following figure, uplink1 is associated with vmnic4 and uplink2 is associated with vmnic5. Record this information.
Figure 79. Uplinks and associated NICs
Modify distributed port group
In vCenter, highlight the NVMe/TCP distributed port group in the left-hand screen. In the right-hand screen navigate to ACTIONS > Edit Settings….
Figure 80. Edit settings
Select Teaming and failover in the left-hand menu in the following figure. Both uplinks display under Active uplinks under Failover order in the right-hand screen. Highlight one of the uplinks of your choice and use the MOVE DOWN button to list it under the Unused uplinks. No other changes are required. Click OK to complete.
Figure 81. Modify uplinks
Remember to note which NIC is active.
VMkernel adapters
After creating and modifying the distributed port group, add a VMkernel adapter for each ESXi host.
Navigate to the new distributed port group in the left-hand screen and in the right-hand screen select ACTIONS > Add VMkernel Adapters…
Figure 82. Add VMkernel adapters
Select hosts.
Use the checkboxes to select all ESXi hosts in the workload domain. Click NEXT.
Figure 83. Select hosts
Configure the VMkernel adapter.
Select the Enabled services for the adapter which is NVMe over TCP. If you fail to check this box, it will not be possible to add the storage controllers in vSphere for NVMe/TCP. Check the box and click NEXT.
Figure 84. Configure VMkernel adapter
IPv4 settings.
Use DHCP or assign a static IP to each ESXi host. If you use static, once you enter the first IP, vSphere offers to auto-fill the other IPs and subnets. A gateway is typically not required. Once complete click NEXT in the following figure.
Figure 85. IPv4 settings
Ready to complete.
Review the proposed changes and if acceptable click FINISH.
Figure 86. Ready to complete
After vSphere adds the VMkernel adapters, it is a best practice to log in to each ESXi host as root and run a vmkping to the IP interfaces on the array to ensure connectivity. Unisphere for PowerMax also offers the ability to ping the hosts from the IP interface. To do this, check the box next to one of the IP interfaces and click Ping Remote IP. Enter the IP of one of the VMkernel adapters and click OK. An example is shown in the following figure.
Figure 87. Ping Remote IP in Unisphere for PowerMax
NVMe/TCP adapter
For each ESXi host, add an NVMe/TCP adapter. Do this in vCenter by highlighting an ESXi host in the left-hand screen and navigating toConfigure > Storage > Storage Adapters in the right-hand screen. Use the drop-down list under ADD SOFTWARE ADAPTER to select Add NVMe over TCP Adapter. You will be immediately prompted to select a Physical Network Adapteras in the following figure. Use thedropdownn to select the NIC that is associated with the active uplink you set in Modify distributed port group.
Figure 88. Adding NVMe/TCP adapter
Repeat these steps for the other two ESXi hosts using the same NIC.
Storage controller
It is now possible to add the PowerMax array controllers to each ESXi host in the workload domain.
Add controller.
In vCenter, highlight an ESXi host in the left-hand screen and navigate to Configure > Storage > Storage Adapters in the right-hand screen. Scroll down the adapters to the bottom and use the radio button next to the newly added NVMe/TCP adapter.In the bottom panel, select the Controllers tab and then click ADD CONTROLLER in the following figure.
Figure 89. Step 1 – Add controller
Add controller automatically.
When adding the controllers, it is easiest to use the auto functionality rather than manual mode. First, be sure the Host NQN is set. In the unlikely event it is not set, a restart of the management agents or reboot of the ESXi will be needed. You cannot add the controllers without a host NQN. Enter the IP of one of the IP Interfaces previously configured in Unisphere for PowerMax, then click DISCOVER CONTROLLERS. Both IP interfaces should populate the box in the bottom screen. Use the checkboxes to select both and click OK to add them.
Figure 90. Step 2 – Add controller automatically
Review the result in vCenter in the following figure.
Figure 91. NVMe/TCP connectivity to PowerMax
Storage provisioning
With connectivity established, we can provision storage. As host creation was previously covered in Host creation, this section will be abbreviated, noting only the differences for NVMe/TCP.
Hosts
When you add the PowerMax controllers to vSphere, the host NQN is automatically provided to Unisphere for PowerMax in much the same way that zoning works for FC. Therefore, when you create the host, select the NVMe/TCP radio button, type in a HostName, and find the host NQN in the list of initiators on the left. Use the checkbox and then the right-hand arrow to push it to the right. An example is shown in the following figure. Click Run Now.
Figure 92. Creating a host for NVMe/TCP
Repeat this process for the other two ESXi hosts. Then create a host group so you can provision storage to all hosts at once as below.
Figure 93. NVMe/TCP host group creation
Device provisioning
Now, using the autoprovisioning wizard, allocate devices to the host group. In the Hosts screen as in Step 1 - Storage provisioning, use the checkbox to select the newly created host group and click Provision Storage To Host. Enter in a Storage Group Name and then the desired devices along with their size and service level. In the following image, we create two devices, each 1 TB but one with a Diamond service level and one with a Bronze. These two service levels will satisfy different application requirements in the workload domain. Click Next.
Figure 94. Devices for supplemental storage
Create a port group for NVMe/TCP. Select the two ports previously used in the IP Interface configuration. Note that the Port Group Type in the following image is automatically selected based on the host group. Click Next.
Figure 95. NVMe/TCP port group
Complete the masking view to present the storage to each ESXi host. Note that unlike FC devices, it is unnecessary to rescan the adapters. The hosts will immediately discover the new devices without interaction. Click Run Now.
Figure 96. NVMe/TCP masking view
View the new devices in vCenter.
Figure 97. NVMe/TCP devices in vCenter
Datastores
Creating datastores on NVMe/TCP devices does not differ in any way from those created on FC. Use the datastore wizard and the NVMe/TCP devices will appear as in the following figure.
Figure 98. Datastore wizard
If the devices are the same size as here, with different service levels, you can compare the WWN in Unisphere with the eui number and create the datastores using identifying names. Here are the newly created datastores in vCenter and VCF Operations in the following figures respectively, labeled so the VMs are assigned to their correct service level.
Figure 99. Supplemental storage view in vCenter
Figure 100. VCF Operations view of supplemental storage
The supplemental storage is now available for workload domain applications.
Protection
Protection
Introduction
Dell PowerMax offers several technologies to help protect both the management and workload domains when deployed on FC. The chapter serves as an introduction to them and how they can be used in a VCF environment to provide both backup and recovery. This chapter is not meant to serve as an in-depth implementation guide, rather it lays out the different options a customer may explore.
TimeFinder/SnapVX
TimeFinder/SnapVX, or SnapVX, is a local replication solution that creates point-in-time copies, or snapshots, of PowerMax devices. SnapVX creates snapshots by storing changed tracks (deltas) directly in the SRP of the source volume. With SnapVX, you do not need to specify a target volume and source/target pairs when you create a snapshot. If the application ever needs to use the point-in-time data, you can create links from the snapshot to one or more target volumes. If there are multiple snapshots and the application needs to find a particular point-in-time copy for host access, you can link and relink until the correct snapshot is located. Snapshots are crash-consistent copies of the data.
Snapshot policies
The snapshot policy feature provides snapshot orchestration at scale (1,024 snaps per storage group). The feature simplifies snapshot management for snapshots. Snapshots can be used to recover from data corruption, accidental deletion, or simply as backup targets, offering continuous data protection. Many snapshots can be difficult to manage and therefore the snapshot policy feature provides an end-to-end solution to create, schedule, and manage snapshots.
The snapshot policy (Recovery Point Objective (RPO)) specifies how often the snapshot should be taken and how many of the snapshots should be retained. The snapshot may also be specified to be secure (these snapshots cannot be terminated by users before their time to live (TTL), derived from the snapshot policy's interval and maximum count, has expired). Up to four policies can be associated with a storage group, and a snapshot policy may be associated with many storage groups.
VCF domains
The following policy is one example of how to protect both the management and workload domains.Create a policy that instructs the array to take a snapshot every hour by logging into Unisphere for PowerMax and navigating to Data Protection in the left-hand menu, then Snapshot Policies, and clicking Create Snapshot Policy. These snapshots rotate over seven days. For additional protection, set the policy to use the secure feature which prevents accidental deletion Click Create. The definition is shown in the following figure.
Figure 101. Snapshot policy
Now assign the policy to each VCF domain in the following figure.
Figure 102. Assigned storage groups to snapshot policy
Using local replication, the VCF environment is now protected.
SRDF
The Dell Symmetrix Remote Data Facility (SRDF) family of products offers a range of PowerMax-based disaster recovery, high availability, and data migration solutions. SRDF configurations require at least two PowerMax systems. Both sites can be in the same room, in different buildings within the same campus, or hundreds to thousands of kilometers apart, depending on the replication mode.
SRDF disaster recovery solutions are based on active remote mirroring and dependent-write consistent copies of data maintained at one or more remote locations. A dependent write is a write operation that an application cannot issue until a prior, related write I/O operation completes. Dependent-write consistency is required to ensure transactional consistency when the applications are restarted at the remote location. Replication can be synchronous or asynchronous.
SRDF/Synchronous (SRDF/S) is a disaster-restart solution that operates in synchronous mode and maintains a real-time (synchronous) mirrored copy of production data (R1 devices) in a physically separated VMAX/PowerMax system (R2 devices) within an SRDF configuration. SRDF/S is a method of replicating production data changes from locations less than 200 km apart.
Synchronous replication takes writes that are inbound to the source PowerMax and copies them to the target PowerMax. The resources of the storage arrays are exclusively used for the copy. The write operation from the virtual machine is not acknowledged back to the host until both PowerMax arrays have a copy of the data in their cache. SRDF/S is a building block of several multisite disaster restart options such as SRDF/Star.
SRDF/Asynchronous (SRDF/A) mode provides a dependent write consistent copy on the target (R2) device, which is only slightly behind the source (R1) device. SRDF/A session data is transferred to the remote PowerMax array in predefined timed cycles or delta sets, which minimizes the redundancy of the same track changes being transferred over the link.
SRDF/A provides a long-distance replication solution with minimal impact on performance that preserves data consistency. If there is a disaster at the R1 site or if SRDF links are lost during data transfer, a partial delta set of data can be discarded, preserving consistency on the R2 with a maximum data loss of two SRDF/A cycles or less.
SRDF/Metro
An SRDF/Metro configuration is a high availability configuration with the following characteristics:
Devices on the additional array are read/write accessible to the application host.
The application host can write on both sides of the device pair.
The devices on the additional array assume the same external identity (such as geometry and device identifier) as the devices on the primary array.
This shared identity means that the devices appear to the application host as a single, virtual device across the two arrays. Using two devices improves the availability of the data that they contain. One device can become unavailable without impacting on the host application as the second device continues to operate.
When this configuration is employed in a VCF management or workload domain vCenter, it is known as a VMware Metro Storage Cluster (vMSC). It provides high availability within a campus radius. There is a single VCF implementation, but it uses two PowerMax arrays on the backend. Detail of this model can be found at: Broadcom - cluster models (https://techdocs.broadcom.com/us/en/vmware-cis/vcf/vcf-9-0-and-later/9-0/design/design-library/cluster-models/single-instance-multiple-availability-zones.html).
VMware Live Site Recovery
VMware Live Site Recovery Manager can leverage storage array-based replication such as SRDF to protect virtual machines in VCF environments. The interaction between VMware VLSR and storage array replication (SRA) is governed through a well-defined set of specifications. These VMware-defined specifications are implemented by the storage array vendor as a lightweight application referred to as the storage replication adapter.
Dell SRDF Adapter is an SRA that enables VMware VLSR to interact with a Dell storage environment. It allows VMware VLSR to automate storage-based disaster restart operations on PowerMax arrays in an SRDF configuration. The SRDF Adapter for VLSR supports SRDF/Synchronous, SRDF/Asynchronous and SRDF/Metro modes of operation with VCF.
Conclusion
Conclusion
Summary
VMware Cloud Foundation provides a complete, unified platform to build both a private and public cloud, combining compute, storage, networking, and management. VCF offers the flexibility of using various storage options to take advantage of the power and scalability of external arrays like PowerMax.
VCF supports VMFS on FC for both the management and workload domains, removing the need for vSAN. The PowerMax provides both superior performance and advanced features like local and remote replication for backup and disaster recovery. When using PowerMax it enables the VCF environment to become highly resilient, scalable, and able to handle the most demanding workload domains.
By following the guidelines outlined in this paper, the user can ensure the successful implementation of VCF 9 running on a PowerMax.
We value your feedback
Dell Technologies and the authors of this document welcome your feedback on the solution and the solution documentation. Contact the Dell Technologies Solutions team by email.
Dell Technologies Content Engineering and Translation team
:
References
References
Dell Technologies documentation
The following Dell Technologies documentation provides additional and relevant information. Access to these documents depends on your login credentials. If you do not have access to a document, contact your Dell Technologies representative.