VxRail: Add New Node Fails When Environment is Using Key Management Service (KMS)

Summary: In an environment using KMS servers, the process to add a new node fails.

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

During the process to add the new node, the process stopped on step "Building vSAN disk groups on cluster" and you receive the message below.

Failed to retrieve key from key management server cluster.

The events below are registered on VxRail logs.

short.term and long.term

microservice.do-storage "2022-09-08T19:51:28.483599063Z stderr F    reason = 'Failed to retrieve key from key management server cluster "
microservice.ms-day2 "2022-09-08T19:51:28.976169781Z stdout F 2022-09-08 19:51:28,976 [INFO] <ThreadPoolExecutor-0_19:140190995695360> pri_exp_state_service.py update_wfe_config_step_status_to_operation_status() (175): update config step status to operation status: {'level': 'step', 'id': 'host_vsan_diskgroups_create.default.host_vsan_diskgroups_create', 'state': 'FAILED', 'progress': 56, 'status': {'id': 'host_vsan_diskgroups_create', 'internal_id': 'host_vsan_diskgroups_create.default.host_vsan_diskgroups_create_False____exp9ce4bac8_65cd_9df01be3cc', 'internal_family': 'host_vsan_diskgroups_create.default.host_vsan_diskgroups_create', 'status': 'FAILED', 'startTime': 1662666560665, 'stage': 'default', 'params': {'vc_conn_info': {'host': 'FQDN.Domain.com', 'username': 'administrator@vsphere.local', '****** 'datacenter_name': 'VxRail-Datacenter', 'host_conn_info': {'host': node_IP, 'username': 'root', '****** 'host_name': 'node_namde', 'host_storage': {}, 'hw_model': 'VxRail P570F', 'customer_supplied': 'false', 'host_sn': 'XXXXXXX', 'disk_group_type': None}, 'error': {'result': {'error': {'code': 'E3100_Storage_4', 'params': [node_name], 'message': 'Failed to create multiplue disk group node_name'}}}}}"
microservice.do-storage "2022-09-08T19:51:28.449335382Z stderr F [2022-09-08 19:51:28,449: ERROR/MainProcess] Create multi DGs failed."

 

Cause

The new VxRail node has no access to KMS server. If a KMS cluster is in use, the VxRail node has no access for one of the KMS server nodes.

 

Resolution

The new VxRail node must have access to all KMS cluster nodes.
If the new VxRail node does not have access for KMS server, or has access to only one KMS node, the process to add the node fails.
The default KMS port is usually 5696, but customer can specify another port during the KMS deployment.
I added the KMS configuration example below, you can see in there what port is in use.
Screenshot showing the port for KMS

 

Affected Products

VxRail, VxRail Appliance Series, VxRail Software
Article Properties
Article Number: 000203248
Article Type: Solution
Last Modified: 23 Oct 2025
Version:  4
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.