NVP vProxy: Os backups falham intermitentemente "VDDK Error: 18000: Não é possível se conectar ao host"
Resumo: Os backups do vProxy falham intermitentemente com um erro de conexão do VDDK (Virtual Disk Development Kit), e uma execução manual ou subsequente agendada pode competir com sucesso.
Sintomas
O erro de conexão do disco do VDDK mostra o seguinte em /opt/emc/vproxy/runtime/logs/vbackupd/vbackupd-engine.log:
MM/DD/YYYY HH:MM:SS INFO: [99] Data Mover: Hard disk 1: Preparing for data movement.
MM/DD/YYYY HH:MM:SS ERROR: [99] Data Mover: Hard disk 1: VDDK: Failed to open source VMDK "[DATASTORE_NAME] VM_NAME/VM_NAME.vmdk": VDDK Error: 18000: Cannot connect to the host.
MM/DD/YYYY HH:MM:SS ERROR: [99] Data Mover: Hard disk 1: Failed to initialize Block Reader.
O /opt/emc/vproxy/runtime/logs/vbackupd/vbackupd-vddk.log mostra:
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: VixDiskLib_OpenEx: Open a disk.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: VixDiskLibVim_GetNfcTicket: Get NFC ticket for [DATASTORE_NAME] VM_NAME/VM_NAME.vmdk.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: Error 18000 (listener error GVmomiFaultInvalidResponse).
A falha da migração de armazenamento mostra:
MM/DD/YYYY HH:MM:SS INFO: [99] Disabling storage migration of virtual machine ...
MM/DD/YYYY HH:MM:SS WARN: [99] Error disabling storage migration: VDDK Error: 18000: Cannot connect to the host., retrying.
MM/DD/YYYY HH:MM:SS INFO: [99] There are 3 certificates available at VCENTER_NAME. First one will be used.
MM/DD/YYYY HH:MM:SS ERROR: [99] Failed to disable storage migration for virtual machine "vm-###": VDDK Error: 18000: Cannot connect to the host.
MM/DD/YYYY HH:MM:SS ERROR: [99] Error disabling storage migration for virtual machine "VM_NAME".
O vbackupd-vddk.log do vProxy mostra:
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: VixDiskLib_PrepareForAccess: Prepare to access disk.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: VixDiskLib_Connect: Establish connection.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: Resolve host.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: VixDiskLibVim_AllowVMotion: Disable VMotion.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: Error 18000 (listener error GVmomiFaultInvalidResponse).
Aumentar a depuração do VDDK ("vixDiskLib.transport.LogLevel = 4") no arquivo /opt/emc/vproxy/conf/VixDiskLib.config fornece mais informações sobre o vbackup-vddk.log.
NetWorker VMware Protection (NVP)-vProxy: Como habilitar o log de depuração
A saída de depuração do VDDK mostra:
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: VixDiskLib_OpenEx: Open a disk.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: VixDiskLibVim_GetNfcTicket: Get NFC ticket for [DATASTORE_NAME] VM_NAME/VM_NAME.vmdk.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:19:20.348Z info -[7FF30C87D700] [Originator@6876 sub=Libs] GVmomi: Instantiating VMOMI session at https://VCENTER_IP:443/sdk
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:19:20.348Z info -[7FF30C87D700] [Originator@6876 sub=Libs] GVmomi: Verifying SSL certificate with thumbprint AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:19:20.348Z info -[7FF30C87D700] [Originator@6876 sub=Libs] GVmomi: Certificate accepted
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:19:20.453Z info -[7FF30C87D700] [Originator@6876 sub=Libs] BasicHttpOnSent: xmlReadMemory (NULL == xmlDoc) errorCode 0 responseCode 503 message
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: Error 18000 (listener error GVmomiFaultInvalidResponse).
A depuração de falha da migração de armazenamento mostra:
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: VixDiskLib_Connect: Establish connection.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLib: Resolve host.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: VixDiskLibVim_AllowVMotion: Enable VMotion.
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:20:11.512Z info -[7FF2CE7AE700] [Originator@6876 sub=Libs] GVmomi: Instantiating VMOMI session at https://VCENTER_IP:443/sdk
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:20:11.512Z info -[7FF2CE7AE700] [Originator@6876 sub=Libs] GVmomi: Verifying SSL certificate with thumbprint AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB:AB
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:20:11.512Z info -[7FF2CE7AE700] [Originator@6876 sub=Libs] GVmomi: Certificate accepted
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO 2019-10-24T13:20:11.612Z info -[7FF2CE7AE700] [Originator@6876 sub=Libs] BasicHttpOnSent: xmlReadMemory (NULL == xmlDoc) errorCode 0 responseCode 503 message
MM/DD/YYYY HH:MM:SS NOTICE: VDDK INFO VixDiskLibVim: Error 18000 (listener error GVmomiFaultInvalidResponse).Causa
503 Service Unavailable The server cannot handle the request (because it is overloaded or down for maintenance). Generally, this is a temporary state.
O vpxd.log do vCenter mostra que o vCenter está atingindo consistentemente o limite de sessões HTTP para a configuração durante a janela de backup.
YYYY-MM-DD HH:MM:SS error vpxd[7FBB590AC700] [Originator@6876 sub=HTTP session map] Out of HTTP sessions: Limited to 2000
O equipamento de backup NetWorker vProxy exige conectividade de sessão HTTP do vCenter durante o backup para executar as funções do vCenter. As sessões HTTP estão sendo esgotadas no vCenter Server e impedindo que o backup do vProxy inicie as conexões HTTP necessárias.