RecoverPoint for VMs: Plugin Server Configure Timeout, or The plug-in does not show information intermittently when using LDAP user

Summary: If an LDAP user is used, authentication might take a long time. If it is over 15 seconds, it causes the plug-in to not show any information. If it is longer, it might timeout during plugin server configuration. ...

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.

Symptoms

From Web Deployer(WDM) during configuration:
 

Configure plugin server failed.
Updating Existing vCenter: xx.xx.xx.xx registered with RP Center:
xx.xx.xx.xx failed. {"error":{"code":994000705","message":"Error: Connection timeout to VC xx.xx.xx.xx"443"}}


Or from logs after configuration:
 

From Plugin server logs:

rpc_rp_inventory.log:
Dec 09 15:23:48 rpc_server run.sh[677]: rp_inventory [ERROR] (rp_clusters_monitor.py:69) - Cannot collect rp_clusters from VC xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx due to internal error
Dec 09 15:23:48 rpc_server run.sh[677]: Traceback (most recent call last):
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/rp_inventory/rp_clusters_monitor.py", line 67, in _get_rp_clusters_from_vcs
Dec 09 15:23:48 rpc_server run.sh[677]:     custom_values = self._vc_inventory_proxy.get_custom_field_values(vc.id)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/api/vc_inventory_api.py", line 877, in get_custom_field_values
Dec 09 15:23:48 rpc_server run.sh[677]:     (data) = self.get_custom_field_values_with_http_info(vc_id, **kwargs)  # noqa: E501
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/api/vc_inventory_api.py", line 952, in get_custom_field_values_with_http_info
Dec 09 15:23:48 rpc_server run.sh[677]:     collection_formats=collection_formats)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/api_client.py", line 342, in call_api
Dec 09 15:23:48 rpc_server run.sh[677]:     _preload_content, _request_timeout, _host)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/api_client.py", line 173, in __call_api
Dec 09 15:23:48 rpc_server run.sh[677]:     _request_timeout=_request_timeout)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/api_client.py", line 365, in request
Dec 09 15:23:48 rpc_server run.sh[677]:     headers=headers)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/rest.py", line 240, in GET
Dec 09 15:23:48 rpc_server run.sh[677]:     query_params=query_params)
Dec 09 15:23:48 rpc_server run.sh[677]:   File "/opt/rpcenter/rp_inventory/generated/vc_inventory_proxy/vc_inventory_proxy/rest.py", line 230, in request
Dec 09 15:23:48 rpc_server run.sh[677]:     raise ApiException(http_resp=r)
Dec 09 15:23:48 rpc_server run.sh[677]: vc_inventory_proxy.exceptions.ApiException: (500)
Dec 09 15:23:48 rpc_server run.sh[677]: Reason: INTERNAL SERVER ERROR
Dec 09 15:23:48 rpc_server run.sh[677]: HTTP response headers: HTTPHeaderDict({'Date': 'Fri, 09 Dec 2022 15:23:48 GMT', 'Content-Type': 'application/json', 'Content-Length': '104', 'Connection': 'keep-alive'})
Dec 09 15:23:48 rpc_server run.sh[677]: HTTP response body: {"error":{"code":"994000705","message":"Failed connecting to VC xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"}}

rpc_authentication.log:
Dec 08 16:43:43 rpc_server run.sh[644]: authentication [ERROR] (vcs_monitor.py:79) - Error getting custom fields for VC xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx ((500)
Dec 08 16:43:43 rpc_server run.sh[644]: Reason: INTERNAL SERVER ERROR
Dec 08 16:43:43 rpc_server run.sh[644]: HTTP response headers: HTTPHeaderDict({'Date': 'Thu, 08 Dec 2022 16:43:43 GMT', 'Content-Type': 'application/json', 'Content-Length': '104', 'Connection': 'keep-alive'})
Dec 08 16:43:43 rpc_server run.sh[644]: HTTP response body: {"error":{"code":"994000705","message":"Failed connecting to VC xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"}}
Dec 08 16:43:43 rpc_server run.sh[644]: ).
Dec 08 16:43:43 rpc_server run.sh[644]: authentication [ERROR] (vcs_monitor.py:66) - Error connecting to VC Inventory service
Dec 08 16:45:08 rpc_server run.sh[644]: authentication [ERROR] (app.py:1780) - Exception on /api/v1/authentication/authenticate [GET]
Dec 08 16:45:08 rpc_server run.sh[644]: Traceback (most recent call last):
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/vsphere_authentication.py", line 90, in connect
Dec 08 16:45:08 rpc_server run.sh[644]:     func_timeout(self._login_timeout, self.__class__._connect_no_timeout, args)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/func_timeout/dafunc.py", line 101, in func_timeout
Dec 08 16:45:08 rpc_server run.sh[644]:     raise FunctionTimedOut('', timeout, func, args, kwargs)
Dec 08 16:45:08 rpc_server run.sh[644]: func_timeout.exceptions.FunctionTimedOut: Function _connect_no_timeout (args=(<authentication.server_impl.vsphere_authentication.BasicVCConnection object at 0x7fcc541474a8>,)) (kwargs={}) timed out after 15.000000 seconds.
Dec 08 16:45:08 rpc_server run.sh[644]: During handling of the above exception, another exception occurred:
Dec 08 16:45:08 rpc_server run.sh[644]: Traceback (most recent call last):
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/app.py", line 2311, in wsgi_app
Dec 08 16:45:08 rpc_server run.sh[644]:     response = self.full_dispatch_request()
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/app.py", line 1834, in full_dispatch_request
Dec 08 16:45:08 rpc_server run.sh[644]:     rv = self.handle_user_exception(e)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/app.py", line 1737, in handle_user_exception
Dec 08 16:45:08 rpc_server run.sh[644]:     reraise(exc_type, exc_value, tb)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/_compat.py", line 36, in reraise
Dec 08 16:45:08 rpc_server run.sh[644]:     raise value
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/app.py", line 1832, in full_dispatch_request
Dec 08 16:45:08 rpc_server run.sh[644]:     rv = self.dispatch_request()
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/flask/app.py", line 1818, in dispatch_request
Dec 08 16:45:08 rpc_server run.sh[644]:     return self.view_functions[rule.endpoint](**req.view_args)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/connexion/decorators/decorator.py", line 48, in wrapper
Dec 08 16:45:08 rpc_server run.sh[644]:     response = function(request)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/connexion/decorators/uri_parsing.py", line 143, in wrapper
Dec 08 16:45:08 rpc_server run.sh[644]:     response = function(request)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/connexion/decorators/validation.py", line 347, in wrapper
Dec 08 16:45:08 rpc_server run.sh[644]:     return function(request)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/usr/lib/python3.6/site-packages/connexion/decorators/parameter.py", line 126, in wrapper
Dec 08 16:45:08 rpc_server run.sh[644]:     return function(**kwargs)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/generated/authentication_server/authentication_server/controllers/authentication_controller.py", line 19, in authenticate
Dec 08 16:45:08 rpc_server run.sh[644]:     return AuthenticationController_impl.authenticate(rpc_origin, authorization, vmware_api_session_id)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/controllers_impl/AuthenticationController_impl.py", line 36, in authenticate
Dec 08 16:45:08 rpc_server run.sh[644]:     login_information = authenticator.authenticate_request(rpc_origin, authorization, vmware_api_session_id)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/authentication_impl.py", line 79, in authenticate_request
Dec 08 16:45:08 rpc_server run.sh[644]:     login_information = self._verify_authorization_string(authorization)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/authentication_impl.py", line 156, in _verify_authorization_string
Dec 08 16:45:08 rpc_server run.sh[644]:     return self._basic_authenticate(username, password)
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/authentication_impl.py", line 174, in _basic_authenticate
Dec 08 16:45:08 rpc_server run.sh[644]:     vc_connection.connect()
Dec 08 16:45:08 rpc_server run.sh[644]:   File "/opt/rpcenter/authentication/authentication/server_impl/vsphere_authentication.py", line 92, in connect
Dec 08 16:45:08 rpc_server run.sh[644]:     raise AuthenticationTimeoutException("Timed out connection to {}}.".format(self._vc_address))
Dec 08 16:45:08 rpc_server run.sh[644]: ValueError: Single '}' encountered in format string


From vRPA logs:
/home/kos/connectors/logs/vi_connector.log - Value of authenticating is higher than 15 seconds:
When adding a vCenter:

2022-12-09 17:31:03,169 [pool-2-thread-1] (BaseCommand.java:59) DEBUG - Command finished: AddArrayCredentialsRPACommand(ID:-2138723560949986653) with returnValue=[<redacted>], took: 64223 milliseconds


When updating a vCenter registration:

2023-07-04 11:01:04,748 [pool-3-thread-7] (BaseCommand.java:59) DEBUG - Command finished: UpdateArrayCredentialsRPACommand(ID:7820722830642366215) with returnValue=[<redacted>], took: 64223 milliseconds

Cause

This issue is due to slow LDAP authentication, which is external to RecoverPoint.

LDAP server investigation is required.

Resolution

Option 1:

In RecoverPoint CLI, run update_vcenter_server_registration and use a local user such as administrator@vsphere.local or any other local service account.

 

Option 2:

Investigate the LDAP server and improve authentication response times.

Article Properties
Article Number: 000211271
Article Type: Solution
Last Modified: 11 Oct 2024
Version:  6
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.