Piattaforma di gestione PowerFlex: Chiamate API del gateway PowerFlex non riuscite a causa dello spazio nell'heap Java

Summary: Le chiamate API da OpenStack e altre integrazioni simili a PowerFlex Management Platform (PFMP) hanno esito negativo a causa dell'esaurimento dello spazio dell'heap Java nei pod del gateway PowerFlex. Il riavvio dei pod del gateway a blocchi interessati risolve temporaneamente il problema. ...

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

  • Le chiamate API a PowerFlex Manager (PFMP) hanno esito negativo a intermittenza, compromettendo OpenStack e altre integrazioni.
  • block-gateway-0 Report pod OutOfMemoryErrore le richieste vengono reindirizzate a block-gateway-1. 
    06:30:21.635 [|https-jsse-nio-443-exec-4-ReceiveLoop-254285513] ERROR c.e.e.n.c.LayeredProtocolConnection - LPC-254285513 #e1a663711aca639e [xxx.xxx.xxx.xxx:8611]: IOException in receive loop: message=null, e=java.io.EOFException, cause=null
06:30:21.635 [|https-jsse-nio-443-exec-5-ReceiveLoop-838015790] ERROR c.e.e.n.c.LayeredProtocolConnection - LPC-838015790 #ed300a36c5228121 [xxx.xxx.xxx.xxx:8611]: IOException in receive loop: message=null, e=java.io.EOFException, cause=null
06:30:23.475 [|https-jsse-nio-443-exec-11] ERROR c.e.s.s.w.c.SpecialImplController - Got an exception in handleException
org.springframework.web.util.NestedServletException: Handler dispatch failed; nested exception is java.lang.OutOfMemoryError: Java heap space
  • Eventualmente block-gateway-1 Il pod segnala inoltre OutOfMemoryError. 
    07:03:30.663 [|https-jsse-nio-443-exec-15] WARN  o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver - Failure in @ExceptionHandler com.emc.s3g.scaleio.web.controller.RestApiController#handleException(Exception, HttpServletRequest, HttpServletResponse)
java.lang.OutOfMemoryError: Java heap space
07:03:42.234 [|https-jsse-nio-443-exec-5-ReceiveLoop-793498724] ERROR c.e.e.n.c.LayeredProtocolConnection - LPC-793498724 #7f7d737257ceb2e0 [10.41.209.52:8611]: Problem with message deserialization
java.lang.OutOfMemoryError: Java heap space
07:03:42.234 [|https-jsse-nio-443-exec-12] ERROR c.e.s.s.s.ConnectionServiceImpl - Got rc MESSAGE_DESERIALIZATION_FAILED for command QueryPoll
  • catalina.out I registri indicano errori in HostConfig.checkResources(), suggerendo l'esaurimento della memoria durante la convalida delle risorse. 
    16-Jan-2025 06:31:21.628 SEVERE [Catalina-utility-2] org.apache.catalina.core.ContainerBase.threadStart Exception processing background thread
        Caused by: java.lang.OutOfMemoryError: Java heap space
                at org.apache.catalina.startup.HostConfig.checkResources(HostConfig.java:1298)
  • Le metriche delle risorse non mostrano un consumo significativo di CPU o memoria da parte dei pod del gateway interessati. 
    Namespace                   Name                                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
---------                   ----                                                     ------------  ----------  ---------------  -------------  ---
powerflex                   block-legacy-gateway-1                                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         56d
powerflex                   ciam-service-8c98989cb-5prsg                             100m (0%)     0 (0%)      128Mi (0%)       0 (0%)         56d
powerflex                   block-legacy-gateway-0                                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         56d

Impatto

  • Le chiamate API a PFMP hanno esito negativo in modo intermittente, con potenziali ripercussioni sulle operazioni di automazione e gestione.
  • I pod del gateway non rispondono a causa dell'esaurimento dello spazio dell'heap Java.
  • Per ripristinare il servizio è necessario un intervento manuale.

 

Cause

This issue is triggered by block-legacy-gateway POST requests and the following API requests: "/api/gatewayLogin", "/api/logout", and "/api/gatewayLogout". The pod handling these requests does not fully release the associated memory upon completion, leading to a memory leak.

 

Resolution

Riavviare il dispositivo interessato block-gateway pod utilizzando il seguente comando:

kubectl -n powerflex rollout restart statefulset block-legacy-gateway

 

 

Additional Information

Versioni interessate

PFMP v4.6.0.x e v4.6.1

Risolto nella versione

PFMP v4.6.2 e versioni successive

 

Article Properties
Article Number: 000297144
Article Type: Solution
Last Modified: 24 Mar 2025
Version:  1
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.