PowerFlex 4.x 升級失敗,並出現記憶體不足錯誤和 Java 堆積空間
Summary: PFxM 升級失敗,並出現記憶體不足錯誤和 Java 堆積空間錯誤。
This article applies to
This article does not apply to
This article is not tied to any specific product.
Not all product versions are identified in this article.
Symptoms
執行 PowerFlex 升級時,升級失敗,並顯示「記憶體不足錯誤與 java 堆積空間」錯誤。
從deployment.log:
DEBUG [2025-01-06T22:50:31.482915] 573476: provider/configuration/vxos_update.rb:1082:in `process!': scaleio-block-legacy-gateway: Upgrade LIA DEBUG [2025-01-06T22:50:31.483170] 573476: provider/configuration/vxos_update.rb:707:in `im_upgrade': scaleio-block-legacy-gateway: Initiating VxOS cluster upgrade DEBUG [2025-01-06T22:50:31.576972] 573476: provider/configuration/vxos_update.rb:687:in `im_upgrade_staging': scaleio-block-legacy-gateway: Uploading VxOS RPMs for current version DEBUG [2025-01-06T22:50:58.310637] 573476: provider/configuration/vxos_update.rb:690:in `im_upgrade_staging': scaleio-block-legacy-gateway: Uploading VxOS RPMs for newer versions DEBUG [2025-01-06T22:50:58.312193] 573476: provider/configuration/vxos_update.rb:404:in `block in vxos_rpms': scaleio-block-legacy-gateway: Downloading rpms from nginx to /tmp: https://http-share.powerflex.svc:443/download//8aaa80939422a51b01943b5873e82d40/os/VxFlex4.5.2SLES15.4Repo/vxflexos_4.5.2000/ DEBUG [2025-01-06T22:50:59.581675] 573476: provider/configuration/vxos_update.rb:418:in `block in vxos_rpms': scaleio-block-legacy-gateway: Download operation result: # DEBUG [2025-01-06T22:50:59.582232] 573476: provider/configuration/vxos_update.rb:424:in `block in vxos_rpms': scaleio-block-legacy-gateway: Local rpm path: /tmp/d20250106-5032-ukddq7/http-share.powerflex.svc/8aaa80939422a51b01943b5873e82d40/os/VxFlex4.5.2SLES15.4Repo/vxflexos_4.5.2000 DEBUG [2025-01-06T22:50:59.587624] 573476: provider/configuration/vxos_update.rb:404:in `block in vxos_rpms': scaleio-block-legacy-gateway: Downloading rpms from nginx to /tmp: https://http-share.powerflex.svc:443/download//8aaa80939422a51b01943b5873e82d40/os/VxFlex4.5.2RHEL7Repo/vxflexos_4.5.2000/ DEBUG [2025-01-06T22:51:00.312803] 573476: provider/configuration/vxos_update.rb:418:in `block in vxos_rpms': scaleio-block-legacy-gateway: Download operation result: # DEBUG [2025-01-06T22:51:00.313528] 573476: provider/configuration/vxos_update.rb:424:in `block in vxos_rpms': scaleio-block-legacy-gateway: Local rpm path: /tmp/d20250106-5032-ukddq7/http-share.powerflex.svc/8aaa80939422a51b01943b5873e82d40/os/VxFlex4.5.2RHEL7Repo/vxflexos_4.5.2000 ERROR [2025-01-06T22:56:16.377904] 573476: rule_engine/rule.rb:241:in `process_state': Encountered a critical unrecoverable error while processing #: Java::JavaLang::OutOfMemoryError: Java heap space ERROR [2025-01-06T22:56:16.378496] 573476: service/processor.rb:54:in `block in process_state_threaded': Encountered a critical unrecoverable error while processing the service: Java::JavaLang::OutOfMemoryError: Java heap space ERROR [2025-01-06T22:56:16.379412] 573400: rule_engine/rule.rb:241:in `process_state': Encountered a critical unrecoverable error while processing #: Java::JavaLang::OutOfMemoryError: Java heap space
影響
升級失敗。
Cause
精簡型部署程式在協調升級程序時,因為 PFxM 中有大量物件 (例如 64 個節點/SVM 環境),因此會發生記憶體不足的問題。
部署程序進程沒有硬編碼的堆大小記憶體設置,因此 JVM 使用 1/4 的節點記憶體。默認情況下,MVM VM 以 32 GB 的記憶體部署。這相當於部署程序進程的最大堆大小為8 GB。
Resolution
如果需要,這兩個選項可以同時使用。
選項 1:
將 MVM VM 記憶體增加到 64 GB。他將部署程式進程使用的可用 Java 堆內存量增加到 16 GB:
工程部門沒有針對每個節點所需記憶體的特定指標,但使用 64 GB 已被證明是成功的。
如果升級仍失敗,請將 PowerFlex Gateway (GW) 的複本集降至至少 1 GW:
1) SSH 至 PFMP 伺服器
2) 將複本降至 1:
kubectl scale sts block-legacy-gateway -n powerflex --replicas=1
3) 執行 GW 升級。這會將系統升級到使用 MTLS 的 4.x,且不會發現此問題。4) 後端 PowerFlex 系統升級至 4.x 後,將 GW 的複本集調整回 2:
kubectl scale sts block-legacy-gateway -n powerflex --replicas=2
選項 2:
請在升級 PowerFlex 之前先移除資源群組 (RG),然後使用「新增現有資源群組」作業將其加回。此問題中描述的記憶體使用方式僅用於 RG 中的節點;如果沒有 RG,則升級不會產生物件,也不應有 OOM。
受影響的版本
PFMP 4.x
已修正問題的版本
PFMP 4.8
Affected Products
PowerFlex rack, VxFlex Ready Nodes, PowerFlex custom node, PowerFlex appliance R650, PowerFlex appliance R6525, PowerFlex appliance R660, PowerFlex appliance R6625, Powerflex appliance R750, PowerFlex appliance R760, PowerFlex appliance R7625
, PowerFlex appliance R640, PowerFlex appliance R740XD, PowerFlex appliance R7525, PowerFlex appliance R840
...
Article Properties
Article Number: 000305779
Article Type: Solution
Last Modified: 16 Apr 2025
Version: 3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.