PowerFlex Unable to do node upgrades error as "mount of remote share failed"

Procedure to fix the node upgrade issue due to NFS container of PFMP unable to communicate with iDRAC of the nodes.

Steps:

1) Run the below command from any MVM to check on which MVM the NFS container is running.

 kubectl get pods -n powerflex -o wide | grep -i nfs 

2) Login to the MVM on which NFS  container is running and run the below command to ensure that all nodes are healthy and in a ready state.

 kubectl get nodes 

3) Open SSH session to MVM on which NFS container is running and run the below command to place MVM in maintenance mode.

 kubectl label node <mvm hostname> cmo.maintenance.mode=true 

4) Run the below command to drain the node.

kubectl drain <mvm hostname> --ignore-daemonsets --delete-emptydir-data 

5) Run the below command to validate that the NFS container is running on another node.

kubectl get pods -n powerflex -o wide | grep -i nfs 

6) Reboot the node by running the below command.

sudo reboot 

7) SSH to another MVM and run the following command to monitor the node you have rebooted until it reaches a STATUS of "Ready"

watch kubectl get nodes 

8) When the MVM comes online, SSH to the MVM and run the following command to uncordon and remove the MVM from maintenance mode.

 kubectl uncordon mvm-hostname ;  kubectl label node mvm-hostname cmo.maintenance.mode-