Powerscale: Unable to add 25gige or 100gige interfaces to a network pool

Summary: This article describes a situation where you cannot add 25gige or 100gige interfaces to a network pool via WebUI or Command Line Interface (CLI)

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

When attempting to add an interface to a network pool in the WebUI, the interface will not be listed in the available interfaces box.  Additionally, when attempting to add an interface to a network pool via CLI, the interface does not exist as an available interface to use.

The following errors can be seen in isi_flexnet_d logs.  The node name may vary from cluster to cluster: 
2023-09-30T10:25:02.798587-07:00 <3.6> isilon-4(id4) isi_flexnet_d[15373]: Unexpected error registering node: Failed to open node.4 in /ifs/.ifsvar/modules/flexnet/nodeinfo: No such file or directory from flx_file_key_get (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_file.c:522) from _flx_node_info_load (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_node_info.c:284) from flx_node_info_load (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_node_info.c:348) from _are_interfaces_capable_of (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_iface.c:344) from flx_validate_interfaces (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_pool.c:1214) from flx_pool_add_members (/b/mnt/src/isilon/lib/isi_flexnet/flexnet_pool.c:2011) from add_member (/b/mnt/src/isilon/lib/isi_flexnet/flexnet.c:1967) from flx_config_apply_rules (/b/mnt/src/isilon/lib/isi_flexnet/flexnet.c:2062) from flx_config_init_node (/b/mnt/src/isilon/lib/isi_flexnet/flexnet.c:2173) from flx_config_register_local_node (/b/mnt/src/isilon/lib/isi_flexnet/flexnet.c:2597) from node_registration_thread (/b/mnt/src/isilon/bin/isi_flexnet_d/main.c:3227)

Network pools will be configured with "NFSv3 RDMA RRoCE only" enabled.

isilon-4# isi network pools list -v | egrep "ID:|RDMA"
                   ID: groupnet0.subnet0.pool0
NFSv3 RDMA RRoCE only: Yes

There is a network rule auto placing 100gige or 25gige interfaces into the same pool configured with "NFSv3 RDMA RRoCE only".

         ID: groupnet0.subnet0.pool0.rule0
  Node Type: any
  Interface: 100gige-1
Description: Initial 100gige-1 provisioning rule
       Name: rule0
   Groupnet: groupnet0
     Subnet: subnet0
       Pool: pool0

Cause

The combination of enabling "NFSv3 RDMA RRoCE only" and network rules creates a permanent guard against adding any interface to the network pool.  This causes isi_flexnet_d to not be able to register the new device to the global network configuration. 

Resolution

There are two options to resolve this:
  1. Disable "NFSv3 RDMA RRoCE only" (if there is more than one network pool configured with this, more than one may need to be disabled).
  2. Delete the network rule pointing to the pool that has "NFSv3 RDMA RRoCE only" enabled.
Both procedures can be done in the WebUI or Command Line Interface (CLI).  Refer to your Admin Guide to complete this task.  Once one of the two options is completed, you will be able to add the interface to the network pool (please allow several minutes for the configuration to update before adding the interface to the network pool).

Products

Isilon Gen6.5, PowerScale Archive A300, PowerScale Archive A3000, PowerScale F200, PowerScale F600, PowerScale F900, PowerScale Hybrid H700, PowerScale Hybrid H7000
Article Properties
Article Number: 000218888
Article Type: Solution
Last Modified: 13 Nov 2023
Version:  2
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.