suspend one node a time ?

isi networks modify pool --name=subnet_3542_vlan:admin_3542_pool --sc-suspend-node=1

DHC,

How many nodes are in the cluster?  If it's 4 or more (why 4?  because then you always have at least 1 node for redundancy, I know someone will ask this question), the simplest approach from my perspective would be:

1. Build the new subnet and pool on the cluster, add no interfaces to the pool yet.

2. Pick a couple of nodes and suspend them from their current pool.

isi networks modify pool subnet0:pool0 --sc-suspend-node=3

isi networks modify pool subnet0:pool0 --sc-suspend-node=4

3. Now watch as the connections to those nodes trickle off.  When all connections to those nodes are gone, remove the interfaces from the relevant nodes

isi networks modify pool subnet0:pool0 --remove-ifaces 3:10gige-1

isi networks modify pool subnet0:pool0 --remove-ifaces 3:10gige-2

isi networks modify pool subnet0:pool0 --remove-ifaces 4:10gige-1

isi networks modify pool subnet0:pool0 --remove-ifaces 4:10gige-2

4. Now add these same interfaces to the new subnet/pool and move over the physical connections, or change the VLANS on the switch(es) in question.

isi networks modify pool subnet1:pool1 --add-ifaces 3:10gige-1

isi networks modify pool subnet1:pool1 --add-ifaces 3:10gige-2

isi networks modify pool subnet1:pool1 --add-ifaces 4:10gige-1

isi networks modify pool subnet1:pool1 --add-ifaces 4:10gige-2

5.  So now you have assuming again 4 nodes, 2 up and running on each subnet.  The question now becomes how to move the load over.  If it were my cluster, I would pick a change window, and remove the smartconnect zone name from subnet0:pool0, and then add that same name to subnet1:pool1, like this:

isi networks modify pool subnet0:pool0 --zone=

isi networks modify pool subnet1:pool1 --zone=pool1

Also you'll need to change at this point the NS delegation from delegating to the A record for subnet0's SSIP to instead delegating to the A record for subnet1's SSIP. 

This should not interrupt any current ongoing IO, just new requests while you make the changes.

6. Now watch the client IO trickle off of nodes 1 and 2.  When there is nothing left, or when you're tired of waiting, and the number of connections is at a minimum, remove the interfaces for nodes 1 and 2 from subnet0:pool0, add them to subnet1:pool1, and then swapover the cables, or again, update the VLANs on the switchports.

7. Done.

I know that there is more to it than this, but these are the highlights, and order of operations hope this helps,

~Chris Klosterman

Senior Solution Architect

EMC Isilon Offer & Enablement Team

chris.klosterman@emc.com

twitter: @croaking

--sc-suspend-node

Suspends SmartConnect DNS query responses for the specified node. While

suspended, SmartConnect does not return IP addresses for this node, but allows

active clients to remain connected.

my NS records point to CNAME. If you are going to change CNAME make sure to work with your DNS team to lower TTL before the migration (depending on default TTL time) and then changing it back after the migration.

Thank you very much for your detailed response, it is very helpful.  The way I read it though, we will want to do this either before we introduce any new applications and smartconnect zones, or well after.

In any case, there will be significant coordinate of effort to accomplish the IP change.

Thanks!