Hello, playing around with different network configurations I found out that it is hard to add an extra network to already established MDM cluster. Maybe you know a way how to achieve it.
In our lab we originally had one management network and one data network for Scaleio cluster on VMware (installed via vCenter plugin). Later we decided to investigate the steps needed to add a second data network (physically independent) to already running system to further increase its availability. Adding extra IP adresses to SDSs is easy and so it is for the SDCs to learn about the new available data paths. However, to have a fully redundant network setup (similar to SAN A & B in Fibre Channel world) it is also necessary to add the second network to the MDM cluster.
Because there is no command to directly achive it, I tried switching the cluster to single mode, deleting secondary MDM, deleting TB, and later adding a new secondary MDM already with two IP adresses. Unfortunatelly this doesn't work and the command fails with information that the primary and secondary MDMs need equal number of IP addresses.
Error: MDM failed command. Status: Illegal number of IP addresses. The Primary MDM, the Secondary MDM, and the Tie-Breaker must each have the same number of IP addresses.
Thank you both, Sanjeev and Alex. This answers my question and confirms our findings. It is a lab environment now, so no problem to rebuild it from scratch, we were just investigating on the possibilities to reconfigure production systems later.
Did you configure the Primary MDM with 2 IP addresses?
I believe there are 2 ways to achieve this. Using the CSV File (Page 37 of the User Guide)
There is an example of CSV file thereafter wherein you can provide multiple IP addresses for MDM IPs seperated by commas.
In your problem description i understand that you have not yet assigned the multiple IP address to the Primary MDM and are assigning multiple IP address to the secondary IP MDM. That is the reason it is giving an error. So if this is a lab environment, you can break the ScaleIO and reconfigure.
scli --add_primary_mdm --primary_mdm_ip IP1 --mdm_management_ip IP1,IP2 (here you can give multiple IP addresses for MDM)
scli --query_cluster (This command will list only 1 IP address for the Primary MDM. Use that IP address in the next command for --mdm_ip parameter)
scli --add_secondary_mdm --mdm_ip IP1 --secondary_mdm_ip IP3,IP4 (IP3,IP4 can be the IP address of the secondary MDM)
Also note when adding new SDS there are 3 IP roles
SDC_ONLY – IP address will only be used by the SDCs for application IO
SDS_ONLY – IP address will be used by MDM and SDS
ALL – IP address will be used for all traffic.
The system constantly validates that every SDS has IPs with all roles. Either at least one IP with the ALL role, Or at least one IP with SDC_ONLY and one IP with SDS_ONLY
If you use All IP role, it will also be used for MDM communication.
alexkh
60 Posts
6421
0
Posted June 24th, 2015 09:00
Currently, ScaleIO doesn't have an option to add data IP to already configured system.
We are working on adding this functionality to the next service pack, which should be released at the end of July