This post is more than 5 years old
28 Posts
1
1635
Moving data between two cluster
Hi,
I need to move/copy particular folders (500TB) between clusters as fast as possible, do i have a chance to utilise infiniband interface/switches if i connect them to same IB switches -- (i can optionally use Synciq or not)
As far as i know more than one cluster is not recommended on same IB switch and IB interfaces are intra-cluster-only but may be someone find a workaround.
Ozen Zorba
28 Posts
0
June 5th, 2014 01:00
Seems that Synciq will be the best solution for this case.
Thank you all for your comments.
Ozen Zorba
28 Posts
0
May 31st, 2014 09:00
This will be one time task, once completed each cluster will have its own IB switch peers.
Ozen Zorba
28 Posts
0
May 31st, 2014 11:00
Per this 2nd cluster will be the new cluster (with brand new nodes), alternatively we can add new nodes to the present cluster then set these "particular folders" to rest on new node pool (yes, smartpools needed) and once smartpool jobs completed we can split these nodes and the data from the cluster with a "appropriate way".
BUT what could be the "appropriate way"?
cadiletta
106 Posts
1
June 3rd, 2014 09:00
Mr Zorba,
In order to utilize the IB network for the transfer of data, you would have to join the nodes together into a single cluster, move all data to the new nodes, then smartfail the old nodes from that cluster. This would work if the 500TB of which you speak represents ALL data, as the smartfail operation would remove data from the old nodes. You could then use the old nodes to setup a 'new' empty cluster to use as you wish.
To be sure that I am explaining this correctly, I will summarize again in an example:
Otherwise, using the IB network for the transfer of data between two clusters is not recommended or officially supported. There can be problems with the integrity of the data if two clusters are placed on the same IB switch. Your best bet for copying data, would be using SyncIQ which will take advantage of all external network bandwidth you allow to move data with multiple parallel workers. You can also monitor and adjust the performance impact if clusters are handling production workflows at the same time.
dynamox
1 Rookie
1 Rookie
•
20.4K Posts
2
June 3rd, 2014 09:00
I would use SyncIQ over joining nodes to existing cluster and Smartfail. Smartfail will take ages, speaking from personal experience on 108NL.