UNSOLVED

Chavell3

updated

4 years ago

C

Chavell3

1 Rookie

2 Posts

0

850

July 15th, 2022 07:00

Virtual Isilon Cluster is down

Hi everybody,

I have an issue with my virtual Isilon cluster I've build up for test purposes.

It is/was a 2 node cluster with(unfortunatly) no quorum configured.

After a power outage, the boot disk of one of those virtual Isilon Node got scrambled... and it didn't boot up again.

 

Because of that, one node is now missing and the complete cluster is down

 

here is what the cluster/surviving node status is:

 

"isi status"

Warning: This node is not connected to the cluster.

 

                               Health    Throughput (bps)  HDD Storage             SSD Storage

ID |IP Address       |DASR |  In   Out  Total         | Used / Size              |Used / Size

---+--------------------+-----+-----+-----+-----+-----------------+-----------------

  1|192.168.4.175  | OK  |    0|    0|    0        | 132G/  n/a( n/a)      |    0/  n/a( n/a)

  2|192.168.4.176  |D--- |  n/a|  n/a|  n/a      |  n/a/  n/a( n/a)        |  n/a/  n/a( n/a)

---+---------------+-----+-----+-----+-----+-----------------+-----------------

Cluster Totals:          |  n/a|  n/a|  n/a            |  n/a/  n/a( n/a)       |  n/a/  n/a( n/a)

 

 

"isi devices node smartfail --node-lnn 2"  - and

"isi devices node smartfail --node-lnn 2 --force"  are not working

  ->  Unable to commit node smartfail update:Error committing config: Could not create a quorum of connections.

"isi devices node stopfail"

You are about to stopfail node lnn 1. Are you sure? (yes/[no]): yes

Cannot stopfail lnn 1 because it is not currently smartfailing.

 

"sysctl efs.gmp.group"

efs.gmp.group: <37a4e0> (2) :{ 1:0-6, down: 2 }

 

 

So my question is, does somebody know how I could either bring that data/OneFS partition up to get the data out of that box

OR how I could add a quorum to that cluster

OR how I could add a node to that cluster

OR add those disks to a newly created cluster to move the data off that Isilon... (but from what I've seen, on the initialization Isilon is writing some GUID to the disks and later looking for that GUID

 

I already tried to manually add a node to that cluster, but this wasn't successfull because as the cluster is offline...

Has anybody an idea on how to get that data back online?

Thanks!!