We ran powermt config - restore - check, all with no luck. the last option here is to reboot the servers but we want to avoid that downtime, does any body have an idea?
Well, you could switch to Windows servers so you don't have to justify the downtime (everyone just expects it )... sorry, I figured I'd get that in before someone else!
Seriously though, I think it looks like you are going to have to reboot. Occasionally PowerPath needs that kick in the pants to get everything back to normal.
I'll have to stand up for PowerPath here... can the OS see the newly presented paths to these LUNs? what can you see in /proc/scsi/scsi?
I'm guessing that the OS cannot 'see' these new paths, therefore PP cannot know about them... What we need to focus on it to force the OS to rescan for these paths, I'm no Linux guru, but the older kernels we could unload and reload the HBA module. In the newer kernels the HBA driver is built into the kernel so that isn't an option. I suggest digging out the Emulex/QLogic manual looking for a utility/script that will perform a SCSI rescan down that HBA.
Wouldn't that be an offline activity as well though? You might not have to reboot for it, but if you "unload the HBA module" you are effectively cutting off access to the storage. If you do this without unmounting the file systems I can't see the OS being happy about it.
loading and unloading the module will result in temporary access loss to storage, but yet that is not the problem since there are several LUNs from the same array and the problem persist on two of them, so for some reason PP doesnt add the missing path for those LUNs.
I think they are going to have to reboot the server.
It would be worth trying a rescan before rebooting. If the Clariion problem had caused loss of access to a couple of paths the OS may not know about them (especially if its been rebooted) - so they effectively may be "new" devices.
Get a copy of "inq" for Linux, or "cat /proc/scsi/scsi" to determine if the OS can even see the missing devices. If not, PowerPath can't be expected to see them.
if the box came up and those paths were missing during the reboot, in my experience the only thing that will bring them back is reboot. I tried all kinds of scans (qlogic/emulex rescan scripts, echoing proc ..etc), no dice. I even had a ticket open with EMC (fruitless affair). I would bounce the box and it should be fine.
Allen Ward
6 Operator
•
2124 Posts
1302
0
Posted June 24th, 2008 09:00
Seriously though, I think it looks like you are going to have to reboot. Occasionally PowerPath needs that kick in the pants to get everything back to normal.
...unless someone else has an alternative?