Solved!
Go to Solution7840
0
Posted February 4th, 2015 14:00
If you are looking to pull the SN of IB Switch from the cluster, this is not possible at this time. You may see the SN in /var/log/opensm*.log.
You may find some useful info in the IB Switch Upgrade :
7840
0
Posted February 4th, 2015 14:00
Hi LucSimard,
you referenced an internal EMC page.
The document states the following:
" Occasionally, InfiniBand switches that provide the back-end networking for an Isilon cluster need to be upgraded to increase the number of available ports. The procedure to upgrade switches while cluster is in production is now available in the Isilon Procedure Generator."
The generator has been replaced by the SolVe Desktop. Please check for more information here if needed:
The Next-generation EMC Product Procedure Generator SolVe Desktop
7840
0
Posted February 5th, 2015 13:00
my Colo charges for everything you ask them to do in our cage, getting serial numbers from IB remotely would be very helpful.
7840
0
Posted February 5th, 2015 15:00
Certainly no disagreement from me. There are a couple of approaches to take here.
1. Run a couple 1Gbe network connections to your IB switches, and assign IPs just so that you can manage or monitor them. (this is not something that EMC does as part of a normal delivery process, but if going forward this is important to you, then ultimately it's your equipment.)
2. Perhaps slightly more secure use a serial console server to connect to the serial ports of your IB switches for remote management, (some people also use these to connect to nodes). Again also not standard procedure, but it does work.
The trouble with both of those options are certainly that they potentially offer more external network exposure to the cluster's back-end, and could have their own security vulerabilities.
So then there is option 3, which probably sounds like boiler-plate, but rest-assured it is helpful.
3. Ask your account team to file an RFE (Request For Enhancement) on your behalf. They sometimes take some time to come to fruition, but these are tracked, and the more frequently product management and engineering hears a common request, the more likely it is to get done.
As always hope this helps,
~Chris
4513
0
Posted February 5th, 2015 16:00
Adding to Chris's statement, you can get the serial of the managed Qlogic switches thru CLI and "Chassis View".
http://filedownloads.qlogic.com/files/driver/79974/User_Guide_QLogic_12000_E.pdf
http://filedownloads.qlogic.com/files/ms/75819/CLI_Reference_QLogic_12000_D.pdf
Sample "showInventory" from CLI reference guide:
MasterMM202-> showInventory
___________________________________
Leaf 101
-----------------------------------
GUID - 00066A00EC002712
Manufacturer Id - 00066A
Manufacturer Name - SST
Mfg Date/Time - 2009/04/09 10:00
Model - 12800-LF18
Part Number - 220052-004-B
Product Name - 12800 QDR 18P Leaf Module
Serial Number - USF1150920031
Version - 004-B
Sample "Chassis View".
Chassis FRU Tab The Chassis FRU tab displays switch Field Replaceable
Unit (FRU) information. This information includes the following items:
Type - The type of component.
Description - A description of the component, assigned by an administrator.
Alias Name - Name of the component, assigned by an administrator.
Serial Num - Component serial number
Detail A button for each row that displays
7840
0
Posted February 6th, 2015 20:00
Chris,
does console access require credentials ? Baud settings ?
Thanks
7840
0
Posted February 9th, 2015 08:00
If the node is up and running, the login over console will appear identical to an SSH login, and use the same credentials.
Serial settings are:
115,200
Parity-None
Data: 8
Stop: 1
Flow-Control: Hardware
Hope this helps,
~Chris
7865
0
Posted February 9th, 2015 20:00
Chris,
are you saying when i change my cluster credentials, Infiniband credentials get changed as well ?
5064
1
Posted February 10th, 2015 07:00
No,
The answer I provided was for serial access to a node, not to an IB switch, I mis-read the question, sorry for any confusion. The Serial port settings of the IB switches will be dependent on the switch manufacturer, either Mellanox, or Qlogic (Qlogic's IB division is now a division of Intel). If you can tell us what model of switch you're running I'm sure we can dig them up.
~Chris
crklosterman
450 Posts
7840
0
Posted February 5th, 2015 07:00
Khkris,
To expand on What Luc said, the switches sold and installed by EMC are not managed. Now that's not to say that they are not manageable, however we do not require, nor as a matter of standard delivery practice do we connect them to a customer's network for management or monitoring. We monitor IB based upon the data flowing in and out of our IB cards in the nodes themselves.
That said, you can from a node on the cluster as root, get some detail about the switches. (model number, number of ports and manufacturer, plus GUID).
isi02-1# cat /var/log/opensm*.topo | grep "Device\[0\]"
Device[0] => 0002c9020046403b 0002c90200464038 (SW, 8) Infiniscale-IV Mellanox Technologies
Device[0] => 0002c902004717db 0002c902004717d8 (SW, 8) Infiniscale-IV Mellanox Technologies
isi02-1#
For some basics about IB, if you're interested, Mellanox has a nice primer here:
http://www.mellanox.com/pdf/whitepapers/IB_Intro_WP_190.pdf
If you really want the switch serial numbers at this time, my recommendation is to either:
a) look at your EMC Packing list, which should contain the information
b) look at the switches themselves and record the serial numbers for later use. I realize that this is often difficult or impossible if you are not in the same building as the cluster in question, however asking someone at a CoLo or a remote datacenter to document the serials should be very low effort.
I don't know what kind of switches you have, but for my 8-port mellanox QDR switches in the lab the details on where to get the serial number are at the bottom of page 10/ top of page 11 here:
http://www.mellanox.com/related-docs/user_manuals/IS5022_User_Manual.pdf
The opensm*.log files that Luc mentioned show a nicer graphical representation of the IB network, but still the GUID is all that is shown per switch.
Hope this helps, if it does answer your question, please mark it as answered.
Thanks,
Chris Klosterman
Senior Solution Architect
EMC Isilon Offer & Enablement Team
twitter: @croaking
email: chris.klosterman@emc.com