UNSOLVED
md3200i multipath.conf
Hi
Can you help me please with a right multipath.conf for my md3200i.
For instance mine is like this but with errors in log/messages.
# multipath -ll
mpath0 (36782bcb0003c3f6700000b944f6c3837) dm-3 DELL,MD32xxi
size=1000G features='1 queue_if_no_path' hwhandler='1 rdac' wp=rw
|-+- policy='round-robin 0' prio=1 status=enabled
| `- 4:0:0:7 sdb 8:16 active ghost running
|-+- policy='round-robin 0' prio=0 status=enabled
| `- 3:0:0:7 sdc 8:32 failed faulty running
|-+- policy='round-robin 0' prio=6 status=enabled
| `- 5:0:0:7 sde 8:64 active ready running
`-+- policy='round-robin 0' prio=1 status=enabled
`- 6:0:0:7 sdd 8:48 active ghost running
sometimes sdc is faulty, sometimes sde.
#vim /etc/multipath.conf
defaults {
flush_on_last_del no
user_friendly_names yes
}
blacklist {
device {
vendor Dell.*
product Universal.*
}
device {
vendor Dell.*
product Virtual.*
}
device {
vendor DELL
product RD1000
}
device {
vendor DELL
product "PERC 6/i"
}
# System disk
device {
vendor ATA
product *
}
# System disk
device {
vendor SEAGATE
product *
}
}
devices {
device {
vendor "DELL"
product "MD32xx"
#path_grouping_policy group_by_prio
prio rdac
polling_interval 5
path_checker rdac
path_selector "round-robin 0"
hardware_handler "1 rdac"
failback immediate
#features "2 pg_init_retries 50"
no_path_retry 30
#rr_min_io 100
prio_callout "/sbin/mpath_prio_rdac /dev/%n"
getuid_callout "/lib/udev/scsi_id --whitelisted --device=/dev/%n"
}
}
multipaths {
multipath {
device {
vendor DELL
product MD32xx
}
}
}
#tail -f /var/log/messages
Apr 6 13:30:55 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:31:08 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:31:08 proxmox1 kernel: device-mapper: multipath: Failing path 8:32.
Apr 6 13:31:21 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:31:34 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:31:47 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:32:00 proxmox1 kernel: connection1:0: detected conn error (1011)
Apr 6 13:32:00 proxmox1 kernel: sd 3:0:0:7: [sdc] Unhandled error code
Apr 6 13:32:00 proxmox1 kernel: sd 3:0:0:7: [sdc] Result: hostbyte=DID_TRANSPORT_DISRUPTED driverbyte=DRIVER_OK
Apr 6 13:32:00 proxmox1 kernel: sd 3:0:0:7: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Apr 6 13:32:10 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:32:23 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:32:23 proxmox1 kernel: device-mapper: multipath: Failing path 8:64.
Apr 6 13:32:36 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:32:49 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:33:02 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:33:15 proxmox1 kernel: connection3:0: detected conn error (1011)
Apr 6 13:33:15 proxmox1 kernel: sd 5:0:0:7: [sde] Unhandled error code
Apr 6 13:33:15 proxmox1 kernel: sd 5:0:0:7: [sde] Result: hostbyte=DID_TRANSPORT_DISRUPTED driverbyte=DRIVER_OK
Apr 6 13:33:15 proxmox1 kernel: sd 5:0:0:7: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
thanks
saïd
If you check the MD3200i's support matrix (available from
<ADMIN NOTE: Broken link has been removed from this post by Dell>
, you can see that the supported linux distros are Red Hat Enterprise Linux and Suse Linux Enterprise Server (There are limitations to which exact versions). You would have to install the MDSM host software on the linux server so that it installs the proprietary MPIO driver (which does leverage DM-MPIO I think, but has it's own driver for the native mpio to use).
Hi
I try today with an openSuze 12.1, install the mdss software on the suze server and i got the same issue :
# multipath -ll
36782bcb0003dbc53000009d74f8d22f5 dm-3 DELL,MD32xxi
size=2.0T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
|-+- policy='round-robin 0' prio=6 status=active
| `- 7:0:0:0 sdb 8:16 active ready running
`-+- policy='round-robin 0' prio=1 status=enabled
`- 6:0:0:0 sdc 8:32 active ghost running
Alwas the same active ghost path
On a centOS the same issue, on debian/ubuntu also the same active ghost path
on every system I can format and mount the drive but no multipath on two controllers.
What can I do to have
-+- policy='round-robin 0' prio=1 status=active
`- 6:0:0:0 sdc 8:32 active ready running
there is something I dont understand can you help me to understanding what , here the log of multipath -v3 :
rsync:/var/log # multipath -v3
Apr 17 19:00:51 | sda: not found in pathvec
Apr 17 19:00:51 | sda: mask = 0x1f
Apr 17 19:00:51 | sda: dev_t = 8:0
Apr 17 19:00:51 | sda: size = 625142448
Apr 17 19:00:51 | sda: vendor = ATA
Apr 17 19:00:51 | sda: product = ST3320418AS
Apr 17 19:00:51 | sda: rev = HP35
Apr 17 19:00:51 | sda: h:b:t:l = 0:0:0:0
Apr 17 19:00:51 | sda: path state = running
Apr 17 19:00:51 | sda: 38913 cyl, 255 heads, 63 sectors/track, start at 0
Apr 17 19:00:51 | sda: serial = 5VMTDXAV
Apr 17 19:00:51 | sda: get_state
Apr 17 19:00:51 | sda: path checker = directio (config file default)
Apr 17 19:00:51 | sda: path state = running
Apr 17 19:00:51 | directio: starting new request
Apr 17 19:00:51 | directio: io finished 4096/0
Apr 17 19:00:51 | sda: state = 3
Apr 17 19:00:51 | sda: getuid = /lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/%n (config file default)
Apr 17 19:00:51 | sda: uid = 35000c50038298899 (callout)
Apr 17 19:00:51 | sda: prio = const (config file default)
Apr 17 19:00:51 | sda: prio args = (null) (config file default)
Apr 17 19:00:51 | sda: const prio = 1
Apr 17 19:00:51 | dm-0: device node name blacklisted
Apr 17 19:00:51 | dm-1: device node name blacklisted
Apr 17 19:00:51 | dm-2: device node name blacklisted
Apr 17 19:00:51 | fd0: device node name blacklisted
Apr 17 19:00:51 | sr0: device node name blacklisted
Apr 17 19:00:51 | sdb: not found in pathvec
Apr 17 19:00:51 | sdb: mask = 0x1f
Apr 17 19:00:51 | sdb: dev_t = 8:16
Apr 17 19:00:51 | sdb: size = 4294967296
Apr 17 19:00:51 | sdb: vendor = DELL
Apr 17 19:00:51 | sdb: product = MD32xxi
Apr 17 19:00:51 | sdb: rev = 0780
Apr 17 19:00:51 | sdb: h:b:t:l = 7:0:0:0
Apr 17 19:00:51 | sdb: path state = running
Apr 17 19:00:51 | sdb: 65535 cyl, 255 heads, 63 sectors/track, start at 0
Apr 17 19:00:51 | sdb: serial = 15L006M
Apr 17 19:00:51 | sdb: get_state
Apr 17 19:00:51 | loading /lib/multipath/libcheckrdac.so checker
Apr 17 19:00:51 | sdb: path checker = rdac (controller setting)
Apr 17 19:00:51 | sdb: path state = running
Apr 17 19:00:51 | sdb: state = 3
Apr 17 19:00:51 | sdb: getuid = /lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/%n (controller setting)
Apr 17 19:00:51 | sdb: uid = 36782bcb0003dbc53000009d74f8d22f5 (callout)
Apr 17 19:00:51 | loading /lib/multipath/libpriordac.so prioritizer
Apr 17 19:00:51 | sdb: prio = rdac (controller setting)
Apr 17 19:00:51 | sdb: prio args = (null) (controller setting)
Apr 17 19:00:51 | sdb: rdac prio = 6
Apr 17 19:00:51 | sdc: not found in pathvec
Apr 17 19:00:51 | sdc: mask = 0x1f
Apr 17 19:00:51 | sdc: dev_t = 8:32
Apr 17 19:00:51 | sdc: size = 4294967296
Apr 17 19:00:51 | sdc: vendor = DELL
Apr 17 19:00:51 | sdc: product = MD32xxi
Apr 17 19:00:51 | sdc: rev = 0780
Apr 17 19:00:51 | sdc: h:b:t:l = 6:0:0:0
Apr 17 19:00:51 | sdc: path state = running
Apr 17 19:00:51 | sdc: 0 cyl, 64 heads, 32 sectors/track, start at 0
Apr 17 19:00:51 | sdc: serial = 0CH008O
Apr 17 19:00:51 | sdc: get_state
Apr 17 19:00:51 | sdc: path checker = rdac (controller setting)
Apr 17 19:00:51 | sdc: path state = running
Apr 17 19:00:51 | sdc: state = 5
Apr 17 19:00:51 | sdc: getuid = /lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/%n (controller setting)
Apr 17 19:00:51 | sdc: uid = 36782bcb0003dbc53000009d74f8d22f5 (callout)
Apr 17 19:00:51 | sdc: prio = rdac (controller setting)
Apr 17 19:00:51 | sdc: prio args = (null) (controller setting)
Apr 17 19:00:51 | sdc: rdac prio = 1
Apr 17 19:00:51 | dm-3: device node name blacklisted
===== paths list =====
uuid hcil dev dev_t pri dm_st chk_st vend/prod
35000c50038298899 0:0:0:0 sda 8:0 1 undef ready ATA,ST332
36782bcb0003dbc53000009d74f8d22f5 7:0:0:0 sdb 8:16 6 undef ready DELL,MD32
36782bcb0003dbc53000009d74f8d22f5 6:0:0:0 sdc 8:32 1 undef ghost DELL,MD32
Apr 17 19:00:51 | params = 3 queue_if_no_path pg_init_retries 50 1 rdac 2 1 round-robin 0 1 1 8:16 1000 round-robin 0 1 1 8:32 1000
Apr 17 19:00:51 | status = 2 0 1 0 2 1 A 0 1 0 8:16 A 0 E 0 1 0 8:32 A 0
Apr 17 19:00:51 | 36782bcb0003dbc53000009d74f8d22f5: disassemble map [3 queue_if_no_path pg_init_retries 50 1 rdac 2 1 round-robin 0 1 1 8:16 1000 round-robin 0 1 1 8:32 1000 ]
Apr 17 19:00:51 | 36782bcb0003dbc53000009d74f8d22f5: disassemble status [2 0 1 0 2 1 A 0 1 0 8:16 A 0 E 0 1 0 8:32 A 0 ]
Apr 17 19:00:51 | sda: ownership set to 35000c50038298899
Apr 17 19:00:51 | sda: not found in pathvec
Apr 17 19:00:51 | sda: mask = 0xc
Apr 17 19:00:51 | sda: path state = running
Apr 17 19:00:51 | sda: get_state
Apr 17 19:00:51 | sda: path state = running
Apr 17 19:00:51 | directio: starting new request
Apr 17 19:00:51 | directio: io finished 4096/0
Apr 17 19:00:51 | sda: state = 3
Apr 17 19:00:51 | sda: const prio = 1
Apr 17 19:00:51 | 35000c50038298899: features = 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: no_path_retry = 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: pgfailover = -1 (internal default)
Apr 17 19:00:51 | 35000c50038298899: pgpolicy = failover (internal default)
Apr 17 19:00:51 | 35000c50038298899: selector = round-robin 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: features = 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: hwhandler = 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: rr_weight = 1 (internal default)
Apr 17 19:00:51 | 35000c50038298899: minio = 1000 (config file default)
Apr 17 19:00:51 | 35000c50038298899: no_path_retry = 0 (internal default)
Apr 17 19:00:51 | 35000c50038298899: pg_timeout = NONE (internal default)
Apr 17 19:00:51 | 35000c50038298899: remove queue_if_no_path from '0'
Apr 17 19:00:51 | 35000c50038298899: assembled map [0 0 1 1 round-robin 0 1 1 8:0 1000]
Apr 17 19:00:51 | 35000c50038298899: set ACT_CREATE (map does not exist)
Apr 17 19:00:51 | 35000c50038298899: domap (0) failure for create/reload map
Apr 17 19:00:51 | directio checker refcount 1
Apr 17 19:00:51 | rdac checker refcount 2
Apr 17 19:00:51 | rdac checker refcount 1
Apr 17 19:00:51 | unloading rdac prioritizer
Apr 17 19:00:51 | unloading const prioritizer
Apr 17 19:00:51 | unloading rdac checker
Apr 17 19:00:51 | unloading directio checker
Try the regular Suse, not OpenSuSE or CentOS (RHEL alternative), but a full version. The OpenSuSE distro implements new features and options which haven't made it into regular SuSE yet, and could cause MDSM not to work. The same applies to CentOS. Though the differences between CentOS and RHEL are smaller, they are still some.
DELL-Sam L
Community Manager
•
8058 Posts
•
34386 Points
2120
0
Posted April 9th, 2012 12:00
Hello Mamouni,
What OS are you using with the MD3200i? Also what type of switch are you using as well?