This post is more than 5 years old
1 Rookie
•
7 Posts
0
3712
January 16th, 2014 20:00
Problem with vgimport on SRDF R2 device on Linux
Linux Redhat 6.4
vMAX40k (local) -> vMAX40k(remote), both on 5876.
The problem is with the vgimport, the underline volumes are presented under VMware ESXi host v5.1, then presented to VM machine (linux platform) as RDM disk.
Local/source server:
[root@stmclip02 ~]# umount /rdf
[root@stmclip02 ~]# vgchange -a n vg_rdf
0 logical volume(s) in volume group "vg_rdf" now active
[root@stmclip02 ~]# vgexport vg_rdf
Volume group "vg_rdf" successfully exported
Then I did split/failover (both option came back with same symptom) on the SRDF pairs.
Remote/Target server:
[root@stmclin01 ~]# pvscan
PV /dev/sdm is in exported VG vg_rdf [10.00 GiB / 96.00 MiB free]
PV /dev/sda3 VG vg00 lvm2 [55.09 GiB / 0 free]
PV /dev/sda2 VG vg_swap lvm2 [24.41 GiB / 0 free]
Total: 3 [89.50 GiB] / in use: 3 [89.50 GiB] / in no VG: 0 [0 ]
[root@stmclin01 ~]# vgimport vg_rdf
/dev/sdm: open failed: Read-only file system
[root@stmclin01 ~]# vgchange -a y vg_rdf
Volume group "vg_rdf" is exported
Anyone can shed on some light? Appreciate it.
arnaudveron
1 Message
2
January 20th, 2014 05:00
Try a scsi rescan after srdf split and before pvscan => echo 1 > /sys/block/sdm/device/rescan
After that reload device maps => multipath -r /dev/sdm
And now vgimport.
dynamox
9 Legend
•
20.4K Posts
0
January 16th, 2014 20:00
says split
PedalHarder
3 Apprentice
•
465 Posts
0
January 16th, 2014 20:00
You are tring to use the R2 volumes but it seems did you perform an SRDF SPLIT to make the R2 volumes Read Write before you did import?
A-J1
1 Rookie
•
49 Posts
0
January 16th, 2014 22:00
Can you post the output of the symrdf split command that you are issung.
cincystorage
2 Intern
•
467 Posts
0
January 16th, 2014 22:00
If we can start by showing the output of a symrdf query on the dg containing the luns in question and a symdev on the r2
rawstorage
3 Apprentice
•
423 Posts
0
January 17th, 2014 00:00
do you have inq or syminq on the R2 VM, can you post the output?
bz15_628e6f
1 Rookie
•
7 Posts
0
January 17th, 2014 05:00
here comes output:
[root@stmclip02 ~]# symrdf -g srcdg1 query
Device Group (DG) Name : srcdg1
DG's Type : RDF1
DG's Symmetrix ID : 000195701660 (Microcode Version: 5876)
Remote Symmetrix ID : 000195701744 (Microcode Version: 5876)
RDF (RA) Group Number : 105 (68)
Source (R1) View Target (R2) View MODES
-------------------------------- ------------------------ ----- ------------
ST LI ST
Standard A N A
Logical T R1 Inv R2 Inv K T R1 Inv R2 Inv RDF Pair
Device Dev E Tracks Tracks S Dev E Tracks Tracks MDAE STATE
-------------------------------- -- ------------------------ ----- ------------
POC001 044D RW 0 0 NR 11E0 RW 0 0 S... Split
DEV002 044E RW 0 0 NR 11E1 RW 0 0 S... Split
Total -------- -------- -------- --------
Track(s) 0 0 0 0
MB(s) 0.0 0.0 0.0 0.0
Legend for MODES:
M(ode of Operation) : A = Async, S = Sync, E = Semi-sync, C = Adaptive Copy
D(omino) : X = Enabled, . = Disabled
A(daptive Copy) : D = Disk Mode, W = WP Mode, . = ACp off
(Consistency) E(xempt): X = Enabled, . = Disabled, M = Mixed, - = N/A
[root@stmclin01 ~]# syminq
Device Product Device
--------------- --------------------------- ---------------------
Name Type Vendor ID Rev Ser Num Cap (KB)
--------------- --------------------------- ---------------------
/dev/sda VMware Virtual disk 1.0 N/A 83886080
/dev/sdb GK EMC SYMMETRIX 5876 44000A0000 2880
/dev/sdc GK EMC SYMMETRIX 5876 44000A1000 2880
/dev/sdd GK EMC SYMMETRIX 5876 44000A2000 2880
/dev/sde GK EMC SYMMETRIX 5876 44000A3000 2880
/dev/sdf GK EMC SYMMETRIX 5876 44000A4000 2880
/dev/sdg GK EMC SYMMETRIX 5876 44000A5000 2880
/dev/sdh GK EMC SYMMETRIX 5876 44000A6000 2880
/dev/sdi GK EMC SYMMETRIX 5876 44000A7000 2880
/dev/sdj GK EMC SYMMETRIX 5876 44000A8000 2880
/dev/sdk GK EMC SYMMETRIX 5876 44000A9000 2880
/dev/sdl GK EMC SYMMETRIX 5876 44000AA000 2880
/dev/sdm R2 EMC SYMMETRIX 5876 44011E0008 10486080
/dev/sdn R2 EMC SYMMETRIX 5876 44011E1008 10486080
Device Physical Name : /dev/sdm
Device Symmetrix Name : 11E0
Device Serial ID : 44011E0008
Symmetrix ID : 000195701744
Device Group Name : tgtdg1
Device Logical Name : POC001
Number of RAID Groups : 0
Encapsulated Device : No
Encapsulated WWN : N/A
Encapsulated Array ID : N/A
Encapsulated Device Name : N/A
Attached BCV Device : N/A
Attached VDEV TGT Device : N/A
Vendor ID : EMC
Product ID : SYMMETRIX
Product Revision : 5876
Device WWN : 60000970000195701744533031314530
Device Emulation Type : FBA
Device Defined Label Type: N/A
Device Defined Label : N/A
Device Sub System Id : 0x0001
Cache Partition Name : DEFAULT_PARTITION
Bound Thin Pool Name : R5_SAS
Device Block Size : 512
Device Capacity
{
Cylinders : 10923
Tracks : 163845
512-byte Blocks : 20972160
MegaBytes : 10240
KiloBytes : 10486080
Geometry Limited : No
}
Device External Identity
{
Device WWN : 60000970000195701744533031314530
Front Director Paths (16):
{
-----------------------------------
DIRECTOR PORT LUN
---------- ---- -------- ---------
Type Num Sts VBUS TID SYMM Host
-----------------------------------
FA 07E:0 RW 000 00 126 000
FA 05E:0 RW 000 00 08C N/A
FA 06E:1 RW 000 00 08C N/A
FA 08E:1 RW 000 00 126 N/A
FA 09E:1 RW 000 00 126 N/A
FA 10E:0 RW 000 00 126 N/A
FA 11E:1 RW 000 00 08C N/A
FA 12E:0 RW 000 00 08C N/A
FA 05G:1 RW 000 00 08B N/A
FA 06G:0 RW 000 00 08B N/A
FA 07G:1 RW 000 00 08C N/A
FA 08G:0 RW 000 00 08C N/A
FA 09G:0 RW 000 00 08C N/A
FA 10G:1 RW 000 00 08C N/A
FA 11G:0 RW 000 00 08B N/A
FA 12G:1 RW 000 00 08B N/A
}
Geometry : Native
{
Sectors/Track : 128
Tracks/Cylinder : 15
Cylinders : 10923
512-byte Blocks : 20972160
MegaBytes : 10240
KiloBytes : 10486080
}
}
Device Configuration : RDF2+TDEV
Device is WORM Enabled : No
Device is WORM Protected : No
SCSI-3 Persistent Reserve: Enabled
Dynamic Spare Invoked : No
Dynamic RDF Capability : RDF2_Capable
STAR Mode : No
STAR Recovery Capability : None
STAR Recovery State : NA
SQAR_MODE : No
Device Service State : Normal
Device Status : Ready (RW)
Device SA Status : Ready (RW)
Device User Pinned : False
Host Access Mode : Active
Device Tag(s) : None
Extent Based Clone : None
DIF1 Flag : False
AS400_GK : False
Host Cache Registered : False
Optimized Read Miss : System
Front Director Paths (16):
{
----------------------------------------------------------------------
POWERPATH DIRECTOR PORT LUN
--------- ---------- ---- -------- ---------
PdevName Type Type Num Sts VBUS TID SYMM Host
----------------------------------------------------------------------
/dev/sdm N/A FA 07E:0 RW 000 00 126 000
Not Visible N/A FA 05E:0 RW 000 00 08C N/A
Not Visible N/A FA 06E:1 RW 000 00 08C N/A
Not Visible N/A FA 08E:1 RW 000 00 126 N/A
Not Visible N/A FA 09E:1 RW 000 00 126 N/A
Not Visible N/A FA 10E:0 RW 000 00 126 N/A
Not Visible N/A FA 11E:1 RW 000 00 08C N/A
Not Visible N/A FA 12E:0 RW 000 00 08C N/A
Not Visible N/A FA 05G:1 RW 000 00 08B N/A
Not Visible N/A FA 06G:0 RW 000 00 08B N/A
Not Visible N/A FA 07G:1 RW 000 00 08C N/A
Not Visible N/A FA 08G:0 RW 000 00 08C N/A
Not Visible N/A FA 09G:0 RW 000 00 08C N/A
Not Visible N/A FA 10G:1 RW 000 00 08C N/A
Not Visible N/A FA 11G:0 RW 000 00 08B N/A
Not Visible N/A FA 12G:1 RW 000 00 08B N/A
}
Mirror Set Type : [R1 Remote,Thin,N/A,N/A]
Mirror Set DA Status : [NR,RW,N/A,N/A]
Mirror Set Inv. Tracks : [0,0,0,0]
Back End Disk Director Information
{
Hyper Type : R1 Remote
Hyper Status : Not Ready (NR)
Disk [Director, Interface, TID] : [N/A,N/A,N/A]
Spindle ID : N/A
Disk Director Volume Number : N/A
Hyper Number : N/A
Mirror Number : 1
Hyper Type : Thin
Hyper Status : Ready (RW)
Disk [Director, Interface, TID] : [N/A,N/A,N/A]
Spindle ID : N/A
Disk Director Volume Number : N/A
Hyper Number : N/A
Mirror Number : 2
}
RDF Information
{
Device Symmetrix Name : 11E0
RDF Type : R2
RDF (RA) Group Number : 120 (77)
Remote Device Symmetrix Name : 044D
Remote Symmetrix ID : 000195701660
R2 Device Is Larger Than The R1 Device : False
Paired with a Diskless Device : False
Paired with a Concurrent Device : False
Paired with a Cascaded Device : False
Thick Thin Relationship : False
RDF Pair Configuration : Normal
RDF STAR Mode : False
RDF SQAR Mode : False
RDF Mode : Synchronous
RDF Adaptive Copy : Disabled
RDF Adaptive Copy Write Pending State : N/A
RDF Adaptive Copy Skew (Tracks) : 65535
RDF Device Domino : Disabled
RDF Link Configuration : Fibre
RDF Link Domino : Disabled
Prevent Automatic RDF Link Recovery : Enabled
Prevent RAs Online Upon Power ON : Enabled
Device RDF Status : Ready (RW)
Device SA Status : Ready (RW)
Device RA Status : Ready (RW)
Device Link Status : Not Ready (NR)
Time of Last Device Link Status Change : Thu Jan 16 21:53:23 2014
Device Suspend State : Offline
Device Consistency State : Disabled
Device Consistency Exempt State : Disabled
RDF R2 Not Ready If Invalid : Disabled
Write Pacing Information
{
Pacing Capable : Yes
Configured Group-level Exempt State: Disabled
Effective Group-level Exempt State : Disabled
Group-level Pacing State : N/A
Device-level Pacing State : N/A
}
Device RDF State : Ready (RW)
Remote Device RDF State : Ready (RW)
RDF Pair State ( R1 <=\=> R2 ) : Split
Number of R1 Invalid Tracks : 0
Number of R2 Invalid Tracks : 0
RDFA Information:
{
Session Number : 119
Cycle Number : 0
Number of Devices in the Session : 2
Session Status : Inactive
Consistency Exempt Devices : No
Session Consistency State : N/A
Minimum Cycle Time : 00:00:15
Average Cycle Time : 00:00:00
Duration of Last cycle : 00:00:00
Session Priority : 33
Tracks not Committed to the R2 Side: 0
Time that R2 is behind R1 : 00:00:00
R2 Image Capture Time : N/A
R2 Data is Consistent : N/A
R1 Side Percent Cache In Use : 0
R2 Side Percent Cache In Use : 0
Transmit Idle Time : 00:00:00
R1 Side DSE Used Tracks : 0
R2 Side DSE Used Tracks : 0
R1 Side Shared Tracks : 0
}
}
bz15_628e6f
1 Rookie
•
7 Posts
0
January 20th, 2014 08:00
Excellent! I did try rescan with diff command earlier and pvscan without any option, without luck.
This new rescan command did solve the problem, Thx a lot!