[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

[Linux-cluster] Multipath or Oracle RAC ASM issue?



Hi
 
We have SAN disk partitions presented to 2 Redhat Linux servers,  running
Oracle RAC (cluster) ASM.  

As suggested by Linux "man multipath", I've made the /var/lib/multipath/bindings the same
on both servers "to ensure That the multipath devices have the same names on all nodes
                            accessing  them" :
# Format:
# alias wwid
mpath0 360a98000567244396334493370345055
mpath1 360a9800056724439633449336c786d69
mpath2 360a980005672443963344933706f536c
mpath3 360a9800056724439633449336c514c75
mpath4 360a980005672443963344933706b4770
mpath5 360a9800056724439633449336c4d6b36

However /proc/partition   on both servers  showed differences on the
 dm-x  devices  (but not on the /dev/sdxx devices) :
  RAC1 server :
 253     0   41947136 dm-0
 253     1   41947136 dm-1
 253     2   41947136 dm-2
 253     3    5242880 dm-3
 253     4    5242880 dm-4
 253     5   41947136 dm-5

  RAC2 server :
 253     0    5242880 dm-0
 253     1   41947136 dm-1
 253     2   41947136 dm-2
 253     3    5242880 dm-3
 253     4   41947136 dm-4
 253     5   41947136 dm-5

 
Appendix A below is the output of "multipath -ll" outputs from both servers :


Q1 :
Do mpath0, mpath1, ...   shown in "multipath -ll" listing refer to
  /dev/mapper/mpathx  or  to  /dev/mpath/mpathx ?

Q2 :
How do we make it such that the dm-x  devices are accessing the same
SAN LUNs across the servers?  I believe they are not the same based
on the observations of the disk spaces associated with each of the dm-x
shown in /proc/partition


What's described above so far is to help relate to the main issue below
(Oracle ASM on both servers seem to be Not accessing the same underlying
  physical storage when trying to access the same ASM diskgroup:

On Server 1 :
==========
[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
isk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk:   OK  ]

[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0]On Server 1 :

[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm created
ddisk land4 /dev/dm-0
Marking disk "/dev/dm-0" as an ASM disk:   OK  ]

[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root landnet-rac1-temp mpath]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [253, 0]   <<== note this number

Server 2:
=======
[root landnet-rac2-temp dev]# /etc/init.d/oracleasm scandisks
Scanning system for ASM disks:   OK  ]
[root landnet-rac2-temp dev]# /etc/init.d/oracleasm listdisks
LAND1
LAND2
LAND4
[root landnet-rac2-temp dev]# /etc/init.d/oracleasm querydisk land4
Disk "LAND4" is a valid ASM disk on device [8, 32] <<== note the number


We logged a call to Oracle who responded :
If we are using device mapper and ASMLib then, we need to use disks from /dev/dm-* disks
instead of disks from  /dev/mapper/mpath*

but Redhat Support told us we should use /dev/mapper/mpath*


Appreciate if you can give me step by step instruction on how to untangle this
whole issue.  Basically we want the Oracle RAC ASM diskgroup LAN4 (& other
diskgroups which we'll be creating) to be accessing the same underlying storage.

I'm inclined to think this has to do with multipathing setup than Oracle ASM setup
or SAN setup.

One last piece of information (which may be relevant) :
On server 2, the dm-x mappings (shown below) differs from that on server 1:
[root landnet-rac2-temp dev]# ls -ld dm-*
brw-r-----  1 root root 253, 0 Jun 18 17:49 dm-0
brw-r-----  1 root root 253, 1 Jun 18 17:49 dm-1
brw-r-----  1 root root 253, 2 Jun 18 17:49 dm-2
brw-r-----  1 root root 253, 3 Jun 18 17:49 dm-3
brw-r-----  1 root root 253, 4 Jun 18 17:49 dm-4
brw-r-----  1 root root 253, 5 Jun 18 17:49 dm-5
 

 
Appendix A ("multipath -ll" output from the servers) :
========================

On RAC1 server :

[root landnet-rac1-temp mpath]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:3 sdq 65:0   [active][ready]
 \_ 8:0:4:3 sdw 65:96  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:3 sde 8:64   [active][ready]
 \_ 8:0:1:3 sdk 8:160  [active][ready]

mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:4 sdr 65:16  [active][ready]
 \_ 8:0:4:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:4 sdf 8:80   [active][ready]
 \_ 8:0:1:4 sdl 8:176  [active][ready]

mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:5 sds 65:32  [active][ready]
 \_ 8:0:4:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:5 sdg 8:96   [active][ready]
 \_ 8:0:1:5 sdm 8:192  [active][ready]

mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:1 sdo 8:224  [active][ready]
 \_ 8:0:4:1 sdu 65:64  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:1 sdc 8:32   [active][ready]
 \_ 8:0:1:1 sdi 8:128  [active][ready]

mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:2 sdp 8:240  [active][ready]
 \_ 8:0:4:2 sdv 65:80  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:2 sdd 8:48   [active][ready]
 \_ 8:0:1:2 sdj 8:144  [active][ready]

mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:0 sdn 8:208  [active][ready]
 \_ 8:0:4:0 sdt 65:48  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:1:0 sdh 8:112  [active][ready]
 \_ 8:0:0:0 sdb 8:16   [active][ready]


=================

On RAC 2 server :

[root landnet-rac2-temp ~]# multipath -ll
mpath2 (360a980005672443963344933706f536c)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:3 sdq 65:0   [active][ready]
 \_ 8:0:3:3 sdw 65:96  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:3 sde 8:64   [active][ready]
 \_ 8:0:1:3 sdk 8:160  [active][ready]

mpath1 (360a9800056724439633449336c786d69)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:4 sdr 65:16  [active][ready]
 \_ 8:0:3:4 sdx 65:112 [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:4 sdf 8:80   [active][ready]
 \_ 8:0:1:4 sdl 8:176  [active][ready]

mpath0 (360a98000567244396334493370345055)
[size=5 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:5 sds 65:32  [active][ready]
 \_ 8:0:3:5 sdy 65:128 [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:5 sdg 8:96   [active][ready]
 \_ 8:0:1:5 sdm 8:192  [active][ready]

mpath5 (360a9800056724439633449336c4d6b36)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:3:1 sdu 65:64  [active][ready]
 \_ 8:0:2:1 sdo 8:224  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:1 sdc 8:32   [active][ready]
 \_ 8:0:1:1 sdi 8:128  [active][ready]

mpath4 (360a980005672443963344933706b4770)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:2 sdp 8:240  [active][ready]
 \_ 8:0:3:2 sdv 65:80  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:1:2 sdj 8:144  [active][ready]
 \_ 8:0:0:2 sdd 8:48   [active][ready]

mpath3 (360a9800056724439633449336c514c75)
[size=40 GB][features="1 queue_if_no_path"][hwhandler="0"]
\_ round-robin 0 [prio=8][active]
 \_ 8:0:2:0 sdn 8:208  [active][ready]
 \_ 8:0:3:0 sdt 65:48  [active][ready]
\_ round-robin 0 [prio=2][enabled]
 \_ 8:0:0:0 sdb 8:16   [active][ready]
 \_ 8:0:1:0 sdh 8:112  [active][ready]

 

Appendix B (rawdevices file)

# This file and interface are deprecated.
# Applications needing raw device access should open regular
# block devices with O_DIRECT.
# raw device bindings
# format:  <rawdev> <major> <minor>
#          <rawdev> <blockdev>
# example: /dev/raw/raw1 /dev/sda1
#          /dev/raw/raw2 8 5
/dev/mpath/mpath0
/dev/mpath/mpath1
/dev/mpath/mpath2
/dev/mpath/mpath3
/dev/mpath/mpath4
/dev/mpath/mpath5

 

Appendix C (/etc/multipath.conf)

========================

Server 1:

# This is an example configuration file for device mapper multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.5/multipath.conf.annotated


# Blacklist all devices by default. Remove this to enable multipathing
# on the default devices.
#devnode_blacklist {
#        devnode "*"
#}

## Use user friendly names, instead of using WWIDs as names.
defaults {
      user_friendly_names yes
}


## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
#     device {
#           vendor                  "IBM"
#           product                 "S/390 DASD ECKD"
#           path_grouping_policy    multibus
#           getuid_callout          "/sbin/dasdview -j /dev/%n"
#           path_checker            directio
#     }
#}


##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
#      udev_dir          /dev
#      polling_interval       10
#      selector          "round-robin 0"
#      path_grouping_policy      multibus
#      getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#      prio_callout            /bin/true
#      path_checker            readsector0
#      rr_min_io         100
#      rr_weight         priorities
#      failback          immediate
#      no_path_retry           fail
#      user_friendly_name      yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid.  The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line.  Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not multipathed
devnode_blacklist {
#       wwid 26353900f02796769
      devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
      devnode "^hd[a-z]"
      devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
#      multipath {
#           wwid              3600508b4000156d700012000000b0000
#           alias             yellow
#           path_grouping_policy      multibus
#           path_checker            readsector0
#           path_selector           "round-robin 0"
#           failback          manual
#           rr_weight         priorities
#           no_path_retry           5
#     }
#      multipath {
#           wwid              1DEC_____321816758474
#           alias             red
#     }
#}
devices {
#     device {
#           vendor                  "COMPAQ  "
#           product                 "HSV110 (C)COMPAQ"
#           path_grouping_policy      multibus
#           getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#           path_checker            readsector0
#           path_selector           "round-robin 0"
#           hardware_handler      "0"
#           failback          15
#           rr_weight         priorities
#           no_path_retry           queue
#     }
#     device {
#           vendor                  "COMPAQ  "
#           product                 "MSA1000         "
#           path_grouping_policy      multibus
#     }
#
       device {
               vendor                  "NETAPP"
               product                 "LUN"
               path_grouping_policy    group_by_prio
               getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
               prio_callout            "/opt/netapp/santools/mpath_prio_ontap /dev/%n"
               features                "1 queue_if_no_path"
               path_checker            readsector0
            failback          immediate  
       }
}

 

Appendix D ("fdisk -l" output)

Server 1:

Disk /dev/sda: 146.6 GB, 146685296640 bytes
255 heads, 63 sectors/track, 17833 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14       13067   104856255   83  Linux
/dev/sda3           13068       15162    16828087+  82  Linux swap
/dev/sda4           15163       17833    21454807+   5  Extended
/dev/sda5           15163       16990    14683378+  83  Linux

Disk /dev/sdb: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes


Disk /dev/sdc: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes


Disk /dev/sdd: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sde: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdf: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sdg: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1               1        1018     5238597    5  Extended

Disk /dev/sdh: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdi: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdj: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdk: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdl: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sdm: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdm1               1        1018     5238597    5  Extended

Disk /dev/sdn: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdo: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdp: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdq: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdr: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sds: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sds1               1        1018     5238597    5  Extended

Disk /dev/sdt: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdu: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdv: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdw: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdx: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sdy: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdy1               1        1018     5238597    5  Extended

Disk /dev/dm-0: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-1: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-2: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-3: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/dm-4: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

     Device Boot      Start         End      Blocks   Id  System
/dev/dm-4p1               1        1018     5238597    5  Extended

Disk /dev/dm-5: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Server 2's "fdisk -l"
Disk /dev/sda: 146.6 GB, 146685296640 bytes
255 heads, 63 sectors/track, 17833 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          13      104391   83  Linux
/dev/sda2              14       13067   104856255   83  Linux
/dev/sda3           13068       15162    16828087+  82  Linux swap
/dev/sda4           15163       17833    21454807+   5  Extended
/dev/sda5           15163       16990    14683378+  83  Linux

Disk /dev/sdb: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdc: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes


Disk /dev/sdd: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes


Disk /dev/sde: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes


Disk /dev/sdf: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes


Disk /dev/sdg: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdg1               1        1018     5238597    5  Extended

Disk /dev/sdh: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdi: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdj: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdk: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdl: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sdm: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdm1               1        1018     5238597    5  Extended

Disk /dev/sdn: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdo: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdp: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdq: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdr: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sds: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sds1               1        1018     5238597    5  Extended

Disk /dev/sdt: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdu: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdv: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdw: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/sdx: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/sdy: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sdy1               1        1018     5238597    5  Extended

Disk /dev/dm-0: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

Disk /dev/dm-1: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-2: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-3: 5368 MB, 5368709120 bytes
166 heads, 62 sectors/track, 1018 cylinders
Units = cylinders of 10292 * 512 = 5269504 bytes

     Device Boot      Start         End      Blocks   Id  System
/dev/dm-3p1               1        1018     5238597    5  Extended

Disk /dev/dm-4: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Disk /dev/dm-5: 42.9 GB, 42953867264 bytes
64 heads, 32 sectors/track, 40964 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Server 2 (/etc/multipath.conf)
========================

## Use user friendly names, instead of using WWIDs as names.
defaults {
      user_friendly_names yes
}


## By default, devices with vendor = "IBM" and product = "S/390.*" are
## blacklisted. To enable mulitpathing on these devies, uncomment the
## following lines.
#devices {
#     device {
#           vendor                  "IBM"
#           product                 "S/390 DASD ECKD"
#           path_grouping_policy    multibus
#           getuid_callout          "/sbin/dasdview -j /dev/%n"
#           path_checker            directio
#     }
#}


##
## This is a template multipath-tools configuration file
## Uncomment the lines relevent to your environment
##
#defaults {
#      udev_dir          /dev
#      polling_interval       10
#      selector          "round-robin 0"
#      path_grouping_policy      multibus
#      getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#      prio_callout            /bin/true
#      path_checker            readsector0
#      rr_min_io         100
#      rr_weight         priorities
#      failback          immediate
#      no_path_retry           fail
#      user_friendly_name      yes
#}
##
## The wwid line in the following blacklist section is shown as an example
## of how to blacklist devices by wwid.  The 3 devnode lines are the
## compiled in default blacklist. If you want to blacklist entire types
## of devices, such as all scsi devices, you should use a devnode line.
## However, if you want to blacklist specific devices, you should use
## a wwid line.  Since there is no guarantee that a specific device will
## not change names on reboot (from /dev/sda to /dev/sdb for example)
## devnode lines are not recommended for blacklisting specific devices.
##
## insert the sda, sdb or whatever local disks below so tt they're not multipathed
devnode_blacklist {
#       wwid 26353900f02796769
      devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st|sda|sdz)[0-9]*"
      devnode "^hd[a-z]"
      devnode "^cciss!c[0-9]d[0-9]*"
}
#multipaths {
#      multipath {
#           wwid              3600508b4000156d700012000000b0000
#           alias             yellow
#           path_grouping_policy      multibus
#           path_checker            readsector0
#           path_selector           "round-robin 0"
#           failback          manual
#           rr_weight         priorities
#           no_path_retry           5
#     }
#      multipath {
#           wwid              1DEC_____321816758474
#           alias             red
#     }
#}
devices {
#     device {
#           vendor                  "COMPAQ  "
#           product                 "HSV110 (C)COMPAQ"
#           path_grouping_policy      multibus
#           getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
#           path_checker            readsector0
#           path_selector           "round-robin 0"
#           hardware_handler      "0"
#           failback          15
#           rr_weight         priorities
#           no_path_retry           queue
#     }
#     device {
#           vendor                  "COMPAQ  "
#           product                 "MSA1000         "
#           path_grouping_policy      multibus
#     }
#
       device {
               vendor                  "NETAPP"
               product                 "LUN"
               path_grouping_policy    group_by_prio
               getuid_callout          "/sbin/scsi_id -g -u -s /block/%n"
               prio_callout            "/opt/netapp/santools/mpath_prio_ontap /dev/%n"
               features                "1 queue_if_no_path"
               path_checker            readsector0
            failback          immediate  
       }
}

 


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]