[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

Re: [dm-devel] rdac path failure - Sun 6140



On Fri, 2009-08-14 at 13:26 -0700, Stewart Smith wrote:
> Interesting.
> 
> I just grabbed 2.6.30.4 from kernel.org and I can no longer reproduce
> the issue with that kernel.  I did not add in your debugging version
> of scsi_dh_rdac.c yet.
> 
> Somewhere between vmlinuz-2.6.29.4-167.fc11 and the generic 2.6.30.4
> (using the same kernel .config) this problem was fixed.

That is good :)

I do not have a fc11 install.... If it is not a hassle, can you send  a
diff of scsi_dh_rdac.c and dm-mpath.c, we should understand what fixed
the problem.
> 
> Its now running over 350 MB/s with 16 sequential writers using both
> active paths.
> 
> 
> 
> 
> # fio --filename=/san0/vol1/test --direct=1 --rw=write --bs=8m
> --size=32G --numjobs=16 --runtime=60 --group_reporting --name=file1
> 
> Run status group 0 (all jobs):
>   WRITE: io=21,416MiB, aggrb=355MiB/s, minb=355MiB/s, maxb=355MiB/s,
> mint=60342msec, maxt=60342msec
> 
> Disk stats (read/write):
>   dm-1: ios=3/85697, merge=0/0, ticks=11/21809639, in_queue=21810085,
> util=99.94%, aggrios=0/11402, aggrmerge=0/10022, aggrticks=2/2805880,
> aggrin_queue=2805875, aggrutil=97.09%
>     sdf: ios=0/22732, merge=0/20168, ticks=0/6090166,
> in_queue=6090145, util=97.09%
>     sdn: ios=3/22876, merge=0/19921, ticks=11/5133355,
> in_queue=5133356, util=96.16%
>     sdb: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
>     sdj: ios=0/0, merge=0/0, ticks=0/0, in_queue=0, util=0.00%
> 
> 
> Thanks!
> --
> Stewart
> 
> 
> 
> 
> On Fri, Aug 14, 2009 at 9:21 AM, Moger, Babu<Babu Moger lsi com> wrote:
> >> -----Original Message-----
> >> From: dm-devel-bounces redhat com [mailto:dm-devel-bounces redhat com] On
> >> Behalf Of Stewart Smith
> >> Sent: Friday, August 14, 2009 10:58 AM
> >> To: device-mapper development
> >> Subject: Re: [dm-devel] rdac path failure - Sun 6140
> >>
> >> I will test this today.
> >>
> >> Does everything look OK from a configuration standpoint?  Should the
> >
> >  I have verified your configuration file. It looks fine..
> >
> >> RDAC virtual HBA drivers from LSI be a requirement?  I am not
> >> currently using them.
> >
> >  You can't use both the solutions at once. You are fine..
> >
> >> Thank you,
> >> --
> >> Stew
> >>
> >>
> >>
> >>
> >> On Thu, Aug 13, 2009 at 5:05 PM, Moger, Babu<Babu Moger lsi com> wrote:
> >> > Stew,
> >> >
> >> >      I don’t see much information about this failure in the logs. Right
> >> now
> >> > device handlers don’t provide much information on failures.  We are
> >> working
> >> > on to add some more debug levels.  I am attaching my draft code
> >> > (scsi_dh_rdac.c) here.  Please use this only for your testing. It is not
> >> > been approved/reviewed yet. I still need to submit this one to community
> >> for
> >> > approval. The code is attached.  Please replace this file with
> >> > scsi_dh_rdac.c in the directory /driver/scsi/device_handlers and rebuild
> >> the
> >> > kernel.  This should give more information from the target point of
> >> view.
> >> > Please send me the /var/log/messages file after the failure. Let see if
> >> we
> >> > can get more information..
> >> >
> >> >
> >> >
> >> > Thanks
> >> >
> >> > Babu Moger
> >> >
> >> > ________________________________
> >> >
> >> > From: dm-devel-bounces redhat com [mailto:dm-devel-bounces redhat com]
> >> On
> >> > Behalf Of Stewart Smith
> >> > Sent: Thursday, August 13, 2009 3:35 PM
> >> > To: device-mapper development
> >> > Subject: Re: [dm-devel] rdac path failure - Sun 6140
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > Same sequence of events, with multipathd -v3
> >> >
> >> >
> >> >
> >> > Aug 13 16:28:48.627  kernel: device-mapper: multipath: Failing path
> >> 8:208.
> >> >
> >> > Aug 13 16:28:48.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:28:48.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:28:48.000  multipathd: pg_timeout = NONE (internal default)
> >> >
> >> > Aug 13 16:28:48.000  multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:28:48.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:28:48.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:28:48.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:28:48.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_ACTION=PATH_FAILED
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_SEQNUM=1
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_NR_VALID_PATHS=3
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:28:48.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:28:48.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:28:48.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DEVTYPE=disk
> >> >
> >> > Aug 13 16:28:48.000  multipathd: SEQNUM=1738
> >> >
> >> > Aug 13 16:28:48.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:28:48.000  multipathd: DEVNAME=/dev/dm-1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: remaining active paths: 4
> >> >
> >> > Aug 13 16:28:50.000  multipathd: sdj: rdac prio = 3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: sdn: rdac prio = 3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: sdb: rdac prio = 0
> >> >
> >> > Aug 13 16:28:50.000  multipathd: sdd: rdac prio = 0
> >> >
> >> > Aug 13 16:28:50.763  kernel: device-mapper: multipath: Failing path
> >> 8:208.
> >> >
> >> > Aug 13 16:28:50.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:28:50.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_ACTION=PATH_REINSTATED
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_SEQNUM=2
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_NR_VALID_PATHS=4
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:28:50.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:28:50.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:28:50.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DEVTYPE=diskAug 13 16:28:50.000
> >> >  multipathd: SEQNUM=1739Aug 13 16:28:50.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:28:50.000  multipathd: pg_timeout = NONE (internal default)
> >> >
> >> > Aug 13 16:28:50.000  multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: remaining active paths: 3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:28:50.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:28:50.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:28:50.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_ACTION=PATH_FAILED
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_SEQNUM=3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_NR_VALID_PATHS=3
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:28:50.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:28:50.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:28:50.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DEVTYPE=disk
> >> >
> >> > Aug 13 16:28:50.000  multipathd: SEQNUM=1740
> >> >
> >> > Aug 13 16:28:50.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:28:50.000  multipathd: DEVNAME=/dev/dm-1
> >> >
> >> > Aug 13 16:29:00.000  multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:29:00.000  multipathd: vol1: remaining active paths: 4
> >> >
> >> > Aug 13 16:29:00.000  multipathd: sdj: rdac prio = 3
> >> >
> >> > Aug 13 16:29:00.000  multipathd: sdn: rdac prio = 3
> >> >
> >> > Aug 13 16:29:00.000  multipathd: sdb: rdac prio = 0
> >> >
> >> > Aug 13 16:29:00.000  multipathd: sdd: rdac prio = 0
> >> >
> >> > Aug 13 16:29:00.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:29:00.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:29:00.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:29:00.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:29:00.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:29:00.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_ACTION=PATH_REINSTATED
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_SEQNUM=4
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_NR_VALID_PATHS=4
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:29:00.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:29:00.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:29:00.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DEVTYPE=disk
> >> >
> >> > Aug 13 16:29:00.000  multipathd: SEQNUM=1741
> >> >
> >> > Aug 13 16:29:00.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:29:00.000  multipathd: DEVNAME=/dev/dm-1
> >> >
> >> > Aug 13 16:29:02.753  kernel: device-mapper: multipath: Failing path
> >> 8:208.
> >> >
> >> > Aug 13 16:29:02.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:29:02.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:29:02.000  multipathd: pg_timeout = NONE (internal default)
> >> >
> >> > Aug 13 16:29:02.000  multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:29:02.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:29:02.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:29:02.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:29:02.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_ACTION=PATH_FAILED
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_SEQNUM=5
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_NR_VALID_PATHS=3
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:29:02.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:29:02.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:29:02.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DEVTYPE=disk
> >> >
> >> > Aug 13 16:29:02.000  multipathd: SEQNUM=1742
> >> >
> >> > Aug 13 16:29:02.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:29:02.000  multipathd: DEVNAME=/dev/dm-1
> >> >
> >> > Aug 13 16:29:10.000  multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:29:10.000  multipathd: vol1: remaining active paths: 4
> >> >
> >> > Aug 13 16:29:10.000  multipathd: sdj: rdac prio = 3
> >> >
> >> > Aug 13 16:29:10.000  multipathd: sdn: rdac prio = 3
> >> >
> >> > Aug 13 16:29:10.000  multipathd: sdb: rdac prio = 0
> >> >
> >> > Aug 13 16:29:10.000  multipathd: sdd: rdac prio = 0
> >> >
> >> > Aug 13 16:29:10.000  multipathd: vol1: rr_weight = 2 (LUN setting)
> >> >
> >> > Aug 13 16:29:10.000  multipathd: vol1: pgfailback = -2 (controller
> >> setting)
> >> >
> >> > Aug 13 16:29:10.000  multipathd: uevent 'change' from
> >> > '/devices/virtual/block/dm-1'
> >> >
> >> > Aug 13 16:29:10.000  multipathd: UDEV_LOG=3
> >> >
> >> > Aug 13 16:29:10.000  multipathd: ACTION=change
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DEVPATH=/devices/virtual/block/dm-1
> >> >
> >> > Aug 13 16:29:10.000  multipathd: SUBSYSTEM=block
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_TARGET=multipath
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_ACTION=PATH_REINSTATED
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_SEQNUM=6
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_PATH=8:208
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_NR_VALID_PATHS=4
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DM_NAME=vol1
> >> >
> >> > Aug 13 16:29:10.000  multipathd:
> >> > DM_UUID=mpath-3600a0b800048335200001e5d48b68a9b
> >> >
> >> > Aug 13 16:29:10.000  multipathd: MAJOR=253
> >> >
> >> > Aug 13 16:29:10.000  multipathd: MINOR=1
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DEVTYPE=disk
> >> >
> >> > Aug 13 16:29:10.000  multipathd: SEQNUM=1743
> >> >
> >> > Aug 13 16:29:10.000  multipathd: UDEVD_EVENT=1
> >> >
> >> > Aug 13 16:29:10.000  multipathd: DEVNAME=/dev/dm-1
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Aug 13, 2009 at 1:27 PM, Stewart Smith <stew cleepdar com>
> >> wrote:
> >> >
> >> >
> >> >
> >> > after a fresh, multipath -F and start of multipathd with -v 2 I see the
> >> > following messages.
> >> >
> >> >
> >> >
> >> > After starting multipathd I mounted /dev/mapper/vol1 and generated some
> >> > simple I/O to it using dd
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > Aug 13 16:23:14.888 localhost kernel: device-mapper: multipath: Failing
> >> path
> >> > 8:208.
> >> >
> >> > Aug 13 16:23:14.000 localhost multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:23:16.000 localhost multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:23:30.462 localhost kernel: device-mapper: multipath: Failing
> >> path
> >> > 8:208.
> >> >
> >> > Aug 13 16:23:30.000 localhost multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:23:39.000 localhost multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:23:46.430 localhost kernel: device-mapper: multipath: Failing
> >> path
> >> > 8:208.
> >> >
> >> > Aug 13 16:23:46.000 localhost multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:23:51.041 localhost kernel: device-mapper: multipath: Failing
> >> path
> >> > 8:208.
> >> >
> >> > Aug 13 16:23:51.000 localhost multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:23:59.000 localhost multipathd: 8:208: reinstated
> >> >
> >> > Aug 13 16:24:06.465 localhost kernel: device-mapper: multipath: Failing
> >> path
> >> > 8:208.
> >> >
> >> > Aug 13 16:24:06.000 localhost multipathd: 8:208: mark as failed
> >> >
> >> > Aug 13 16:24:09.000 localhost multipathd: 8:208: reinstated
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > Thanks,
> >> >
> >> > --
> >> >
> >> > Stew
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Aug 13, 2009 at 12:42 PM, Moger, Babu <Babu Moger lsi com>
> >> wrote:
> >> >
> >> > Do you have /var/log/messages file for this problem?
> >> >
> >> > Thanks
> >> > Babu Moger
> >> >
> >> >> -----Original Message-----
> >> >> From: dm-devel-bounces redhat com [mailto:dm-devel-bounces redhat com]
> >> On
> >> >> Behalf Of Stewart Smith
> >> >> Sent: Thursday, August 13, 2009 1:51 PM
> >> >> To: dm-devel redhat com
> >> >> Subject: [dm-devel] rdac path failure - Sun 6140
> >> >>
> >> >> Hello All,
> >> >>
> >> >> I am seeing many of these messages when my Sun 6140 array is under
> >> heavy
> >> >> I/O
> >> >> device-mapper: multipath: Failing path 8:208.
> >> >> device-mapper: multipath: Failing path 8:208.
> >> >> device-mapper: multipath: Failing path 8:208.
> >> >> device-mapper: multipath: Failing path 8:208.
> >> >> device-mapper: multipath: Failing path 8:208.
> >> >>
> >> >>
> >> >> I am running a Fedora 10 server, with two fiber connections to two
> >> >> different switches.  Both controllers on the 6140 have one connection
> >> >> to each switch as well.  The end result is that I see four paths to
> >> >> each LUN.
> >> >>
> >> >> When the volume is mounted and under significant load I see the
> >> >> messages above every few seconds.  They seem to appear every
> >> >> "no_path_retry" seconds.
> >> >>
> >> >> The 6140 controller firmware is up to date at version 07.50.08.10 and
> >> >> I have installed the latest firmware for my Emulex LPe11002 cards.  I
> >> >> have reproduced the problem using both Cisco MDS and Brocade fiber
> >> >> channel switches as well.
> >> >>
> >> >> Using CAM, I have set the initiator Host Type to "Linux" at the
> >> >> moment.  I have tried other options as well without success.
> >> >>
> >> >> I have NOT installed the RDAC drivers from either Sun or LSI -
> >> >> primarily because they do not seem to build on my Fedora 10 kernel.
> >> >>
> >> >> Any ideas would be greatly appreciated!!!
> >> >>
> >> >> configs and debugging multipathd output is below.
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> Kernel: 2.6.27.24-170.2.68.fc10.x86_64
> >> >>
> >> >> # multipath -lll
> >> >> vol1 (3600a0b800048335200001e5d48b68a9b) dm-1 SUN,CSM200_R
> >> >> [size=12T][features=1 queue_if_no_path][hwhandler=1 rdac][rw]
> >> >> \_ round-robin 0 [prio=6][active]
> >> >>  \_ 5:0:1:2 sdj 8:144 [active][ready]
> >> >>  \_ 2:0:1:2 sdn 8:208 [active][ready]
> >> >> \_ round-robin 0 [prio=0][enabled]
> >> >>  \_ 2:0:0:2 sdb 8:16  [active][ghost]
> >> >>  \_ 5:0:0:2 sdd 8:48  [active][ghost]
> >> >>
> >> >>
> >> >> # cat /etc/multipath.conf
> >> >>
> >> >> blacklist {
> >> >>         devnode "^sd[a-z][[0-9]*]"
> >> >>         devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"
> >> >>         devnode "^hd[a-z][0-9]*"
> >> >>         devnode "^cciss!c[0-9]d[0-9](p[0-9]*)*"
> >> >> }
> >> >>
> >> >> defaults {
> >> >>         udev_dir                /dev
> >> >>         polling_interval        10
> >> >>         selector                "round-robin 0"
> >> >>         path_grouping_policy    multibus
> >> >>         getuid_callout          "/sbin/scsi_id --whitelisted /dev/%n"
> >> >>         prio                    alua
> >> >>         path_checker            readsector0
> >> >>         rr_min_io               100
> >> >>         max_fds                 8192
> >> >>         rr_weight               priorities
> >> >>         failback                immediate
> >> >>         no_path_retry           fail
> >> >>         user_friendly_names     yes
> >> >> }
> >> >> devices {
> >> >>         device {
> >> >>                 vendor                  "SUN"
> >> >>                 product                 "CSM200_R"
> >> >>                 product_blacklist       "Universal Xport"
> >> >>                 getuid_callout          "/sbin/scsi_id --whitelisted
> >> >> /dev/%n"
> >> >>                 features                "0"
> >> >>                 hardware_handler        "1 rdac"
> >> >>                 path_selector           "round-robin 0"
> >> >>                 path_grouping_policy    group_by_prio
> >> >>                 failback                immediate
> >> >>                 rr_weight               uniform
> >> >>                 no_path_retry           queue
> >> >>                 rr_min_io               1000
> >> >>                 path_checker            rdac
> >> >>                 prio                    rdac
> >> >>         }
> >> >> }
> >> >>
> >> >> multipaths {
> >> >>         multipath {
> >> >>                 wwid
> >>  3600a0b800048335200001e5d48b68a9b
> >> >>                 alias                   vol1
> >> >>                 rr_weight               priorities
> >> >>                 no_path_retry           5
> >> >>                 rr_min_io               100
> >> >>         }
> >> >> }
> >> >>
> >> >>
> >> >>
> >> >> # multipathd -d v3
> >> >>
> >> >>
> >> >> Aug 13 14:48:53 | sdb: ownership set to vol1
> >> >> Aug 13 14:48:53 | sdb: not found in pathvec
> >> >> Aug 13 14:48:53 | sdb: mask = 0xc
> >> >> Aug 13 14:48:53 | sdb: path checker = rdac (controller setting)
> >> >> Aug 13 14:48:53 | sdb: state = 4
> >> >> Aug 13 14:48:53 | sdb: rdac prio = 0
> >> >> Aug 13 14:48:53 | sdd: ownership set to vol1
> >> >> Aug 13 14:48:53 | sdd: not found in pathvec
> >> >> Aug 13 14:48:53 | sdd: mask = 0xc
> >> >> Aug 13 14:48:53 | sdd: path checker = rdac (controller setting)
> >> >> Aug 13 14:48:53 | sdd: state = 4
> >> >> Aug 13 14:48:53 | sdd: rdac prio = 0
> >> >> Aug 13 14:48:53 | sdj: ownership set to vol1
> >> >> Aug 13 14:48:53 | sdj: not found in pathvec
> >> >> Aug 13 14:48:53 | sdj: mask = 0xc
> >> >> Aug 13 14:48:53 | sdj: path checker = rdac (controller setting)
> >> >> Aug 13 14:48:53 | sdj: state = 2
> >> >> Aug 13 14:48:53 | sdj: rdac prio = 3
> >> >> Aug 13 14:48:53 | sdn: ownership set to vol1
> >> >> Aug 13 14:48:53 | sdn: not found in pathvec
> >> >> Aug 13 14:48:53 | sdn: mask = 0xc
> >> >> Aug 13 14:48:53 | sdn: path checker = rdac (controller setting)
> >> >> Aug 13 14:48:53 | sdn: state = 2
> >> >> Aug 13 14:48:53 | sdn: rdac prio = 3
> >> >> Aug 13 14:48:53 | vol1: pgfailback = -2 (controller setting)
> >> >> Aug 13 14:48:53 | vol1: pgpolicy = group_by_prio (controller setting)
> >> >> Aug 13 14:48:53 | vol1: selector = round-robin 0 (controller setting)
> >> >> Aug 13 14:48:53 | vol1: features = 0 (controller setting)
> >> >> Aug 13 14:48:53 | vol1: hwhandler = 1 rdac (controller setting)
> >> >> Aug 13 14:48:53 | vol1: rr_weight = 2 (LUN setting)
> >> >> Aug 13 14:48:53 | vol1: minio = 100 (LUN setting)
> >> >> Aug 13 14:48:53 | vol1: no_path_retry = 5 (multipath setting)
> >> >> Aug 13 14:48:53 | pg_timeout = NONE (internal default)
> >> >> Aug 13 14:48:53 | vol1: set ACT_CREATE (map does not exist)
> >> >> create: vol1 (3600a0b800048335200001e5d48b68a9b) n/a SUN,CSM200_R
> >> >> [size=12T][features=0][hwhandler=1 rdac][n/a]
> >> >> \_ round-robin 0 [prio=6][undef]
> >> >>  \_ 5:0:1:2 sdj 8:144 [undef][ready]
> >> >>  \_ 2:0:1:2 sdn 8:208 [undef][ready]
> >> >> \_ round-robin 0 [prio=0][undef]
> >> >>  \_ 2:0:0:2 sdb 8:16 [undef][ghost]
> >> >>  \_ 5:0:0:2 sdd 8:48 [undef][ghost]
> >> >>
> >> >
> >> >> --
> >> >> dm-devel mailing list
> >> >> dm-devel redhat com
> >> >> https://www.redhat.com/mailman/listinfo/dm-devel
> >> >
> >> > --
> >> > dm-devel mailing list
> >> > dm-devel redhat com
> >> > https://www.redhat.com/mailman/listinfo/dm-devel
> >> >
> >> >
> >> >
> >> >
> >>
> >> --
> >> dm-devel mailing list
> >> dm-devel redhat com
> >> https://www.redhat.com/mailman/listinfo/dm-devel
> >
> > --
> > dm-devel mailing list
> > dm-devel redhat com
> > https://www.redhat.com/mailman/listinfo/dm-devel
> >
> 
> --
> dm-devel mailing list
> dm-devel redhat com
> https://www.redhat.com/mailman/listinfo/dm-devel


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]