[dm-devel] Question regarding failback option in multipath.conf

Thu Oct 1 21:16:43 UTC 2009

Any ideas on this? Not sure if this e-mail made it out to the list.
Thanks!

-Eli

On Wed, Sep 30, 2009 at 1:36 PM, Eli Klein <elijah at aclue.com> wrote:

> On Sep 30, 2009, at 1:24 PM, John Brier wrote:
>
> On 09/30/2009 03:16 PM, Eli Klein wrote:
>
>
> Here's the abbreviated output from multipath -v3:
>
>
> mpath1: pgfailback = 120 (config file default)
>
> mpath1: pgpolicy = multibus (config file default)
>
> mpath1: selector = round-robin 0 (internal default)
>
> mpath1: features = 1 queue_if_no_path (internal default)
>
> mpath1: hwhandler = 0 (internal default)
>
> mpath1: rr_weight = 2 (config file default)
>
> mpath1: minio = 10 (config file default)
>
> mpath1: no_path_retry = 1 (config file default)
>
> pg_timeout = NONE (internal default)
>
> mpath1: set ACT_NOTHING (map unchanged)
>
>
> It's definitely picking up the settings correctly from multipath.conf,
>
> but the paths are still reinstated immediately once they're reconnected
>
> (even if it's just for a split second).
>
>
>
> What does /var/log/messages look like when this happens? Since you changed
> failback to 120 did you restart multipathd or restart the box?
>
> John Brier
>
> --
> dm-devel mailing list
> dm-devel at redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>
>
> I've tried rebooting, restarting multipath (and iscsid), flushing multipath
> (-F), removing all the iscsi targets completely and then reinitializing the
> targets.  Nothing changes the behavior.  Here's output from
> /var/log/messages.. note the time between when the link becomes active
> (13:31:08) to when the path is reinstated (13:31:15):
>
> Sep 30 13:30:28 testbox kernel:  connection7:0: ping timeout of 5 secs
> expired, recv timeout 5, last rx 4470061909, last ping 4470066909, now
> 4470071909
> Sep 30 13:30:28 testbox kernel:  connection7:0: detected conn error (1011)
> Sep 30 13:30:28 testbox multipathd: sdf: readsector0 checker reports path
> is down
> Sep 30 13:30:28 testbox multipathd: checker failed path 8:80 in map mpath0
> Sep 30 13:30:28 testbox multipathd: mpath0: remaining active paths: 1
> Sep 30 13:30:28 testbox kernel: device-mapper: multipath: Failing path
> 8:80.
> Sep 30 13:30:28 testbox iscsid: Kernel reported iSCSI connection 7:0 error
> (1011) state (3)
> Sep 30 13:30:29 testbox kernel:  connection9:0: ping timeout of 5 secs
> expired, recv timeout 5, last rx 4470063232, last ping 4470068232, now
> 4470073232
> Sep 30 13:30:29 testbox kernel:  connection9:0: detected conn error (1011)
> Sep 30 13:30:29 testbox multipathd: sdg: readsector0 checker reports path
> is down
> Sep 30 13:30:29 testbox multipathd: checker failed path 8:96 in map mpath1
> Sep 30 13:30:29 testbox multipathd: mpath1: remaining active paths: 1
> Sep 30 13:30:29 testbox kernel: device-mapper: multipath: Failing path
> 8:96.
> Sep 30 13:30:30 testbox kernel:  connection11:0: ping timeout of 5 secs
> expired, recv timeout 5, last rx 4470064373, last ping 4470069373, now
> 4470074373
> Sep 30 13:30:30 testbox kernel:  connection11:0: detected conn error (1011)
> Sep 30 13:30:30 testbox iscsid: Kernel reported iSCSI connection 9:0 error
> (1011) state (3)
> Sep 30 13:30:30 testbox multipathd: sdh: readsector0 checker reports path
> is down
> Sep 30 13:30:30 testbox multipathd: checker failed path 8:112 in map mpath2
> Sep 30 13:30:30 testbox kernel: device-mapper: multipath: Failing path
> 8:112.
> Sep 30 13:30:30 testbox multipathd: mpath2: remaining active paths: 1
> Sep 30 13:30:30 testbox multipathd: dm-4: add map (uevent)
> Sep 30 13:30:30 testbox multipathd: dm-4: devmap already registered
> Sep 30 13:30:30 testbox multipathd: dm-2: add map (uevent)
> Sep 30 13:30:30 testbox multipathd: dm-2: devmap already registered
> Sep 30 13:30:30 testbox multipathd: dm-3: add map (uevent)
> Sep 30 13:30:30 testbox multipathd: dm-3: devmap already registered
> Sep 30 13:30:31 testbox iscsid: Kernel reported iSCSI connection 11:0 error
> (1011) state (3)
> Sep 30 13:30:43 testbox kernel:  session7: session recovery timed out after
> 15 secs
> Sep 30 13:30:43 testbox multipathd: sdf: readsector0 checker reports path
> is down
> Sep 30 13:30:44 testbox kernel:  session9: session recovery timed out after
> 15 secs
> Sep 30 13:30:44 testbox multipathd: sdg: readsector0 checker reports path
> is down
> Sep 30 13:30:45 testbox kernel:  session11: session recovery timed out
> after 15 secs
> Sep 30 13:30:45 testbox kernel: sd 13:0:0:0: SCSI error: return code =
> 0x000f0000
> Sep 30 13:30:45 testbox kernel: end_request: I/O error, dev sdh, sector
> 407978223
> Sep 30 13:30:45 testbox multipathd: sdh: readsector0 checker reports path
> is down
> Sep 30 13:30:55 testbox multipathd: sdf: readsector0 checker reports path
> is down
> Sep 30 13:31:05 testbox multipathd: sdg: readsector0 checker reports path
> is down
> Sep 30 13:31:05 testbox multipathd: sdh: readsector0 checker reports path
> is down
> Sep 30 13:31:05 testbox multipathd: sdf: readsector0 checker reports path
> is down
> Sep 30 13:31:05 testbox multipathd: sdg: readsector0 checker reports path
> is down
> Sep 30 13:31:05 testbox multipathd: sdh: readsector0 checker reports path
> is down
> Sep 30 13:31:08 testbox iscsid: connection9:0 is operational after recovery
> (3 attempts)
> Sep 30 13:31:08 testbox iscsid: connection11:0 is operational after
> recovery (3 attempts)
> Sep 30 13:31:11 testbox iscsid: connection7:0 is operational after recovery
> (3 attempts)
> Sep 30 13:31:15 testbox multipathd: sdf: readsector0 checker reports path
> is up
> Sep 30 13:31:15 testbox multipathd: 8:80: reinstated
> Sep 30 13:31:15 testbox multipathd: mpath0: remaining active paths: 2
> Sep 30 13:31:15 testbox multipathd: sdg: readsector0 checker reports path
> is up
> Sep 30 13:31:15 testbox multipathd: 8:96: reinstated
> Sep 30 13:31:15 testbox multipathd: mpath1: remaining active paths: 2
> Sep 30 13:31:15 testbox multipathd: sdh: readsector0 checker reports path
> is up
> Sep 30 13:31:15 testbox multipathd: 8:112: reinstated
> Sep 30 13:31:15 testbox multipathd: mpath2: remaining active paths: 2
> Sep 30 13:31:15 testbox multipathd: dm-4: add map (uevent)
> Sep 30 13:31:15 testbox multipathd: dm-4: devmap already registered
> Sep 30 13:31:15 testbox multipathd: dm-2: add map (uevent)
> Sep 30 13:31:15 testbox multipathd: dm-2: devmap already registered
> Sep 30 13:31:15 testbox multipathd: dm-3: add map (uevent)
> Sep 30 13:31:15 testbox multipathd: dm-3: devmap already registered
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/dm-devel/attachments/20091001/56f1bc30/attachment.htm>