[dm-devel] Multipath failover problems

Thu Jan 13 22:27:31 UTC 2005

I have never been able to get multipath failover to work reliably. I just
tried the newest 2.6.10 kernel with the udm patches.  I'm using
multipath-tool 0.4.1.  I this test I pull the cable and multipath failed to
inactive paths without a problem, however, when I put the cable back in, I
got more scsi IO errors and XFS shutdown the filesystem.

Kernel : 2.6.10+udm1 patch, qla2300 HBAs.

Questions:
1) When I pulled the cable, why do I get IO errors on both cards?  Instead
of just the one I pull the cable from.
2) Why do I get scsi IO errors when I plug a cable back in?  Nothing should
be happening with the other path.  I can see that when a cable is pulled IO
errors would be caused by commands that have not been acknowledged yet.

Here is the log:

Jan 13 14:08:23 linuxha2 multipathd: devmap event on shared1
Jan 13 14:08:23 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x20000
Jan 13 14:08:23 linuxha2 kernel: end_request: I/O error, dev sdm, sector 17498304
Jan 13 14:08:23 linuxha2 kernel: end_request: I/O error, dev sdm, sector 17498312
Jan 13 14:08:23 linuxha2 multipathd: event checker startup : shared1
Jan 13 14:08:23 linuxha2 multipathd: devmap event on shared1
Jan 13 14:08:23 linuxha2 multipathd: event checker startup : shared1
Jan 13 16:05:28 linuxha2 kernel: qla2300 0000:00:04.0: LOOP DOWN detected.
Jan 13 16:05:29 linuxha2 multipathd: devmap event on shared1
Jan 13 16:05:29 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4251336
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4251344
Jan 13 16:05:29 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4252360
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4252368
Jan 13 16:05:29 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdg, sector 4247432
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdg, sector 4247440
Jan 13 16:05:29 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4253384
Jan 13 16:05:29 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4253392
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4254408
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4254416
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4255432
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4255440
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4256456
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4256464
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4257480
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4257488
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4258504
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4258512
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4283336
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4283344
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4284360
Jan 13 16:05:30 linuxha2 multipathd: event checker startup : shared1
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4284368
Jan 13 16:05:30 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:30 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4285384
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4285392
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4286408
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4286416
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4287432
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4287440
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4288456
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4288464
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4289480
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4289488
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4290504
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4290512
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4315336
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4315344
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4316360
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4316368
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4317384
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4317392
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4318408
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4318416
Jan 13 16:05:31 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:31 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4319432
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4319440
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4320456
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4320464
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4321480
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4321488
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4322504
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4322512
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4347336
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4347344
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4348360
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdd, sector 4348368
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x2004043376
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4044392
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4044400
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4045416
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4045424
Jan 13 16:05:32 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4046440
Jan 13 16:05:32 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4046448
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4047464
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4047472
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4048488
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4048496
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4049512
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4049520
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4050536
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4050544
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4071456
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4071464
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4072480
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4072488
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4073504
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4073512
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4074528
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4074536
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4099360
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4099368
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4100384
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4100392
Jan 13 16:05:33 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:33 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4101408
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4101416
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4102432
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4102440
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4075360
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4075368
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4076384
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4076392
Jan 13 16:05:34 linuxha2 multipathd: 8:112 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 multipathd: 8:128 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4077408
Jan 13 16:05:34 linuxha2 multipathd: 8:144 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4077416
Jan 13 16:05:34 linuxha2 multipathd: 8:160 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 multipathd: 8:176 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4078432
Jan 13 16:05:34 linuxha2 multipathd: 8:192 : tur checker reports path is down 
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4078440
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4079456
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4079464
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4080480
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4080488
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4081504
Jan 13 16:05:34 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4081512
Jan 13 16:05:34 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4082528
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4082536
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4107360
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4107368
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4108384
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4108392
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4109408
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4109416
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4110432
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4110440
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4103456
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4103464
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4104480
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4104488
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4105504
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4105512
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4106528
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4106536
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4131360
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4131368
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4132384
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4132392
Jan 13 16:05:35 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4133408
Jan 13 16:05:35 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4133416
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4134432
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4134440
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4111456
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4111464
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4112480
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4112488
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4113504
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4113512
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4114528
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4114536
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4139336
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4139344
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4140360
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4140368
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4141384
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4141392
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4142408
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4142416
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4135456
Jan 13 16:05:36 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4135464
Jan 13 16:05:36 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4136480
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4136488
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4137504
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4137512
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4138528
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4138536
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4143432
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4143440
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4144456
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4144464
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4145480
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4145488
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4146504
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4146512
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4163336
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4163344
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4164360
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4164368
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4165384
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4165392
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4166408
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4166416
Jan 13 16:05:37 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:37 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4167432
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4167440
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4168456
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4168464
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4169480
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4169488
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4170504
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4170512
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4195336
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4195344
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4196360
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4196368
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4197384
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4197392
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4198408
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4198416
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4171336
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4171344
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4172360
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4172368
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4173384
Jan 13 16:05:38 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4173392
Jan 13 16:05:38 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4174408
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4174416
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4175432
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4175440
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4176456
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4176464
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4177480
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4177488
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4178504
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4178512
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4199432
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4199440
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 0> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4200456
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4200464
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4201480
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4201488
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 1> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4202504
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4202512
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4227336
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4227344
Jan 13 16:05:39 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:39 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4228360
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4228368
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4229384
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4229392
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4230408
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4230416
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4203336
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4203344
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4204360
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4204368
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 0 1> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4205384
Jan 13 16:05:40 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4205392
Jan 13 16:05:40 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4206408
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4206416
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4207432
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4207440
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4208456
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4208464
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4209480
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4209488
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4210504
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4210512
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4235336
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4235344
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4236360
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4236368
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4237384
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4237392
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4238408
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4238416
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4231432
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4231440
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4232456
Jan 13 16:05:41 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4232464
Jan 13 16:05:41 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4233480
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4233488
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4234504
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4234512
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4247432
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4247440
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4248456
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4248464
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4251336
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4251344
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4252360
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4252368
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4239432
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4239440
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4240456
Jan 13 16:05:42 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4240464
Jan 13 16:05:42 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4241480
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4241488
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4242504
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4242512
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4258304
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4258312
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4259328
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4267336
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4267344
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4268360
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4268368
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4253384
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4253392
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4254408
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4254416
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4255432
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4255440
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4256456
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4256464
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4269384
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4269392
Jan 13 16:05:43 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4270408
Jan 13 16:05:43 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4270416
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4271432
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4271440
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4272456
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4272464
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4257480
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4257488
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4259336
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4259344
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4260360
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4260368
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4261384
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4261392
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4262408
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4262416
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4263432
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4263440
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4264456
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4264464
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4265480
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4265488
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4266504
Jan 13 16:05:44 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4266512
Jan 13 16:05:44 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4290304
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4290312
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4291328
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4291336
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4291344
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4273480
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4273488
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4274504
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4274512
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4283336
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4283344
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4284360
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4284368
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4285384
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4285392
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4286408
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4286416
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4287432
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4287440
Jan 13 16:05:45 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:45 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4288456
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4288464
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4292360
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4292368
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4293384
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4293392
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4294408
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4294416
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4295432
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4295440
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4296456
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4296464
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4297480
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4297488
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4298504
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4298512
Jan 13 16:05:46 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4315336
Jan 13 16:05:46 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4315344
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4289480
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4289488
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4299336
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4299344
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4300360
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4300368
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4301384
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4301392
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4302408
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4302416
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4303432
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4303440
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4304456
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4304464
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4305480
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4305488
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4306504
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4306512
Jan 13 16:05:47 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4322304
Jan 13 16:05:47 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4322312
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4323328
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4331336
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4331344
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4316360
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4316368
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4317384
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4317392
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4318408
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4318416
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4319432
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4319440
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4320456
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4320464
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4321480
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4321488
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4323336
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4323344
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4324360
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4324368
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4332360
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4332368
Jan 13 16:05:48 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:48 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4333384
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4333392
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4334408
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4334416
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4335432
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4335440
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4336456
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4336464
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4337480
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4337488
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4338504
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4338512
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4347336
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4347344
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4325384
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4325392
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4326408
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4326416
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4327432
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4327440
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4328456
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4328464
Jan 13 16:05:49 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4348360
Jan 13 16:05:49 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4348368
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4349384
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4349392
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4350408
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4350416
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4351432
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4351440
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4329480
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4329488
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4330504
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4330512
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4460272
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4460280
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4461304
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4461312
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4462328
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4462336
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4463352
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4463360
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4464376
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4464384
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4465400
Jan 13 16:05:50 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4465408
Jan 13 16:05:50 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4466424
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4466432
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4467448
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4467456
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4468472
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4468480
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdj, sector 1
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4352456
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4352464
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4459392
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4459400
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4469304
Jan 13 16:05:51 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4469312
Jan 13 16:05:51 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4470328
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4470336
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4471352
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4471360
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4472376
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4472384
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4473400
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4473408
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4474424
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4474432
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdj, sector 8
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdj, sector 16
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4475448
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4475456
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4476472
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4476480
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4249480
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 0> return code = 0x10000
Jan 13 16:05:52 linuxha2 kernel: SCSI error : <2 0 1 0> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 1> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 1> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: XFS: device dm-2- XFS write error in file system meta-data block 0x1 in dm-2
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 1> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 1> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 1> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4356496
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4355472
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4355480
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4354448
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4354456
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4353424
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4353432
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 1 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4356504
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdm, sector 4356512
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4357344
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4357352
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4358368
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4358376
Jan 13 16:05:53 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:53 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4359392
Jan 13 16:05:54 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4359400
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4360416
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 0 2> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4360424
Jan 13 16:05:54 linuxha2 kernel: end_request: I/O error, dev sdj, sector 4360432
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 1 1> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 0 0> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 0 0> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 1 0> return code = 0x10000
Jan 13 16:05:54 linuxha2 kernel: SCSI error : <2 0 1 0> return code = 0x10000
Jan 13 16:06:16 linuxha2 kernel: qla2300 0000:00:04.0: LOOP UP detected (2 Gbps).
Jan 13 16:06:17 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:06:17 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17599568
Jan 13 16:06:17 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17599576
Jan 13 16:06:17 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:17 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17593616
Jan 13 16:06:17 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17593624
Jan 13 16:06:17 linuxha2 kernel: printk: 36014 messages suppressed.
Jan 13 16:06:17 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199203
Jan 13 16:06:17 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:17 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199204
Jan 13 16:06:17 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:17 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199205
Jan 13 16:06:17 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:17 linuxha2 multipathd: devmap event on shared1
Jan 13 16:06:17 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199206
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199207
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 multipathd: event checker startup : shared1
Jan 13 16:06:18 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199208
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199209
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199210
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 kernel: Buffer I/O error on device dm-2, logical block 2199211
Jan 13 16:06:18 linuxha2 kernel: lost page write due to I/O error on dm-2
Jan 13 16:06:18 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:18 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17594640
Jan 13 16:06:18 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17594648
Jan 13 16:06:18 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:06:18 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17600592
Jan 13 16:06:18 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17600600
Jan 13 16:06:18 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17601616
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdd, sector 17601624
Jan 13 16:06:19 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17595664
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17595672
Jan 13 16:06:19 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17596688
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17596696
Jan 13 16:06:19 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17597712
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17597720
Jan 13 16:06:19 linuxha2 kernel: SCSI error : <1 0 1 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17598736
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdg, sector 17598744
Jan 13 16:06:19 linuxha2 kernel: SCSI error : <1 0 0 2> return code = 0x20000
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdd, sector 26238415
Jan 13 16:06:19 linuxha2 kernel: end_request: I/O error, dev sdd, sector 26238423
Jan 13 16:06:19 linuxha2 kernel: I/O error in filesystem ("dm-2") meta-data dev dm-2 block 0x1905dcf       ("xlog_iodone") error 5 buf count 6656
Jan 13 16:06:19 linuxha2 kernel: xfs_force_shutdown(dm-2,0x2) called from line 952 of file fs/xfs/xfs_log.c.  Return address = 0xc024c26b
Jan 13 16:06:19 linuxha2 kernel: Filesystem "dm-2": Log I/O Error Detected.  Shutting down filesystem: dm-2
Jan 13 16:06:19 linuxha2 kernel: Please umount the filesystem, and rectify the problem(s)
Jan 13 16:06:20 linuxha2 multipathd: 8:112 : tur checker reports path is up 
Jan 13 16:06:21 linuxha2 multipathd: 8:128 : tur checker reports path is up 
Jan 13 16:06:21 linuxha2 multipathd: 8:144 : tur checker reports path is up 
Jan 13 16:06:21 linuxha2 multipathd: 8:160 : tur checker reports path is up 
Jan 13 16:06:21 linuxha2 multipathd: 8:176 : tur checker reports path is up 
Jan 13 16:06:21 linuxha2 multipathd: 8:192 : tur checker reports path is up 
Jan 13 16:10:11 linuxha2 kernel: xfs_force_shutdown(dm-2,0x1) called from line 353 of file fs/xfs/xfs_rw.c.  Return address = 0xc024c26b
Jan 13 16:10:48 linuxha2 kernel: XFS mounting filesystem dm-2
Jan 13 16:10:48 linuxha2 kernel: Starting XFS recovery on filesystem: dm-2 (dev: dm-2)
Jan 13 16:10:48 linuxha2 kernel: Ending XFS recovery on filesystem: dm-2 (dev: dm-2)