Some SAN LUNs not visible with RHEL 5.3
Michal Ludvig
mludvig at logix.net.nz
Sat Mar 28 10:00:58 UTC 2009
Hi George,
lspci, among other things reports two channels on the HBA:
02:02.0 Fibre Channel: QLogic Corp. ISP2312-based 2Gb Fibre Channel to
PCI-X HBA (rev 02)
Subsystem: QLogic Corp. Unknown device 0101
Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 74
I/O ports at ec00 [size=256]
Memory at dfdff000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at d8000000 [disabled] [size=128K]
Capabilities: [44] Power Management version 2
Capabilities: [4c] PCI-X non-bridge device
Capabilities: [54] Message Signalled Interrupts: 64bit+
Queue=0/3 Enable-
Capabilities: [64] #06 [0080]
02:02.1 Fibre Channel: QLogic Corp. ISP2312-based 2Gb Fibre Channel to
PCI-X HBA (rev 02)
Subsystem: QLogic Corp. Unknown device 0101
Flags: bus master, 66MHz, medium devsel, latency 128, IRQ 82
I/O ports at e800 [size=256]
Memory at dfdfe000 (32-bit, non-prefetchable) [size=4K]
Expansion ROM at d8020000 [disabled] [size=128K]
Capabilities: [44] Power Management version 2
Capabilities: [4c] PCI-X non-bridge device
Capabilities: [54] Message Signalled Interrupts: 64bit+
Queue=0/3 Enable-
Capabilities: [64] #06 [0080]
/proc/scsi/scsi says:
[...]
Host: scsi1 Channel: 00 Id: 00 Lun: 00
Vendor: HP Model: A6218A Rev: A140
Type: Direct-Access ANSI SCSI revision: 03
Host: scsi2 Channel: 00 Id: 00 Lun: 00
Vendor: HP Model: A6218A Rev: A140
Type: Direct-Access ANSI SCSI revision: 03
Host: scsi2 Channel: 00 Id: 00 Lun: 01
Vendor: HP Model: A6218A Rev: A140
Type: Direct-Access ANSI SCSI revision: 03
Host: scsi2 Channel: 00 Id: 00 Lun: 02
Vendor: HP Model: A6218A Rev: A140
Type: Direct-Access ANSI SCSI revision: 03
In /sys/class/scsi_device/ it says:
# First FC channel, LUN0 - scsi generic
1:0:0:0/device/generic -> /sys/class/scsi_generic/sg3
1:0:0:0/device/scsi_device:1:0:0:0 -> /sys/class/scsi_device/1:0:0:0
1:0:0:0/device/scsi_generic:sg3 -> /sys/class/scsi_generic/sg3
# Second FC channel, LUN0 - scsi generic + disk
2:0:0:0/device/driver -> /sys/bus/scsi/drivers/sd
2:0:0:0/device/generic -> /sys/class/scsi_generic/sg4
2:0:0:0/device/scsi_device:2:0:0:0 -> /sys/class/scsi_device/2:0:0:0
2:0:0:0/device/scsi_disk:2:0:0:0 -> /sys/class/scsi_disk/2:0:0:0
2:0:0:0/device/scsi_generic:sg4 -> /sys/class/scsi_generic/sg4
# Second FC channel, LUN1 - scsi generic + disk
2:0:0:1/device/driver -> /sys/bus/scsi/drivers/sd
2:0:0:1/device/generic -> /sys/class/scsi_generic/sg5
2:0:0:1/device/scsi_device:2:0:0:1 -> /sys/class/scsi_device/2:0:0:1
2:0:0:1/device/scsi_disk:2:0:0:1 -> /sys/class/scsi_disk/2:0:0:1
2:0:0:1/device/scsi_generic:sg5 -> /sys/class/scsi_generic/sg5
# Second FC channel, LUN2 - scsi generic only
2:0:0:2/device/generic -> /sys/class/scsi_generic/sg6
2:0:0:2/device/scsi_device:2:0:0:2 -> /sys/class/scsi_device/2:0:0:2
2:0:0:2/device/scsi_generic:sg6 -> /sys/class/scsi_generic/sg6
What sysfs files' contents do you want to know?
Michal
George Magklaras wrote:
> output of lspci -v?
>
> The marking of LUN 2, how does it exactly appear in
> /sys/class/scsi_device/?
>
> GM
>
>
> Michal Ludvig wrote:
>> Hi all,
>>
>> I've got RHEL5.3 (x86) server with dual-port QLA2342 HBA (kernel module
>> qla2xx) connected using FibreChannel to HP VA7410 disk array, one HBA
>> port to each of the two SAN controllers.
>>
>> I've got three LUNs created on the array:
>> LUN 0:
>> Capacity: 1.0 GB
>> RGID: 1
>>
>> LUN 1:
>> Capacity: 301.4 GB
>> RGID: 1
>>
>> LUN 2:
>> Capacity: 100.0 GB
>> RGID: 2
>>
>> RGID is a "redundancy group" - RGID 1 is "owned" by the first SAN
>> controller, RGID 2 by the second ctrlr.
>>
>> However when I modprobe qla2xxx only LUN0 and LUN1 are attached as disks
>> (sd). LUN2 is attached as 'scsi' and not accessible as a disk. The
>> system knows that it exists, because there is an entry in
>> /sys/class/scsi_device/ but is no accessible as a block device.
>>
>> This is the relevant 'dmesg' output:
>>
>> QLogic Fibre Channel HBA Driver
>> ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 35 (level, low) -> IRQ 74
>> qla2xxx 0000:02:02.0: Found an ISP2312, irq 74, iobase 0xd0040000
>> qla2xxx 0000:02:02.0: LIP reset occured (f82b).
>> scsi1 : qla2xxx
>> qla2xxx 0000:02:02.0: LIP occured (f82b).
>> qla2xxx 0000:02:02.0: LOOP UP detected (2 Gbps).
>> qla2xxx 0000:02:02.0:
>> QLogic Fibre Channel HBA Driver: 8.02.00.06.05.03-k
>> QLogic QLA2342 - 133MHz PCI-X to 2Gb FC, Dual Channel
>> ISP2312: PCI (66 MHz) @ 0000:02:02.0 hdma-, host#=1, fw=3.03.26 IPX
>> ACPI: PCI Interrupt 0000:02:02.1[B] -> GSI 34 (level, low) -> IRQ 82
>> qla2xxx 0000:02:02.1: Found an ISP2312, irq 82, iobase 0xd0042000
>> qla2xxx 0000:02:02.1: LIP reset occured (f827).
>> scsi2 : qla2xxx
>> qla2xxx 0000:02:02.1: LIP occured (f827).
>> qla2xxx 0000:02:02.1: LOOP UP detected (2 Gbps).
>> qla2xxx 0000:02:02.1:
>> QLogic Fibre Channel HBA Driver: 8.02.00.06.05.03-k
>> QLogic QLA2342 - 133MHz PCI-X to 2Gb FC, Dual Channel
>> ISP2312: PCI (66 MHz) @ 0000:02:02.1 hdma-, host#=2, fw=3.03.26 IPX
>> Vendor: HP Model: A6218A Rev: A140
>> Type: Direct-Access ANSI SCSI revision: 03
>> Vendor: HP Model: A6218A Rev: A140
>> Type: Direct-Access ANSI SCSI revision: 03
>> SCSI device sdb: 2097152 512-byte hdwr sectors (1074 MB)
>> sdb: Write Protect is off
>> sdb: Mode Sense: af 00 10 08
>> SCSI device sdb: drive cache: write back w/ FUA
>> sdb: unknown partition table
>> sd 2:0:0:0: Attached scsi disk sdb
>> Vendor: HP Model: A6218A Rev: A140
>> Type: Direct-Access ANSI SCSI revision: 03
>> SCSI device sdc: 632164352 512-byte hdwr sectors (323668 MB)
>> sdc: Write Protect is off
>> sdc: Mode Sense: af 00 10 08
>> SCSI device sdc: drive cache: write back w/ FUA
>> sdc: sdc1
>> sd 2:0:0:1: Attached scsi disk sdc
>> Vendor: HP Model: A6218A Rev: A140
>> Type: Direct-Access ANSI SCSI revision: 03
>> kjournald starting. Commit interval 5 seconds
>> [... and then, later on, when modules are loaded ...]
>> scsi 1:0:0:0: Attached scsi generic sg3 type 0
>> sd 2:0:0:0: Attached scsi generic sg4 type 0
>> sd 2:0:0:1: Attached scsi generic sg5 type 0
>> scsi 2:0:0:2: Attached scsi generic sg6 type 0
>>
>> The last three lins are for LUN0, LUN1 (both accessible - 'sd' type) and
>> LUN2 (inaccessible - 'scsi' type).
>>
>> I tried all ports on the array as well as swapped the cables on HBA, so
>> a HW problem of this type is unlikely.
>>
>> Any ideas what's wrong?
>>
>> Thanks!
>>
>> Michal
>>
>
>
>
More information about the redhat-list
mailing list