Problem with ciss(4) in production system
Anthony Stanton
anthony.stanton at es.easynet.net
Wed Sep 24 06:20:38 PDT 2003
Hello,
This morning I moved a server I've been running for over a year now,
a Compaq (HP!) Proliant DL360 with a 4314 StorageWorks external SCSI
disk box connected to it. The server has one internal disk on its
Integrated Smart Array (ida(4) driver) and a RAID 5 using all of the disks
in the external box on a Smart Array 5300 (ciss(4) driver). Uname:
FreeBSD brooklyn.mail.es.easynet.net 4.8-RELEASE-p8 FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN i386
Upon reinstalling in its new rack, I mistakenly plugged the disk box
into the Integrated array, making it believe it had 2 logical volumes;
I rebooted with the cable properly connected and deleted the bogus volume,
but now it was the 5300 which had a phantom logical volume corresponding
to the internal disk. I deleted that.
After this, I can get FreeBSD to boot, and the ciss0 initialization
seems OK, but it cannot find da0 (which used to represent the external
RAID 5 on the disk box). Using camcontrol I get this:
brooklyn# camcontrol devlist -v
scbus0 on ciss0 bus 0:
scbus-1 on xpt0 bus 0:
< > at scbus-1 target -1 lun -1 (xpt0)
brooklyn# camcontrol rescan 0:0:0
(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
(probe0:ciss0:0:0:0): Logical unit not configured
Re-scan of 0:0:0 was successful
The same "probe0" errors show up in the boot sequence where it should
have detected da0. (see attached dmesg output). Any attempt to use mount(8)
or disklabel(8) with da0 or any of its slices fail with a "Device not
configured" error. Booting with a Debian GNU/Linux install CD reveals a
BSD/386 /dev/cciss/codop1 partition, but I cannot get fdisk under FreeBSD
to see it.
I am at a loss for what to do. I can think of nothing that will set things
right... Compaq support have assured me that there is nothing more they
can do if the array configuration is there, this is an OS issue.
Attached is the output to pciconf -lv, the dmesg from today's (broken)
boot and a diff of that to the previous (good) boot.
Can anyone help me?
Thanks in advance,
--
Anthony Stanton +34 91 789 46 00
Systems Manager, Easynet España S.A.U. http://www.es.easynet.net/
-------------- next part --------------
chip0 at pci0:0:0: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00
vendor = 'Reliance Computer Corp./ServerWorks'
device = 'NB6536 (CNB20-LE) AGP interface'
class = bridge
subclass = HOST-PCI
chip1 at pci0:0:1: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00
vendor = 'Reliance Computer Corp./ServerWorks'
device = 'NB6536 (CNB20-LE) AGP interface'
class = bridge
subclass = HOST-PCI
ida0 at pci0:1:0: class=0x010400 card=0x40400e11 chip=0x00101000 rev=0x02 hdr=0x00
vendor = 'LSI Logic (Was: Symbios Logic, NCR)'
device = 'LSI53C1510 I2O-Ready PCI RAID Ultra2 SCSI Controller (Intelligent mode)'
class = mass storage
subclass = RAID
none0 at pci0:3:0: class=0x030000 card=0x47561002 chip=0x47561002 rev=0x7a hdr=0x00
vendor = 'ATI Technologies'
device = 'Rage 3D IIC PCI [Mach64 GT IIC] (PQFP Package)'
class = display
subclass = VGA
none1 at pci0:4:0: class=0x088000 card=0xb0f30e11 chip=0xa0f00e11 rev=0x00 hdr=0x00
vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)'
device = 'Advanced System Management Controller'
class = base peripheral
ciss0 at pci0:5:0: class=0x010400 card=0x40700e11 chip=0xb0600e11 rev=0x02 hdr=0x00
vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)'
device = 'CISS SMART2 Array Controller'
class = mass storage
subclass = RAID
isab0 at pci0:15:0: class=0x060100 card=0x02001166 chip=0x02001166 rev=0x51 hdr=0x00
vendor = 'Reliance Computer Corp./ServerWorks'
device = 'OSB4 PCI to ISA Bridge'
class = bridge
subclass = PCI-ISA
atapci0 at pci0:15:1: class=0x01018a card=0x00000000 chip=0x02111166 rev=0x00 hdr=0x00
vendor = 'Reliance Computer Corp./ServerWorks'
device = 'OSB4 PCI EIDE Controller'
class = mass storage
subclass = ATA
fxp0 at pci3:4:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
vendor = 'Intel Corporation'
device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
class = network
subclass = ethernet
fxp1 at pci3:5:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
vendor = 'Intel Corporation'
device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
class = network
subclass = ethernet
-------------- next part --------------
Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003
root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN
Timecounter "i8254" frequency 1193182 Hz
CPU: Intel Pentium III (863.94-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x686 Stepping = 6
Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory = 1207943168 (1179632K bytes)
avail memory = 1170554880 (1143120K bytes)
Changing APIC ID for IO APIC #0 from 0 to 8 on chip
Programming 35 pins in IOAPIC #0
IOAPIC #0 intpin 2 -> irq 0
FreeBSD/SMP: Multiprocessor motherboard
cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000
cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000
io0 (APIC): apic id: 8, version: 0x00220011, at 0xfec00000
Preloaded elf kernel "kernel" at 0xc0328000.
Pentium Pro MTRR support enabled
md0: Malloc disk
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
ida0: <Compaq Integrated Array controller> port 0x2000-0x20ff mem 0xc4000000-0xc4ffffff,0xc5000000-0xc5ffffff irq 5 at device 1.0 on pci0
ida0: drives=1 firm_rev=1.50
idad0: <Compaq Logical Drive> on ida0
idad0: 17359MB (35553120 sectors), blocksize=512
pci0: <ATI Mach64-GV graphics accelerator> at 3.0
pci0: <unknown card> (vendor=0x0e11, dev=0xa0f0) at 4.0
ciss0: <Compaq Smart Array 5300> port 0x2800-0x28ff mem 0xc3e00000-0xc3efffff,0xc3f80000-0xc3fbffff irq 3 at device 5.0 on pci0
ciss0: using 256 of 1024 available commands
ciss0: 1 logical drive configured
ciss0: firmware 2.92
ciss0: 2 SCSI channels
ciss0: signature 'CISS'
ciss0: valence 1
ciss0: supported I/O methods 0xe<simple,performant,MEMQ>
ciss0: active I/O method 0x3<simple>
ciss0: 4G page base 0x00000000
ciss0: interrupt coalesce delay 1000us
ciss0: interrupt coalesce count 0
ciss0: max outstanding commands 1024
ciss0: bus types 0x2<ultra3>
ciss0: server name ''
ciss0: heartbeat 0xe0000027
ciss0: 1 logical drive
ciss0: logical drive 1: RAID 5, 381952MB online
isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks ROSB4 ATA33 controller> port 0x2c00-0x2c0f at device 15.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
pcib3: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x3000-0x303f mem 0xc6e00000-0xc6efffff,0xc6fff000-0xc6ffffff irq 7 at device 4.0 on pci3
fxp0: Ethernet address 00:02:a5:8a:83:c0
inphy0: <i82555 10/100 media interface> on miibus0
inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x3040-0x307f mem 0xc6c00000-0xc6cfffff,0xc6dff000-0xc6dfffff irq 10 at device 5.0 on pci3
fxp1: Ethernet address 00:02:a5:8a:83:bf
inphy1: <i82555 10/100 media interface> on miibus1
inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
eisa0: <EISA bus> on motherboard
mainboard0: <CPQ0685 (System Board)> on eisa0 slot 0
orm0: <Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcffff,0xe8000-0xedfff,0xee000-0xeffff on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: model Generic PS/2 mouse, device ID 0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1: configured irq 3 not in bitmap of probed irqs 0
ppc0: parallel port not found.
APIC_IO: Testing 8254 interrupt delivery
APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin 2
APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0
ata1-slave: ATAPI identify retries exceeded
SMP: AP CPU #1 Launched!
acd0: CDROM <CD-224E> at ata1-master PIO4
(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
(probe0:ciss0:0:0:0): Logical unit not configured
(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
(probe0:ciss0:0:0:0): Logical unit not configured
Mounting root from ufs:/dev/idad0s1a
-------------- next part --------------
--- dmesg.yesterday Wed Sep 24 14:53:33 2003
+++ dmesg.broken Wed Sep 24 15:18:37 2003
@@ -1,8 +1,8 @@
Copyright (c) 1992-2003 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
-FreeBSD 4.8-RELEASE #0: Tue Aug 26 17:20:41 CEST 2003
- ewen at brooklyn.mail.es.easynet.net:/usr/src/sys/compile/BROOKLYN
+FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003
+ root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN
Timecounter "i8254" frequency 1193182 Hz
CPU: Intel Pentium III (863.94-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0x686 Stepping = 6
@@ -44,7 +44,7 @@
ciss0: max outstanding commands 1024
ciss0: bus types 0x2<ultra3>
ciss0: server name ''
-ciss0: heartbeat 0x20000059
+ciss0: heartbeat 0xe0000027
ciss0: 1 logical drive
ciss0: logical drive 1: RAID 5, 381952MB online
isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0
@@ -71,6 +71,8 @@
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
+psm0: <PS/2 Mouse> irq 12 on atkbdc0
+psm0: model Generic PS/2 mouse, device ID 0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
@@ -84,12 +86,10 @@
ata1-slave: ATAPI identify retries exceeded
SMP: AP CPU #1 Launched!
acd0: CDROM <CD-224E> at ata1-master PIO4
+(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
+(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
+(probe0:ciss0:0:0:0): Logical unit not configured
+(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
+(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
+(probe0:ciss0:0:0:0): Logical unit not configured
Mounting root from ufs:/dev/idad0s1a
-da0 at ciss0 bus 0 target 0 lun 0
-da0: <COMPAQ RAID 5 VOLUME OK> Fixed Direct Access SCSI-0 device
-da0: 135.168MB/s transfers
-da0: 382045MB (782429760 512 byte sectors: 255H 63S/T 48704C)
-WARNING: / was not properly dismounted
-fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6
-fxp1: Microcode loaded, int_delay: 1000 usec bundle_max: 6
-fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6
More information about the freebsd-scsi
mailing list