Problem with ciss(4) in production system
Paul Saab
ps at mu.org
Wed Sep 24 17:14:01 PDT 2003
dmesg from a boot verbose please.
Anthony Stanton (anthony.stanton at es.easynet.net) wrote:
> Hello,
>
> This morning I moved a server I've been running for over a year now,
> a Compaq (HP!) Proliant DL360 with a 4314 StorageWorks external SCSI
> disk box connected to it. The server has one internal disk on its
> Integrated Smart Array (ida(4) driver) and a RAID 5 using all of the disks
> in the external box on a Smart Array 5300 (ciss(4) driver). Uname:
>
> FreeBSD brooklyn.mail.es.easynet.net 4.8-RELEASE-p8 FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003 root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN i386
>
> Upon reinstalling in its new rack, I mistakenly plugged the disk box
> into the Integrated array, making it believe it had 2 logical volumes;
> I rebooted with the cable properly connected and deleted the bogus volume,
> but now it was the 5300 which had a phantom logical volume corresponding
> to the internal disk. I deleted that.
>
> After this, I can get FreeBSD to boot, and the ciss0 initialization
> seems OK, but it cannot find da0 (which used to represent the external
> RAID 5 on the disk box). Using camcontrol I get this:
>
> brooklyn# camcontrol devlist -v
> scbus0 on ciss0 bus 0:
> scbus-1 on xpt0 bus 0:
> < > at scbus-1 target -1 lun -1 (xpt0)
>
> brooklyn# camcontrol rescan 0:0:0
> (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
> (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
> (probe0:ciss0:0:0:0): Logical unit not configured
> Re-scan of 0:0:0 was successful
>
> The same "probe0" errors show up in the boot sequence where it should
> have detected da0. (see attached dmesg output). Any attempt to use mount(8)
> or disklabel(8) with da0 or any of its slices fail with a "Device not
> configured" error. Booting with a Debian GNU/Linux install CD reveals a
> BSD/386 /dev/cciss/codop1 partition, but I cannot get fdisk under FreeBSD
> to see it.
>
> I am at a loss for what to do. I can think of nothing that will set things
> right... Compaq support have assured me that there is nothing more they
> can do if the array configuration is there, this is an OS issue.
>
> Attached is the output to pciconf -lv, the dmesg from today's (broken)
> boot and a diff of that to the previous (good) boot.
>
> Can anyone help me?
>
> Thanks in advance,
>
> --
> Anthony Stanton +34 91 789 46 00
> Systems Manager, Easynet Espa?a S.A.U. http://www.es.easynet.net/
> chip0 at pci0:0:0: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00
> vendor = 'Reliance Computer Corp./ServerWorks'
> device = 'NB6536 (CNB20-LE) AGP interface'
> class = bridge
> subclass = HOST-PCI
> chip1 at pci0:0:1: class=0x060000 card=0x00000000 chip=0x00091166 rev=0x05 hdr=0x00
> vendor = 'Reliance Computer Corp./ServerWorks'
> device = 'NB6536 (CNB20-LE) AGP interface'
> class = bridge
> subclass = HOST-PCI
> ida0 at pci0:1:0: class=0x010400 card=0x40400e11 chip=0x00101000 rev=0x02 hdr=0x00
> vendor = 'LSI Logic (Was: Symbios Logic, NCR)'
> device = 'LSI53C1510 I2O-Ready PCI RAID Ultra2 SCSI Controller (Intelligent mode)'
> class = mass storage
> subclass = RAID
> none0 at pci0:3:0: class=0x030000 card=0x47561002 chip=0x47561002 rev=0x7a hdr=0x00
> vendor = 'ATI Technologies'
> device = 'Rage 3D IIC PCI [Mach64 GT IIC] (PQFP Package)'
> class = display
> subclass = VGA
> none1 at pci0:4:0: class=0x088000 card=0xb0f30e11 chip=0xa0f00e11 rev=0x00 hdr=0x00
> vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)'
> device = 'Advanced System Management Controller'
> class = base peripheral
> ciss0 at pci0:5:0: class=0x010400 card=0x40700e11 chip=0xb0600e11 rev=0x02 hdr=0x00
> vendor = 'Compaq Computer Corp (Now owned by Hewlett-Packard)'
> device = 'CISS SMART2 Array Controller'
> class = mass storage
> subclass = RAID
> isab0 at pci0:15:0: class=0x060100 card=0x02001166 chip=0x02001166 rev=0x51 hdr=0x00
> vendor = 'Reliance Computer Corp./ServerWorks'
> device = 'OSB4 PCI to ISA Bridge'
> class = bridge
> subclass = PCI-ISA
> atapci0 at pci0:15:1: class=0x01018a card=0x00000000 chip=0x02111166 rev=0x00 hdr=0x00
> vendor = 'Reliance Computer Corp./ServerWorks'
> device = 'OSB4 PCI EIDE Controller'
> class = mass storage
> subclass = ATA
> fxp0 at pci3:4:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
> vendor = 'Intel Corporation'
> device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
> class = network
> subclass = ethernet
> fxp1 at pci3:5:0: class=0x020000 card=0xb1340e11 chip=0x12298086 rev=0x08 hdr=0x00
> vendor = 'Intel Corporation'
> device = '82557/8/9 EtherExpress PRO/100(B) Ethernet Adapter'
> class = network
> subclass = ethernet
> Copyright (c) 1992-2003 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> The Regents of the University of California. All rights reserved.
> FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003
> root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN
> Timecounter "i8254" frequency 1193182 Hz
> CPU: Intel Pentium III (863.94-MHz 686-class CPU)
> Origin = "GenuineIntel" Id = 0x686 Stepping = 6
> Features=0x383fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
> real memory = 1207943168 (1179632K bytes)
> avail memory = 1170554880 (1143120K bytes)
> Changing APIC ID for IO APIC #0 from 0 to 8 on chip
> Programming 35 pins in IOAPIC #0
> IOAPIC #0 intpin 2 -> irq 0
> FreeBSD/SMP: Multiprocessor motherboard
> cpu0 (BSP): apic id: 3, version: 0x00040011, at 0xfee00000
> cpu1 (AP): apic id: 0, version: 0x00040011, at 0xfee00000
> io0 (APIC): apic id: 8, version: 0x00220011, at 0xfec00000
> Preloaded elf kernel "kernel" at 0xc0328000.
> Pentium Pro MTRR support enabled
> md0: Malloc disk
> npx0: <math processor> on motherboard
> npx0: INT 16 interface
> pcib0: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard
> pci0: <PCI bus> on pcib0
> ida0: <Compaq Integrated Array controller> port 0x2000-0x20ff mem 0xc4000000-0xc4ffffff,0xc5000000-0xc5ffffff irq 5 at device 1.0 on pci0
> ida0: drives=1 firm_rev=1.50
> idad0: <Compaq Logical Drive> on ida0
> idad0: 17359MB (35553120 sectors), blocksize=512
> pci0: <ATI Mach64-GV graphics accelerator> at 3.0
> pci0: <unknown card> (vendor=0x0e11, dev=0xa0f0) at 4.0
> ciss0: <Compaq Smart Array 5300> port 0x2800-0x28ff mem 0xc3e00000-0xc3efffff,0xc3f80000-0xc3fbffff irq 3 at device 5.0 on pci0
> ciss0: using 256 of 1024 available commands
> ciss0: 1 logical drive configured
> ciss0: firmware 2.92
> ciss0: 2 SCSI channels
> ciss0: signature 'CISS'
> ciss0: valence 1
> ciss0: supported I/O methods 0xe<simple,performant,MEMQ>
> ciss0: active I/O method 0x3<simple>
> ciss0: 4G page base 0x00000000
> ciss0: interrupt coalesce delay 1000us
> ciss0: interrupt coalesce count 0
> ciss0: max outstanding commands 1024
> ciss0: bus types 0x2<ultra3>
> ciss0: server name ''
> ciss0: heartbeat 0xe0000027
> ciss0: 1 logical drive
> ciss0: logical drive 1: RAID 5, 381952MB online
> isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0
> isa0: <ISA bus> on isab0
> atapci0: <ServerWorks ROSB4 ATA33 controller> port 0x2c00-0x2c0f at device 15.1 on pci0
> ata0: at 0x1f0 irq 14 on atapci0
> ata1: at 0x170 irq 15 on atapci0
> pcib3: <ServerWorks NB6635 3.0LE host to PCI bridge> on motherboard
> pci3: <PCI bus> on pcib3
> fxp0: <Intel Pro 10/100B/100+ Ethernet> port 0x3000-0x303f mem 0xc6e00000-0xc6efffff,0xc6fff000-0xc6ffffff irq 7 at device 4.0 on pci3
> fxp0: Ethernet address 00:02:a5:8a:83:c0
> inphy0: <i82555 10/100 media interface> on miibus0
> inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
> fxp1: <Intel Pro 10/100B/100+ Ethernet> port 0x3040-0x307f mem 0xc6c00000-0xc6cfffff,0xc6dff000-0xc6dfffff irq 10 at device 5.0 on pci3
> fxp1: Ethernet address 00:02:a5:8a:83:bf
> inphy1: <i82555 10/100 media interface> on miibus1
> inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
> eisa0: <EISA bus> on motherboard
> mainboard0: <CPQ0685 (System Board)> on eisa0 slot 0
> orm0: <Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcffff,0xe8000-0xedfff,0xee000-0xeffff on isa0
> fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
> fdc0: FIFO enabled, 8 bytes threshold
> fd0: <1440-KB 3.5" drive> on fdc0 drive 0
> atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> psm0: <PS/2 Mouse> irq 12 on atkbdc0
> psm0: model Generic PS/2 mouse, device ID 0
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
> sio0: type 16550A
> sio1: configured irq 3 not in bitmap of probed irqs 0
> ppc0: parallel port not found.
> APIC_IO: Testing 8254 interrupt delivery
> APIC_IO: Broken MP table detected: 8254 is not connected to IOAPIC #0 intpin 2
> APIC_IO: routing 8254 via 8259 and IOAPIC #0 intpin 0
> ata1-slave: ATAPI identify retries exceeded
> SMP: AP CPU #1 Launched!
> acd0: CDROM <CD-224E> at ata1-master PIO4
> (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
> (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
> (probe0:ciss0:0:0:0): Logical unit not configured
> (probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
> (probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
> (probe0:ciss0:0:0:0): Logical unit not configured
> Mounting root from ufs:/dev/idad0s1a
> --- dmesg.yesterday Wed Sep 24 14:53:33 2003
> +++ dmesg.broken Wed Sep 24 15:18:37 2003
> @@ -1,8 +1,8 @@
> Copyright (c) 1992-2003 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> The Regents of the University of California. All rights reserved.
> -FreeBSD 4.8-RELEASE #0: Tue Aug 26 17:20:41 CEST 2003
> - ewen at brooklyn.mail.es.easynet.net:/usr/src/sys/compile/BROOKLYN
> +FreeBSD 4.8-RELEASE-p8 #1: Wed Sep 24 13:37:08 CEST 2003
> + root at brooklyn.mail.es.easynet.net:/usr/obj/usr/src/sys/BROOKLYN
> Timecounter "i8254" frequency 1193182 Hz
> CPU: Intel Pentium III (863.94-MHz 686-class CPU)
> Origin = "GenuineIntel" Id = 0x686 Stepping = 6
> @@ -44,7 +44,7 @@
> ciss0: max outstanding commands 1024
> ciss0: bus types 0x2<ultra3>
> ciss0: server name ''
> -ciss0: heartbeat 0x20000059
> +ciss0: heartbeat 0xe0000027
> ciss0: 1 logical drive
> ciss0: logical drive 1: RAID 5, 381952MB online
> isab0: <ServerWorks IB6566 PCI to ISA bridge> at device 15.0 on pci0
> @@ -71,6 +71,8 @@
> atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> +psm0: <PS/2 Mouse> irq 12 on atkbdc0
> +psm0: model Generic PS/2 mouse, device ID 0
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> @@ -84,12 +86,10 @@
> ata1-slave: ATAPI identify retries exceeded
> SMP: AP CPU #1 Launched!
> acd0: CDROM <CD-224E> at ata1-master PIO4
> +(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
> +(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
> +(probe0:ciss0:0:0:0): Logical unit not configured
> +(probe0:ciss0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
> +(probe0:ciss0:0:0:0): ILLEGAL REQUEST asc:68,0
> +(probe0:ciss0:0:0:0): Logical unit not configured
> Mounting root from ufs:/dev/idad0s1a
> -da0 at ciss0 bus 0 target 0 lun 0
> -da0: <COMPAQ RAID 5 VOLUME OK> Fixed Direct Access SCSI-0 device
> -da0: 135.168MB/s transfers
> -da0: 382045MB (782429760 512 byte sectors: 255H 63S/T 48704C)
> -WARNING: / was not properly dismounted
> -fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6
> -fxp1: Microcode loaded, int_delay: 1000 usec bundle_max: 6
> -fxp0: Microcode loaded, int_delay: 1000 usec bundle_max: 6
> _______________________________________________
> freebsd-scsi at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-scsi
> To unsubscribe, send any mail to "freebsd-scsi-unsubscribe at freebsd.org"
--
-ps
More information about the freebsd-scsi
mailing list