Regression since 8.4?

Mon Mar 2 20:02:05 UTC 2015

Hiya,

Running an HP Proliant DL380 G5. It has the HP Smart Array P400 card in it.

I've got a mirror on the P400 for my base file systems. I have the other 6 drives in a RAIDZ setup. Also have a QLogic QLE 2532 card which has two NEC D1-10 RAID arrays connected into a single ZPool.

I use this machine at work for backups.

Everything was fine in FreeBSD 8.4. I upgraded to 9.3 and then to 10.1 a couple weekends ago. Since then the machine won't stay up more than a couple of days. When I power the machine off and reboot, it will not see the QLogic card or RAID arrays. I have to physically power down the entire system and RAIDs in order for it to boot properly.

It's running the GENERIC kernel and freezes up with no core dump. This machine runs Bacula, Samba, netatalk. Before the upgrade this machine would run for hundreds of days uptime. Now it's more like 1-2 days.

I'd downgrade back to 8.4, but now that I have upgraded the ZPools and file systems I don't think it will work with the older 8.4 any more.

Looking for ideas where I should start looking for the culprit. I suspect the Smart Array P400 or the QLE 2532. Following is the dmesg.boot output, but the one thing that immediately catches my eye is this:

(da3:ciss0:0:1:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da3:ciss0:0:1:0): CAM status: SCSI Status Error
(da3:ciss0:0:1:0): SCSI status: Check Condition
(da3:ciss0:0:1:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da3:ciss0:0:1:0): Error 22, Unretryable error
(da4:ciss0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da4:ciss0:0:2:0): CAM status: SCSI Status Error
(da4:ciss0:0:2:0): SCSI status: Check Condition
(da4:ciss0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da4:ciss0:0:2:0): Error 22, Unretryable error
(da5:ciss0:0:3:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da5:ciss0:0:3:0): CAM status: SCSI Status Error
(da5:ciss0:0:3:0): SCSI status: Check Condition
(da5:ciss0:0:3:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da5:ciss0:0:3:0): Error 22, Unretryable error
(da6:ciss0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da6:ciss0:0:4:0): CAM status: SCSI Status Error
(da6:ciss0:0:4:0): SCSI status: Check Condition
(da6:ciss0:0:4:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da6:ciss0:0:4:0): Error 22, Unretryable error
(da7:ciss0:0:5:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da7:ciss0:0:5:0): CAM status: SCSI Status Error
(da7:ciss0:0:5:0): SCSI status: Check Condition
(da7:ciss0:0:5:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da7:ciss0:0:5:0): Error 22, Unretryable error
(da8:ciss0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da8:ciss0:0:6:0): CAM status: SCSI Status Error
(da8:ciss0:0:6:0): SCSI status: Check Condition
(da8:ciss0:0:6:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da8:ciss0:0:6:0): Error 22, Unretryable error

Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.1-RELEASE-p5 #0: Tue Jan 27 08:55:07 UTC 2015
    root at amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Xeon(R) CPU            5160  @ 3.00GHz (3000.06-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6fb  Family = 0x6  Model = 0xf  Stepping = 11
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4e3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  VT-x: (disabled in BIOS) HLT,PAUSE
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 8269488128 (7886 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <HP     ProLiant>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130823/tbfadt-682)
ACPI BIOS Warning (bug): Invalid length for FADT/Pm2ControlBlock: 32, using default 8 (20130823/tbfadt-682)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
random: <Software, Yarrow> initialized
acpi0: <HP ProLiant> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
ACPI Warning: \134_SB_.PCI0.PT02._PRT: Return Package has no elements (empty) (20130823/nsprepkg-137)
pci9: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci9
pci10: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 0.0 on pci10
pci11: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 1.0 on pci10
pci14: <ACPI PCI bus> on pcib4
isp0: <Qlogic ISP 2532 PCI FC-AL Adapter> port 0x5000-0x50ff mem 0xfdff0000-0xfdff3fff,0xfde00000-0xfdefffff irq 17 at device 0.0 on pci14
isp1: <Qlogic ISP 2532 PCI FC-AL Adapter> port 0x5400-0x54ff mem 0xfddf0000-0xfddf3fff,0xfdc00000-0xfdcfffff irq 18 at device 0.1 on pci14
pcib5: <ACPI PCI-PCI bridge> at device 2.0 on pci10
pci17: <ACPI PCI bus> on pcib5
pcib6: <PCI-PCI bridge> at device 0.3 on pci9
pci18: <PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci6: <ACPI PCI bus> on pcib7
ciss0: <HP Smart Array P400> port 0x4000-0x40ff mem 0xfda00000-0xfdafffff,0xfd9f0000-0xfd9f0fff irq 18 at device 0.0 on pci6
ciss0: PERFORMANT Transport
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci19: <ACPI PCI bus> on pcib8
pcib9: <PCI-PCI bridge> at device 5.0 on pci0
pci22: <PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci23: <ACPI PCI bus> on pcib10
pcib11: <PCI-PCI bridge> at device 7.0 on pci0
pci26: <PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib12
pcib13: <PCI-PCI bridge> at device 0.0 on pci2
pci3: <PCI bus> on pcib13
bce0: <HP NC373i Multifunction Gigabit Server Adapter (B2)> mem 0xf8000000-0xf9ffffff irq 16 at device 0.0 on pci3
bce0: /usr/src/sys/dev/bce/if_bce.c(1247): Management firmware enabled but not running!
miibus0: <MII bus> on bce0
brgphy0: <BCM5708C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce0: Ethernet address: 00:1c:c4:ec:75:3a
bce0: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); B/C (1.9.6); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI|MFW); MFW (NOT RUNNING!)
Coal (RX:6,6,18,18; TX:20,20,80,80)
pcib14: <ACPI PCI-PCI bridge> at device 28.1 on pci0
pci4: <ACPI PCI bus> on pcib14
pcib15: <PCI-PCI bridge> at device 0.0 on pci4
pci5: <PCI bus> on pcib15
bce1: <HP NC373i Multifunction Gigabit Server Adapter (B2)> mem 0xfa000000-0xfbffffff irq 17 at device 0.0 on pci5
bce1: /usr/src/sys/dev/bce/if_bce.c(1247): Management firmware enabled but not running!
miibus1: <MII bus> on bce1
brgphy1: <BCM5708C 1000BASE-T media interface> PHY 1 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bce1: Ethernet address: 00:1c:c4:ec:75:38
bce1: ASIC (0x57081020); Rev (B2); Bus (PCI-X, 64-bit, 133MHz); B/C (1.9.6); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI|MFW); MFW (NOT RUNNING!)
Coal (RX:6,6,18,18; TX:20,20,80,80)
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1000-0x101f irq 16 at device 29.0 on pci0
usbus0 on uhci0
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1020-0x103f irq 17 at device 29.1 on pci0
usbus1 on uhci1
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1040-0x105f irq 18 at device 29.2 on pci0
usbus2 on uhci2
uhci3: <Intel 631XESB/632XESB/3100 USB controller USB-4> port 0x1060-0x107f irq 19 at device 29.3 on pci0
usbus3 on uhci3
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xf7df0000-0xf7df03ff irq 16 at device 29.7 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci0
pcib16: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib16
vgapci0: <VGA-compatible display> port 0x3000-0x30ff mem 0xd8000000-0xdfffffff,0xf7ff0000-0xf7ffffff irq 23 at device 3.0 on pci1
vgapci0: Boot video device
uhci4: <UHCI (generic) USB controller> port 0x3800-0x381f irq 22 at device 4.4 on pci1
usbus5 on uhci4
pci1: <serial bus> at device 4.6 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f irq 17 at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xd1000-0xdf7ff,0xe6000-0xe7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
Event timer "RTC" frequency 32768 Hz quality 0
ppc0: cannot reserve I/O port range
uart1: <Non-standard ns8250 class UART with FIFOs> at port 0x2f8-0x2ff irq 3 on isa0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 92a092a0600092a
device_attach: est0 attach returned 6
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 92a092a0600092a
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
Timecounters tick every 1.000 msec
random: unblocking device.
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 480Mbps High Speed USB v2.0
usbus5: 12Mbps Full Speed USB v1.0
ugen1.1: <Intel> at usbus1
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen0.1: <Intel> at usbus0
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen3.1: <Intel> at usbus3
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen2.1: <Intel> at usbus2
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen5.1: <0x103c> at usbus5
uhub4: <0x103c UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen4.1: <Intel> at usbus4
uhub5: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
da2 at ciss0 bus 0 scbus2 target 0 lun 0
da2: <HP RAID 1(1+0) OK> Fixed Direct Access SCSI-5 device 
da2: Serial Number P61620F9VV88SR
da2: 135.168MB/s transfers
da2: Command Queueing enabled
da2: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da0 at isp0 bus 0 scbus0 target 0 lun 0
da0: <NEC iStorage 1000 1000> Fixed Direct Access SCSI-4 device 
da0: Serial Number 0000934988650000
da0: 400.000MB/s transfers WWNN 0x200000169712094c WWPN 0x210000169712094c PortID 0xb3
da0: Command Queueing enabled
da0: 8255488MB (16907239424 512 byte sectors: 255H 63S/T 1052426C)
da3 at ciss0 bus 0 scbus2 target 1 lun 0
da3: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da3: Serial Number P61620F9VV88SR
da3: 135.168MB/s transfers
da3: Command Queueing enabled
da3: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da1 at isp1 bus 0 scbus1 target 0 lun 0
da1: <NEC iStorage 1000 1000> Fixed Direct Access SCSI-4 device 
da1: Serial Number 0000349001230000
da1: 400.000MB/s transfers WWNN 0x20000030138419c8 WWPN 0x21000030138419c8 PortID 0xcd
da1: Command Queueing enabled
da1: 4124672MB (8447328256 512 byte sectors: 255H 63S/T 525821C)
da4 at ciss0 bus 0 scbus2 target 2 lun 0
da4: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da4: Serial Number P61620F9VV88SR
da4: 135.168MB/s transfers
da4: Command Queueing enabled
da4: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da5 at ciss0 bus 0 scbus2 target 3 lun 0
da5: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da5: Serial Number P61620F9VV88SR
da5: 135.168MB/s transfers
da5: Command Queueing enabled
da5: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da6 at ciss0 bus 0 scbus2 target 4 lun 0
da6: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da6: Serial Number P61620F9VV88SR
da6: 135.168MB/s transfers
da6: Command Queueing enabled
da6: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da7 at ciss0 bus 0 scbus2 target 5 lun 0
da7: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da7: Serial Number P61620F9VV88SR
da7: 135.168MB/s transfers
da7: Command Queueing enabled
da7: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
da8 at ciss0 bus 0 scbus2 target 6 lun 0
da8: <HP RAID 0 OK> Fixed Direct Access SCSI-5 device 
da8: Serial Number P61620F9VV88SR
da8: 135.168MB/s transfers
da8: Command Queueing enabled
da8: 476908MB (976707632 512 byte sectors: 255H 32S/T 65535C)
uhub2: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
SMP: AP CPU #1 Launched!
Timecounter "TSC-low" frequency 1500029482 Hz quality 1000
ugen5.2: <HP> at usbus5
ukbd0: <Virtual Keyboard> on usbus5
kbd2 at ukbd0
ugen5.3: <HP> at usbus5
uhub6: <Virtual Hub> on usbus5
uhub5: 8 ports with 8 removable, self powered
uhub6: 7 ports with 7 removable, self powered
ugen3.2: <Lite-On Technology Corp.> at usbus3
ukbd1: <Lite-On Technology Corp. HP Basic USB Keyboard, class 0/0, rev 1.10/1.03, addr 2> on usbus3
kbd3 at ukbd1
isp1: isp_watchdog: timeout for handle 0x2f2000, recovered during interrupt
GEOM_PART: integrity check failed (da3, MBR)
GEOM_PART: integrity check failed (da4, BSD)
GEOM_PART: integrity check failed (da7, BSD)
GEOM_PART: integrity check failed (da8, BSD)
Trying to mount root from ufs:/dev/da2s1a [rw]...
WARNING: / was not properly dismounted
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
(da3:ciss0:0:1:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da3:ciss0:0:1:0): CAM status: SCSI Status Error
(da3:ciss0:0:1:0): SCSI status: Check Condition
(da3:ciss0:0:1:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da3:ciss0:0:1:0): Error 22, Unretryable error
(da4:ciss0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da4:ciss0:0:2:0): CAM status: SCSI Status Error
(da4:ciss0:0:2:0): SCSI status: Check Condition
(da4:ciss0:0:2:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da4:ciss0:0:2:0): Error 22, Unretryable error
(da5:ciss0:0:3:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da5:ciss0:0:3:0): CAM status: SCSI Status Error
(da5:ciss0:0:3:0): SCSI status: Check Condition
(da5:ciss0:0:3:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da5:ciss0:0:3:0): Error 22, Unretryable error
(da6:ciss0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da6:ciss0:0:4:0): CAM status: SCSI Status Error
(da6:ciss0:0:4:0): SCSI status: Check Condition
(da6:ciss0:0:4:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da6:ciss0:0:4:0): Error 22, Unretryable error
(da7:ciss0:0:5:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da7:ciss0:0:5:0): CAM status: SCSI Status Error
(da7:ciss0:0:5:0): SCSI status: Check Condition
(da7:ciss0:0:5:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da7:ciss0:0:5:0): Error 22, Unretryable error
(da8:ciss0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 
(da8:ciss0:0:6:0): CAM status: SCSI Status Error
(da8:ciss0:0:6:0): SCSI status: Check Condition
(da8:ciss0:0:6:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
(da8:ciss0:0:6:0): Error 22, Unretryable error
WARNING: /tmp was not properly dismounted
WARNING: /usr was not properly dismounted
WARNING: /var was not properly dismounted
bce0: Gigabit link up!
ums0: <Virtual Mouse> on usbus5
ums0: 3 buttons and [XY] coordinates ID=0
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to deny, logging disabled

--------
Dave Robison
Sales Solution Architect II
FIS Banking Solutions
510/621-2089 (w)
530/518-5194 (c)
510/621-2020 (f)
daver at vicor.com
david.robison at fisglobal.com

_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.