aac controller in amd64 very slow?

[Hostas Red]

Hi!

1) I have one Quad Opteron box with FreeBSD 5.3-amd64 installed and have 
strange downgrade in performance with Adaptec 2120S raid controller (acc 
driver, 4-disk RAID5 configured). It is approx. 30-40% loss in performance 
of disk operations compared to my previous Dual 2.4 Xeon with Adaptec 
2015S with two disks mirrored.

Is it normal or maybe I need some tweaking? Also one of my colleagues 
suggested installation of i386 version of 5.3 for speeding things up, that 
sound strange for me.

I'm new for amd64 version of freebsd, but using freebsd-i386 for 7 years 
or so on i386 platforms. May this problem be an amd64-specific?

Any suggestions how I can resolve this problem?



2) One more Q - apache is eating a lot of memory when running - about 64M 
for each process instead of usual approx 7-10M per process on previous 
i386 with same compiled configuration:

== from top ===
   PID USERNAME PRI NICE   SIZE    RES STATE  C   TIME   WCPU    CPU COMMAND
  3351 www       96    0 69560K 18712K select 3   0:01  0.93%  0.93% httpd
==========

Other programs looks the same or about it. Is it normal for amd64 platform 
or also my mistake?



3) And one more Q - box has 4G of memory, but kernel can see only 3.5G, as 
can be seen from following dmesg output. What can be a problem?



Box is a Tyan's Thunder K8QS Pro (S4882) 4-way AMD Opteron platform (with 
Tyan S4882UG2NR board).

Disk split in two parts:

Filesystem    1K-blocks     Used     Avail Capacity  Mounted on
/dev/aacd0s1a   6090094  1998300   3604588    36%    /
devfs                 1        1         0   100%    /dev
/dev/aacd0s1d 402268316 26148124 343938728     7%    /work

On /, of course, is a system and second one is working partiton.

Here's boot message of the new box:

Copyright (c) 1992-2004 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
         The Regents of the University of California. All rights reserved.
FreeBSD 5.3-STABLE #2: Mon Dec 27 08:27:05 GMT 2004
     root at sys154.3fn.net:/usr/obj/usr/src/sys/kong
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Opteron(tm) Processor 846 (1992.22-MHz K8-class CPU)
   Origin = "AuthenticAMD"  Id = 0xf58  Stepping = 8
   Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
   AMD Features=0xe0500800<SYSCALL,NX,MMX+,LM,3DNow+,3DNow>
real memory  = 3757506560 (3583 MB)
avail memory = 3627720704 (3459 MB)
ACPI APIC Table: <PTLTD          APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
  cpu0 (BSP): APIC ID:  0
  cpu1 (AP): APIC ID:  1
  cpu2 (AP): APIC ID:  2
  cpu3 (AP): APIC ID:  3
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ioapic1 <Version 1.1> irqs 24-27 on motherboard
ioapic2 <Version 1.1> irqs 28-31 on motherboard
ioapic3 <Version 1.1> irqs 32-35 on motherboard
ioapic4 <Version 1.1> irqs 36-39 on motherboard
acpi0: <PTLTD    XSDT> on motherboard
acpi0: Power Button (fixed)
unknown: I/O range not supported
unknown: I/O range not supported
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0xc008-0xc00b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xc080-0xc0ff,0xc000-0xc07f,0xcf8-0xcff iomem 0xd8000-0xdbfff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci1: <ACPI PCI bus> on pcib1
ohci0: <OHCI (generic) USB controller> mem 0xe8000000-0xe8000fff irq 19 at device 0.0 on pci1
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 3 ports with 3 removable, self powered
ohci1: <OHCI (generic) USB controller> mem 0xe8001000-0xe8001fff irq 19 at device 0.1 on pci1
ohci1: [GIANT-LOCKED]
usb1: OHCI version 1.0, legacy support
usb1: SMM does not respond, resetting
usb1: <OHCI (generic) USB controller> on ohci1
usb1: USB revision 1.0
uhub1: AMD OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 3 ports with 3 removable, self powered
pci1: <display, VGA> at device 4.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <AMD 8111 UDMA133 controller> port 0x1000-0x100f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 7.1 on pci0
ata0: channel #0 on atapci0
ata1: channel #1 on atapci0
pci0: <bridge, PCI-unknown> at device 7.3 (no driver attached)
pcib2: <ACPI Host-PCI bridge> on acpi0
pci8: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 1.0 on pci8
pci9: <ACPI PCI bus> on pcib3
aac0: <Adaptec SCSI RAID 2120S> mem 0xf8000000-0xfbffffff irq 26 at device 2.0 on pci9
aac0: [FAST]
aac0: Enabling 64-bit address support
aac0: Unknown processor 100MHz, 48MB cache memory, optional battery not installed
aac0: Kernel 4.1-0, Build 7244, S/N be37b0
aac0: Supported 
Options=11d7e<CLUSTERS,WCACHE,DATA64,HOSTTIME,RAID50,WINDOW4GB,SOFTERR,SGMAP64,ALARM,NONDASD>
aacp0: <SCSI Passthrough Bus> on aac0
pci8: <base peripheral, interrupt controller> at device 1.1 (no driver attached)
pcib4: <ACPI PCI-PCI bridge> at device 2.0 on pci8
pci14: <ACPI PCI bus> on pcib4
mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x3000-0x30ff mem 0xed000000-0xed00ffff,0xed010000-0xed01ffff irq 29 at device 1.0 on pci14
mpt0: [GIANT-LOCKED]
mpt1: <LSILogic 1030 Ultra4 Adapter> port 0x3400-0x34ff mem 0xed020000-0xed02ffff,0xed030000-0xed03ffff irq 30 at device 1.1 on pci14
mpt1: [GIANT-LOCKED]
bge0: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2002> mem 0xed040000-0xed04ffff,0xed050000-0xed05ffff irq 31 at device 3.0 on pci14
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge0: Ethernet address: 00:00:1a:1a:0d:5a
bge1: <Broadcom BCM5704C Dual Gigabit Ethernet, ASIC rev. 0x2002> mem 0xed060000-0xed06ffff,0xed070000-0xed07ffff irq 28 at device 3.1 on pci14
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge1: Ethernet address: 00:00:1a:1a:0d:5b
pci8: <base peripheral, interrupt controller> at device 2.1 (no driver attached)
pcib5: <ACPI PCI-PCI bridge> mem 0xea202000-0xea202fff irq 32 at device 3.0 on pci8
pci19: <ACPI PCI bus> on pcib5
pci8: <base peripheral, interrupt controller> at device 3.1 (no driver attached)
pcib6: <ACPI PCI-PCI bridge> mem 0xea204000-0xea204fff irq 36 at device 4.0 on pci8
pci27: <ACPI PCI bus> on pcib6
pci8: <base peripheral, interrupt controller> at device 4.1 (no driver attached)
atkbdc0: <Keyboard controller (i8042)> port 0x64,0x60 irq 1 on acpi0
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
fdc0: <floppy drive controller> port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
orm0: <ISA Option ROMs> at iomem 0xcc800-0xd0fff,0xcb000-0xcc7ff,0xc9800-0xcafff,0xc9000-0xc97ff,0xc8000-0xc8fff,0xc0000-0xc7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x100>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
ipfw2 initialized, divert disabled, rule-based forwarding disabled, default to accept, logging disabled
acd0: DVDROM <DV-28E-B/1.2B> at ata0-master UDMA33
Waiting 15 seconds for SCSI devices to settle
aacd0: <RAID 5> on aac0
aacd0: 419943MB (860045184 sectors)
(probe0:aacp0:0:0:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe0:aacp0:0:0:0): ILLEGAL REQUEST asc:55,3
(probe0:aacp0:0:0:0): Reserved ASC/ASCQ pair
(probe5:aacp0:0:5:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe5:aacp0:0:5:0): ILLEGAL REQUEST asc:55,3
(probe5:aacp0:0:5:0): Reserved ASC/ASCQ pair
(probe9:aacp0:0:10:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe9:aacp0:0:10:0): ILLEGAL REQUEST asc:55,3
(probe9:aacp0:0:10:0): Reserved ASC/ASCQ pair
(probe10:aacp0:0:11:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe10:aacp0:0:11:0): ILLEGAL REQUEST asc:55,3
(probe10:aacp0:0:11:0): Reserved ASC/ASCQ pair
(probe13:aacp0:0:14:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe13:aacp0:0:14:0): ILLEGAL REQUEST asc:55,3
(probe13:aacp0:0:14:0): Reserved ASC/ASCQ pair
(probe1:aacp0:0:1:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe1:aacp0:0:1:0): ILLEGAL REQUEST asc:55,3
(probe1:aacp0:0:1:0): Reserved ASC/ASCQ pair
(probe2:aacp0:0:2:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe2:aacp0:0:2:0): ILLEGAL REQUEST asc:55,3
(probe2:aacp0:0:2:0): Reserved ASC/ASCQ pair
(probe3:aacp0:0:3:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe3:aacp0:0:3:0): ILLEGAL REQUEST asc:55,3
(probe3:aacp0:0:3:0): Reserved ASC/ASCQ pair
(probe4:aacp0:0:4:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe4:aacp0:0:4:0): ILLEGAL REQUEST asc:55,3
(probe4:aacp0:0:4:0): Reserved ASC/ASCQ pair
(probe6:aacp0:0:6:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe6:aacp0:0:6:0): ILLEGAL REQUEST asc:55,3
(probe6:aacp0:0:6:0): Reserved ASC/ASCQ pair
(probe7:aacp0:0:8:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe7:aacp0:0:8:0): ILLEGAL REQUEST asc:55,3
(probe7:aacp0:0:8:0): Reserved ASC/ASCQ pair
(probe8:aacp0:0:9:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe8:aacp0:0:9:0): ILLEGAL REQUEST asc:55,3
(probe8:aacp0:0:9:0): Reserved ASC/ASCQ pair
(probe11:aacp0:0:12:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe11:aacp0:0:12:0): ILLEGAL REQUEST asc:55,3
(probe11:aacp0:0:12:0): Reserved ASC/ASCQ pair
(probe12:aacp0:0:13:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe12:aacp0:0:13:0): ILLEGAL REQUEST asc:55,3
(probe12:aacp0:0:13:0): Reserved ASC/ASCQ pair
(probe14:aacp0:0:15:0): INQUIRY. CDB: 12 0 0 0 24 0
(probe14:aacp0:0:15:0): ILLEGAL REQUEST asc:55,3
(probe14:aacp0:0:15:0): Reserved ASC/ASCQ pair
SMP: AP CPU #2 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
Mounting root from ufs:/dev/aacd0s1a

Thank You.

adios,
/kong

========================================================================
Hostas Red (KVK10, KVK10-RIPE) || IP Networks Administrator, CJSC Rascom
========================================================================