amd64/105187: make -j2 buildworld renders FreeBSD 6.2-PRE/AMD64 unusuable

O. Hartmann ohartman at zedat.fu-berlin.de
Sun Nov 5 22:00:54 UTC 2006


>Number:         105187
>Category:       amd64
>Synopsis:       make -j2 buildworld renders FreeBSD 6.2-PRE/AMD64 unusuable
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    freebsd-amd64
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun Nov 05 22:00:52 GMT 2006
>Closed-Date:
>Last-Modified:
>Originator:     O. Hartmann
>Release:        FreeBSD 6.2-PRE/AMD64
>Organization:
Freie Universität Berlin
>Environment:
FreeBSD foo.org 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #8: Sat Nov  4 11:23:20 UTC 2006     root at foo.org:/usr/obj/usr/src/sys/FOO  amd64

>Description:
make -j2 buildworld renders a FreeBSD 6.2-PRE/AMD64 box unusuable. Mouse pointer begin to jump, keyboard input occurs with one or up to five seconds latency, moving windows is nearly impossible. This behaviour got worse since a undetermined cvsupdate within the last 4 weeks.
On the same hardware this was never seen before on 6.1/amd64 or 6.1-STABLE/AMD64. A i386 box with the exact same OS and setup does not show this problem while building world with make -j2, although the i386 hardware is older and possibly less powerful.

special kernel options:

PREEMPTION
SCHED_4BSD
ADAPTIVE_GIANT

Execpt SCHED_4BSD the setup and config of kernel has not changed. The problem gets even worse with SCHED_ULE enabled. As I wrote before, I could watch a kind of development into this worse situation without specifying what the reasons are. Because I did the same make -j2 many times before without problems, this drives me crazy.
make without any parallelisation does hease the pain a bit, but still renders mouse, keyboard and graphics jumping ...

Some output from top -S:

last pid: 46621;  load averages:  4.19,  4.16,  4.04               up 0+03:50:36  21:53:45
133 processes: 7 running, 106 sleeping, 1 zombie, 19 waiting
CPU states: 82.6% user,  0.0% nice, 17.1% system,  0.3% interrupt,  0.0% idle
Mem: 216M Active, 1392M Inact, 187M Wired, 75M Cache, 214M Buf, 11M Free
Swap: 8192M Total, 8192M Free

  PID USERNAME    THR PRI NICE   SIZE    RES STATE    TIME   WCPU COMMAND
46540 root          1 131    0 13896K 13408K RUN      0:01 11.03% cc1
  906 root          1 129    0   336M 97620K RUN      9:56 10.89% Xorg
46620 root          1 131    0 11588K 11080K RUN      0:00  7.00% cc1
46594 root          1 128    0  1176K  1096K select   0:00  0.51% make
   10 root          1 171   52     0K    16K RUN    151:20  0.00% idle
 1422 hartmann      4  20    0   232M 95060K kserel   4:34  0.00% firefox-bin
   12 root          1 -32 -151     0K    16K WAIT     0:29  0.00% swi4: clock sio
  968 hartmann      1  96    0 27420K  1456K select   0:18  0.00% xclock
   34 root          1 -60 -179     0K    16K WAIT     0:11  0.00% irq12: psm0
    4 root          1  -8    0     0K    16K -        0:10  0.00% g_down
 1215 hartmann      1  96    0 30264K  2528K select   0:10  0.00% xterm
   39 root          1 171   52     0K    16K RUN      0:08  0.00% pagezero
  860 root          1  96    0  3600K   168K select   0:07  0.00% moused
   11 root          1 -44 -163     0K    16K WAIT     0:07  0.00% swi1: net
   16 root          1 -24 -143     0K    16K WAIT     0:05  0.00% swi6: task queue
   41 root          1  20    0     0K    16K syncer   0:04  0.00% syncer
  937 hartmann      1  96    0 29528K  2880K select   0:04  0.00% fvwm
   25 root          1 -68 -187     0K    16K WAIT     0:04  0.00% irq22: nfe0 ehci0
   30 root          1 -64 -183     0K    16K WAIT     0:04  0.00% irq20: atapci1
 1496 hartmann      1  96    0 29192K  4916K select   0:04  0.00% xterm
    3 root          1  -8    0     0K    16K -        0:03  0.00% g_up
25005 hartmann      1  96    0 30764K  2396K select   0:03  0.00% xterm
  969 hartmann      1  96    0 18180K  2576K select   0:02  0.00% xload
 5556 root          1  96    0   668K   348K select   0:01  0.00% make
10721 hartmann      1  96    0 31352K  7080K select   0:01  0.00% xterm
   14 root          1 -16    0     0K    16K -        0:01  0.00% yarrow
   43 root          1 -16    0     0K    16K sdflus   0:01  0.00% softdepflush
   44 root          1 -68    0     0K    16K -        0:01  0.00% schedcpu
  966 hartmann      1  96    0 23788K  1300K select   0:01  0.00% FvwmPager
  962 hartmann      1  96    0 21552K  1212K select   0:01  0.00% FvwmIconMan
 5645 root          1  96    0  1004K   920K select   0:01  0.00% make
    2 root          1  -8    0     0K    16K -        0:01  0.00% g_event
   28 root          1 -64 -183     0K    16K WAIT     0:01  0.00% irq14: ata0
  743 root          1  96    0  7720K  1816K select   0:00  0.00% ntpd
  430 _pflogd       1 -58    0  4924K  1300K bpf      0:00  0.00% pflogd
   37 root          1  20    0     0K    16K psleep   0:00  0.00% vmdaemon
93707 root          1  96    0   988K   904K select   0:00  0.00% make
   33 root          1 -60 -179     0K    16K WAIT     0:00  0.00% irq1: atkbd0
  816 root          1  96    0  9472K  2740K select   0:00  0.00% sendmail
  967 hartmann      1  96    0 18148K   840K select   0:00  0.00% xbiff
   17 root          1 -40 -159     0K    16K WAIT     0:00  0.00% swi2: cambio
   15 root          1 -24 -143     0K    16K WAIT     0:00  0.00% swi6: Giant taskq
44492 root          1 119    0  6324K  6252K select   0:00  0.00% make
  811 root          1   4    0 19656K     0K select   0:00  0.00% <sshd>
  961 hartmann      1  96    0 23772K   736K select   0:00  0.00% FvwmButtons
   36 root          1 -16    0     0K    16K psleep   0:00  0.00% pagedaemon


Some dmesg output:

Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-PRERELEASE #8: Sat Nov  4 11:23:20 UTC 2006
    root at thor.quark-park.dyndns.org:/usr/obj/usr/src/sys/THOR
ACPI APIC Table: <A M I  OEMAPIC >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) 64 Processor 3500+ (2210.07-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x10ff0  Stepping = 0
  Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
  AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow+,3DNow>
  AMD Features2=0x1<LAHF>
real memory  = 2147155968 (2047 MB)
avail memory = 2065395712 (1969 MB)
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <A M I OEMXSDT> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory, RAM> at device 0.0 (no driver attached)
pci0: <memory, RAM> at device 0.1 (no driver attached)
pci0: <memory, RAM> at device 0.2 (no driver attached)
pci0: <memory, RAM> at device 0.3 (no driver attached)
pci0: <memory, RAM> at device 0.4 (no driver attached)
pci0: <memory, RAM> at device 0.5 (no driver attached)
pci0: <memory, RAM> at device 0.6 (no driver attached)
pci0: <memory, RAM> at device 0.7 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pci1: <mass storage> at device 0.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 3.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pci2: <network, ethernet> at device 0.0 (no driver attached)
pcib3: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pci3: <display, VGA> at device 0.0 (no driver attached)
pci0: <memory> at device 9.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 10.0 on pci0
isa0: <ISA bus> on isab0
nfsmb0: <nForce2/3/4 MCP SMBus Controller> port 0xbc00-0xbc1f,0x600-0x63f,0x700-0x73f irq 20 at device 10.1 on pci0
smbus0: <System Management Bus> on nfsmb0
smb0: <SMBus generic I/O> on smbus0
nfsmb1: <nForce2/3/4 MCP SMBus Controller> on nfsmb0
smbus1: <System Management Bus> on nfsmb1
smb1: <SMBus generic I/O> on smbus1
ohci0: <OHCI (generic) USB controller> mem 0xdcdfa000-0xdcdfafff irq 21 at device 11.0 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 10 ports with 10 removable, self powered
ehci0: <NVIDIA nForce4 USB 2.0 controller> mem 0xdcdfbc00-0xdcdfbcff irq 22 at device 11.1 on pci0
ehci0: [GIANT-LOCKED]
usb1: EHCI version 1.0
usb1: companion controller, 4 ports each: usb0
usb1: <NVIDIA nForce4 USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub1: 10 ports with 10 removable, self powered
umass0: Macpower &Tytech Tech USB2.0 Enclosure, rev 2.00/1.00, addr 2
pcm0: <nVidia nForce4> port 0xb400-0xb4ff,0xb000-0xb0ff mem 0xdcdf9000-0xdcdf9fff irq 23 at device 13.0 on pci0
pcm0: <Avance Logic ALC850 AC97 Codec>
atapci0: <nVidia nForce CK804 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 15.0 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <nVidia nForce CK804 SATA300 controller> port 0xac00-0xac07,0xa880-0xa883,0xa800-0xa807,0xa480-0xa483,0xa400-0xa40f mem 0xdcdf8000-0xdcdf8fff irq 20 at device 16.0 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
atapci2: <nVidia nForce CK804 SATA300 controller> port 0xa080-0xa087,0xa000-0xa003,0x9c00-0x9c07,0x9880-0x9883,0x9800-0x980f mem 0xdcdf7000-0xdcdf7fff irq 21 at device 17.0 on pci0
ata4: <ATA channel 0> on atapci2
ata5: <ATA channel 1> on atapci2
pcib4: <ACPI PCI-PCI bridge> at device 18.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pci4: <multimedia, audio> at device 7.0 (no driver attached)
fwohci0: <Texas Instruments TSB43AB22/A> mem 0xdffff800-0xdfffffff,0xdfff8000-0xdfffbfff irq 17 at device 11.0 on pci4
fwohci0: OHCI version 1.10 (ROM=1)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 00:11:d8:00:00:8c:1f:22
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
sbp0: <SBP-2/SCSI over FireWire> on firewire0
fwohci0: Initiate bus reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
nfe0: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0x9480-0x9487 mem 0xdcdf6000-0xdcdf6fff irq 22 at device 19.0 on pci0
miibus0: <MII bus> on nfe0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
nfe0: Ethernet address: 00:15:f2:a2:85:ba
pcib5: <ACPI PCI-PCI bridge> at device 22.0 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 23.0 on pci0
pci6: <ACPI PCI bus> on pcib6
acpi_button0: <Power Button> on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse, device ID 3
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <8 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
fb0 at vga0
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
Timecounter "TSC" frequency 2210070207 Hz quality 800
Timecounters tick every 1.000 msec
Fast IPsec: Initialized Security Association Processing.
acd0: DVDR <NEC DVD RW ND-3500AG/2.1B> at ata0-master UDMA33
ad4: 238475MB <HDT722525DLA380 V44OA96A> at ata2-master SATA300
ad6: 238475MB <HDT722525DLA380 V44OA96A> at ata3-master SATA300
ar0: 476950MB <nVidia MediaShield RAID0 (stripe 64 KB)> status: READY
ar0: disk0 READY using ad6 at ata3-master
ar0: disk1 READY using ad4 at ata2-master
cd0 at ata0 bus 0 target 0 lun 0
cd0: <_NEC DVD_RW ND-3500AG 2.1B> Removable CD-ROM SCSI-0 device 
cd0: 33.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <SAMSUNG S07GJ10Y304470 VM10> Fixed Direct Access SCSI-2 device 
da0: 40.000MB/s transfers
da0: 190782MB (390721968 512 byte sectors: 255H 63S/T 24321C)
GEOM_LABEL: Label for provider da0d is ufs/BACKUP.
GEOM_LABEL: Label for provider ar0s3 is ufs/HOMES.
GEOM_LABEL: Label for provider ar0s1d is ufs/VAR.
GEOM_LABEL: Label for provider ar0s1e is ufs/USR.
GEOM_LABEL: Label for provider ar0s1f is ufs/LOCAL.
GEOM_LABEL: Label for provider ar0s1g is ufs/OBJ.
GEOM_LABEL: Label for provider ar0s1h is ufs/SRC.
GEOM_LABEL: Label for provider ar0s2d is ufs/COMPAT.
GEOM_LABEL: Label for provider ar0s2e is ufs/DATABASE.
GEOM_LABEL: Label for provider ar0s2f is ufs/PORTS.
GEOM_LABEL: Label for provider ar0s2g is ufs/SCRATCH.
Trying to mount root from ufs:/dev/ar0s1a

>How-To-Repeat:
build world with make -j2 on FreeBSD 6.2-PRE/AMD64 with UP.
>Fix:

>Release-Note:
>Audit-Trail:
>Unformatted:


More information about the freebsd-amd64 mailing list