SCSI, SMP, and Supermicro, problems!

[David Raistrick]

[resending to scsi@ after posting to hardware@]

Folks,

My Supermicro 6023P-8R arrived and I've started working with it.  2 2.4Ghz
533FSB Xeons and 512 megs of ram. This has the X5DP8 motherboard. (e7501
chipset)

Installed FreeBSD 4.8-RELEASE (development constraints currently restrict
this to 4.8-R.) and everything is fine w/o SMP.  Hyperthreading /disabled/ in the
Bios and NOT enabled in the kernel.

Added options SMP and APIC_IO to a generic kernel and rebuilt it.

Rebooted to serious problems.  I removed my PCI devices just to be sure,
and still have the same problems.

If anyone has suggestions please let me know.   I'm also sending a copy of
this message to Supermicro support.

Details below:

PhoenixBIOS 4.0 Release 6.0
Copyright 1985-2001 Phoenix Technologies Ltd.  All Rights Reserved
Supermicro X5DP8-G2/X5DPE-G2
BIOS Rev 1.4c

The most common error message is:
ahd0: Timedout SCB already complete. Interrupts may not be functioning.
ahd0: Timedout SCB already complete. Interrupts may not be functioning.
em0: watchdog timeout -- resetting
em0: watchdog timeout -- resetting

The machine usually freezes sometime during the boot, or just after boot,
outputing these messages every few minutes.

On some boots, I get this message before boot.  It eventually repeats,
boot never continuing (LONG error message):

Waiting 15 seconds for SCSI devices to settle
(probe3:ahd0:0:3:0): SCB 0xc - timed out
>>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<<
ahd0: Dumping Card State at program address 0x10f Mode 0x33
Card was paused
HS_MAILBOX[0x0] INTCTL[0x80]:(SWTMINTMASK) SEQINTSTAT[0x0]
SAVED_MODE[0x11] DFFSTAT[0x33]:(CURRFIFO_NONE|FIFO0FREE|FIFO1FREE)
SCSISIGI[0xb6]:(P_MESGOUT|REQI|BSYI|ATNI) SCSIPHASE[0x0]
SCSIBUS[0xc0] LASTPHASE[0xa0]:(P_MESGOUT) SCSISEQ0[0x0]
SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI) SEQCTL0[0x0] SEQINTCTL[0x0]
SEQ_FLAGS[0x40]:(NO_CDB_SENT) SEQ_FLAGS2[0x0] SSTAT0[0x2]:(SPIORDY)
SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0x0]
SIMODE1[0xac]:(ENSCSIPERR|ENBUSFREE|ENSCSIRST|ENSELTIMO)
LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] LQOSTAT0[0x0]
LQOSTAT1[0x0] LQOSTAT2[0x0]

SCB Count = 16 CMDS_PENDING = 1 LASTSCB 0xffff CURRSCB 0xc NEXTSCB 0x0
qinstart = 38 qinfifonext = 39
QINFIFO: 0xf
WAITING_TID_QUEUES:
Pending list:
 15 FIFO_USE[0x0] SCB_CONTROL[0x40]:(DISCENB) SCB_SCSIID[0x7]
 12 FIFO_USE[0x0] SCB_CONTROL[0x40]:(DISCENB) SCB_SCSIID[0x37]
Total 2
Kernel Free SCB list: 9 1 2 3 4 5 6 7 8 10 11 13 14 0
Sequencer Complete DMA-inprog list:
Sequencer Complete list:
Sequencer DMA-Up and Complete list:

ahd0: FIFO0 Free, LONGJMP == 0x80ff, SCB 0x0
SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVE
SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL)
ahd0: FIFO1 Free, LONGJMP == 0x8063, SCB 0xc
SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVE
SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL)
SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0]
SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0
HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL)
LQIN: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
0x0 0
ahd0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52
ahd0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x0

SIMODE0[0xc]:(ENOVERRUN|ENIOERR)
CCSCBCTL[0x4]:(CCSCBDIR)
ahd0: REG0 == 0xc, SINDEX = 0x107, DINDEX = 0xe1
ahd0: SCBPTR == 0xc, SCB_NEXT == 0xff00, SCB_NEXT2 == 0xff12
CDB 0 0 0 0 0 0
STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0
<<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>>





I have complete boot messages available if anyone needs them, and will be
happy to supply any other information you folks need.

FWIW, I tried a ~Aug 8 2003 -STABLE kernel with SMP enabled with identical
results.








---
david raistrick
drais at atlasta.net		http://www.expita.com/nomime.html