[problem] aac0 does not respond

Thu Apr 2 03:29:48 PDT 2009

Ed Maste wrote:
> 2009/3/24 Vladimir Ermakov <samflanker at gmail.com>:
>   
>> Hello, All
>>
>> Describe my problem:
>> have volume RAID-10 (SAS-HDD x 6) on Adaptec RAID 5805
>> 2 HHD of 6  have errors in smart data (damaged)
>> i am try read file /var/db/mysql/ibdata1 from this volume
>> system does not respond ( lost access to ssh ) after read 6GB data 
>>     
> >from this
>   
>> file
>> and print debug messages on ttyv0
>>     
>
> If the messages you see are the same as in the message to which you
> provided a link ("COMMAND xxx TIMED OUT AFTER xxx SECONDS") it typically
> means that the RAID controller has crashed.  My initial suggestion is to
> check the firmware version installed on your card, and update to the
> latest from Adaptec's website if you're not running that one already.
>
> Attilio also has some driver updates (ported from Adaptec's latest
> vendor driver) that you can try.  The plan is to commit them sometime
> soon, but he can forward those on for testing before that happens.
>
> -Ed
>
>   

after update to FreeBSD 7-STABLE amd64

Adaptec 5805 firmware build: 16501

# uname -a
FreeBSD  7.2-PRERELEASE FreeBSD 7.2-PRERELEASE #1: Thu Apr  2 11:03:45 
CEST 2009     root at sys3:/usr/obj/usr/src/sys/GENERIC  amd64


# tar -cf - ibdata1 | pv -brt > /dev/null
5.98GB 0:30:23 [   0B/s ]

---------/var/log/messages--------------------------------
Apr  2 09:13:51  kernel: SMP: AP CPU #4 Launched!
Apr  2 09:13:51  kernel: lapic5: Forcing LINT1 to edge trigger
Apr  2 09:13:51  kernel: SMP: AP CPU #5 Launched!
Apr  2 09:13:51  kernel: da0 at umass-sim0 bus 0 target 0 lun 0
Apr  2 09:13:51  kernel: da0: <USB 2.0 USB Flash Drive 0.00> Removable 
Direct Access SCSI-2 device
Apr  2 09:13:51  kernel: da0: 40.000MB/s transfers
Apr  2 09:13:51  kernel: da0: 15424MB (31588352 512 byte sectors: 255H 
63S/T 1966C)
Apr  2 09:13:51  kernel: aac0: EventNotify(0)
Apr  2 09:13:51  kernel: aac0: (22)
Apr  2 09:13:51  kernel: Trying to mount root from ufs:/dev/da0s1a
Apr  2 09:13:51  kernel: aac0: EventNotify(0)
Apr  2 09:13:51  kernel: aac0: (22)
Apr  2 09:13:52  savecore: no dumps found
Apr  2 09:13:53  kernel: aac0: EventNotify(0)
Apr  2 09:13:53  kernel: aac0: (22)
Apr  2 09:14:07  kernel: aac0: EventNotify(0)
Apr  2 09:14:07  kernel: aac0: (22)
Apr  2 09:55:07  kernel: aac0: COMMAND 0xfffffffe80244060 TIMEOUT AFTER 
41 SECONDS
Apr  2 09:55:07  kernel: aac0: aac_timeout: FIB @ 0xffffffff4cd37000
Apr  2 09:55:07  kernel: aac0:   XferState 
830ad<HOSTOWNED,INITIALISED,EMPTY,FROMHOST,REXPECTED,NORM,ASYNC,FAST_RESPONSE>
Apr  2 09:55:07  kernel: aac0:   Command       502
Apr  2 09:55:07  kernel: aac0:   StructType    1
Apr  2 09:55:07  kernel: aac0:   Flags         0x0
Apr  2 09:55:07  kernel: aac0:   Size          80
Apr  2 09:55:07  kernel: aac0:   SenderSize    2048
Apr  2 09:55:07  kernel: aac0:   SenderAddress 0x528
Apr  2 09:55:07  kernel: aac0:   RcvrAddress   0x3e53000
Apr  2 09:55:07  kernel: aac0:   SenderData    0x14a
Apr  2 09:55:07  kernel: aac0:    7f 3e c2 10 00 00 00 00 00 00 01 00 00 
00 01 00
Apr  2 09:55:07  kernel: aac0:    00 00 00 00 01 00 00 00 00 00 00 00 00 
00 00 00
Apr  2 09:55:07  kernel: aac0: COMMAND 0xfffffffe80240080 TIMEOUT AFTER 
41 SECONDS
Apr  2 09:55:07  kernel: aac0: aac_timeout: FIB @ 0xffffffff4ccee000
Apr  2 09:55:07  kernel: aac0:   XferState 
830ad<HOSTOWNED,INITIALISED,EMPTY,FROMHOST,REXPECTED,NORM,ASYNC,FAST_RESPONSE>
Apr  2 09:55:07  kernel: aac0:   Command       502
Apr  2 09:55:07  kernel: aac0:   StructType    1
Apr  2 09:55:07  kernel: aac0:   Flags         0x0
Apr  2 09:55:07  kernel: aac0:   Size          80
Apr  2 09:55:07  kernel: aac0:   SenderSize    2048
Apr  2 09:55:07  kernel: aac0:   SenderAddress 0x2e0
Apr  2 09:55:07  kernel: aac0:   RcvrAddress   0x3956000
Apr  2 09:55:07  kernel: aac0:   SenderData    0xb8
Apr  2 09:55:07  kernel: aac0:    ff 3e c2 10 00 00 00 00 00 00 01 00 00 
00 01 00
Apr  2 09:55:07  kernel: aac0:    00 00 00 00 01 00 00 00 00 00 00 00 00 
00 00 00
Apr  2 09:55:07  kernel: aac0: WARNING! Controller is no longer running! 
code= 0xbc620100
Apr  2 09:55:27  kernel: aac0: COMMAND 0xfffffffe80244060 TIMEOUT AFTER 
61 SECONDS
Apr  2 09:55:27  kernel: aac0: aac_timeout: FIB @ 0xffffffff4cd37000
Apr  2 09:55:27  kernel: aac0:   XferState 
830ad<HOSTOWNED,INITIALISED,EMPTY,FROMHOST,REXPECTED,NORM,ASYNC,FAST_RESPONSE>
Apr  2 09:55:27  kernel: aac0:   Command       502
Apr  2 09:55:27  kernel: aac0:   StructType    1
Apr  2 09:55:27  kernel: aac0:   Flags         0x0
Apr  2 09:55:27  kernel: aac0:   Size          80
Apr  2 09:55:27  kernel: aac0:   SenderSize    2048
Apr  2 09:55:27  kernel: aac0:   SenderAddress 0x528
Apr  2 09:55:27  kernel: aac0:   RcvrAddress   0x3e53000
Apr  2 09:55:27  kernel: aac0:   SenderData    0x14a
Apr  2 09:55:27  kernel: aac0:    7f 3e c2 10 00 00 00 00 00 00 01 00 00 
00 01 00
Apr  2 09:55:27  kernel: aac0:    00 00 00 00 01 00 00 00 00 00 00 00 00 
00 00 00
Apr  2 09:55:27  kernel: aac0: COMMAND 0xfffffffe80240080 TIMEOUT AFTER 
61 SECONDS
Apr  2 09:55:27  kernel: aac0: aac_timeout: FIB @ 0xffffffff4ccee000
Apr  2 09:55:27  kernel: aac0:   XferState 
830ad<HOSTOWNED,INITIALISED,EMPTY,FROMHOST,REXPECTED,NORM,ASYNC,FAST_RESPONSE>
Apr  2 09:55:27  kernel: aac0:   Command       502
Apr  2 09:55:27  kernel: aac0:   StructType    1
Apr  2 09:55:27  kernel: aac0:   Flags         0x0
Apr  2 09:55:27  kernel: aac0:   Size          80
Apr  2 09:55:27  kernel: aac0:   SenderSize    2048
Apr  2 09:55:27  kernel: aac0:   SenderAddress 0x2e0
Apr  2 09:55:27  kernel: aac0:   RcvrAddress   0x3956000
Apr  2 09:55:27  kernel: aac0:   SenderData    0xb8
Apr  2 09:55:27  kernel: aac0:    ff 3e c2 10 00 00 00 00 00 00 01 00 00 
00 01 00
Apr  2 09:55:27  kernel: aac0:    00 00 00 00 01 00 00 00 00 00 00 00 00 
00 00 00
***
---------------------------------------------------------------------


/Vladimir Ermakov