NVidia RAID on Tyan-S2865

[Igor Robul]

Hello, 

I have got my first trouble with FreeBSD + SATA RAID :-)
I had installed FreeBSD 6.1 on SATA RAID-1 and after two weeks of
couldless work :-) I got one problem.

I was required to make backup copy of external 100Gb USB2 disk with
NTFS, so I had attached disk and had entered:

dd if=/dev/da0 of=/usr/local/disk-backup/disk.hdd bs=4m

after some time PC became very slow and these messages appeared on
console (extracted from /var/log/messages):

Jun  7 12:17:19 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
entered:

dd if=/dev/da0 of=/usr/local/disk-backup/disk.hdd bs=4m

after some time PC became very slow and these messages appeared on
console (extracted from /var/log/messages):

Jun  7 12:17:19 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (1 retry left) LBA=1048831
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (1 retry left) LBA=287
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (0 retries left) LBA=1048831
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (0 retries left) LBA=287
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: FAILURE - WRITE_DMA timed out LBA=1048831
Jun  7 12:19:15 sysadm kernel: ar0: WARNING - mirror protection lost.  RAID1 array in DEGRADED mode
Jun  7 12:19:15 sysadm kernel: ar0: writing of nVidia MediaShield metadata is NOT supported yet
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (1 retry left) LBA=1048831
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (1 retry left) LBA=287
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (0 retries left) LBA=1048831
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: TIMEOUT - WRITE_DMA retrying (0 retries left) LBA=287
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES SET TRANSFER MODE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE RCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SETFEATURES ENABLE WCACHE taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: WARNING - SET_MULTI taskqueue timeout - completing request directly
Jun  7 12:19:15 sysadm kernel: ad8: FAILURE - WRITE_DMA timed out LBA=1048831
Jun  7 12:19:15 sysadm kernel: ar0: WARNING - mirror protection lost.  RAID1 array in DEGRADED mode
Jun  7 12:19:15 sysadm kernel: ar0: writing of nVidia MediaShield metadata is NOT supported yet


I had then rebooted my PC, and got fsck + softupdates errors followed by
panic. I have rebooted in single user mode and run fsck -y. Rebooting to
multiuser mode resulted in panic with message about softupdates
inconsistency. After this I gave up, and booted to single user mode and
changed ar0* to ad4* in /etc/fstab. Now system works fine (I have lost
some new files and my WindowMaker configuration :-) ).

Later I have successfully copied 100Gb disk to /usr/local mounted on ad6
insted of ar0.