zfs i/o error - all block copies unavailable

Thu Dec 12 13:32:07 UTC 2013

Hi.

On 12.12.2013 17:05, Andriy Gapon wrote:
>
> A few words about your pool configuration and the disks that it is comprised of...
>
It was created under 8.2-STABLE, still not upgraded.
Now it's running on one disk (I keep another as a cold backup, just in
case).
It has a separated log device (addition or removal doesn't affect the
error message - I tried that).

Disks:

diskid/DISK-MK0311YHG8W4EA is ada2, got this strange id while importing
pool on different machines and different FreeBSd versions.
ada1 is a blank disk, waiting to attach and resilver.
ada0 is a separate log device.

BIOS is set to boot from ada2 first.

Other data:

===Cut===
# zpool status
  pool: zfsroot
 state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas
exist for
        the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
   see: http://illumos.org/msg/ZFS-8000-2Q
  scan: resilvered 352G in 9h34m with 0 errors on Thu Dec 12 09:20:25 2013
config:

        NAME                              STATE     READ WRITE CKSUM
        zfsroot                           DEGRADED     0     0     0
          mirror-0                        DEGRADED     0     0     0
            17492019096575782489          UNAVAIL      0     0     0 
was /dev/diskid/DISK-MK0311YHG0P7KAp2
            diskid/DISK-MK0311YHG8W4EAp2  ONLINE       0     0     0
        logs
          ada0                            ONLINE       0     0     0

errors: No known data errors
# gpart show
=>        34  7814037101  ada1  GPT  (3.6T)
          34        4062        - free -  (2.0M)
        4096         128     1  freebsd-boot  (64K)
        4224        3968        - free -  (1.9M)
        8192    16777216     2  freebsd-swap  (8.0G)
    16785408  7797248000     3  freebsd-zfs  (3.6T)
  7814033408        3727        - free -  (1.8M)

=>        34  5860533101  diskid/DISK-MK0311YHG8W4EA  GPT  (2.7T)
          34         128                           1  freebsd-boot  (64K)
         162  5860532973                           2  freebsd-zfs  (2.7T)

# zpool get version zfsroot
NAME     PROPERTY  VALUE    SOURCE
zfsroot  version   28       local

# camcontrol devlist
<ST380215A 3.AAD>                  at scbus0 target 0 lun 0 (ada0,pass0)
<ST4000DM000-1F2168 CC52>          at scbus4 target 0 lun 0 (ada1,pass1)
<Hitachi HDS723030ALA640 MKAOA580>  at scbus5 target 0 lun 0 (ada2,pass2)

# uname -a
FreeBSD witchdoctor.hq.norma.perm.ru 10.0-BETA1 FreeBSD 10.0-BETA1 #0
r257042: Fri Oct 25 10:36:18 YEKT 2013    
emz at ravenholm:/usr/obj/usr/src/sys/GENERIC  amd64

# zdb -uuu zfsroot

Uberblock:
        magic = 0000000000bab10c
        version = 28
        txg = 14319226
        guid_sum = 834775614900075866
        timestamp = 1386855032 UTC = Thu Dec 12 19:30:32 2013
        rootbp = DVA[0]=<0:1cdb997dc00:800> DVA[1]=<0:1823b8000:800>
DVA[2]=<0:8903e6de00:800> [L0 DMU objset] fletcher4 uncompressed LE
contiguous unique triple size=800L/800P birth=14319226L/14319226P
fill=1536 cksum=9d27e4420:11a5620d1142:fe973030dd097:99a2a40f6f1dcdc

# zdb
zfsroot:
    version: 28
    name: 'zfsroot'
    state: 0
    txg: 14309424
    pool_guid: 956623217810981947
    hostid: 1697066120
    hostname: 'witchdoctor.hq.norma.perm.ru'
    vdev_children: 2
    vdev_tree:
        type: 'root'
        id: 0
        guid: 956623217810981947
        children[0]:
            type: 'mirror'
            id: 0
            guid: 13487386534404888877
            whole_disk: 0
            metaslab_array: 23
            metaslab_shift: 31
            ashift: 9
            asize: 3000588042240
            is_log: 0
            children[0]:
                type: 'disk'
                id: 0
                guid: 17492019096575782489
                path: '/dev/diskid/DISK-MK0311YHG0P7KAp2'
                phys_path: '/dev/diskid/DISK-MK0311YHG0P7KAp2'
                whole_disk: 0
                not_present: 1
                DTL: 29
            children[1]:
                type: 'disk'
                id: 1
                guid: 14768018157997934015
                path: '/dev/diskid/DISK-MK0311YHG8W4EAp2'
                phys_path: '/dev/diskid/DISK-MK0311YHG8W4EAp2'
                whole_disk: 0
                DTL: 27
        children[1]:
            type: 'disk'
            id: 1
            guid: 9470960829239143386
            path: '/dev/ada0'
            phys_path: '/dev/ada0'
            whole_disk: 1
            metaslab_array: 4113
            metaslab_shift: 29
            ashift: 9
            asize: 80021553152
            is_log: 1
            create_txg: 14308146
    features_for_read:
===Cut===

Thanks.
Eugene.