zpool can't bring online disk2

[Garrett Cooper]

On Sun, Sep 23, 2012 at 11:23 AM, Jose A. Lombera <jose at lajni.com> wrote:
> Hello! all,
>
> I hope someone can help me out with this.
>
> Recently disk2 when bad, I have used
>
> Zpool offline tank hast/disk2
>
> To bring the disk offline.
> Then I replaced it.
>
>
>
> And use the command
>
> Zpool online tank hast/disk2
>
> But the disk show   REMOVE.
>
>
>
>
>
> [root at san1 /usr/home/jose]# zpool status -v
>   pool: tank
> state: DEGRADED
> status: One or more devices has been removed by the administrator.
>
>         Sufficient replicas exist for the pool to continue functioning in a
>         degraded state.
>
> action: Online the device using 'zpool online' or replace the device with
>
>         'zpool replace'.
>
> scan: resilvered 2.49M in 0h2m with 0 errors on Sat Sep 22 01:03:13 2012
> config:
>
>         NAME                      STATE     READ WRITE CKSUM
>
>         tank                      DEGRADED     0     0     0
>
>           raidz1-0                DEGRADED     0     0     0
>
>             hast/disk1            ONLINE       0     0     0
>
>             11919832608590631234  REMOVED      0     0     0  was
> /dev/hast/disk2
>
>             hast/disk3            ONLINE       0     0     0
>
>             hast/disk4            ONLINE       0     0     0
>
>             hast/disk5            ONLINE       0     0     0
>
>             hast/disk6            ONLINE       0     0     0
>
>             hast/disk7            ONLINE       0     0     0
>
>             hast/disk8            ONLINE       0     0     0
>
>             hast/disk9            ONLINE       0     0     0
>
>             hast/disk10           ONLINE       0     0     0
>
> [root at san1 /usr/home/jose]# zpool online tank hast/disk2
>
> warning: device 'hast/disk2' onlined, but remains in faulted state
>
> use 'zpool replace' to replace devices that are no longer present
>
> [root at san1 /usr/home/jose]#
>
> I can't bring it back online.
>
> Can you guys help me out what to do.
>
> This is a production server and I can't afford to bring the server down.
>
> I have already swap 3 disks and I got the same result.
>
> Thank you guys in advance.

    You forgot to call zpool replace as the last step in the process
of replacing your faulted disk:
http://docs.oracle.com/cd/E19253-01/819-5461/gbcet/index.html .
Cheers,
-Garrett