multipath device never failing - loops over providers instead

[John]

Hi Folks,

   Running 10.3-STABLE  r308246 from Nov 3, 2016

   I thought I saw a commit in this area a while back but I
cannot seem to find it nor is google helping..

   I have SAS drives behind 2 multiplexers (4 paths total) which
are all configured similar to the following:

# gmultipath status Z76
         Name   Status  Components
multipath/Z76  OPTIMAL  da92 (ACTIVE)
                        da236 (PASSIVE)
                        da428 (PASSIVE)
                        da572 (PASSIVE)

   For each path on the components above, the following sequence occurs:

kernel: (da92:mpr0:0:399:0): READ(10). CDB: 28 00 0b a7 20 c0 00 00 10 00 
kernel: (da92:mpr0:0:399:0): CAM status: SCSI Status Error
kernel: (da92:mpr0:0:399:0): SCSI status: Check Condition
kernel: (da92:mpr0:0:399:0): SCSI sense: HARDWARE FAILURE asc:32,0 (No defect spare location available)
kernel: (da92:mpr0:0:399:0): Info: 0xba720c0
kernel: (da92:mpr0:0:399:0): Field Replaceable Unit: 157
kernel: (da92:mpr0:0:399:0): Command Specific Info: 0x80010000
kernel: (da92:mpr0:0:399:0): Actual Retry Count: 255
kernel: (da92:mpr0:0:399:0): Retrying command (per sense data)

   After each path has failed, the following is seen:

kernel: GEOM_MULTIPATH: Error 5, da92 in Z76 marked FAIL
kernel: GEOM_MULTIPATH: all paths in Z76 were marked FAIL, restore da572
kernel: GEOM_MULTIPATH: all paths in Z76 were marked FAIL, restore da428
kernel: GEOM_MULTIPATH: all paths in Z76 were marked FAIL, restore da236
kernel: GEOM_MULTIPATH: da572 is now active path in Z76

   and the entire failure loop occurs again. The multipath device
itself is never failed (so the zfs pool can never go into degraded mode,
the faulty drive replaced with a spare, etc).

   Once I pulled the drive the multipath device Z76 fails and
things sent as expected.

   It seems g_multipath_fault() in this instance should just fail the device.

   Does anyone have any pointers on this issue?

Thanks,
John

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 585 bytes
Desc: not available
URL: <http://lists.freebsd.org/pipermail/freebsd-scsi/attachments/20170211/cf3fbdd1/attachment.sig>