ZFS stalled after some mirror disks were lost

[Steven Hartland]

I'm guessing that the devices haven't disconnected cleanly so are just 
stalling all requests to them and hence the pool.

I'm not that familiar with iscsi, does it still show under under 
camcontrol or geom?

Does iscsid have any options on how to treat failed devices?

On 02/10/2017 19:28, Ben RUBSON wrote:
> Before disconnecting the targets the pool was online without any issue.
>
>> On 02 Oct 2017, at 20:17, Ben RUBSON <ben.rubson at gmail.com> wrote:
>>
>> Unfortunately the command stalls / does not return :/
>>
>>> On 02 Oct 2017, at 20:15, Steven Hartland <killing at multiplay.co.uk> wrote:
>>>
>>> What does zpool status report when you have disconnected the iscsi targets?
>>>
>>> On 02/10/2017 19:12, Ben RUBSON wrote:
>>>> Hi,
>>>>
>>>> On a FreeBSD 11 server, the following online/healthy zpool :
>>>>
>>>> home
>>>>   mirror-0
>>>>     label/local1
>>>>     label/local2
>>>>     label/iscsi1
>>>>     label/iscsi2
>>>>   mirror-1
>>>>     label/local3
>>>>     label/local4
>>>>     label/iscsi3
>>>>     label/iscsi4
>>>> cache
>>>>   label/local5
>>>>   label/local6
>>>>
>>>> A sustained read throughput of 180 MB/s, 45 MB/s on each iscsi disk
>>>> according to "zpool iostat", nothing on local disks (strange but I
>>>> noticed that IOs always prefer iscsi disks to local disks).
>>>> No write IOs.
>>>>
>>>> Let's disconnect all iSCSI disks :
>>>> iscsictl -Ra
>>>>
>>>> Expected behavior :
>>>> IO activity flawlessly continue on local disks.
>>>>
>>>> What happened :
>>>> All IOs stalled, server only answers to IOs are made to its zroot pool.
>>>> All commands related to the iSCSI disks (iscsictl), or to ZFS (zfs/zpool),
>>>> don't return.
>>>>
>>>> Questions :
>>>> Why this behavior ?
>>>> How to know what happens ? (/var/log/messages says almost nothing)
>>>>
>>>> I already disconnected the iSCSI disks without any issue in the past,
>>>> several times, but there were almost no IOs running.
>>>>
>>>> Thank you for your help !
>>>>
>>>> Ben
>>>>
>>>> _______________________________________________
>>>> freebsd-fs at freebsd.org mailing list
>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs
>>>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
>>> _______________________________________________
>>> freebsd-fs at freebsd.org mailing list
>>> https://lists.freebsd.org/mailman/listinfo/freebsd-fs
>>> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"
> _______________________________________________
> freebsd-fs at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe at freebsd.org"