Hastd activemap cache flush and "request failed: FLUSH.: Operation not supported by device" messages.

[Juris Krumins]

Hi everybody.
I've recently setup two FreeBSD nodes to use them as a storage.
So I'm using hast over "MegaRAID SAS 1078" and ZFS filesystem created on
HAST resource devices from /dev/hast/*.
Everything looks good, but when I execute iozone tests, I'm constantly
getting following messages in /var/log/message:

primary node:
May 29 15:44:15 rook hastd[2313]: [mfid2] (primary) Local request failed
(Operation not supported by device): FLUSH.
May 29 15:44:15 rook hastd[2311]: [mfid0] (primary) Local request failed
(Operation not supported by device): FLUSH.
May 29 15:44:15 rook hastd[2312]: [mfid1] (primary) Local request failed
(Operation not supported by device): FLUSH.
May 29 15:44:15 rook hastd[2312]: [mfid1] (primary) Remote request
failed (Operation not supported by device): FLUSH.
May 29 15:44:15 rook hastd[2313]: [mfid2] (primary) Remote request
failed (Operation not supported by device): FLUSH.
May 29 15:44:15 rook hastd[2311]: [mfid0] (primary) Remote request
failed (Operation not supported by device): FLUSH.

secondary node:
May 29 15:43:41 rook2 hastd[2458]: [mfid1] (secondary) Request failed:
FLUSH.: Operation not supported by device.
May 29 15:43:41 rook2 hastd[2457]: [mfid0] (secondary) Request failed:
FLUSH.: Operation not supported by device.
May 29 15:43:41 rook2 hastd[2462]: [mfid2] (secondary) Request failed:
FLUSH.: Operation not supported by device.

I'v also found following topic
http://lists.freebsd.org/pipermail/freebsd-fs/2012-January/013385.html.
I've updated src, rebuild world and kernel and rebooted. I've also added
metaflush "off" options to /etc/hast.conf configuration file. But still
getting previously mentioned messages.

Can somebody point me to the right direction how to configure hastd to
throw this warning only once.

I'm using:
FreeBSD primary. 9.0-STABLE FreeBSD 9.0-STABLE #0: Tue May 29 12:53:44
EEST 2012     root at primary.:/usr/obj/usr/src/sys/GENERIC  amd64

FreeBSD secondary. 9.0-STABLE FreeBSD 9.0-STABLE #0: Tue May 29 12:53:44
EEST 2012     root at secondary.:/usr/obj/usr/src/sys/GENERIC  amd64

and hast.conf configuration from both machines:
I've decided to put metaflush option on every single level just to be
sure. No effect.

metaflush "off"
resource mfid0 {
        metaflush "off"
        on primary {
                local /dev/mfid0
                remote 10.0.0.2
                metaflush "off"
        }
        on secondary {
                local /dev/mfid0
                remote 10.0.0.1
                metaflush "off"
        }
}
resource mfid1 {
        metaflush "off"
        on primary {
                local /dev/mfid1
                remote 10.0.0.2
                metaflush "off"
        }
        on secondary {
                local /dev/mfid1
                remote 10.0.0.1
                metaflush "off"
        }
}
resource mfid2 {
        metaflush "off"
        on primary {
                local /dev/mfid2
                remote 10.0.0.2
                metaflush "off"
        }
        on secondary {
                local /dev/mfid2
                remote 10.0.0.1
                metaflush "off"
        }
}

Thank in advance.
Juris Krumins