NVMe (U.2) hot-swap support status?

Hello all,

I'm not sure where to go with questions these days, most of the mail archives look pretty quiet and I didn't see one focused on storage (maybe -scsi?). The forums seem active enough, but maybe more home user focused?

Anyhow, we're trying purchase a few servers (likely this Supermicro: https://www.supermicro.com/en/products/system/UP/1U/SYS-111E-WR) and since manufacturers don't seem to validate for FreeBSD these days, I was hoping for some community input.

Last time I looked into this NVMe (specifically the "U.2" format for servers that includes hot swap) was supported in FreeBSD but hot swap was kind of iffy. I don't think too many FreeBSD users/developers at that time had the hardware, most people seemed to just be using an on-board NVMe drive on desktop or laptop systems, and there's not any real call for hot swap in that segment.

I have a thread on the forums linked below, but really what I'm looking to find is some larger orgs that are running NVMe drives and can confirm hot swap works as expected, if there's any gotchas to be on the lookout for, etc. Trying not to overcomplicate it, but we don't want to be stuck with a bunch of servers that might be less stable than our current SAS/SATA servers. We exclusively use ZFS, if that's useful info.

Let me know if there's another list I should be bringing this too, it's been a long time since I posted to a FreeBSD list.

Thanks!

Charles

https://forums.freebsd.org/threads/server-u-2-nvme-hot-swap-support-status.97588/