Re: WD Blue 510 SSD and strange write performance

Flash storage is complicated. I doubt there's a huge cache in them, as as it would be volatile it'd be a big no-no for synchronous writes. The OS could cache it, of course. And if you're using ZFS then all bets are off. ZFS guarantees (for POSIX) that a synchronous write goes to non volatile memory before the system call returns. However this does not mean it goes to the final location on the disk. ZFS has an intent log of stuff that needs to be sorted out sometime, but is safe for now. So with can write away, especially with highly compressible blocks, and it'll go fast enough until it gets to the point it needs to get the FS in order (you run out of ZIL).

I'm speculating about the cause of the effect in your case, but I'm not surprised you're getting an effect.

Look up Flash storage strategies and the workings of the ZIL for more information.