Re: {* 05.00 *}Re: Re: Desperate with 870 QVO and ZFS

From: <egoitz_at_ramattack.net>
Date: Thu, 07 Apr 2022 13:53:06 UTC
Hi Stefan, 

Thanks a lot again, mate. Answering below in bold blue...

El 2022-04-07 09:59, Stefan Esser escribió:

> I have not compared dovecot's zlib compression with zstd-2 on the file system,
> but since I use the latter on all my ZFS file systems (excepts those that
> exclusively hold compressed files and media), I'm using it for Dovecot mdbox
> files, too. I get a compression ratio of 2,29 with ZFS zstd-2, maybe I should
> copy the files over into a zlib compressed mdbox for comparison ... 
> 
> WE ARE RUNNING CYRUS HERE... ALTHOUGH THAT CHECK SOUNDS INTERESTING...
> 
> One large advantage of the mdbox format in the context of the mail server
> set-up at the start of this thread is that deletions are only registered in
> an index file (while mbox needs a rewrite of potentially large parts of the
> mail folder and mdir immediately deletes files (TRIM) and updates inodes and
> directory entries, causing multiple writes per deleted message). 
> 
> I SEE... REALLY SAID... I LOVE CYRUS... IT'S REPLICATION IS EXTREMELY RELIABLE... 
> 
> SOME TIME NOW... DOVECOT DIDN'T HAD REPLICATION... AND WE HAVE SOME DEVELOPMENTS DONE FROM SOME TIME NOW FOR CYRUS IMAP... 
> 
> BUT GOOD TO KNOW TO ABOUT OTHER SOFTWARE'S ADVANTAGES...
> 
> With mdbox you can delay all "expensive" file system operations to the
> point of least load each day, for example. Such a compression run is also
> well suited for SSDs, since it does not perform random updates that punch
> holes in a large number of erase blocks (which then will need to be garbage
> collected, causing write amplification to put further load and stress on
> the SSD). 
> 
> WE DON'T DELETE MAIL DURING DAY HOURS. WE USE A FEATURE OF CYRUS CALLED EXPUNGE DELAYED. THE DELETED EMAIL IS DELETED FROM DISK AT 04AM (UNTIL THAT MOMENT IS JUST TAGGED AS DELETED IN A CYRUS DATABASE). THE EXCEPTION HAPPENS WHEN YOU RENAME A FOLDER OR DELETE AN ENTIRE FOLDER. IF YOU DELETE AN ENTIRE FOLDER, I THINK IT GETS COPIED TO A DELETED/..WHATEVER.. FOLDER AND THEN YES... IT COPIES AND LATER DELETES... 
> 
> APART FROM THAT, CYRUS DOES A LOT OF DATABASE CHECKPOINTING, CAUSING DATABASES TO BE COPIED TO A NEW CREATED ONE AND THE OLD ONE TO BE DELETED. THIS ARE THE ONLY REMOVALS WE DO DURING DAY TIME. THE REST IS DONE FROM 04AM TO 05AM, WHEN THERE'S NO LOAD. 
> 
> CHEERS!!!