Filesystem operations slower in 13.0 than 12.2

[Christos Chatzaras]

Hello,

After finding slow filesystem operations with 13.0-BETA2 I did more tests.

All tests done with same hardware (Seagate ST4000NM0245 4TB HDD - 2 disks with RAID-1 using gmirror).

Filesystem mounted with noatime.

Command used:

/usr/bin/time -l portsnap extract

but similar differences I see with "/usr/bin/time -l rm -fr /usr/ports"

----------

FreeBSD 12.2p4 

       98.18 real        35.31 user        59.31 sys
     49064  maximum resident set size
        21  average shared memory size
         3  average unshared data size
        86  average unshared stack size
  11821398  page reclaims
         0  page faults
         0  swaps
        29  block input operations
      2783  block output operations
         0  messages sent
         0  messages received
         0  signals received
    354648  voluntary context switches
       322  involuntary context switches

----------

FreeBSD 13.0-BETA2 (2021-02-12)

      497.88 real        76.06 user       120.03 sys
     49032  maximum resident set size
        22  average shared memory size
         3  average unshared data size
        91  average unshared stack size
  12288156  page reclaims
        23  page faults
         0  swaps
     29890  block input operations
    621229  block output operations
      4412  messages sent
   2536379  messages received
         0  signals received
   1004790  voluntary context switches
       251  involuntary context switches

--------------

FreeBSD 13.0-BETA4 (2021-02-26)

      163.81 real        71.93 user       107.32 sys
     49032  maximum resident set size
        21  average shared memory size
         3  average unshared data size
        89  average unshared stack size
  12288156  page reclaims
         5  page faults
         0  swaps
       716  block input operations
       868  block output operations
      4412  messages sent
   2536379  messages received
         0  signals received
    355244  voluntary context switches
       277  involuntary context switches

----------

FreeBSD 14-CURRENT (2021-03-04)

      255.43 real        74.94 user       148.90 sys
     49032  maximum resident set size
        23  average shared memory size
         3  average unshared data size
        96  average unshared stack size
  12288156  page reclaims
        23  page faults
         0  swaps
     31207  block input operations
       175  block output operations
      4412  messages sent
   2536379  messages received
         0  signals received
    385527  voluntary context switches
       369  involuntary context switches

----------

Differences between 13.0 and 14-CURRENT maybe related to debugging features.

But 13.0-BETA4 is slower than 12.2. Does someone have more information about this?