FreeBSD-main-amd64-test - Build #20025 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Tue, 07 Dec 2021 19:35:24 UTC
FreeBSD-main-amd64-test - Build #20025 (38dbca724335fec679e79b72d91a8e36b2624fe1) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20025/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20025/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/20025/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

38dbca724335fec679e79b72d91a8e36b2624fe1 by andrew:
Teach vm.pmap.kernel_maps about both XN bits



The end of the build log:

[...truncated 3.91 MB...]
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by 240 to 240 (pfsync bulk start)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
passed  [3.523s]
sys/netpfil/pf/pfsync:defer  ->  epair124a: Ethernet address: 02:c0:b8:7a:2f:0a
epair124b: Ethernet address: 02:c0:b8:7a:2f:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:0f:44:e2:f0:0a
epair125b: Ethernet address: 02:0f:44:e2:f0:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:89:e2:8a:22:0a
epair126b: Ethernet address: 02:89:e2:8a:22:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
carp: demoted by 240 to 240 (pfsync bulk start)
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
carp: demoted by -240 to 0 (pfsync bulk done)
epair124b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: promiscuous mode enabled
epair125b: promiscuous mode enabled
epair126b: promiscuous mode enabled
epair126b: promiscuous mode disabled
epair125b: promiscuous mode disabled
epair124b: promiscuous mode disabled
epair124b: link state changed to DOWN
epair124a: link state changed to DOWN
epair125b: link state changed to DOWN
epair125a: link state changed to DOWN
epair126b: link state changed to DOWN
epair126a: link state changed to DOWN
passed  [8.681s]
sys/netpfil/pf/proxy:ftp  ->  skipped: Required program 'twistd' not found in PATH  [0.002s]
sys/netpfil/pf/rdr:basic  ->  epair124a: Ethernet address: 02:f0:13:a0:e8:0a
epair124b: Ethernet address: 02:f0:13:a0:e8:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [4.189s]
sys/netpfil/pf/ridentifier:basic  ->  epair124a: Ethernet address: 02:3c:1c:f4:cb:0a
epair124b: Ethernet address: 02:3c:1c:f4:cb:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
lo0: link state changed to UP
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
pflog0: promiscuous mode enabled
pflog0: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [5.286s]
sys/netpfil/pf/route_to:icmp_nat  ->  epair124a: Ethernet address: 02:07:44:5f:2d:0a
epair124b: Ethernet address: 02:07:44:5f:2d:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair125a: Ethernet address: 02:3c:78:46:0f:0a
epair125b: Ethernet address: 02:3c:78:46:0f:0b
epair125a: link state changed to UP
epair125b: link state changed to UP
epair126a: Ethernet address: 02:5c:dd:d1:77:0a
epair126b: Ethernet address: 02:5c:dd:d1:77:0b
epair126a: link state changed to UP
epair126b: link state changed to UP
nd6_setmtu0: new link MTU on epair126a (500) is too small for IPv6
nd6_setmtu0: new link MTU on epair126b (500) is too small for IPv6
epair124a: promiscuous mode enabled
epair124a: promiscuous mode disabled
epair124a: link state changed to DOWN
epair124b: link state changed to DOWN
passed  [12.536s]
sys/netpfil/pf/route_to:multiwan  ->  epair124a: Ethernet address: 02:cf:dd:0a:e9:0a
epair124b: Ethernet address: 02:cf:dd:0a:e9:0b
epair124a: link state changed to UP
epair124b: link state changed to UP
epair127a: Ethernet address: 02:30:82:c0:0b:0a
epair127b: Ethernet address: 02:30:82:c0:0b:0b
epair127a: link state changed to UP
epair127b: link state changed to UP
epair128a: Ethernet address: 02:3d:c0:1e:2e:0a
epair128b: Ethernet address: 02:3d:c0:1e:2e:0b
epair128a: link state changed to UP
epair128b: link state changed to UP
epair129a: Ethernet address: 02:fa:ad:d0:93:0a
epair129b: Ethernet address: 02:fa:ad:d0:93:0b
epair129a: link state changed to UP
epair129b: link state changed to UP
lo0: link state changed to UP
passed  [0.607s]
sys/netpfil/pf/route_to:multiwanlocal  ->  epair130a: Ethernet address: 02:6e:16:6b:80:0a
epair130b: Ethernet address: 02:6e:16:6b:80:0b
epair130a: link state changed to UP
epair130b: link state changed to UP
epair131a: Ethernet address: 02:74:7f:9b:51:0a
epair131b: Ethernet address: 02:74:7f:9b:51:0b
epair131a: link state changed to UP
epair131b: link state changed to UP
epair132a: Ethernet address: 02:a5:07:b1:5c:0a
epair132b: Ethernet address: 02:a5:07:b1:5c:0b
epair132a: link state changed to UP
epair132b: link state changed to UP
epair133a: Ethernet address: 02:c9:3a:49:02:0a
epair133b: Ethernet address: 02:c9:3a:49:02:0b
epair133a: link state changed to UP
epair133b: link state changed to UP
passed  [2.810s]
sys/netpfil/pf/route_to:v4  ->  epair134a: Ethernet address: 02:eb:eb:be:33:0a
epair134b: Ethernet address: 02:eb:eb:be:33:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:75:57:ec:d1:0a
epair135b: Ethernet address: 02:75:57:ec:d1:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.239s]
sys/netpfil/pf/route_to:v6  ->  epair134a: Ethernet address: 02:f1:41:e8:99:0a
epair134b: Ethernet address: 02:f1:41:e8:99:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair135a: Ethernet address: 02:5c:56:08:d6:0a
epair135b: Ethernet address: 02:5c:56:08:d6:0b
epair135a: link state changed to UP
epair135b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
epair135a: link state changed to DOWN
epair135b: link state changed to DOWN
passed  [3.201s]
sys/netpfil/pf/rules_counter:get_clear  ->  epair134a: Ethernet address: 02:b8:31:82:6f:0a
epair134b: Ethernet address: 02:b8:31:82:6f:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [2.368s]
sys/netpfil/pf/rules_counter:keepcounters  ->  epair134a: Ethernet address: 02:2d:fb:62:b8:0a
epair134b: Ethernet address: 02:2d:fb:62:b8:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [6.378s]
sys/netpfil/pf/set_skip:pr255852  ->  epair134a: Ethernet address: 02:f5:c5:4b:96:0a
epair134b: Ethernet address: 02:f5:c5:4b:96:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
lo0: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [1.235s]
sys/netpfil/pf/set_skip:set_skip_dynamic  ->  epair134a: Ethernet address: 02:87:9b:21:71:0a
epair134b: Ethernet address: 02:87:9b:21:71:0b
epair134a: link state changed to UP
epair134b: link state changed to UP
epair134a: link state changed to DOWN
epair134b: link state changed to DOWN
passed  [0.181s]
sys/netpfil/pf/set_skip:set_skip_group  ->  pid 752 (kyua), jid 0, uid 0, was killed: out of swap space
pid 679 (auditd), jid 0, uid 0, was killed: out of swap space
pid 479 (devd), jid 0, uid 0, was killed: out of swap space
pid 19528 (sh), jid 0, uid 0, was killed: out of swap space
pid 751 (sh), jid 0, uid 0, was killed: out of swap space
pid 744 (sh), jid 0, uid 0, was killed: out of swap space
pid 19549 (jail), jid 0, uid 0, was killed: out of swap space
pid 731 (sh), jid 0, uid 0, was killed: out of swap space
carp: demoted by -240 to 0 (pfsync bulk fail)
2021-12-07T19:35:16.142204+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 done
Waiting (max 60 seconds) for system thread `bufdaemon' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-0' to stop... done
Waiting (max 60 seconds) for system thread `bufspacedaemon-1' to stop... done
All buffers synced.
Uptime: 1h57m18s
pid 15 (sh), jid 0, uid 0, was killed: out of swap space
lock order reversal:
 1st 0xffffffff81f9dba0 cc_list (cc_list, rw) @ /usr/src/sys/netinet/cc/cc.c:245
 2nd 0xffffffff81f9d420 vnet_rwlock (vnet_rwlock, rw) @ /usr/src/sys/netinet/cc/cc.c:208
lock order cc_list -> vnet_rwlock attempted at:
#0 0xffffffff80c6e59d at witness_checkorder+0xbdd
#1 0xffffffff80bf9142 at __rw_rlock_int+0x82
#2 0xffffffff80dd3913 at cc_deregister_algo+0x113
#3 0xffffffff80dd3eca at cc_modevent+0x1a
#4 0xffffffff80bd8f3b at module_shutdown+0x6b
#5 0xffffffff80bfddfe at kern_reboot+0x4de
#6 0xffffffff80bfd8c8 at sys_reboot+0x3a8
#7 0xffffffff810bdc94 at amd64_syscall+0x6b4
#8 0xffffffff8108ed2b at fast_syscall_common+0xf8
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20025' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./disable-notyet-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins4101245592831081983.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '38dbca724335fec679e79b72d91a8e36b2624fe1', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../38dbca724335fec679e79b72d91a8e36b2624fe1/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address