From nobody Mon Sep 11 08:13:18 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkfcJ44kcz4sxHb for ; Mon, 11 Sep 2023 08:13:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-54.consmr.mail.gq1.yahoo.com (sonic308-54.consmr.mail.gq1.yahoo.com [98.137.68.30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkfcH1B5tz3T7s for ; Mon, 11 Sep 2023 08:13:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=W4KrNCQg; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.30 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694420013; bh=SNmkxddGzS2bg40R6camNqdjv0a7N9GV4mPeRzeNHA0=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=W4KrNCQgKC/D5ey3Z6nn7AOQ/IKuMBkPoB4i+iuXTknmTAMGiqQ490VId5LaP+XNE4gze6ku8QTqBkVHjCChOAlfhhHz3UvQjq7PBVC4Q1x1U5zvZbGnp1XT/i7d95BY2atlkeDTffKpE0COmjLeu7dDTe3AFBkaB8WAFP5ckC9tLUgGza+fFBgl6/tzyXrCXnSXKALzdoY8/GUBR/n1PM01rOuy0/nL+TtSl6wgBgpM/AEl9w6jgvuMLMfMqYrstNzIKY+kxVntHJ4IvZkSO3eaSG+gRdzIjTZhcdsxM4DddWUdIgclYXuTPA7oOAhO7JX0vlqdCvP1IfKoWmfwJw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694420013; bh=CZxrPZTyTRKnnWjm+86t/xiw9eZU3Jeg86R4pdbBYGI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=dwj+Y6aVBgqdiHxzllJf4FZiHjLd/K8UROH86C1LIL9Dvev/umsMB5gg13Wuo1vh4UiZEk7VeRaaXZuObwtXGos22H/riLHUuccnkyzT2VP2C7LF6uK2iQDAQbmDDcHr+0YHLEdeFnmf7FLjZ6hR6Bz5l7CS6bl1j30pCiXXFqi/3uDSLpY3wmAJpM49o8g0GkEIcikaKPDNIKAWkNlLn2A6UtCazeaslcUdmA6l9ma+NCWslZxtkbvRZuFOUmBUFSlz9rm3p/C3CcHl2utyfi9SSuzTMyLHb4fIs93Dr846U97Skw3qy5tj9DH+jYjis6jGDt9XTeCcrr3t/6IfWA== X-YMail-OSG: mW9JKFIVM1kkkkTDTP51trPHld0tF2826Jo1YgjPHLNgw9bAhjvFWR0suo6f7x7 CUno5S2Kkch0QrNEUH9b.CmD6jq3LdeZE8zicSUANGORclxqeMcW_WB1WJLkxg6igoGn2RSw_7Te ihUgom0ITaoGJ6iUnD8lCAMOxPWTuiQLv_aUz5LkbVlHyAa9AWTh.Nkbd0GuDJOM8QUxxif0rMJF QvVJZV6g_O97fCmjTu_8s0EIcU2XvNV_NKo.a7MRROraUKcrhWqxfhe_IMFy2V1ktEKwLCgjZM9C w4poFp3l3A.WtYxpp1leoHxVMZhMzuQycGX3sRlWIqabBzHaccx8wSZrlEauo0bmGpdmh3zoZrm. 3obgB1w39JCNmM.7cw5OS0vaOwpvKipD309C20UvBTJX13aF8u045v3Q66dZ2iZlXFq2BwyGc_zW QZKDSQfCgqMNxkKQlJgqDA4GXbpZoISkbiV3.qm3dd6GbWHB7qNOEFZHTbyDf2lW_y6HP3_Ybagb _r9xw1Wo7UsGfBulPqG06dys4DQqrP4lUVywrgxs9lw7CxADe7bMEJhgigxpVXsWbLJIyyqkZzim i_EfgYkXJTzHEszslAjyTNQdkPT3lk58rjFSTEJKajhEsZ_GTbuNdB3swRRH.NUBMg_Q5LowF77E Y4XiDYOB2PJmmGWNViX.hz87KIu3lLMZS_3hR5ByEwNKe10T_2WTPy9KpRUorWkVP9RiYf3cd8jV 0Z5a4YQb_SSTzQywfuFBEAaGPjSZPfA5.v95C8t_x2NuZXpe_jAruIxsx95VTQTwq4ToTz4a32KC dA3ktT3c2d4Z.Mvyef0d8xukWQcqMLDelm1swC7URrDSnYQprvFPco.UqigxRgJZ6OKrbkg4QYAU 0Ve6tlonhAnqQp01entLNyGahK7lHpelRN6UxL466ulmGMGy7eI8tXP7dCoT5ZuVmMBINNSyaBu5 XcbhQj4_0b1cKSEg1YHOMx41jekAi.7PZnA5pTLD1r3KlVb65gnaEseSsKYMxrZd8sHAQhCe_4qo rtfR_cDWugUIXm.lozoSggkK5mIy4ruRHYwbbS8XmFy3InqFqsf4lGnng0lJYy.bzRqzh_.mxi.0 2SVWirDFhIef32ICOv51MrCVRiMppVrpl26OK0zmvYAKuYEVhF_yGe5nyYRwh4DHgIPi3UcYo91Q blsEqrXXKkJapMhdYgB7VeO3h02_eeNn6HD5CfdDtFefWX_xk_zHh7sCouqUfr0hHIQGOPnFcSP. kf.uq9XupHjMCThgXE6nBsigklZOJ.bbcOPB3i7c6eA_WYFQjvR7FdXg7.apaJnG36KqgnkL1vsc 6QCzwiopVebJZPoEsL0dtJCdCCUmL4dz1jK9eSLbzhPlPtOQNl3WwT9VhZNNHfRKqX83qdWOz.9v 1T7KiCNz4YcC3En6PRvikF8rb4tP_VOKc2ADogMzeKxKKSzDZCcX1qILHCz5u1CAxaa84x9q19al ilteopqJSkgC.JJvdqb2Y2uHus4.NkQbc4gVrPhd7uVO1TX2.SAthwJbgjTmZowIx80RhUasHm2k EeUfMNGtzqHo0qDSIdEXGJvXx6WiwlJJ9ClYNKSk8cR4uR2R5uV1mrUWhPM4o.w_r.VEU_8Vqf56 Vz4B9zwWJLxx3_GkiVNQM9Z3KkQU7jxeh9F2isA9cpkPPApgTrd1rTbEf0H4Uix25PrvIWb6_gpq RM.fG.J5CQn4axh_JDp06q2dlciKoR2wfG_REYc0W7X9fGV8CuK_0GtWQDmzomsGLRK1h6RTgqzR KTZIiDiT5YgGYGIA3pKNbBSnkbHkLFqv4aVcp1YaEZ7_Re24q0f3_isW_MxMQpnPW_4GJnmBPRLb g0bPignjhZ9G0_ZCyHF1HE_oQ5DEulRpNNZW609Asc8wZkM0HhfTdxNv_BF0gGSnsIm7oh3105Ou gAZHZqmtO9hr0dy6sZdky2sLfi41th_fdzTcXpCYTSrIG9BDqsOIUo0yybTTnK9BU7xQma.uiK1z zyHsBoFXNzalUyBP8OagAylkBIcAkn4lp92av.yHXB.LkoTbVx0tOjIxtLV3bMooG9Pi._UHcRip dBnZDJBx0XLgV6hxxAz3pHXFLOO8EFypjRvqozWlPsNJF8XW._nYfa4q3jwp.83.Yzi0o38WYiO6 YrDLLKtgjRsTR9T8bvg6zXI0U6nue_QSdT3.bcCvwVOSIKHY1YSouIvmJw0bu4jQK7HDlm.XZ1xd kvY3JDgLZU4kxOHkdyl8Mx9utLIUVsk1dk4MCIt2ls6Zz28G.MNDVUZa0STypl8U7LRV212uBJm6 QQmcP X-Sonic-MF: X-Sonic-ID: 841a8442-cc5b-407c-8e0b-638279886f0e Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 08:13:33 +0000 Received: by hermes--production-gq1-6b7c87dcf5-j6k2s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID cf3d50cc1a683e5ae488cebcca2597d6; Mon, 11 Sep 2023 08:13:29 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: aarch64 main [so: 15] panic's in kyua's sys/net/if_lagg_test:status_stress Message-Id: <318444EA-B18D-4A6B-8D74-2A4276E366A8@yahoo.com> Date: Mon, 11 Sep 2023 01:13:18 -0700 Cc: freebsd-arm To: Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <318444EA-B18D-4A6B-8D74-2A4276E366A8.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.22 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.72)[-0.721]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.30:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkfcH1B5tz3T7s It will be some time before I can try this with an official snapshot instead of a personal build. The build is based on b6ce41118bb1 : # uname -apKU FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #17 main-n265279-b6ce41118bb1-dirty: Sun Sep 10 14:36:47 PDT = 2023 = root@CA78C-WDK23-ZFS:/usr/obj/BUILDs/main-CA78C-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA78C arm64 aarch64 1500000 1500000 So it was a non-debug build, although I do not strip symbols and such in my builds. . . . sys/net/if_lagg_test:create -> passed [0.105s] sys/net/if_lagg_test:create_destroy_stress -> skipped: Skipping this = test because it easily panics the machine [0.019s] sys/net/if_lagg_test:lacp_linkstate_destroy_stress -> passed = [60.045s] sys/net/if_lagg_test:set_ether -> passed [0.066s] sys/net/if_lagg_test:status_stress -> =20 The core.txt.5 is not great, unfortunately: panic: vm_fault failed: 0xffff0000006b96dc error 1 GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] . . . Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: (dump_iface + 0x2c0) elr: 0xffff0000006b96dc (dump_sa + 0x1c) spsr: 0x0000000000400045 far: 0x44572d4338374144 esr: 0x0000000096000004 panic: vm_fault failed: 0xffff0000006b96dc error 1 cpuid =3D 2 time =3D 1694414226 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x1a0 panic() at panic+0x44 data_abort() at data_abort+0x304 handle_el1h_sync() at handle_el1h_sync+0x14 --- exception, esr 0x96000004 dump_sa() at dump_sa+0x1c dump_iface() at dump_iface+0x2bc dump_cb() at dump_cb+0x18 if_foreach_sleep() at if_foreach_sleep+0x244 rtnl_handle_getlink() at rtnl_handle_getlink+0xec rtnl_handle_message() at rtnl_handle_message+0x19c nl_taskqueue_handler() at nl_taskqueue_handler+0x674 taskqueue_run_locked() at taskqueue_run_locked+0x194 taskqueue_thread_loop() at taskqueue_thread_loop+0xcc fork_exit() at fork_exit+0x88 fork_trampoline() at fork_trampoline+0x14 KDB: enter: panic get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); (kgdb) #0 get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 #1 doadump (textdump=3D0, textdump@entry=3D4003518992) at /usr/main-src/sys/kern/kern_shutdown.c:405 #2 0xffff0000000f7704 in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) at /usr/main-src/sys/ddb/db_command.c:591 #3 0xffff0000000f74e0 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) at /usr/main-src/sys/ddb/db_command.c:504 #4 0xffff0000000f71b8 in db_command_loop () at /usr/main-src/sys/ddb/db_command.c:551 #5 0xffff0000000fad9c in db_trap (type=3D, = code=3D) at /usr/main-src/sys/ddb/db_main.c:268 #6 0xffff0000004f4ec4 in kdb_trap (type=3D60, code=3D0, tf=3D) at /usr/main-src/sys/kern/subr_kdb.c:790 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 Backtrace stopped: Cannot access memory at address 0x10 (kgdb)=20 So some transcribing of a picture in order to show register values that were reported: Fatal data abort: x0: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) x1: 0x0000000000000001 x2: 0x44572d4338374143 x3: 0xffff0000005d3f90 (ifdead_ioctl + 0x0) x4: 0xffffa00b7f0d185e x5: 0xffffa0023fe4b992 x6: 0x000000006767616c x7: 0x00706174016f7575 x8: 0x00000000000001a4 x9: 0x0000000000210005 x10: 0=C3=970000000000000800 x11: 0xfefefefefefefeff x12: 0x0000000000000008 x13: 0x0000000000000000 x14: 0x00000000000000ff x15: 0x0000000000000700 x16: 0x0000000000000008 x17: 0x0000000000000007 x18: 0xffff0001eea0e500 (_DYNAMIC + 0x6d816358) x19: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) x=EF=BB=BF20: 0xffffa00b7f0d1800 x21: 0xffffa00b7f0d1858 x22: 0x000000000000000c x23: 0X0000000000000005 x24: 0=C3=970000000000000000 x25: 0xffff000000c68000 (sysctl___kern_features_netlink + 0x10) x26: 0x0000000000000000 x27: 0xffff000000ce9000 (cap_linkat_source_rights + 0x8) x28: 0xffff0000006bb0a0 (dump_cb + 0x0) x29: 0xffff0001eea0e520 (_DYNAMIC + 0x6d816378) sp: 0xffff0001eea0e500 lr: 0xffff0000006b8fe0 (dump_iface + 0x2c0) elr: 0xffff0000006b96dc (dump_sa + 0x1c) spsr: 0x0000000000400045 far: 0x44572d4338374144 esr: 0x0000000096000004 panic: m_fault failed: 0xffff0000006b96dc error 1 I expect that this is similar to reports I'd made back in 14.0-CURRENT days. As I remember, snapshot builds of the time also got the panic. I will note that an earlier 14.0-BETA1 snapshot kernel test run did not panic at this point in the sequence (or at any point). But I do not know how repeatable the panics are in the various contexts. I'll note that I've tried to have the various ports installed (poudriere built) that are listed at: = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 (The ones that build for aarch64, anyway.) I had in /etc/kyua/kyua.conf : test_suites.FreeBSD.disks =3D '/dev/md0 /dev/md1 /dev/md2 /dev/md3 = /dev/md4 /dev/md5' and used: # more ~/prekyua-aarch64-mdconfig.sh=20 #! /bin/sh truncate -s 4g /var/tmp/for-md0.dat truncate -s 4g /var/tmp/for-md1.dat truncate -s 4g /var/tmp/for-md2.dat truncate -s 4g /var/tmp/for-md3.dat truncate -s 4g /var/tmp/for-md4.dat truncate -s 4g /var/tmp/for-md5.dat mdconfig -f /var/tmp/for-md0.dat -u md0 mdconfig -f /var/tmp/for-md1.dat -u md1 mdconfig -f /var/tmp/for-md2.dat -u md2 mdconfig -f /var/tmp/for-md3.dat -u md3 mdconfig -f /var/tmp/for-md4.dat -u md4 mdconfig -f /var/tmp/for-md5.dat -u md5 I also did a: # kldload linux64 before doing: # /usr/bin/kyua test -k /usr/tests/Kyuafile (Not true of linux64.ko in 14.0-CURRENT days.) =3D=3D=3D Mark Millard marklmi at yahoo.com