From nobody Fri Feb 17 01:00:33 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PHtls2RB7z3r8cV for ; Fri, 17 Feb 2023 01:00:41 +0000 (UTC) (envelope-from artem@artem.ru) Received: from fallback16.mail.ru (fallback16.mail.ru [94.100.177.128]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PHtlq68phz4VTp for ; Fri, 17 Feb 2023 01:00:39 +0000 (UTC) (envelope-from artem@artem.ru) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mail.ru header.s=mail4 header.b=UZvO6jvE; dkim=pass header.d=mail.ru header.s=mail4 header.b=q8TKjEgE; spf=none (mx1.freebsd.org: domain of artem@artem.ru has no SPF policy when checking 94.100.177.128) smtp.mailfrom=artem@artem.ru; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=mail.ru; s=mail4; h=Content-Transfer-Encoding:Content-Type:To:Subject:From:MIME-Version:Date:Message-ID:From:Subject:Content-Type:Content-Transfer-Encoding:To:Cc; bh=jyRtFrVLaPwdmLb+3CoTxk+Gw0q+aK0ZG8qUmTAoyBs=; t=1676595639;x=1676685639; b=UZvO6jvE2pajqPijrsZhey4eZX7OZq3EXaoBsHzHmam1TTQCiK/r7SkKhIlieN2S7KdjhDtdWuLV1K4JG2GWocFzXx9aUxYZjrEtTMQJmd5hWmD0R9bg/ezOil9315oBmy76sRA7oew0EnuCsYQxeBU3fZocPlbUMalYIvR7QGOkdmAPDaCqzrL+NW3aiZJ4yiDTw1gQr4fVGT0qI0jXpQqOmWg5zbSKik6liJbPE7mXWv4AHzMFZuc5K4na/wmn6r1BchZHIoHkTK5VeDPAUGO7iGZExq/E/1R/19oURqa/BEiDBvjm+M05kXW/VD/NK50trDMqvhyGsQ4uM8GONw==; Received: from [10.12.4.16] (port=60620 helo=smtp47.i.mail.ru) by fallback16.i with esmtp (envelope-from ) id 1pSp77-0003b7-5f for freebsd-fs@FreeBSD.org; Fri, 17 Feb 2023 04:00:37 +0300 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=mail.ru; s=mail4; h=Content-Transfer-Encoding:Content-Type:To:Subject:From:MIME-Version:Date:Message-ID:From:Subject:Content-Type:Content-Transfer-Encoding:To:Cc; bh=jyRtFrVLaPwdmLb+3CoTxk+Gw0q+aK0ZG8qUmTAoyBs=; t=1676595637;x=1676685637; b=q8TKjEgExE74t/M0WTcgoW2aB7l4ooDGGIPzKNY6jFJmFahMQrGe2Vf6qSQfNYJb4Myg8nory/UcuPFixn+8fqeWsAum5XpQ6fgp3sCNoQ/GMwZimDpVHh2UW2NcnpkGoKJxBTx5DZSk+vTCPgwPLV6ylfmV60T7sR5ONO5xvCz4RIiwxYxFCDyILb69lFpERDg6w40uWnITfXgmn7LcGy4cupEPd7uBpNb7U44k8yAITwI9yqwc5yFqcNN+xewgR4AeohPqUzVsnHqTUoYz5/fifENAsSnP5LJqbAyjc8PxQW1XVilUIkkgi1pY6xyYgVAzeVITGIszarUZH/WpVg==; Received: by smtp47.i.mail.ru with esmtpa (envelope-from ) id 1pSp73-00DXWl-6C for freebsd-fs@FreeBSD.org; Fri, 17 Feb 2023 04:00:33 +0300 Message-ID: <9c512fd6-f7d4-c827-300a-e7057176c232@artem.ru> Date: Fri, 17 Feb 2023 04:00:33 +0300 List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.7.2 From: Artem Kuchin Subject: Lock order reversals (LOR) for ufs,devfs,nullfs To: freebsd-fs@FreeBSD.org Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Mailru-Src: smtp X-7564579A: 78E4E2B564C1792B X-77F55803: 4F1203BC0FB41BD9806C989EC2150E3345DC9DC7E492C5E8A0F43A05865B0FB7182A05F538085040B0991A7992CF099A6EAA345766EC4796407A6950C4B00201D7E4D12EE2579626 X-7FA49CB5: FF5795518A3D127A4AD6D5ED66289B5278DA827A17800CE7DBA72CFE7C57007CEA1F7E6F0F101C67BD4B6F7A4D31EC0BCC500DACC3FED6E28638F802B75D45FF8AA50765F7900637F0D8FAB78312C5B48638F802B75D45FF36EB9D2243A4F8B5A6FCA7DBDB1FC311F39EFFDF887939037866D6147AF826D8C47978DF4ADF9CAD7A7AEAB99020EB69117882F4460429724CE54428C33FAD305F5C1EE8F4F765FC07CB022245CAE856389733CBF5DBD5E9C8A9BA7A39EFB766F5D81C698A659EA7CC7F00164DA146DA9985D098DBDEAEC8B4B51A2BAB7FBE05117882F4460429728AD0CFFFB425014E868A13BD56FB6657D81D268191BDAD3DC09775C1D3CA48CFC6DC9FE6046F588BBA3038C0950A5D36C8A9BA7A39EFB766EC990983EF5C0329BA3038C0950A5D36D5E8D9A59859A8B6EF8BFD536A21CBFA76E601842F6C81A1F004C906525384303E02D724532EE2C3F43C7A68FF6260569E8FC8737B5C2249EC8D19AE6D49635B68655334FD4449CB9ECD01F8117BC8BEAAAE862A0553A39223F8577A6DFFEA7C289736CE4F78F08343847C11F186F3C59DAA53EE0834AAEE X-C1DE0DAB: 0D63561A33F958A5E15E754F0A1597EA5D416CDA4C8665564C21E1984037AAE14EAF44D9B582CE87C8A4C02DF684249CC203C45FEA855C8F X-C8649E89: 4E36BF7865823D7055A7F0CF078B5EC49A30900B95165D347D10A9FCB2A62DFEB49085CBDAB2DED1F48722628618376CCFB4E9BCC845F77ADC4D347618F2EF2E1D7E09C32AA3244CCDD8D37AC2927F272626CC0266A25AED95A9E0DC41E9A4CF3EB3F6AD6EA9203E X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu530nj6fImhcD4MUrOEAnl0W826KZ9Q+tr5ycPtXkTV4k65bRjmOUUP8cvGozZ33TWg5HZplvhhXbhDGzqmQDTd6OAevLeAnq3Ra9uf7zvY2zzsIhlcp/Y7m53TZgf2aB4JOg4gkr2biojohRiI5imL4+rcv0fESehFg== X-Mailru-Sender: B928727FE0CF249431584989AF455E2130BDB02C573EE0C9C334DCB61C46C7EE218F2A15E86B27930A1FD29A504278DEE66B5C1DBFD5D09D2FFF0A5F0DFA254CD0701747CC0EF98689F635B1FCB23A660D4ABDE8C577C2ED X-Mras: Ok X-7564579A: B8F34718100C35BD X-77F55803: 6242723A09DB00B48F971C29D06D6C0B4F378AFA56BA89B94CE5E36B4ED7089E049FFFDB7839CE9EEEB0D775C03ED89CFE9B6312E31B08F8D1DCFFF6459C354C8DE37A548F754D51 X-D57D3AED: 3ZO7eAau8CL7WIMRKs4sN3D3tLDjz0dLbV79QFUyzQ2Ujvy7cMT6pYYqY16iZVKkSc3dCLJ7zSJH7+u4VD18S7Vl4ZUrpaVfd2+vE6kuoey4m4VkSEu530nj6fImhcD4MUrOEAnl0W826KZ9Q+tr5xhPKz0ZEsZ5k6NOOPWz5QAiZSCXKGQRq3/7KxbCLSB2ESzQkaOXqCBFZPLWFrEGlV1shfWe2EVcxl5toh0c/aCGOghz/frdRhzMe95NxDFd4DXhU0ygpf3xKyNlqlETgQ== X-Mailru-MI: 800 X-Mras: Ok X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[mail.ru:s=mail4]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@FreeBSD.org]; R_SPF_NA(0.00)[no SPF record]; ASN(0.00)[asn:47764, ipnet:94.100.176.0/20, country:RU]; MIME_TRACE(0.00)[0:+]; RCVD_IN_DNSWL_NONE(0.00)[94.100.177.128:from]; RCVD_TLS_LAST(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[mail.ru:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[artem.ru]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[mail.ru:dkim] X-Rspamd-Queue-Id: 4PHtlq68phz4VTp X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N I see LORs on every boot and at shutdown.Is it bad? 13-STABLE Feb 17 03:55:44 omni kernel: lock order reversal: Feb 17 03:55:44 omni kernel:  1st 0xfffff8001d9f2258 ufs (ufs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:1062 Feb 17 03:55:44 omni kernel:  2nd 0xfffff8001d8309f8 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:1074 Feb 17 03:55:44 omni kernel: lock order devfs -> ufs established at: Feb 17 03:55:44 omni kernel: #0 0xffffffff80cab8cd at witness_checkorder+0x32d Feb 17 03:55:44 omni kernel: #1 0xffffffff80c0ccf2 at lockmgr_lock_flags+0x182 Feb 17 03:55:44 omni kernel: #2 0xffffffff80fa98ac at ffs_lock+0x6c Feb 17 03:55:44 omni kernel: #3 0xffffffff80d3a174 at _vn_lock+0x54 Feb 17 03:55:44 omni kernel: #4 0xffffffff80d1ccaf at vfs_domou Feb 17 03:55:44 omni kernel: nt_first+0x58f Feb 17 03:55:44 omni kernel: #5 0xffffffff80d196b4 at vfs_domount+0x2d4 Feb 17 03:55:44 omni kernel: #6 0xffffffff80d18585 at vfs_donmount+0x895 Feb 17 03:55:44 omni kernel: #7 0xffffffff80d1bcd3 at kernel_mount+0x63 Feb 17 03:55:44 omni kernel: #8 0xffffffff80d1f984 at parse_mount+0x4d4 Feb 17 03:55:44 omni kernel: 9 0xffffffff80d1dfc3 at vfs_mountroot+0x7c3 Feb 17 03:55:44 omni kernel: #10 0xffffffff80bcae03 at start_init+0x23 Feb 17 03:55:44 omni kernel: #11 0xffffffff80bf7f40 at fork_exit+0x80 Feb 17 03:55:44 omni kernel: #12 0xffffffff8110bf2e at fork_trampoline+0xe Feb 17 03:55:44 omni kernel: lock order ufs -> devfs attempted at: Feb 17 03:55:44 omni kernel: #0 0xffffffff80cac19d at witness_checkord Feb 17 03:55:44 omni kernel: er+0xbfd Feb 17 03:55:44 omni kernel: #1 0xffffffff80c0e725 at lockmgr_xlock+0x55 Feb 17 03:55:44 omni kernel: #2 0xffffffff80d3a174 at _vn_lock+0x54 Feb 17 03:55:44 omni kernel: #3 0xffffffff80d1ccaf at vfs_domou Feb 17 03:55:44 omni kernel: nt_first+0x58f Feb 17 03:55:44 omni kernel: #4 0xffffffff80d196b4 at vfs_domount+0x2d4 Feb 17 03:55:44 omni kernel: #5 0xffffffff80d18585 at vfs_donmount+0x895 Feb 17 03:55:44 omni kernel: #6 0xffffffff80d17cb9 at sys_nmount+0x69 Feb 17 03:55:44 omni kernel: #7 0xffffffff8113752e at amd64_syscall+0x12e Feb 17 03:55:44 omni kernel: #8 0xffffffff8110b7cb at fast_syscall_common+0xf8 Feb 17 03:55:50 omni kernel: lock order reversal: Feb 17 03:55:50 omni kernel:  1st 0xfffff8001dc0b810 ufs (ufs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:3043 Feb 17 03:55:50 omni kernel:  2nd 0xfffff8001dc0b628 nullfs (nullfs, lockmgr) @ /usr/src/sys/fs/nullfs/null_vnops.c:913 Feb 17 03:55:50 omni kernel:  3rd 0xfffff80003b6b810 ufs (ufs, lockmgr) @ /usr/src/sys/ufs/ufs/ufs_quota.c:1596 Feb 17 03:55:50 omni kernel: lock order ufs -> nullfs established at: Feb 17 03:55:50 omni kernel: #0 0xffffffff80cab8cd at witness_checkorder+0x32d Feb 17 03:55:50 omni kernel: #1 0xffffffff80c0d3db at lockmgr_xlock_hard+0x6b Feb 17 03:55:50 omni kernel: #2 0xffffffff80c0dcd9 at __lockmgr_args+0x1f9 Feb 17 03:55:50 omni kernel: #3 0xffffffff825abb80 at null_reclaim+0x60 Feb 17 03:55:50 omni kernel: #4 0xffffffff81208914 at VOP_RECLAIM_APV+0x34 Feb 17 03:55:50 omni kernel: #5 0xffffffff80d25f84 at vgonel+0x3b4 Feb 17 03:55:50 omni kernel: #6 0xffffffff80d2664e at vrecycle+0x3e Feb 17 03:55:50 omni kernel: #7 0xffffffff825abac0 at null_inactive+0x40 Feb 17 03:55:50 omni kernel: #8 0xffffffff80d250bf at vinactivef+0xbf Feb 17 03:55:50 omni kernel: #9 0xffffffff80d248f7 at vput_final+0x2a7 Feb 17 03:55:50 omni kernel: #10 0xffffffff80d31f05 at kern_funlinkat+0x235 Feb 17 03:55:50 omni kernel: #11 0xffffffff80d31cc8 at sys_unlink+0x28 Feb 17 03:55:50 omni kernel: #12 0xffffffff8113752e at amd64_syscall+0x12e Feb 17 03:55:50 omni kernel: #13 0xffffffff8110b7cb at fast_syscall_common+0xf8 Feb 17 03:55:50 omni kernel: lock order nullfs -> ufs attempted at: Feb 17 03:55:50 omni kernel: #0 0xffffffff80cac19d at witness_checkorder+0xbfd Feb 17 03:55:50 omni kernel: #1 0xffffffff80c0ccf2 at lockmgr_lock_flags+0x182 Feb 17 03:55:50 omni kernel: #2 0xffffffff80fa98ac at ffs_lock+0x6c Feb 17 03:55:50 omni kernel: #3 0xffffffff80d3a174 at _vn_lock+0x54 Feb 17 03:55:50 omni kernel: #4 0xffffffff80fb630a at dqsync+0x14a Feb 17 03:55:50 omni kernel: #5 0xffffffff80fb6632 at qsyncvp+0x52 Feb 17 03:55:50 omni kernel: #6 0xffffffff80fb0e2e at ufs_inactive+0x3e Feb 17 03:55:50 omni kernel: #7 0xffffffff80d250bf at vinactivef+0xbf Feb 17 03:55:50 omni kernel: #8 0xffffffff80d248f7 at vput_final+0x2a7 Feb 17 03:55:50 omni kernel: #9 0xffffffff825abc16 at null_reclaim+0xf6 Feb 17 03:55:50 omni kernel: #10 0xffffffff81208914 at VOP_RECLAIM_APV+0x34 Feb 17 03:55:50 omni kernel: #11 0xffffffff80d25f84 at vgonel+0x3b4 Feb 17 03:55:50 omni kernel: #12 0xffffffff80d2664e at vrecycle+0x3e Feb 17 03:55:50 omni kernel: #13 0xffffffff825abac0 at null_inactive+0x40 Feb 17 03:55:50 omni kernel: #14 0xffffffff80d250bf at vinactivef+0xbf Feb 17 03:55:50 omni kernel: #15 0xffffffff80d248f7 at vput_final+0x2a7 Feb 17 03:55:50 omni kernel: #16 0xffffffff80d31f05 at kern_funlinkat+0x235 Feb 17 03:55:50 omni kernel: #17 0xffffffff80d31cc8 at sys_unlink+0x28 Regards, Artem