From nobody Fri Mar 04 16:10:50 2022 X-Original-To: dev-commits-src-branches@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 2D2C719E28E6; Fri, 4 Mar 2022 16:10:51 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4K9CWb0P7lz3rBS; Fri, 4 Mar 2022 16:10:51 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646410251; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=hSsGREU3W7AcaY2YlobX/kKSNAqWm+1d4BZb3pFywJk=; b=umdU2uWJvtAuUdKdG2aTVDnrrOAxmSpPKGnku48Jg0BcEgqbP9KsuMWlU+L9v4ZVQcxxMC esNWe4aK/tPMdXePPBa0dBm5WcQShqfo7HgtoEmEWVeicKw4pgMDOd2+JmsgSipnmMsG57 3ujRRVEY5w4Is+aiQegj2i8wWmichbGImYPDx4iYJ/jeqJjCsa//3/uM/1RDAC6kc5dXmW QdvA5xXHVzQbrOBTMO8lwk553PJIrrPmaZ7YG0Mf1CrnpAr9j0Ep7Nf5lszs+ffQ/OLzwZ jImxCTpM3tvqUGqw2zEMjEbbCLDKw0U2jb6AJ3f5urcrVg8fOK3nW4IxkCEnKQ== Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E17AE70EA; Fri, 4 Mar 2022 16:10:50 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from gitrepo.freebsd.org ([127.0.1.44]) by gitrepo.freebsd.org (8.16.1/8.16.1) with ESMTP id 224GAoAX082943; Fri, 4 Mar 2022 16:10:50 GMT (envelope-from git@gitrepo.freebsd.org) Received: (from git@localhost) by gitrepo.freebsd.org (8.16.1/8.16.1/Submit) id 224GAoR3082941; Fri, 4 Mar 2022 16:10:50 GMT (envelope-from git) Date: Fri, 4 Mar 2022 16:10:50 GMT Message-Id: <202203041610.224GAoR3082941@gitrepo.freebsd.org> To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, dev-commits-src-branches@FreeBSD.org From: Rick Macklem Subject: git: 69b2217cde24 - stable/13 - nfscl: Fix a use after free in nfscl_cleanupkext() List-Id: Commits to the stable branches of the FreeBSD src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-branches List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-branches@freebsd.org X-BeenThere: dev-commits-src-branches@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: rmacklem X-Git-Repository: src X-Git-Refname: refs/heads/stable/13 X-Git-Reftype: branch X-Git-Commit: 69b2217cde24b3691f4cea14682baa75f48225ea Auto-Submitted: auto-generated ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1646410251; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=hSsGREU3W7AcaY2YlobX/kKSNAqWm+1d4BZb3pFywJk=; b=NCMzOdHLu45jd1lcRnb+fAJCnO33ZF5klZmIywzPy1OtF/AYZ/oKCTtCPF3sVpGbUUwJOZ NQVbrTOdQcc31gXm25DhK8qkHRmdnzMVWrNpFxYUaLRRFSRG8sue12YJyIznMAToBIz+1O //JeshI/nuR5Mk72/6h/mY2GOepbE3H/qRoMbsF9pgsGTEOUS40vmju7kWLTRCCaFbSg4k ti5ZoTw9GXAikbopM093BITTTOyIo6UK7ecVZF5iveRzHLAVwMkEZTDjDUcdLnSQIk0dnc K0UVADjT74ccJbmUZBUrXsKnqCrTjNN53fsgKAlLiNvNEqGx7OxizjPD30MYBQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1646410251; a=rsa-sha256; cv=none; b=mylGoy00yzHVn7OrJB1lTgu7M7/JrmTwZevC7oLt8j4+LFd0SASgg+7ckEYTqppndh5gfH SDvn0ymIlm21LZT9OdneM8nLwO7yXy4so44DUAw/1PdQNpDCnmAJafFjC2AXLvTX+byo8t m7Yz+3c/PSuY2Z0EXFvMtIbLRNT1XeVqV2ZKVyQdCvyER4k7em0V8dVjaJWWCuA5Bqfh3Z UoGTEvbnWEFOZIIm1B9sDL62zJZOKKR2N29VgpQbg+gjRlD84NmsIsD42TKfX0zwLvVJoY vT/6yTbjW8IxkuIHn+jB8hpIYoFtkyJHpIwLpeNXmIGz8E293HzOdpCqXTb1Sw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N The branch stable/13 has been updated by rmacklem: URL: https://cgit.FreeBSD.org/src/commit/?id=69b2217cde24b3691f4cea14682baa75f48225ea commit 69b2217cde24b3691f4cea14682baa75f48225ea Author: Rick Macklem AuthorDate: 2022-02-25 15:27:03 +0000 Commit: Rick Macklem CommitDate: 2022-03-04 16:08:36 +0000 nfscl: Fix a use after free in nfscl_cleanupkext() ler@, markj@ reported a use after free in nfscl_cleanupkext(). They also provided two possible causes: - In nfscl_cleanup_common(), "own" is the owner string owp->nfsow_owner. If we free that particular owner structure, than in subsequent comparisons "own" will point to freed memory. - nfscl_cleanup_common() can free more than one owner, so the use of LIST_FOREACH_SAFE() in nfscl_cleanupkext() is not sufficient. I also believe there is a 3rd: - If nfscl_freeopenowner() or nfscl_freelockowner() is called without the NFSCLSTATE mutex held, this could race with nfscl_cleanupkext(). This could happen when the exclusive lock is held on the client, such as when delegations are being returned or when recovering from NFSERR_EXPIRED. This patch fixes them as follows: 1 - Copy the owner string to a local variable before the nfscl_cleanup_common() call. 2 - Modify nfscl_cleanup_common() so that it will never free more than the first matching element. Normally there should only be one element in each list with a matching open/lock owner anyhow (but there might be a bug that results in a duplicate). This should guarantee that the FOREACH_SAFE loops in nfscl_cleanupkext() are adequate. 3 - Acquire the NFSCLSTATE mutex in nfscl_freeopenowner() and nfscl_freelockowner(), if it is not already held. This serializes all of these calls with the ones done in nfscl_cleanup_common(). (cherry picked from commit 1cedb4ea1a790f976ec6211c938dfaa23874b497) --- sys/fs/nfsclient/nfs_clstate.c | 48 ++++++++++++++++++++++++++++++++++++------ 1 file changed, 42 insertions(+), 6 deletions(-) diff --git a/sys/fs/nfsclient/nfs_clstate.c b/sys/fs/nfsclient/nfs_clstate.c index dc86d1fded12..a4704a04ac22 100644 --- a/sys/fs/nfsclient/nfs_clstate.c +++ b/sys/fs/nfsclient/nfs_clstate.c @@ -1644,8 +1644,22 @@ nfscl_expireopen(struct nfsclclient *clp, struct nfsclopen *op, static void nfscl_freeopenowner(struct nfsclowner *owp, int local) { + int owned; + /* + * Make sure the NFSCLSTATE mutex is held, to avoid races with + * calls in nfscl_renewthread() that do not hold a reference + * count on the nfsclclient and just the mutex. + * The mutex will not be held for calls done with the exclusive + * nfsclclient lock held, in particular, nfscl_hasexpired() + * and nfscl_recalldeleg() might do this. + */ + owned = mtx_owned(NFSCLSTATEMUTEXPTR); + if (owned == 0) + NFSLOCKCLSTATE(); LIST_REMOVE(owp, nfsow_list); + if (owned == 0) + NFSUNLOCKCLSTATE(); free(owp, M_NFSCLOWNER); if (local) nfsstatsv1.cllocalopenowners--; @@ -1660,8 +1674,22 @@ void nfscl_freelockowner(struct nfscllockowner *lp, int local) { struct nfscllock *lop, *nlop; + int owned; + /* + * Make sure the NFSCLSTATE mutex is held, to avoid races with + * calls in nfscl_renewthread() that do not hold a reference + * count on the nfsclclient and just the mutex. + * The mutex will not be held for calls done with the exclusive + * nfsclclient lock held, in particular, nfscl_hasexpired() + * and nfscl_recalldeleg() might do this. + */ + owned = mtx_owned(NFSCLSTATEMUTEXPTR); + if (owned == 0) + NFSLOCKCLSTATE(); LIST_REMOVE(lp, nfsl_list); + if (owned == 0) + NFSUNLOCKCLSTATE(); LIST_FOREACH_SAFE(lop, &lp->nfsl_lock, nfslo_list, nlop) { nfscl_freelock(lop, local); } @@ -1851,16 +1879,17 @@ static void nfscl_cleanup_common(struct nfsclclient *clp, u_int8_t *own) { struct nfsclowner *owp, *nowp; - struct nfscllockowner *lp, *nlp; + struct nfscllockowner *lp; struct nfscldeleg *dp; /* First, get rid of local locks on delegations. */ TAILQ_FOREACH(dp, &clp->nfsc_deleg, nfsdl_list) { - LIST_FOREACH_SAFE(lp, &dp->nfsdl_lock, nfsl_list, nlp) { + LIST_FOREACH(lp, &dp->nfsdl_lock, nfsl_list) { if (!NFSBCMP(lp->nfsl_owner, own, NFSV4CL_LOCKNAMELEN)) { if ((lp->nfsl_rwlock.nfslock_lock & NFSV4LOCK_WANTED)) panic("nfscllckw"); nfscl_freelockowner(lp, 1); + break; } } } @@ -1879,6 +1908,7 @@ nfscl_cleanup_common(struct nfsclclient *clp, u_int8_t *own) nfscl_freeopenowner(owp, 0); else owp->nfsow_defunct = 1; + break; } owp = nowp; } @@ -1894,6 +1924,7 @@ nfscl_cleanupkext(struct nfsclclient *clp, struct nfscllockownerfhhead *lhp) struct nfsclopen *op; struct nfscllockowner *lp, *nlp; struct nfscldeleg *dp; + uint8_t own[NFSV4CL_LOCKNAMELEN]; /* * All the pidhash locks must be acquired, since they are sx locks @@ -1910,8 +1941,10 @@ nfscl_cleanupkext(struct nfsclclient *clp, struct nfscllockownerfhhead *lhp) nfscl_emptylockowner(lp, lhp); } } - if (nfscl_procdoesntexist(owp->nfsow_owner)) - nfscl_cleanup_common(clp, owp->nfsow_owner); + if (nfscl_procdoesntexist(owp->nfsow_owner)) { + memcpy(own, owp->nfsow_owner, NFSV4CL_LOCKNAMELEN); + nfscl_cleanup_common(clp, own); + } } /* @@ -1923,8 +1956,11 @@ nfscl_cleanupkext(struct nfsclclient *clp, struct nfscllockownerfhhead *lhp) */ TAILQ_FOREACH(dp, &clp->nfsc_deleg, nfsdl_list) { LIST_FOREACH_SAFE(lp, &dp->nfsdl_lock, nfsl_list, nlp) { - if (nfscl_procdoesntexist(lp->nfsl_owner)) - nfscl_cleanup_common(clp, lp->nfsl_owner); + if (nfscl_procdoesntexist(lp->nfsl_owner)) { + memcpy(own, lp->nfsl_owner, + NFSV4CL_LOCKNAMELEN); + nfscl_cleanup_common(clp, own); + } } } NFSUNLOCKCLSTATE();