From nobody Wed Feb 02 05:49:25 2022 X-Original-To: dev-commits-src-main@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6CA5E19AC461; Wed, 2 Feb 2022 05:49:26 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JpW8Q0qt4z4nrD; Wed, 2 Feb 2022 05:49:26 +0000 (UTC) (envelope-from git@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643780966; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=p5n84jtz9jX/A2Bf44AVJUVoPoNQHKoUQHldWu/b4U8=; b=qwl3OF6F5md6PyAMUY2dNSoucXdaxZRQlfSjc0X92WvnoJn4IYU2CjClfypOUpWzrAIlVv qId8vSho5xxBIiW1ZTWaQNcrWvBypfr3nl+WiW2Tk1j/KpL7pacv05CGorJG+lyzyIn6KZ NJpc+2y0gjh85uCiWRTsBIXDY1XSJljS5LmxY3ThJ/6VAeiwuMiKMeedJtN92qwjfmMwG4 7i9sPRyZrezLt+SAQ6mzZ4F2p5acH8utWS/A0+p2ngr252z5QSOGPo7M9OmFM/lzEGsMci +zBktgQvgezJRNedaX0pJWxvd/znkFs6l3YqP1VLfx8GrxNDALDy6aArxzdd/g== Received: from gitrepo.freebsd.org (gitrepo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id F20E11EC42; Wed, 2 Feb 2022 05:49:25 +0000 (UTC) (envelope-from git@FreeBSD.org) Received: from gitrepo.freebsd.org ([127.0.1.44]) by gitrepo.freebsd.org (8.16.1/8.16.1) with ESMTP id 2125nPxl002817; Wed, 2 Feb 2022 05:49:25 GMT (envelope-from git@gitrepo.freebsd.org) Received: (from git@localhost) by gitrepo.freebsd.org (8.16.1/8.16.1/Submit) id 2125nP5I002816; Wed, 2 Feb 2022 05:49:25 GMT (envelope-from git) Date: Wed, 2 Feb 2022 05:49:25 GMT Message-Id: <202202020549.2125nP5I002816@gitrepo.freebsd.org> To: src-committers@FreeBSD.org, dev-commits-src-all@FreeBSD.org, dev-commits-src-main@FreeBSD.org From: Wojciech Macek Subject: git: 77223d98b6f8 - main - ip_mroute: refactor epoch-basd locking List-Id: Commit messages for the main branch of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-main List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-main@freebsd.org X-BeenThere: dev-commits-src-main@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Git-Committer: wma X-Git-Repository: src X-Git-Refname: refs/heads/main X-Git-Reftype: branch X-Git-Commit: 77223d98b6f84eea73191fd28d99d5b9ec0739f7 Auto-Submitted: auto-generated ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1643780966; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=p5n84jtz9jX/A2Bf44AVJUVoPoNQHKoUQHldWu/b4U8=; b=WFospwrY46NNwhJKLjJdyyzqWRYemNV2YKYsQ5fdOSKHAMhvXWpLcWafPn4WgfXjaqJyrI pp1ke1Mk8Z8nhNX9cxZxBt1mjx9DhpvCea3AcKk9zk5xl0cMbLUCsGpNI+101iixkZTEqr I7oY5tdxW7kfdYyB2lue6Xit43AiiC6+fBJ3XDx5FyS97ErlXSAIVKsPUgwQciTzPfII2t clMw/sJDQgX5XSvuH3tn2NghpOTkeCWlf8yMXnYkAAdfkMsqwP8uuA8zPfRB/nc25npiYN 3l+sYke0tDYVTtXaOVs1aCKbTswlO1d3PxTRRjXFfV8h6jbEsHvB5XFFSXNXkQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1643780966; a=rsa-sha256; cv=none; b=x2ylKePIrFoHP74Go5HneqGiGc6Kw4Ve5YJ2MdPFs4tgeB2Enxkn5P4OZIQF+ztY2Awi9m WsAcUMru3BAaTwQmxKjyxGfzzbOIhmuIfeF7iIw2JJErrP8WCAH7oez3FwShQoazH8nZtI 8f810tCNPP/b67o40xG1/nhIq9bR2fl6Eb3/Jm5nmletfn6Kw7jSXdRofvnSGY7HY+eHjR zSBAC116s0lLCyCnv1scS19UywZNV1Dv/aOvifMLBABRxN2qGrsmiBG9/KtlwO3E5kcNoq qamczy+GuHVFA1HBTUpe6f26/joD6bDrjItJm/RcSPwa3TqpVZXa1cy2+SbomA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N The branch main has been updated by wma: URL: https://cgit.FreeBSD.org/src/commit/?id=77223d98b6f84eea73191fd28d99d5b9ec0739f7 commit 77223d98b6f84eea73191fd28d99d5b9ec0739f7 Author: Wojciech Macek AuthorDate: 2022-01-25 09:10:44 +0000 Commit: Wojciech Macek CommitDate: 2022-02-02 05:48:05 +0000 ip_mroute: refactor epoch-basd locking Remove duplicated epoch_enter and epoch_exit in IP inp/outp routines. Remove unnecessary macros as well. Obtained from: Semihalf Spponsored by: Stormshield Reviewed by: glebius Differential revision: https://reviews.freebsd.org/D34030 --- sys/netinet/ip_input.c | 6 ------ sys/netinet/ip_mroute.c | 26 ++++++++++---------------- sys/netinet/ip_mroute.h | 9 +-------- sys/netinet/ip_output.c | 5 ----- sys/netinet/raw_ip.c | 10 +++------- 5 files changed, 14 insertions(+), 42 deletions(-) diff --git a/sys/netinet/ip_input.c b/sys/netinet/ip_input.c index 8fd26e4ca861..7c365b2e51b8 100644 --- a/sys/netinet/ip_input.c +++ b/sys/netinet/ip_input.c @@ -82,7 +82,6 @@ __FBSDID("$FreeBSD$"); #include #include #include -#include #include @@ -448,7 +447,6 @@ ip_direct_input(struct mbuf *m) void ip_input(struct mbuf *m) { - MROUTER_RLOCK_TRACKER; struct ip *ip = NULL; struct in_ifaddr *ia = NULL; struct ifaddr *ifa; @@ -744,7 +742,6 @@ passin: ia = NULL; } if (IN_MULTICAST(ntohl(ip->ip_dst.s_addr))) { - MROUTER_RLOCK(); /* * RFC 3927 2.7: Do not forward multicast packets from * IN_LINKLOCAL. @@ -759,7 +756,6 @@ passin: * must be discarded, else it may be accepted below. */ if (ip_mforward && ip_mforward(ip, ifp, m, 0) != 0) { - MROUTER_RUNLOCK(); IPSTAT_INC(ips_cantforward); m_freem(m); return; @@ -771,12 +767,10 @@ passin: * host belongs to their destination groups. */ if (ip->ip_p == IPPROTO_IGMP) { - MROUTER_RUNLOCK(); goto ours; } IPSTAT_INC(ips_forward); } - MROUTER_RUNLOCK(); /* * Assume the packet is for us, to avoid prematurely taking * a lock on the in_multi hash. Protocols must perform diff --git a/sys/netinet/ip_mroute.c b/sys/netinet/ip_mroute.c index fdca39b5dbb9..c678acd650c0 100644 --- a/sys/netinet/ip_mroute.c +++ b/sys/netinet/ip_mroute.c @@ -300,7 +300,7 @@ VNET_DEFINE_STATIC(struct ifnet *, multicast_register_if); static u_long X_ip_mcast_src(int); static int X_ip_mforward(struct ip *, struct ifnet *, struct mbuf *, struct ip_moptions *); -static int X_ip_mrouter_done(void *); +static int X_ip_mrouter_done(void); static int X_ip_mrouter_get(struct socket *, struct sockopt *); static int X_ip_mrouter_set(struct socket *, struct sockopt *); static int X_legal_vif_num(int); @@ -431,7 +431,7 @@ X_ip_mrouter_set(struct socket *so, struct sockopt *sopt) break; case MRT_DONE: - error = ip_mrouter_done(NULL); + error = ip_mrouter_done(); break; case MRT_ADD_VIF: @@ -734,20 +734,15 @@ ip_mrouter_init(struct socket *so, int version) * Disable multicast forwarding. */ static int -X_ip_mrouter_done(void *locked) +X_ip_mrouter_done(void) { struct ifnet *ifp; u_long i; vifi_t vifi; struct bw_upcall *bu; - if (V_ip_mrouter == NULL) { - if (locked) { - struct epoch_tracker *mrouter_et = locked; - MROUTER_RUNLOCK_PARAM(mrouter_et); - } - return EINVAL; - } + if (V_ip_mrouter == NULL) + return (EINVAL); /* * Detach/disable hooks to the reset of the system. @@ -756,12 +751,11 @@ X_ip_mrouter_done(void *locked) atomic_subtract_int(&ip_mrouter_cnt, 1); V_mrt_api_config = 0; - if (locked) { - struct epoch_tracker *mrouter_et = locked; - MROUTER_RUNLOCK_PARAM(mrouter_et); - } - - MROUTER_WAIT(); + /* + * Wait for all epoch sections to complete to ensure + * V_ip_mrouter = NULL is visible to others. + */ + epoch_wait_preempt(net_epoch_preempt); /* Stop and drain task queue */ taskqueue_block(V_task_queue); diff --git a/sys/netinet/ip_mroute.h b/sys/netinet/ip_mroute.h index 016d026d184c..5ad25b485dfc 100644 --- a/sys/netinet/ip_mroute.h +++ b/sys/netinet/ip_mroute.h @@ -363,16 +363,9 @@ struct sockopt; extern int (*ip_mrouter_set)(struct socket *, struct sockopt *); extern int (*ip_mrouter_get)(struct socket *, struct sockopt *); -extern int (*ip_mrouter_done)(void *); +extern int (*ip_mrouter_done)(void); extern int (*mrt_ioctl)(u_long, caddr_t, int); -#define MROUTER_RLOCK_TRACKER struct epoch_tracker mrouter_et -#define MROUTER_RLOCK_PARAM_PTR &mrouter_et -#define MROUTER_RLOCK() epoch_enter_preempt(net_epoch_preempt, &mrouter_et) -#define MROUTER_RUNLOCK() epoch_exit_preempt(net_epoch_preempt, &mrouter_et) -#define MROUTER_RUNLOCK_PARAM(param) epoch_exit_preempt(net_epoch_preempt, param) -#define MROUTER_WAIT() epoch_wait_preempt(net_epoch_preempt) - #endif /* _KERNEL */ #endif /* _NETINET_IP_MROUTE_H_ */ diff --git a/sys/netinet/ip_output.c b/sys/netinet/ip_output.c index f203bc165e61..818d115d8a2d 100644 --- a/sys/netinet/ip_output.c +++ b/sys/netinet/ip_output.c @@ -82,7 +82,6 @@ __FBSDID("$FreeBSD$"); #include #include #include -#include #include #include @@ -321,7 +320,6 @@ int ip_output(struct mbuf *m, struct mbuf *opt, struct route *ro, int flags, struct ip_moptions *imo, struct inpcb *inp) { - MROUTER_RLOCK_TRACKER; struct ip *ip; struct ifnet *ifp = NULL; /* keep compiler happy */ struct mbuf *m0; @@ -609,7 +607,6 @@ again: * above, will be forwarded by the ip_input() routine, * if necessary. */ - MROUTER_RLOCK(); if (V_ip_mrouter && (flags & IP_FORWARDING) == 0) { /* * If rsvp daemon is not running, do not @@ -621,12 +618,10 @@ again: imo = NULL; if (ip_mforward && ip_mforward(ip, ifp, m, imo) != 0) { - MROUTER_RUNLOCK(); m_freem(m); goto done; } } - MROUTER_RUNLOCK(); } /* diff --git a/sys/netinet/raw_ip.c b/sys/netinet/raw_ip.c index 229716918875..fb6718dfd28e 100644 --- a/sys/netinet/raw_ip.c +++ b/sys/netinet/raw_ip.c @@ -119,7 +119,7 @@ VNET_DEFINE(struct socket *, ip_mrouter); */ int (*ip_mrouter_set)(struct socket *, struct sockopt *); int (*ip_mrouter_get)(struct socket *, struct sockopt *); -int (*ip_mrouter_done)(void *locked); +int (*ip_mrouter_done)(void); int (*ip_mforward)(struct ip *, struct ifnet *, struct mbuf *, struct ip_moptions *); int (*mrt_ioctl)(u_long, caddr_t, int); @@ -879,19 +879,15 @@ static void rip_detach(struct socket *so) { struct inpcb *inp; - MROUTER_RLOCK_TRACKER; inp = sotoinpcb(so); KASSERT(inp != NULL, ("rip_detach: inp == NULL")); KASSERT(inp->inp_faddr.s_addr == INADDR_ANY, ("rip_detach: not closed")); - /* Disable mrouter first, lock released inside ip_mrouter_done */ - MROUTER_RLOCK(); + /* Disable mrouter first */ if (so == V_ip_mrouter && ip_mrouter_done) - ip_mrouter_done(MROUTER_RLOCK_PARAM_PTR); - else - MROUTER_RUNLOCK(); + ip_mrouter_done(); INP_WLOCK(inp); INP_HASH_WLOCK(&V_ripcbinfo);