From nobody Wed Dec 15 04:55:19 2021 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 62EE918E7410 for ; Wed, 15 Dec 2021 04:55:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4JDNGb0tQRz3JyV for ; Wed, 15 Dec 2021 04:55:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id ECFFC1604B for ; Wed, 15 Dec 2021 04:55:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 1BF4tIJS099607 for ; Wed, 15 Dec 2021 04:55:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 1BF4tIMM099606 for bugs@FreeBSD.org; Wed, 15 Dec 2021 04:55:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 260427] [regression]: netmap causes packet drops Date: Wed, 15 Dec 2021 04:55:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: emz@norma.perm.ru X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@freebsd.org MIME-Version: 1.0 ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1639544119; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=WrBUN81J5F+c17q2f1vipXMfVsoZE1hMajtlJONRGV0=; b=oH9MQ2jf1Te7ntnzUi6/90Q3qp0j3rFJXRpTSzEm66BS5LUwPdJ58wB3UNwMNF/+W12Os8 H/wiiPJ3fPl8ZywBapm0/hxf1WQgBwV8dgbulRH8kvZGwNmtqCEmPjCRgnHrCnscRcMC4h 2dkEImhzbN2jhHb5hh3gzYpXroZCyR0XXchq7hiCxvk6RmGWgTGlZMA+mVNseoTerqvdoY Vwug6Ya0TwASV6r+U8JPOzGyRnGcqNdMUaL8Yj9RRbReR72Qfu+PQFsaRpRNtLOqLILT6w 7i09CpTG+z4Mk96kgq3QvGKqEoYv4iIckfksCeK6xima74Bnn6quCKOhCr8hug== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1639544119; a=rsa-sha256; cv=none; b=Rxjh9ZgiOFty+uy6kubmDGGnONZJpng06omRgeHGlgQ1Uda9qasD97x7wbp18Vg9hGRs5r OATa8cTmT3ygjZUnN+ESCyaieOsRoDkBT/mIcbSAIWYBV+E3LEVKs4aeAdoNfg+jXNhTyM 883kSyAep+WD5n/yxdCjXjL38xqzJsLO/t4KojwrR08608NDJsl0WwfGCT9ggjbmeB9Piu f78L3NRQvV9wcptR7TMYMnnmmjJmP8asLbbDU9BtXMVxcC5l8e9QKBcN692VzfmarY4ert n+hiNYDmFuccPUmWUUCuV4VOM/rffIZTs/gi2kfiJoWcjLV49w7qKMlYXq+oJA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D260427 Bug ID: 260427 Summary: [regression]: netmap causes packet drops Product: Base System Version: 12.2-RELEASE Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: bugs@FreeBSD.org Reporter: emz@norma.perm.ru Env: FreeBSD 12.2-RELEASE which was previously running 11.x and 10.x Input flow from Catalyst 2960 around 30-300 Mbit/sec, media 1000baseT Hardware: IBM System x3250 m2 Hardware interfaces: bge(4) NetXtreme BCM5722 Gigabit Ethernet PCI Express em(4) 82572EI Gigabit Ethernet Controller (Copper) First the input flow was directd via onboard bge(4), port no.1. Around seve= ral months ago we noticed high error rate reflecting in netstat input errors and hardware dev.bge.0 counters like=20 dev.bge.0.stats.InputDiscards Error input rate was changing from 0 (most of the time) to 6K-80K per secon= d. Recovery measures (that didn't help, each step): - changed the patch cable from catalyst - changed the onboard port from 1 to 0 - started to suspect the onboeard ethernet controller, added the Intel Pro/= 1000 MT external adapter via the riser card, error rate migrated into the dev.em.0.mac_stats.missed_packets counter, sometimes triggering the dev.em.0.mac_stats.recv_no_buff: dev.em.0.mac_stats.recv_no_buff: 9424 dev.em.0.mac_stats.missed_packets: 1853592 - added the iflib/netmap tuning: net.isr.numthreads=3D"2" net.isr.maxthreads=3D"2" dev.em.0.iflib.rx_budget=3D"65535" dev.em.0.iflib.override_nrxds=3D"4096" dev.em.0.iflib.override_ntxds=3D"4096" dev.em.0.iflib.disable_msix=3D"0" - added the interrupt moderation dev.em.0.rx_int_delay=3D"200" dev.em.0.tx_int_delay=3D"200" dev.em.0.rx_abs_int_delay=3D"4000" dev.em.0.tx_abs_int_delay=3D"4000" - tried to play with the kern.eventtimer kern.eventtimer.periodic=3D"1" Steps that did help: - decided to try the Intel em(4) module from ports, that doesn't wotk with netmap and requires kernel built without em(4) support. Added the "nodevice= em" and "nodevice netmap" config lines, rebuilt the kernel, installed it and rebooted (still with the stock driver at this time, just to switch to the loadable module). Errors magically stopped. --=20 You are receiving this mail because: You are the assignee for the bug.=