From nobody Mon Oct 04 17:16:14 2021 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id C3C7910F9312 for ; Mon, 4 Oct 2021 17:16:27 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-yb1-xb2b.google.com (mail-yb1-xb2b.google.com [IPv6:2607:f8b0:4864:20::b2b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HNS6z4tYhz3lFC for ; Mon, 4 Oct 2021 17:16:27 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: by mail-yb1-xb2b.google.com with SMTP id u32so39320150ybd.9 for ; Mon, 04 Oct 2021 10:16:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=ZLARl+0orqI8h4YFOyv09jhtdBCKXTgI0Xp5bLTl99Q=; b=qIWzgnwA5GzM+cx3phSiwpess9Un7ObG33Y2pfzJsck3pDGv8Ecbw8/T5iH1+9ZoTB IcOF2lbipAmzSLYIkaf2H2ZDCEe0UuhLr43A2msROe8wvK0vD9nXUX9VeVZc2F9mAohQ MBp2huGJUtXWKEvkW/FiMEXiTd2SHgOu8D+dM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=ZLARl+0orqI8h4YFOyv09jhtdBCKXTgI0Xp5bLTl99Q=; b=wloRsQb3ewozddwm624N87Q55DgZVrOtLyyCVXL/7AOR4lBWa98bSoqpk75wwL5ERr l0ajHMejMMfWGSiGb+o4kTuGpz4J2E39wUrlRRA7Wy+kv+sNNv2UMTLXNVNRf83qEQVH dgFLhmaSPAuFv9aPMCiCrksvgzRNR86zSm+ifp60e/bcCdmDYxXokPsKI2qGUXSJ8nP6 f11k4iiZ18Ghwb01hCazxeBB+ZT7lWLholgtPnOV9SKt3jZzJ9JXkr5Q0NreTbdlz6T6 DZOVHgQ8sANQMZXNf5bX3fRpEihHkHOUGeI2VfOmkjHddhodgljA11yl+yniBPth+Auv 8yaA== X-Gm-Message-State: AOAM533HWXQ9nUX6vtAtqqX4ceB5f017W9809AkLvJatSouaQOf9yaSY 7n6VplJxp2xQh89SPEL69SpA3nugykA+DbDR8bLw2QWv2ZFClTS1 X-Google-Smtp-Source: ABdhPJyh2LFGNNgr67GXVX9txDnoHGlDY9PlZHeMc0BMdwkut0GNceD7yqVqmmPDbli7i2oYNg/0DWk4nEbaA5OdZ1U= X-Received: by 2002:a25:6884:: with SMTP id d126mr15759905ybc.533.1633367786757; Mon, 04 Oct 2021 10:16:26 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org MIME-Version: 1.0 References: <20210517192054.0907beea@x23> <33b2b043-f3b7-e8e0-c290-f754082e0692@codenetworks.net> In-Reply-To: From: Kevin Bowling Date: Mon, 4 Oct 2021 10:16:14 -0700 Message-ID: Subject: Re: Vector Packet Processing (VPP) portability on FreeBSD To: Francois ten Krooden Cc: Santiago Martinez , "freebsd-net@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4HNS6z4tYhz3lFC X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N On Mon, Oct 4, 2021 at 4:35 AM Francois ten Krooden wrote= : > > Hi Santiago > > The patches we have made is all available on the github fork we made from= the VPP repository. > It is located at https://github.com/ftk-ntq/vpp/tree/freebsd > So anyone who is interested can find it there. > > To make the VFIO support work I unfortunately have no idea. > I am not exactly sure but I think there is some kernel work required and = then an update to DPDK. > I am not sure how much effort that would be. I would like to take a look at this, maybe we should discuss it at the upcoming vendor summit https://wiki.freebsd.org/DevSummit/202111 > Kind Regards > > Francois ten Krooden > Principal Developer > > Nanoteq > Tel: +27 12 672 7000 > Fax: +27 12 665 1343 > Postal: P.O. Box 7991, Centurion, 0046 > Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue, Ce= nturion > > ________________________________________ > From: Santiago Martinez [sm@codenetworks.net] > Sent: Wednesday, September 22, 2021 11:22 AM > To: freebsd-net@freebsd.org > Subject: Re: Vector Packet Processing (VPP) portability on FreeBSD > > Hi Francois, I hope you are doing well. > > It is great to hear about work/progress/updates on VPP / DPDK / Netmap > on FBSD, even if the results are not the best. > > Unfortunately, I'm not a developer, so I cannot help much on the matter > of the missing bits. > Just wondering if those modifications that your team have done to make > VPP run can be upstreamed or shared with the community, so maybe we can > create a VPP package making it easier for others to deploy/test/improve. > > On the other hand, do you roughly know how much effort is required to > make VFIO support at the same level as Linux? > > I hope it makes sense. > > Best regards. > > Santiago > > > On 9/21/21 11:52 AM, Francois ten Krooden wrote: > > Hi > > > > This is just some feedback for those who had an interest in this topic. > > > > After spending quite some time on the VPP to FreeBSD porting effort whe= re we did manage to get VPP working with netmap, and VPP compiling with DPD= K; We realised that there are some big issues that we would need to overcom= e. Some of these efforts are not viable for our small team to accomplish in= a reasonable time frame. > > The main issues that we have found are: > > - Tests proved that netmap would not deliver the desired performance as= it is currently implemented within VPP. The main issues here are that for = every 256 packets memory seems to be allocated again, also a number of copi= es occur in the memory which slows down the performance. > > - VPP relies on VFIO to map device memory into user space for processin= g within the application. This code is implemented in DPDK in the Linux imp= lementation but in the FreeBSD implementation in DPDK these functions are s= tubbed. > > - To interface with crypto-offloading hardware such as the QAT card fro= m Intel, or our own card VPP/DPDK also utilize VFIO with the PCI device. > > - As far as we have been able to see the VFIO support in FreeBSD is not= at the same level as Linux, which would then require additional kernel dev= elopment which is not possible in the time frame. > > > > Regards > > > > Francois ten Krooden > > Principal Developer > > > > > > Tel: +27 12 672 7000 > > Fax: +27 12 665 1343 > > Postal: P.O. Box 7991, Centurion, 0046 > > Physical: Unit C01, Corporate Park 66, 269 Von Willich Avenue,= Centurion > > > > > > > > Important Notice: > > > > This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mai= l legal notice available at: > > http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx > > > > > > Important Notice: > > This e-mail and its contents are subject to the Nanoteq (Pty) Ltd e-mail = legal notice available at: > http://www.nanoteq.com/AboutUs/EmailDisclaimer.aspx > > >