From nobody Fri Nov 12 21:24:22 2021 X-Original-To: freebsd-git@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 820A618455D7 for ; Fri, 12 Nov 2021 21:24:34 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ua1-x92c.google.com (mail-ua1-x92c.google.com [IPv6:2607:f8b0:4864:20::92c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4HrWnF6NnLz4sWV for ; Fri, 12 Nov 2021 21:24:33 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-ua1-x92c.google.com with SMTP id y5so3677413ual.7 for ; Fri, 12 Nov 2021 13:24:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20210112.gappssmtp.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=iIX24eKuX88uYzp881kWNNHaOzNRBc6rrAdQZzhwMzk=; b=wPbAAsE5iais8lBtQV4G5Ju4bG9MOe7uGLURFnsGcmPY38lVL2BjEdB5/LqxGY2Xe6 D299qEbiTfNXCzAWON1TTOV+LL391+/BP+i/MXweW/KQZZunYkMizi4VmvZkfSklXPvD xgPMU+p8DQRv5dx5+Ch0ewIIyWxPW0GlwH5ChkLN1lZMmu9FeGIVSaqY35IbF8YwZeVb HAqPtjEST47WxDCN+LhdiRPNTwfJu881Mx/W+t6U4xx4S7LT57fiP0GFHwgqvRKWgkjX q48yXNsCDcPmhTRpCLqbCW0+cucgei1wzzf3CbvBOhymDaSLSO3BNrwQ6J9xdZqBXMLX VKxQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=iIX24eKuX88uYzp881kWNNHaOzNRBc6rrAdQZzhwMzk=; b=VGPnUO36mmeZDXKgPibehqPF6wQeRL8GYCuiT4YcDnR+oeBOLU4pQDb5qtH5nfP88Y s8cWBrmiChiMmqq/1vpSkKnlVgjWMHQzKDebpujCifNVBYvnIRW3Z+1mENZEcfWw7NzN XWmBkCTAWmANDc6xax9iIQLh+g8E1Xe/rGbcqcJfxcNHOGSxWbvoc7q9vicDIQM8dpoJ D0NM49ars9DNLKASQ/immIfer/d822Ozb/4sv8SwdfoKZ0bYaPTjvE4yk+S6zcG8vLo2 4sTOhYxafWS4DLBzgXdpUyOFn5abjl4tdyEJKFq9ioyg2VBqSJSFXt/2URu2PD1YYaps Tnqw== X-Gm-Message-State: AOAM530py0G7brdsNs4n/c+YAqL5YhkU5qvzPTfxHTChlHZAyz2BqcpI e0wiG8VPh7fTKGY69FYReHpkm3Pv/yJAJI2EzQYe9ZSFJ3NPAw== X-Google-Smtp-Source: ABdhPJwTowLkaTaUzApD17rt9IRUH8HhGbf1jj5/k/OcmBpEGOrWHAnD8lfm3NcbvyNUheawhky2EFMhm/sI62GkSD8= X-Received: by 2002:a67:fdc3:: with SMTP id l3mr13122672vsq.42.1636752273040; Fri, 12 Nov 2021 13:24:33 -0800 (PST) List-Id: Discussion of git use in the FreeBSD project List-Archive: https://lists.freebsd.org/archives/freebsd-git List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-git@freebsd.org MIME-Version: 1.0 From: Warner Losh Date: Fri, 12 Nov 2021 14:24:22 -0700 Message-ID: Subject: CI Piplines To: freebsd-git Content-Type: multipart/alternative; boundary="000000000000d1fb9e05d09e1565" X-Rspamd-Queue-Id: 4HrWnF6NnLz4sWV X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20210112.gappssmtp.com header.s=20210112 header.b=wPbAAsE5; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::92c) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [1.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20210112.gappssmtp.com:s=20210112]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(1.00)[1.000]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-git@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20210112.gappssmtp.com:+]; NEURAL_SPAM_LONG(1.00)[0.999]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::92c:from]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: Y --000000000000d1fb9e05d09e1565 Content-Type: text/plain; charset="UTF-8" Greetings, The weekly meetings haven't been as productive as I'd have liked them to be. That tells me I need to try something else. That's another reason I skipped this week, but I'm planning on having one next week at the 1pm MST time slot (UTC 20:00). More details by Monday. In the meantime, I've been looking at what we can do. I thought I'd start trying to deconstruct CI into smaller pieces so that we can start to make progress on defining "what to do". First up on that list is before the commit testing. We can do a lot more. I have done work with other projects that have setup sophisticated pipelines to ensure that nothing is broken. We have a couple of github and Cirrus CI jobs defined in the tree for smoke testing, but it would be nice to have more. The Asia-timed meeting has extensive notes on this (I'm publishing all the docs for this effort at https://gitlab.com/bsdimp/freebsd-workflow if you didn't know already). What's needed is some experimentation. We have a large number of scripts that Li-Wen Hsu runs as part of the FreeBSD CI. The repo is at https://github.com/freebsd/freebsd-ci for reference. In theory, these scripts were written independent of the system running them and have Jenkins glue. We need people to test this theory. It sure would be cool to push to github and/or gitlab and have all the architectures built and/or all the kernels like we do now after each commit. It would be nice if we could do some testing as well. It would be good to know what the issues are doing it natively with CirrusCI, github or gitlab CI chains. It would be good to learn about runners, how we can use them, integrate with them, etc. It would be good to look at other code hygiene tools that could be pipeline elements. It would also be good to have docs for how to get started. Even a MD page that is just links to all the relevant info for the different testing services, info about them, etc would be great. I'd also like to start collecting recipes that we can publish so people can place them in their repos and experiment with changes or enhancements. If you are looking to help out, and aren't quite sure how this could be for you. If you don't think you can commit to something, but if you get a chance to do something you want to share your results, this is for you. Warner --000000000000d1fb9e05d09e1565--