Automatically running /usr/tests on stable/10 branch under Jenkins

[Craig Rodrigues]

Susan,

In addition to the slides which I previously mentioned, you and your
colleagues at Xinuos
may wish to take a quick read of this document which I wrote, the  "Kyua
Quickstart Guide":

https://github.com/rodrigc/kyua/wiki/Quickstart-Guide

kyua is the test harness that is used to run the tests in the /usr/tests
directory in FreeBSD.
That doc is a very quick guide on how to run tests under kyua, and also
how to write tests which can be run under kyua.

Getting any feedback on this would be very useful.  Does that doc make
sense to a newcomer?
Are there typos?

I want the FreeBSD project to get to the point where:
    (1) anybody can download the FreeBSD tests
    (2) anybody can run the tests
    (3) people can easily figure out how to write new tests and contribute
them back (if they wish) to FreeBSD

Better documentation will hopefully help with this.
Thanks.
--
Craig



On Fri, Oct 24, 2014 at 1:37 PM, Susan Stanziano <susan.stanziano at xinuos.com
> wrote:

> Hello Craig,
>
> I have been reading through your slides and your website announcement, as
> requested, and have a few questions.  (I have also subscribed to the
> mailing list as suggested).
>
> (1)  The slides indicate that with a FreeBSD10 and lower OS, I should be
> able to build tests already included with FreeBSD.  I have created a VM on
> FreeBSD10.0 but do not have the /etc/make.conf file necessary to build and
> install the tests.  This may be that I am missing some set-up steps
> required but not covered in the slide presentation.
>
> (2) Does the test build require the use of the "Build Flow Plugin" or can
> the tests be run independent of the "continuous build" model?
>
> (3) Can the tests only be run under Bhyve as described in the announcement?
>
> I would be happy to exchange emails with you or skype as I investigate
> this work further.
>
> Regards,
>
> Susan
>
> ------------------------------
> *From: *"Craig Rodrigues" <rodrigc at FreeBSD.org>
> *To: *Eric at xinuos.com
> *Cc: *"Allan Jude" <allanjude at freebsd.org>, "John Wolfe" <jlw at xinuos.com>,
> freebsd-virtualization at freebsd.org, freebsd-testing at freebsd.org, "Susan
> Stanziano" <susan.stanziano at xinuos.com>, "Cheryl Blain" <
> cheryl.blain at xinuos.com>, "Andy Nagle" <andrew.nagle at xinuos.com>
> *Sent: *Friday, October 24, 2014 7:09:04 AM
> *Subject: *Re: Re: Automatically running /usr/tests on stable/10 branch
> under Jenkins
>
>
>
>
> On Fri, Oct 24, 2014 at 1:11 AM, Eric le Blan <Eric at xinuos.com> wrote:
>
>> Allan,
>>
>>
>>
>> Always happy to discuss testing. I believe that Susan Stanziono of Xinuos
>> system test team already spoke to some of you. Please do not hesitate to
>> reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of
>> operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach
>> to Craig.
>
>
>
> It would be helpful if someone (or some people) from Xinuous could do the
> following:
>
> (1)  Subscribe to freebsd-testing at freebsd.org at
> https://lists.freebsd.org/mailman/listinfo/freebsd-testing to start
> monitoring the discussions on that list.
>
> (2)   Review this announcement:
> http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing
>
> (3)  Review these slides:
> http://www.slideshare.net/CraigRodrigues1/kyua-jenkins
>
> (4)  Talk to me at MeetBSD Vendor Summit
>
> I have not been given a long timeslot to give a presentation, so reviewing
> those links before MeetBSD would
> be helpful.  Long term, any testing of FreeBSD will only succeed if there
> is
> an ecosystem of people working together and sharing common scripts and
> information for testing FreeBSD.
>
> Any help that Xinuous (or any other company) can provide would be welcome.
>
> --
> Craig
>
>