testing with FreeBSD and Kyua

[Craig Rodrigues]

On Sun, Nov 2, 2014 at 5:56 AM, Susan Stanziano <susan.stanziano at xinuos.com>
wrote:

> (1) I have 10.1-RC3 installed and have run vmrun.sh a number of times. I
> notice the following failure on subsequent invocations:
>
> vm_open: Invalid argument
>




What is the full command that you are using to invoke
vmrun.sh?



(2) If I attempt to run two VM's under Bhyve at the same time, I see a
> vm_run error and the first VM is destroyed:
>


It is possible to run two bhyve VM's at the same time
but you must use a different <vmname>
for each invocation of the vmrun.sh script,
so you would have to use freebsd-test1, freebsd-test2, etc.





> -- local/atf/atf-c/macros_test:use -> failed: Build of macros_h_test.c
> failed; some macros in atf-c/macros.h are broken [0.022s]
>


I think this might be fixed by:
https://lists.freebsd.org/pipermail/svn-src-stable/2014-September/025633.html


You may need a newer 10.1-RC version to get that fix.



>
>
>
>
>
>
> -- local/kyua/testers/run_test:fork_wait__unprivileged_group -> failed:
> testers/run_test.c:600: Subprocess is still running with GID set to root
> [0.010s]
>


I think that might be fixed by:
https://lists.freebsd.org/pipermail/svn-src-stable/2014-October/025688.html

You may need a newer 10.1-RC version to get that fix.



>
>
>
>
>
> -- usr.bin/yacc/legacy_test:main -> failed: 15 tests of 15 failed [0.150s]
>


The yacc problems were reported here:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193499

The fix is not yet in 10.1.





>
> Is there some place that I can see more details on the actual failures
> from Kyua? I ran "kyua report" and redirected that into a file and that is
> all the information I have.
>

You can try using the "kyua report-junit" or "kyua report-html"
commands which produce more detailed reports.
kyua 0.11 (which just was released last week) has
kyua report --verbose, but the "--verbose" flag is not in kyua 0.10
which is what you are using.

--
Craig