My first ATF test
Peter Holm
peter at holm.cc
Tue Feb 25 18:42:53 UTC 2014
On Tue, Feb 25, 2014 at 12:12:38PM -0500, Mehmet Erol Sanliturk wrote:
> On Tue, Feb 25, 2014 at 11:47 AM, Alan Somers <[1]asomers at freebsd.org>
> wrote:
>
> On Tue, Feb 25, 2014 at 9:11 AM, Peter Holm <peter at holm.cc> wrote:
> > In order to understand how ATF works I wrote a small test so I had
> > something to work with:
> > [2]http://people.freebsd.org/~pho/kern_descrip_test.diff
> > Did I get it right?
> ATF-wise, it looks good. Â However, it's a bad idea to use random
> numbers in test code, except in stress tests. Â Random numbers
> result
> in irreproducible tests. Â How about replacing the body of
> dup2_r234131
> with something like this?
> Â int fd1, fd2, ret;
> Â fd1 = Â open("/etc/passwd", O_RDONLY);
> Â fd2 = INT_MAX;
> Â ret = dup2(fd1, fd2);
> Â ATF_CHECK_EQ(-1, ret);
> Â ATF_CHECK_EQ(EBADF, errno);
> On a side note, perhaps WARNS should be set in [3]atf.test.mk, so we
> won't have to set it in every other Makefile.
> -Alan
> _______________________________________________
>
> When random numbers are used , it is possible to make the runs
> reproducible in the following way :
> Generate a specified number of random numbers and store them into a
> file .
> During usage , for random numbers , traverse that file .
> This may be repeated any number of times for different other parameters
> .
> All of the runs will use the same random numbers .
> Then the results ( which they are generated from the same distribution
> ) may be compared with suitable statistical tests .
> Thank you very much .
> Mehmet Erol Sanliturk
>
I guess I'm too used to using random values in tests :)
Using random(3) with an initial seed of "1" could have been an
alternative, but ...
- Peter
More information about the freebsd-testing
mailing list