My first ATF test

Mehmet Erol Sanliturk m.e.sanliturk at gmail.com
Tue Feb 25 17:12:40 UTC 2014


On Tue, Feb 25, 2014 at 11:47 AM, Alan Somers <asomers at freebsd.org> wrote:

> On Tue, Feb 25, 2014 at 9:11 AM, Peter Holm <peter at holm.cc> wrote:
> > In order to understand how ATF works I wrote a small test so I had
> > something to work with:
> > http://people.freebsd.org/~pho/kern_descrip_test.diff
> > Did I get it right?
>
> ATF-wise, it looks good.  However, it's a bad idea to use random
> numbers in test code, except in stress tests.  Random numbers result
> in irreproducible tests.  How about replacing the body of dup2_r234131
> with something like this?
>
>   int fd1, fd2, ret;
>   fd1 =  open("/etc/passwd", O_RDONLY);
>   fd2 = INT_MAX;
>   ret = dup2(fd1, fd2);
>   ATF_CHECK_EQ(-1, ret);
>   ATF_CHECK_EQ(EBADF, errno);
>
> On a side note, perhaps WARNS should be set in atf.test.mk, so we
> won't have to set it in every other Makefile.
>
> -Alan
> _______________________________________________
>
>


When random numbers are used , it is possible to make the runs reproducible
in the following way :

Generate a specified number of random numbers and store them into a file .

During usage , for random numbers , traverse that file .
This may be repeated any number of times for different other parameters .
All of the runs will use the same random numbers .
Then the results ( which they are generated from the same distribution )
may be compared with suitable statistical tests .


Thank you very much .


Mehmet Erol Sanliturk


More information about the freebsd-testing mailing list