[RFC] test layout/standardization for FreeBSD

Poul-Henning Kamp phk at phk.freebsd.dk
Wed Nov 14 09:43:09 UTC 2012


--------
In message <CAGH67wSoU08N8=40RE3j0na4B6-VhZFwhMdkw-6CYhoxKKHumg at mail.gmail.com>
, Garrett Cooper writes:

>I asked for feedback from some of the stakeholders of
>the FreeBSD test automation effort [...]

Can I throw in something here ?

A very important thing is to have systematic metadata about test-cases,
in particular:

A) Is the test 100% deterministic, or is there a risk of random failure ?

B) Is the test reliable on a heavily loaded machine ?

C) Estimated duration of test

etc.

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


More information about the freebsd-arch mailing list