regression-test

[Christian Weisgerber]

Kris Kennaway <kris at freebsd.org> wrote:

> Our experience has shown that it is very common for tests to succeed 
> when run by the maintainer, but to fail in the package cluster 
> environment because of differences in the environment, configuration, 
> default assumptions, etc.  i.e. the regression tests found bugs, which 
> is the entire point.

In my experience from OpenBSD, where "make regress" has been a
standard part of the bsd.port.mk framework for a long time, a failing
regression test is not infrequently a problem in the test itself
rather than in the tested functionality.

I do agree that running the included regression tests is a good
idea, but the details can be tricky.

-- 
Christian "naddy" Weisgerber                          naddy at mips.inka.de