openssh: no pre-release sanity check? [Re: ssh-to-rawhide hangs

Richard W.M. Jones rjones at redhat.com
Mon Sep 12 10:17:19 UTC 2011


On Mon, Sep 12, 2011 at 01:02:26AM -0700, Adam Williamson wrote:
> On Mon, 2011-09-12 at 08:56 +0100, Richard W.M. Jones wrote:
> 
> > I thought AutoQA was going to do this, but it's been disappointing.
> 
> AutoQA is under active development, still. It's a complex project.

I hope I can make a suggestion:

Can we have it so that packagers can commit a file into Fedora git
(eg. "autoqa.sh"), and have that picked up by AutoQA and run whenever
a new package appears in Rawhide.

It could just return exit status zero / non-zero, or if someone is
feeling ambitious:

http://en.wikipedia.org/wiki/Test_Anything_Protocol

> Especially being able to automate this kind of high level functionality
> testing is tricky: remember, to properly test OpenSSH, we'd need to set
> up two separate installations with current packages and then connect one
> to the other, all without any kind of human interaction and with 100%
> reliability - any breakdown in the *testing mechanism* which is
> misrepresented as a failure in the *thing being tested* tends to make
> people scream bloody murder. Rome wasn't built in a day, etc etc.

I think you are overthinking this.  Look at how libguestfs builds,
boots up and tests a Rawhide distro, *inside Koji!* (there's no root,
no network, ...)

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
libguestfs lets you edit virtual machines.  Supports shell scripting,
bindings from many languages.  http://libguestfs.org


More information about the devel mailing list