openssh: no pre-release sanity check? [Re: ssh-to-rawhide hangs
Richard W.M. Jones
rjones at redhat.com
Mon Sep 12 10:17:19 UTC 2011
On Mon, Sep 12, 2011 at 01:02:26AM -0700, Adam Williamson wrote:
> On Mon, 2011-09-12 at 08:56 +0100, Richard W.M. Jones wrote:
> > I thought AutoQA was going to do this, but it's been disappointing.
> AutoQA is under active development, still. It's a complex project.
I hope I can make a suggestion:
Can we have it so that packagers can commit a file into Fedora git
(eg. "autoqa.sh"), and have that picked up by AutoQA and run whenever
a new package appears in Rawhide.
It could just return exit status zero / non-zero, or if someone is
> Especially being able to automate this kind of high level functionality
> testing is tricky: remember, to properly test OpenSSH, we'd need to set
> up two separate installations with current packages and then connect one
> to the other, all without any kind of human interaction and with 100%
> reliability - any breakdown in the *testing mechanism* which is
> misrepresented as a failure in the *thing being tested* tends to make
> people scream bloody murder. Rome wasn't built in a day, etc etc.
I think you are overthinking this. Look at how libguestfs builds,
boots up and tests a Rawhide distro, *inside Koji!* (there's no root,
no network, ...)
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
libguestfs lets you edit virtual machines. Supports shell scripting,
bindings from many languages. http://libguestfs.org
More information about the devel