----- "James Laska" <jlaska(a)redhat.com> wrote:
This topic came up elsewhere last week, how do you test your tests?
Our
current approach is to say ... just run your tests. This works
great,
but perhaps we can also offer testing in a 'autotest' environment. I
think Kamil's ticket now makes sense to me.
Kamil ... is there any documentation needed to help setup the
environment as you have done in ticket#52?
I don't know if I exactly got what you mean, but after applying
the patch you can just edit /etc/autoqa.conf, set "run_locally =
True" and then you can test watchers/tests locally. For example like
this:
$ autoqa post-repo-update -t repoclosure --arch x86_64 \
--name rawhide
http://mirror/pub/fedora/linux/development/%a/os
13:40:20 INFO | Writing results to /usr/share/autotest/client/results/default
13:40:21 INFO | Initializing the state engine
13:40:21 INFO | Symlinking init scripts
13:40:26 INFO | START ---- ---- timestamp=1256560826 localtime=Oct 26 13:40:26
13:40:26 INFO | START repoclosure repoclosure timestamp=1256560826 localtime=Oct 26
13:40:26
13:41:01 INFO | Test started. Number of iterations: 1
13:41:01 INFO | Executing iteration 1 of 1
13:43:26 INFO | Test finished after 1 iterations.
13:43:27 INFO | GOOD repoclosure repoclosure timestamp=1256561007 localtime=Oct 26
13:43:27 completed successfully
13:43:27 INFO | END GOOD repoclosure repoclosure timestamp=1256561007 localtime=Oct 26
13:43:27
13:43:28 INFO | END GOOD ---- ---- timestamp=1256561008 localtime=Oct 26 13:43:28
Currently you can't do that without autotest_server install and
configuring at least one client (which will be probably localhost
anyway, so why all the bother?).
I guess if the patch is applied (it was a fast fix, I suppose wwoods
may tweak according to his views), it would be nice to tell people
"Hey, you don't have to install autotest_server if you don't want,
just edit autoqa.conf and test your script locally". This can be added
to the wiki or to README.