autoqa-devel August 2010

autoqa-devel@lists.fedorahosted.org

7 participants
87 discussions

[AutoQA] #184: Add tags for destructive testing
by fedora-badges 02 Aug '10

02 Aug '10

#184: Add tags for destructive testing ----------------------------+----------------------------------------------- Reporter: kparal | Owner: Type: task | Status: new Priority: major | Milestone: Virtualization Component: infrastructure | Version: 1.0 Keywords: | ----------------------------+----------------------------------------------- We need to add tags into autotest and autoqa tests that will determine whether test is (may be) destructive. This tag must be propagated and appropriate test client must be selected. After finishing this test the test machine must be restored to a previous safe state. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/184> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 1

[AutoQA] #181: Quick and dirty support for Virtualization
by fedora-badges 02 Aug '10

02 Aug '10

#181: Quick and dirty support for Virtualization ----------------------------+----------------------------------------------- Reporter: kparal | Owner: Type: task | Status: new Priority: major | Milestone: Virtualization Component: infrastructure | Version: 1.0 Keywords: | ----------------------------+----------------------------------------------- The task is to implement quick and dirty support for virtualization for AutoQA tests. We can already install autotest-client into virt machine, but there are some tests which must not run inside virt environment (tests using virt themselves for example). Therefore we must ensure all our tests are marked properly ("may use virt", "may not use virt"), all our tests clients are marked properly ("is virt", "is bare metal"), and this information are propagated from AutoQA to autotest-server and used properly when selecting appropriate host and scheduling jobs. This could be quite easy, there is some support for tags in autotest already. As an enhancement, we may think about preferences. Do we want to mark some test that it is preferred to run it in virt, but may also be run on bare metal? How do we achieve correct behavior for autotest-server for such task? For example: We may want to prefer executing sanity tests in virt env, but it's not really mandatory, just desired. Food for thoughts. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/181> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 10

[AutoQA] #207: post-koji-build watcher does not watch for new updates-candidate builds
by fedora-badges 02 Aug '10

02 Aug '10

#207: post-koji-build watcher does not watch for new updates-candidate builds ----------------------+----------------------------------------------------- Reporter: kparal | Owner: Type: defect | Status: new Priority: major | Milestone: Package Update Acceptance Test Plan Component: watchers | Version: 1.0 Keywords: | ----------------------+----------------------------------------------------- I have found out that our post-koji-build watches only these tags: dist-f10 dist-f10-updates dist-f10-updates-testing dist-f11 dist-f11-updates dist-f11-updates-testing dist-f12 dist-f12-updates dist-f12-updates-testing dist-f13 dist-f13-updates dist-f13-updates- testing dist-f14 Which is incorrect, we should be watching dist-f*-updates-candidate (and maybe dist-f14, I don't know). We don't need to watch for the rest of it. The change happened in commit 580734d4f2aa768aefa1c0498904df2296747918. See the diff and inspect current contents of repoinfo.conf to grasp the change. The result is that we don't currently test almost any packages except f14 ones. Do we have it already deployed on our production machine? What we can do about it? Well, I hope someone with a deep understanding of repoinfo stuff knows what's the best approach :) It seems to me that we could define the *-updates-testing repositories in repoinfo.conf (and make sure we didn't break something else) and retrieve and select just those in watch-koji-builds. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/207> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

2 5

[AutoQA] #200: Multiple control files / multiple test wrappers
by fedora-badges 02 Aug '10

02 Aug '10

#200: Multiple control files / multiple test wrappers --------------------+------------------------------------------------------- Reporter: wwoods | Owner: Type: task | Status: new Priority: major | Milestone: Multi-hook tests Component: tests | Version: 1.0 Keywords: | --------------------+------------------------------------------------------- For a test to run under multiple hooks, it may need multiple control files, since we may want to do slightly different things to prepare for each test. We could have multiple test wrappers and conditionalize the job.run_test() argument based on the calling hook, for example: if hook == 'post-koji-build': job.run_test('mytest_koji', name=name, envrs=envrs, ...) elif hook == 'post-bodhi-update': job.run_test('mytest_bodhi', name=name, envrs=envrs, ...) Alternately, we could have multiple control.HOOKNAME files - one for each hook the test can be run under. This would also allow us to eliminate the use of the 'testlist' file to determine the tests that are eligible for use in each hook - each test would be able to declare how to run itself under each hook. This ticket requires deciding on a method for handling multi-hook tests, documenting that method, and (perhaps) converting existing tests. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/200> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 2

[AutoQA] #211: Update repoinfo.conf - Add branch f14
by fedora-badges 02 Aug '10

02 Aug '10

#211: Update repoinfo.conf - Add branch f14 ----------------------------+----------------------------------------------- Reporter: jkeating | Owner: Type: task | Status: new Priority: critical | Milestone: Component: infrastructure | Version: 1.0 Keywords: | ----------------------------+----------------------------------------------- We branched, SOp says make a ticket. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/211> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 2

[AutoQA] #195: Write HelloWorld test
by fedora-badges 02 Aug '10

02 Aug '10

#195: Write HelloWorld test --------------------+------------------------------------------------------- Reporter: kparal | Owner: kparal Type: task | Status: new Priority: major | Milestone: Component: tests | Version: 1.0 Keywords: | --------------------+------------------------------------------------------- Write a HelloWorld test that will just serve for testing purposes. More information here: https://fedorahosted.org/pipermail/autoqa-devel/2010-June/000727.html If anyone is eager to write this, feel free to reassign. -- Ticket URL: <https://fedorahosted.org/autoqa/ticket/195> AutoQA <http://autoqa.fedorahosted.org> Automated QA project

1 5

Update repoinfo.conf for F-14 branch
by James Laska 02 Aug '10

02 Aug '10

Greetings, Per ticket#211, I have updated repoinfo.conf for the new F-14 branch. Instructions for updating repoinfo.conf are on the wiki at https://fedoraproject.org/wiki/How_to_update_AutoQA_repoinfo.conf. I have tested this change and confirmed that watch-koji-builds.py goes from monitoring these repos: Looking for builds with tags dist-f10-updates-candidate dist-f11-updates-candidate dist-f12-updates-candidate dist-f13-updates-candidate dist-f14 To monitoring for koji builds in these repos: Looking for builds with tags dist-f10-updates-candidate dist-f11-updates-candidate dist-f12-updates-candidate dist-f13-updates-candidate dist-f14-updates-candidate dist-f15 Thanks, James

2 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

autoqa-devel August 2010