#157: conflicts: requested arch not respected
--------------------+-------------------------------------------------------
Reporter: kparal | Owner:
Type: defect | Status: new
Priority: major | Milestone:
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
This is a bug in the potential_conflict.py script in tests/conflicts/.
Usage suggests using --arch options for specifying requested architecture
to be tested. But if you look at the attached log, the first and second
output match (that's correct), but the third doesn't match, even though it
should. Everything was tested on x86_64 machine.
Also from the usage line it is not clear whether --arch is related only to
particular yum repository selection (replacing $basearch keyword), or
whether it also relates to packages built for one architecture but being
in different repo (e.g. i686 packages are very often in x86_64 repo).
I have looked into the source code of the script and it seems that the
--arch option is not used at all, just printed out in the usage help??
Seth, you're listed as script author. Any comments on that? Thanks.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/157>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#206: Update bodhi to enforce Package Update Acceptance policy
----------------------------+-----------------------------------------------
Reporter: wwoods | Owner:
Type: task | Status: new
Priority: major | Milestone: Package Update Acceptance Test Plan
Component: infrastructure | Version: 1.0
Keywords: |
----------------------------+-----------------------------------------------
In order to enforce the Package Update Acceptance Test Plan, Bodhi will
need be modified to reject the push of any package that fails acceptance
testing.
The acceptance tests may need to send status/data to bodhi in order for it
to make decisions about policy (see e.g. ticket #205). Later bodhi might
just get data from resultdb (see that milestone for details).
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/206>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#186: Automate media kit sanity tests
--------------------+-------------------------------------------------------
Reporter: jlaska | Owner: lili
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
This ticket is intended to track automating the mediakit sanity tests
(http://fedoraproject.org/wiki/Category:Installer_Image_Sanity_Test_Cases)
Discussion already underway, along with code in Liam's private branch.
For details see https://fedorahosted.org/pipermail/autoqa-
devel/2010-June/000595.html
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/186>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#194: Incorporate automated anaconda storage suite
--------------------+-------------------------------------------------------
Reporter: jlaska | Owner:
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
Chris Lumens has developed a virt-based test suite to automate different
disk/storage install scenarios. I've discussed this briefly with Chris,
but I'd be interested in seeing his test suite incorporated within autoqa
and run on a regular interval (perhaps along-side Liam's install tests).
The tests are currently available at http://clumens.fedorapeople.org
/anaconda-storage-test/
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/194>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#182: Write virt management script
----------------------------+-----------------------------------------------
Reporter: kparal | Owner:
Type: task | Status: new
Priority: major | Milestone: Virtualization
Component: infrastructure | Version: 1.0
Keywords: |
----------------------------+-----------------------------------------------
We must write a virt management script that will be able to the basic
tasks for us:
* query for available virt systems that we can use
* switch between "real" disk and a disk snapshot for a virt system
* revert a disk snapshot for a virt system
* perform some command in a virt system - e.g. "yum update" for keeping
it periodically up-to-date
* install/reinstall a virt-system for us with specified distro
* (some more to come?)
We may want to use some pre-defined names syntax to recognize what virt
systems do we have. For example:
{{{
/dev/vg_autoqa/F12_i686_1
/dev/vg_autoqa/F12_i686_1-snap
}}}
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/182>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#196: Log failed job scheduling
-------------------------+--------------------------------------------------
Reporter: kparal | Owner: kparal
Type: enhancement | Status: new
Priority: major | Milestone:
Component: harness | Version: 1.0
Keywords: |
-------------------------+--------------------------------------------------
Currently when we schedule a job and it fails, we just print it out and
forget about it:
{{{
retval = schedule_job(control, email=email, name=testname,
required_arch=arch, dryrun=opts.dryrun,
labels=aq_labels)
if retval != 0:
print "ERROR: failed to schedule job %s" % testname
}}}
That should not be the case. We should:
* use syslog and log important stuff to /var/log/autoqa.log or similar
* send an email about failed scheduling to autoqa-results
That way we will know something is wrong and will be able to fix it.
Otherwise it just silently fails and we don't know about it.
Feel free to reassign the ticket if you want to work on it.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/196>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#125: initscripts: Choosing the right repo for dependencies
-------------------------+--------------------------------------------------
Reporter: kparal | Owner: jskladan
Type: task | Status: new
Priority: major | Milestone:
Component: tests | Version: 1.0
Keywords: initscripts |
-------------------------+--------------------------------------------------
Currently after new Koji build the initscripts test downloads all relevant
binary packages (related to the particular source package) and installs
them. But the RPM dependencies are installed from stable/updates repos,
not from Koji. Also the dependencies parsed out of Makefile are installed
from stable/updates repos.
We have to inquire a little more into this situation. Is it
sufficient/desirable? Or is it desirable to download dependencies from
updates-testing or bleeding edge Koji? May the initscripts test sometimes
fail because of insufficient dependencies are in stable/updates repos?
This also depends on cases when we are going to use initscripts test. If
it will be used with Bodhi hook, it will be probably easier to solve it
than when used with Koji hook.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/125>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#102: post-iso-build hook
----------------------+-----------------------------------------------------
Reporter: wwoods | Owner:
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: watchers | Version: 1.0
Keywords: |
----------------------+-----------------------------------------------------
We need one (or more) standard locations where new iso images get posted
for testing, and a watcher that can monitor for new iso images and launch
appropriate installation/sanity tests.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/102>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#209: complete auto CD install test driver
-------------------+--------------------------------------------------------
Reporter: liam | Owner:
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: tests | Version: 1.0
Keywords: |
-------------------+--------------------------------------------------------
complete the cd_install.py as dvd_install.py to support CD install, with
some functions like automatically swap CD when CD1 install was completed.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/209>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#149: rpmlint: Provide whitelisting of messages
--------------------+-------------------------------------------------------
Reporter: kparal | Owner:
Type: task | Status: new
Priority: major | Milestone: Package update tests
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
We need to provide some whitelisting capability of rpmlint packages, so
the package maintainers can mark some messages as invalid. We will also
probably want to mark some messages as invalid by default for the whole
Fedora project.
As an interesting inspiration, look at lintian project (validation of deb
packages). It provides some "overrides" on a package basis, you just
create a definition file in /etc/lintian/package_name or kind of. I have
the feeling that rpmlint provides something similar, but we need to
discover it more properly.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/149>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#104: virtguest.py: accept iso image(s) as install location
--------------------+-------------------------------------------------------
Reporter: wwoods | Owner:
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
allow {{{VirtGuest.create()}}} to use an iso image (or images) for its
{{{location}}} arg, and automatically choose the appropriate {{{--location
URL}}} or {{{--cdrom IMAGE}}} flag.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/104>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#183: Write a script and a daemon to send signals between virt machine and host
----------------------------+-----------------------------------------------
Reporter: kparal | Owner:
Type: task | Status: new
Priority: major | Milestone: Virtualization
Component: infrastructure | Version: 1.0
Keywords: |
----------------------------+-----------------------------------------------
We need to exchange some signals between virt machine and a host. For
example "autotest job finished, need to revert to previous state". We need
to write simple script that will send this signal for virt machine and a
daemon that will receive this signal in the host machine and act
accordingly.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/183>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#208: update minimon to transport logs between guest and host via virtio
-------------------+--------------------------------------------------------
Reporter: liam | Owner:
Type: task | Status: new
Priority: major | Milestone: Automate installation test plan
Component: tests | Version: 1.0
Keywords: |
-------------------+--------------------------------------------------------
Since minimon has to use network during test, some test cases will not
activate network during test,in this case, minimon can not transport logs
to host, test also be identified fail even it was successfully run.
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/208>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project
#214: conflicts: fails with parent repositories
--------------------+-------------------------------------------------------
Reporter: kparal | Owner:
Type: defect | Status: new
Priority: major | Milestone: Hot issues
Component: tests | Version: 1.0
Keywords: |
--------------------+-------------------------------------------------------
These two commands work (although the package counts are somewhat weirdly
same):
{{{
# repoclosure --tempcache --newest
--repofrompath=target,http://download.fedoraproject.org/pub/fedora/linux/releases/13/Everything/x86_64/os
--repoid=target
Added target repo from
/root/http:/download.fedoraproject.org/pub/fedora/linux/releases/13/Everything/x86_64/os
Reading in repository metadata - please wait....
Checking Dependencies
/usr/lib/python2.6/site-packages/yum/packages.py:401: UnicodeWarning:
Unicode equal comparison failed to convert both arguments to Unicode -
interpreting them as being unequal
if prcotuple in self.prco[prcotype]:
Repos looked at: 1
target
Num Packages in Repos: 20806
}}}
{{{
# repoclosure --tempcache --newest
--repofrompath=target,http://download.fedoraproject.org/pub/fedora/linux/updates/13/x86_64
--repoid=target
Added target repo from
/root/http:/download.fedoraproject.org/pub/fedora/linux/updates/13/x86_64
Reading in repository metadata - please wait....
Checking Dependencies
/usr/lib/python2.6/site-packages/yum/packages.py:401: UnicodeWarning:
Unicode equal comparison failed to convert both arguments to Unicode -
interpreting them as being unequal
if prcotuple in self.prco[prcotype]:
Repos looked at: 1
target
Num Packages in Repos: 20806
}}}
But if you combine it:
{{{
# repoclosure --tempcache --newest
--repofrompath=target,http://download.fedoraproject.org/pub/fedora/linux/updates/13/x86_64
--repoid=target
--repofrompath=parent1,http://download.fedoraproject.org/pub/fedora/linux/releases/13/Everything/x86_64/os
--repoid=parent1
Added target repo from
/root/http:/download.fedoraproject.org/pub/fedora/linux/updates/13/x86_64
Added parent1 repo from
/root/http:/download.fedoraproject.org/pub/fedora/linux/releases/13/Everything/x86_64/os
Reading in repository metadata - please wait....
Cannot retrieve repository metadata (repomd.xml) for repository: parent1.
Please verify its path and try again
Some dependencies may not be complete for this repository
Run as root to get all dependencies or use -t to enable a user temp cache
Checking Dependencies
Cannot retrieve repository metadata (repomd.xml) for repository: parent1.
Please verify its path and try again
}}}
Something is broken here.
{{{
yum-utils-1.1.28-1.fc13.noarch
yum-metadata-parser-1.1.4-1.fc13.x86_64
yum-3.2.27-4.fc13.noarch
}}}
--
Ticket URL: <https://fedorahosted.org/autoqa/ticket/214>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project