Error - depcheck including multiple versions of same package ?

[James Laska]

Greetings,

Just tossing this to the list for review before it gets buried.  I've
seen this with several depcheck results so far.  Is the fwd'd depcheck
log finding a bug in bodhi/koji where multiple versions of a package are
showing up?

Thanks,
James

[Tim Flink]

On 03/17/2011 12:30 PM, James Laska wrote:
> Greetings,
>
> Just tossing this to the list for review before it gets buried.  I've
> seen this with several depcheck results so far.  Is the fwd'd depcheck
> log finding a bug in bodhi/koji where multiple versions of a package are
> showing up?

I've been looking through depcheck logs and comparing them against data
from bodhi and koji. I'm pretty much at the limit of my knowledge and
google-fu, when it comes to the purpose of the *-pending koji tags, though.

There are other packages that show this behavior, but I was looking at qemu.

There have been 2 updates to qemu recently; qemu-0.14.0-2.fc15 and
qemu-0.14.0-3.fc15. qemu-0.14.0-2.fc15 is already out of updates-testing
(has koji tag dist-f15-updates-pending) and qemu-0.14.0-3.fc15 is
pending a push to updates-testing (has koji tag
dist-f15-updates-testing-pending). I put more details on the package's
data in koji/bodhi at the end of this email.

From the way that we're classifying packages in watch-koji-builds, any
package with a koji tag ending in '-pending' is sent to depcheck - for
now this means dist-f15-updates-pending and
dist-f15-updates-testing-pending for Fedora 15.

Is this really what we want to be doing? I would think that we would
want to just send *-updates-testing-pending packages to depcheck.
However, I could be quite wrong on that. I can't find any information on
koji's *-pending tags other than that they're related to AutoQA so I'm
going on intuition here.

On the other hand, this could just be a side-effect of not enabling
bodhi comments since the existence of an autoqa "PASSED" comment does
affect how depcheck is called and how it creates yum metadata.

Tim

----------------------------------------
qemu-0.14.0-2.fc15

Timeline:
  2011-03-02 - built in koji
  2011-03-03 - submitted for testing
  2011-03-04 - pushed to testing
  2011-03-07 - submitted for stable
  2011-03-08 - pushed to stable

Tags:
  dist-f15
  dist-f15-updates-candidate
  dist-f15-updates-pending
  dist-f15-updates-testing

https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15?_csrf_token=6461b...

http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
----------------------------------------

----------------------------------------
qemu-0.14.0-3.fc15

Timeline:
  2011-03-17 - built in koji
  2011-03-17 - submitted for testing

Tags:
  dist-f15-updates-candidate
  dist-f15-updates-testing-pending

https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15?_csrf_token=6461b...

http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
----------------------------------------

[Tim Flink]

On 03/17/2011 07:15 PM, Tim Flink wrote:
<snip>

Oh, the evils of copy paste!. Forgot to update the links in the extra data.

Tim

----------------------------------------
qemu-0.14.0-2.fc15

Timeline:
  2011-03-02 - built in koji
  2011-03-03 - submitted for testing
  2011-03-04 - pushed to testing
  2011-03-07 - submitted for stable
  2011-03-08 - pushed to stable

Tags:
  dist-f15
  dist-f15-updates-candidate
  dist-f15-updates-pending
  dist-f15-updates-testing

https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15

http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
----------------------------------------

----------------------------------------
qemu-0.14.0-3.fc15

Timeline:
  2011-03-17 - built in koji
  2011-03-17 - submitted for testing

Tags:
  dist-f15-updates-candidate
  dist-f15-updates-testing-pending

https://admin.fedoraproject.org/updates/qemu-0.14.0-3.fc15

http://koji.fedoraproject.org/koji/buildinfo?buildID=234195
----------------------------------------

[Josef Skladanka]

Thank you for the timeline!

IMHO, the problem is this:

2:qemu-0.14.0-3.fc15.x86_64 from pending has depsolving problems
  --> Package: 2:qemu-0.14.0-3.fc15.x86_64 (pending)
  -->     Requires: qemu-system-ppc = 2:0.14.0-3.fc15
  -->     Installed: 2:qemu-system-ppc-0.14.0-2.fc15.x86_64 (f15)
  -->         qemu-system-ppc = 2:0.14.0-2.fc15

2:qemu-system-ppc-0.14.0-3.fc15.x86_64 requires: openbios-ppc
--> Processing Dependency: openbios-ppc for package: 2:qemu-system-ppc-0.14.0-3.fc15.x86_64
Searching pkgSack for dep: openbios-ppc

qemu depends on qemu-system-ppc (so far so good), but qemu-system-ppc needs openbios-ppc,
and this package is not present.

I might be wrong, of course, but IMHO this is the problem causing quemu to fail, not
that there are two versions of it.

Joza

----- Original Message -----
> From: "Tim Flink" 
> To: [e-mail]
> Sent: Friday, March 18, 2011 2:20:37 AM
> Subject: Re: Error - depcheck including multiple versions of same package ?
> On 03/17/2011 07:15 PM, Tim Flink wrote:
>
> <snip>
>
> Oh, the evils of copy paste!. Forgot to update the links in the extra
> data.
>
> Tim
>
> qemu-0.14.0-2.fc15
>
> Timeline:
> 2011-03-02 - built in koji
> 2011-03-03 - submitted for testing
> 2011-03-04 - pushed to testing
> 2011-03-07 - submitted for stable
> 2011-03-08 - pushed to stable
>
> Tags:
> dist-f15
> dist-f15-updates-candidate
> dist-f15-updates-pending
> dist-f15-updates-testing
>
> https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15
> http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
>
> qemu-0.14.0-3.fc15
>
> Timeline:
> 2011-03-17 - built in koji
> 2011-03-17 - submitted for testing
>
> Tags:
> dist-f15-updates-candidate
> dist-f15-updates-testing-pending
>
> https://admin.fedoraproject.org/updates/qemu-0.14.0-3.fc15
> http://koji.fedoraproject.org/koji/buildinfo?buildID=234195
>
> autoqa-devel mailing list
> [e-mail]
> https://fedorahosted.org/mailman/listinfo/autoqa-devel

[Tim Flink]

On 03/18/2011 03:32 AM, Josef Skladanka wrote:
> Thank you for the timeline!
>
> IMHO, the problem is this:
>
> 2:qemu-0.14.0-3.fc15.x86_64 from pending has depsolving problems -->
> Package: 2:qemu-0.14.0-3.fc15.x86_64 (pending) -->     Requires:
> qemu-system-ppc = 2:0.14.0-3.fc15 -->     Installed:
> 2:qemu-system-ppc-0.14.0-2.fc15.x86_64 (f15) -->
> qemu-system-ppc = 2:0.14.0-2.fc15
>
> 2:qemu-system-ppc-0.14.0-3.fc15.x86_64 requires: openbios-ppc -->
> Processing Dependency: openbios-ppc for package:
> 2:qemu-system-ppc-0.14.0-3.fc15.x86_64 Searching pkgSack for dep:
> openbios-ppc
>
> qemu depends on qemu-system-ppc (so far so good), but qemu-system-ppc
> needs openbios-ppc, and this package is not present.
>
> I might be wrong, of course, but IMHO this is the problem causing
> quemu to fail, not that there are two versions of it.

I agree with your analysis on why the run failed but I thought that the
original question was about why there were multiple versions in the same
depcheck run instead of why it was failing.

Tim
> Joza
>
> ----- Original Message -----
> > From: "Tim Flink"  To:
> > [e-mail] Sent: Friday, March 18, 2011
> > 2:20:37 AM Subject: Re: Error - depcheck including multiple
> > versions of same package ? On 03/17/2011 07:15 PM, Tim Flink
> > wrote: <snip>
> >
> > Oh, the evils of copy paste!. Forgot to update the links in the
> > extra data.
> >
> > Tim
> >
> > ---------------------------------------- qemu-0.14.0-2.fc15
> >
> > Timeline: 2011-03-02 - built in koji 2011-03-03 - submitted for
> > testing 2011-03-04 - pushed to testing 2011-03-07 - submitted for
> > stable 2011-03-08 - pushed to stable
> >
> > Tags: dist-f15 dist-f15-updates-candidate dist-f15-updates-pending 
> > dist-f15-updates-testing
> >
> > https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15
> > http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
> >
> > ---------------------------------------- qemu-0.14.0-3.fc15
> >
> > Timeline: 2011-03-17 - built in koji 2011-03-17 - submitted for
> > testing
> >
> > Tags: dist-f15-updates-candidate dist-f15-updates-testing-pending
> >
> > https://admin.fedoraproject.org/updates/qemu-0.14.0-3.fc15
> > http://koji.fedoraproject.org/koji/buildinfo?buildID=234195
> >
> > _______________________________________________ autoqa-devel
> > mailing list [e-mail] 
> > https://fedorahosted.org/mailman/listinfo/autoqa-devel
>
> _______________________________________________ autoqa-devel mailing
> list [e-mail] 
> https://fedorahosted.org/mailman/listinfo/autoqa-devel

[Josef Skladanka]

Ah, my bad - guess I won't read work related email right before my morning shower.
I thought that the problem was "why is depcheck failing", I'll try to dig into
the real one during weekend :)

J.

----- Original Message -----
> From: "Tim Flink" 
> To: [e-mail]
> Sent: Friday, March 18, 2011 4:23:33 PM
> Subject: Re: Error - depcheck including multiple versions of same package ?
> On 03/18/2011 03:32 AM, Josef Skladanka wrote:
> > Thank you for the timeline!
> >
> > IMHO, the problem is this:
> >
> > 2:qemu-0.14.0-3.fc15.x86_64 from pending has depsolving problems -->
> > Package: 2:qemu-0.14.0-3.fc15.x86_64 (pending) --> Requires:
> > qemu-system-ppc = 2:0.14.0-3.fc15 --> Installed:
> > 2:qemu-system-ppc-0.14.0-2.fc15.x86_64 (f15) -->
> > qemu-system-ppc = 2:0.14.0-2.fc15
> >
> > 2:qemu-system-ppc-0.14.0-3.fc15.x86_64 requires: openbios-ppc -->
> > Processing Dependency: openbios-ppc for package:
> > 2:qemu-system-ppc-0.14.0-3.fc15.x86_64 Searching pkgSack for dep:
> > openbios-ppc
> >
> > qemu depends on qemu-system-ppc (so far so good), but
> > qemu-system-ppc
> > needs openbios-ppc, and this package is not present.
> >
> > I might be wrong, of course, but IMHO this is the problem causing
> > quemu to fail, not that there are two versions of it.
>
> I agree with your analysis on why the run failed but I thought that
> the
> original question was about why there were multiple versions in the
> same
> depcheck run instead of why it was failing.
>
> Tim
> > Joza
> >
> > ----- Original Message -----
> > > From: "Tim Flink"  To:
> > > [e-mail] Sent: Friday, March 18, 2011
> > > 2:20:37 AM Subject: Re: Error - depcheck including multiple
> > > versions of same package ? On 03/17/2011 07:15 PM, Tim Flink
> > > wrote: <snip>
> > >
> > > Oh, the evils of copy paste!. Forgot to update the links in the
> > > extra data.
> > >
> > > Tim
> > >
> > > ---------------------------------------- qemu-0.14.0-2.fc15
> > >
> > > Timeline: 2011-03-02 - built in koji 2011-03-03 - submitted for
> > > testing 2011-03-04 - pushed to testing 2011-03-07 - submitted for
> > > stable 2011-03-08 - pushed to stable
> > >
> > > Tags: dist-f15 dist-f15-updates-candidate dist-f15-updates-pending
> > > dist-f15-updates-testing
> > >
> > > https://admin.fedoraproject.org/updates/qemu-0.14.0-2.fc15
> > > http://koji.fedoraproject.org/koji/buildinfo?buildID=231714
> > >
> > > ---------------------------------------- qemu-0.14.0-3.fc15
> > >
> > > Timeline: 2011-03-17 - built in koji 2011-03-17 - submitted for
> > > testing
> > >
> > > Tags: dist-f15-updates-candidate dist-f15-updates-testing-pending
> > >
> > > https://admin.fedoraproject.org/updates/qemu-0.14.0-3.fc15
> > > http://koji.fedoraproject.org/koji/buildinfo?buildID=234195
> > >
> > > _______________________________________________ autoqa-devel
> > > mailing list [e-mail]
> > > https://fedorahosted.org/mailman/listinfo/autoqa-devel
> >
> > _______________________________________________ autoqa-devel mailing
> > list [e-mail]
> > https://fedorahosted.org/mailman/listinfo/autoqa-devel
>
> autoqa-devel mailing list
> [e-mail]
> https://fedorahosted.org/mailman/listinfo/autoqa-devel

[James Laska]

On Fri, 2011-03-18 at 11:38 -0400, Josef Skladanka wrote:
> Ah, my bad - guess I won't read work related email right before my morning shower.
> I thought that the problem was "why is depcheck failing", I'll try to dig into
> the real one during weekend :)

The good news is, you're both right :)

From the output, I hadn't figured out why qemu was failing depcheck in
this case.  So good to know why there are multiple versions *and* why
qemu wasn't getting past depcheck.

https://bugzilla.redhat.com/show_bug.cgi?id=679179

Thanks all!
James

[Kamil Paral]

> I've been looking through depcheck logs and comparing them against
> data
> from bodhi and koji. I'm pretty much at the limit of my knowledge and
> google-fu, when it comes to the purpose of the *-pending koji tags,
> though.
>
> There are other packages that show this behavior, but I was looking at
> qemu.
>
> There have been 2 updates to qemu recently; qemu-0.14.0-2.fc15 and
> qemu-0.14.0-3.fc15. qemu-0.14.0-2.fc15 is already out of
> updates-testing
> (has koji tag dist-f15-updates-pending) and qemu-0.14.0-3.fc15 is
> pending a push to updates-testing (has koji tag
> dist-f15-updates-testing-pending). I put more details on the package's
> data in koji/bodhi at the end of this email.
>
> From the way that we're classifying packages in watch-koji-builds, any
> package with a koji tag ending in '-pending' is sent to depcheck - for
> now this means dist-f15-updates-pending and
> dist-f15-updates-testing-pending for Fedora 15.
>
> Is this really what we want to be doing? I would think that we would
> want to just send *-updates-testing-pending packages to depcheck.
> However, I could be quite wrong on that. I can't find any information
> on
> koji's *-pending tags other than that they're related to AutoQA so I'm
> going on intuition here.
> From a quick look, everything seems well. We asked depcheck to check everything that's about to enter dist-f15-updates-testing [1]. That means everything in the dist-f15-updates-testing-pending flag. That means "qemu-...-3.fc15". You can see it listed among the "pending builds" [2].

In the process, depcheck considers everything from dist-f15-updates-testing installed. That means "qemu-...-2.fc15". And then it tries to update all the packages from the "pending builds" set.

Unfortunately that fails for qemu. That causes depcheck to reject both versions. (I argued [3] that it should reject just the one package from "pending set" - the newer one - but wwoods said the current behavior is correct. So that's the reason why they are listed both).

[1] http://autoqa.fedoraproject.org/results/68249-autotest/qa04.c.fedoraproject....
[2] http://autoqa.fedoraproject.org/results/68249-autotest/qa04.c.fedoraproject....
[3] https://fedorahosted.org/autoqa/ticket/279