Staled build

[Dmitrij S. Kryzhevich]

Hi!

I have an issue with building a package under arm arch [1]. i686 and 
x86_64 builds completed with no errors but not arm. It is running (or 
staled) already more then for 10 hours.

The question: could I somehow investigate what going on there? And how 
(if yes)? I have no arm machine to run this build directly.

Dmitrij

[1] http://koji.fedoraproject.org/koji/buildinfo?buildID=701204

[Brendan Jones]

On 25/11/15 04:25, Dmitrij S. Kryzhevich wrote:
>  Hi!
>
>  I have an issue with building a package under arm arch [1]. i686 and
>  x86_64 builds completed with no errors but not arm. It is running (or
>  staled) already more then for 10 hours.
>
>  The question: could I somehow investigate what going on there? And how
>  (if yes)? I have no arm machine to run this build directly.
>
>  Dmitrij
>
>  [1] http://koji.fedoraproject.org/koji/buildinfo?buildID=701204 
I experienced the
same thing yesterday. Looks like the stall happens 
after the build phase (which only took half an hour). It actually 
completed after 14 hours after that.

https://koji.fedoraproject.org/koji/taskinfo?taskID=11962048

[Dmitrij S. Kryzhevich]

>  On 25/11/15 04:25, Dmitrij S. Kryzhevich wrote:
>  I experienced the same thing yesterday. Looks like the stall happens
>  after the build phase (which only took half an hour). It actually
>  completed after 14 hours after that.
>
>  https://koji.fedoraproject.org/koji/taskinfo?taskID=11962048 
18 hours. Still stalled.

[Dominik 'Rathann' Mierzejewski]

On Wednesday, 25 November 2015 at 10:17, Dmitrij S. Kryzhevich wrote:
>  >On 25/11/15 04:25, Dmitrij S. Kryzhevich wrote:
>  >I experienced the same thing yesterday. Looks like the stall happens
>  >after the build phase (which only took half an hour). It actually
>  >completed after 14 hours after that.
>  >
>  >https://koji.fedoraproject.org/koji/taskinfo?taskID=11962048
>  
>  18 hours. Still stalled. 
Looks like it completed in 12 hours, not 18:
Created	Tue, 24 Nov 2015 04:13:07 UTC
Started	Tue, 24 Nov 2015 04:13:11 UTC
Completed	Tue, 24 Nov 2015 16:47:45 UTC

Regards,
Dominik
-- 
Fedora http://fedoraproject.org/wiki/User:Rathann
RPMFusion http://rpmfusion.org
"Faith manages."
        -- Delenn to Lennier in Babylon 5:"Confessions and Lamentations"

[Dmitrij S. Kryzhevich]

>  On Wednesday, 25 November 2015 at 10:17, Dmitrij S. Kryzhevich
> wrote:
> >> On 25/11/15 04:25, Dmitrij S. Kryzhevich wrote:
> >> I experienced the same thing yesterday. Looks like the stall happens
> >> after the build phase (which only took half an hour). It actually
> >> completed after 14 hours after that.
> >>
> >> https://koji.fedoraproject.org/koji/taskinfo?taskID=11962048
> >
> > 18 hours. Still stalled.
>
>  Looks like it completed in 12 hours, not 18:
>  Created	Tue, 24 Nov 2015 04:13:07 UTC
>  Started	Tue, 24 Nov 2015 04:13:11 UTC
>  Completed	Tue, 24 Nov 2015 16:47:45 UTC
>  
I'm talking about my build from first message: 
http://koji.fedoraproject.org/koji/buildinfo?buildID=701204


>  Regards,
>  Dominik
>

[Kevin Fenzi]

On Wed, 25 Nov 2015 09:25:39 +0600
"Dmitrij S. Kryzhevich" <kryzhev(a)ispms.ru&gt; wrote:

>  Hi!
>  
>  I have an issue with building a package under arm arch [1]. i686 and 
>  x86_64 builds completed with no errors but not arm. It is running (or 
>  staled) already more then for 10 hours.
>  
>  The question: could I somehow investigate what going on there? And
>  how (if yes)? I have no arm machine to run this build directly. 
sure. 

It looks like it's stuck in: 

kojibui+  4858 99.9  0.1  20196  7520 ?        R    Nov24
1467:23 ../utils/make_bin -p /builddir/build/BUILD/mathgl-2.3.3/fonts/
-o /builddir/build/BUILD/mathgl-2.3.3/armv7hl-redhat-linux-gnueabi_serial/fonts/STIX.vfmb
STIX

An strace of that just stalls. 

You can use arm03-packager01.cloud.fedoraproject.org to duplicate. Its
the same exact hardware as the armv7 builders. 

kevin

[Dmitrij S. Kryzhevich]

>  On Wed, 25 Nov 2015 09:25:39 +0600
>  "Dmitrij S. Kryzhevich" <kryzhev(a)ispms.ru&gt; wrote:
>
> > Hi!
> >
> > I have an issue with building a package under arm arch [1]. i686 and
> > x86_64 builds completed with no errors but not arm. It is running (or
> > staled) already more then for 10 hours.
> >
> > The question: could I somehow investigate what going on there? And
> > how (if yes)? I have no arm machine to run this build directly.
>
>  sure.
>
>  It looks like it's stuck in:
>
>  kojibui+  4858 99.9  0.1  20196  7520 ?        R    Nov24
>  1467:23 ../utils/make_bin -p /builddir/build/BUILD/mathgl-2.3.3/fonts/
>  -o
> /builddir/build/BUILD/mathgl-2.3.3/armv7hl-redhat-linux-gnueabi_serial/fonts/STIX.vfmb
>  STIX
>
>  An strace of that just stalls.
>
>  You can use arm03-packager01.cloud.fedoraproject.org to duplicate. Its
>  the same exact hardware as the armv7 builders.
>
>  kevin
>
>  
Thanks! Somehow have forgotten about there existence.
(did successfully detect a problem)

Dmitrij

[Richard W.M. Jones]

On Wed, Nov 25, 2015 at 09:25:39AM +0600, Dmitrij S. Kryzhevich wrote:
>  Hi!
>  
>  I have an issue with building a package under arm arch [1]. i686 and
>  x86_64 builds completed with no errors but not arm. It is running
>  (or staled) already more then for 10 hours.
>  
>  The question: could I somehow investigate what going on there? And
>  how (if yes)? I have no arm machine to run this build directly.
>  
>  Dmitrij
>  
>  [1] http://koji.fedoraproject.org/koji/buildinfo?buildID=701204 
I'm not saying this is exactly your problem (it won't be because we
fixed it), but we've seen bugs like this one which affected only ARM
builds:

  https://bugzilla.redhat.com/show_bug.cgi?id=1222286

Infuriatingly difficult to debug too :-(

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
libguestfs lets you edit virtual machines.  Supports shell scripting,
bindings from many languages.  http://libguestfs.org