python-bugzilla performance question

[Dave Johnson]

Is it just me or does querying RH bugzilla version 5 through
python-bugzilla now painfully slow?  Queries that took seconds to come back
now take 10-15 minutes.

Translating that same query into a bugzilla URL and clicking on it renders
as expected within seconds but it seems querying with python-bugzilla now
is almost unusable.

Am I missing something?  Where am I going wrong here?

Thanks,
-Dave

[Bryan Kearney]

I have noticed that the fields/bug is super slow in BZ 5, it times out
for me in ruby and does not seem to accept the include_fields directive.

-- bk

On 12/11/18 11:39 PM, Dave Johnson wrote:
> Is it just me or does querying RH bugzilla version 5 through
> python-bugzilla now painfully slow?  Queries that took seconds to come
> back now take 10-15 minutes.
>
> Translating that same query into a bugzilla URL and clicking on it
> renders as expected within seconds but it seems querying with
> python-bugzilla now is almost unusable.
>
> Am I missing something?  Where am I going wrong here?
>
> Thanks,
> -Dave
>
> python-bugzilla mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedorahosted.org/archives/list/[e-mail]...

[Dustin Mitchell]

python-bugzilla doesn't do anything that could take 15 minutes --
unless you're somehow parsing 100's of GB of XML or something like
that.  It's more likely you're seeing differences in response times
from the RH bugzilla, and that may be due to some caching either at
the Bugzilla or MySQL layers.

You could figure it out by adding some temporary logging statements
(maybe just print(..)) to python-bugzilla to see when it finishes
sending the request, and when it begins getting the response.  I
suspect all but a second or two of those 10-15 minutes are spent
waiting.

Dustin
On Wed, Dec 12, 2018 at 8:39 AM Dave Johnson  wrote:
> Is it just me or does querying RH bugzilla version 5 through python-bugzilla now painfully slow?  Queries that took seconds to come back now take 10-15 minutes.
>
> Translating that same query into a bugzilla URL and clicking on it renders as expected within seconds but it seems querying with python-bugzilla now is almost unusable.
>
> Am I missing something?  Where am I going wrong here?
>
> Thanks,
> -Dave
>
> python-bugzilla mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedorahosted.org/archives/list/[e-mail]...

[Dave Johnson]

Right, it's waiting on bugzilla, I could have wrote that first email
better, just trying to confirm if others see it too and see if anyone has a
lead on escalating that.

-Dave

On Wed, Dec 12, 2018 at 9:40 AM Dustin Mitchell  wrote:
> python-bugzilla doesn't do anything that could take 15 minutes --
> unless you're somehow parsing 100's of GB of XML or something like
> that.  It's more likely you're seeing differences in response times
> from the RH bugzilla, and that may be due to some caching either at
> the Bugzilla or MySQL layers.
>
> You could figure it out by adding some temporary logging statements
> (maybe just print(..)) to python-bugzilla to see when it finishes
> sending the request, and when it begins getting the response.  I
> suspect all but a second or two of those 10-15 minutes are spent
> waiting.
>
> Dustin
> On Wed, Dec 12, 2018 at 8:39 AM Dave Johnson  wrote:
> > Is it just me or does querying RH bugzilla version 5 through
>
> python-bugzilla now painfully slow?  Queries that took seconds to come back
> now take 10-15 minutes.
> > Translating that same query into a bugzilla URL and clicking on it
>
> renders as expected within seconds but it seems querying with
> python-bugzilla now is almost unusable.
> > Am I missing something?  Where am I going wrong here?
> >
> > Thanks,
> > -Dave
> >
> > python-bugzilla mailing list -- [e-mail]
> > To unsubscribe send an email to
>
> [e-mail]
> > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
>
> https://lists.fedorahosted.org/archives/list/[e-mail]...

[Cole Robinson]

On 12/11/2018 11:39 PM, Dave Johnson wrote:
> Is it just me or does querying RH bugzilla version 5 through 
> python-bugzilla now painfully slow?  Queries that took seconds to come 
> back now take 10-15 minutes.
>
> Translating that same query into a bugzilla URL and clicking on it 
> renders as expected within seconds but it seems querying with 
> python-bugzilla now is almost unusable.
>
> Am I missing something?  Where am I going wrong here?

Like others indicate, this is probably a bug on rhbz side after the 
bugzilla 5 upgrade. Can you provide the query you are using? I'll poke 
at it and file an rhbz bug

Thanks,
Cole

[Bryan Kearney]

On 12/12/18 9:52 AM, Cole Robinson wrote:
> On 12/11/2018 11:39 PM, Dave Johnson wrote:
> > Is it just me or does querying RH bugzilla version 5 through
> > python-bugzilla now painfully slow?  Queries that took seconds to come
> > back now take 10-15 minutes.
> >
> > Translating that same query into a bugzilla URL and clicking on it
> > renders as expected within seconds but it seems querying with
> > python-bugzilla now is almost unusable.
> >
> > Am I missing something?  Where am I going wrong here?
>
> Like others indicate, this is probably a bug on rhbz side after the
> bugzilla 5 upgrade. Can you provide the query you are using? I'll poke
> at it and file an rhbz bug

calling bugzilla.getbugfields() is about 2 minutes. I opened
https://bugzilla.redhat.com/show_bug.cgi?id=1658636 for this.

-- bk