MM2 crawler crash solved
by Adrian Reber
While trying to recreate the mm2_crawler crash without the MirrorManager
database as backend I discovered that the crawler mainly uses python's
httplib to do all the HEAD requests. For repomd.xml file, which are
actually downloaded, the crawler switches to urlgrabber. Which seems to
be problematic in threaded applications. Or in combination with httplib.
Or something.
The easiest solution seems to be to rewrite the single
urlgrabber.urlread() to use one of the other available methods.
So a question to the python experts. Which implementation is the
"best" to download a single repomd.xml via either http or ftp?
I would replace it with urllib2. Is that the correct replacement?
Adrian
7 years, 11 months
Freeze Break Request: Increase execution timeouts in taskotron's buildbot
by Tim Flink
As the set of packages in f22 has grown with freeze, some of the tasks
(most often depcheck) are not completing before hitting the default
timeout of 20 minutes for execution in buildbot.
I want to double the timeout for task execution from 20 to 40 minutes.
I've made the change in dev and stg already and the change works - long
tasks are no longer being killed prior to completion. This freeze break
is for production.
+1s?
Tim
diff --git a/roles/taskotron/buildmaster-configure/templates/taskotron.master.cfg.j2 b/roles/taskotron/bu
index d7a698f..1a63b0e 100644
--- a/roles/taskotron/buildmaster-configure/templates/taskotron.master.cfg.j2
+++ b/roles/taskotron/buildmaster-configure/templates/taskotron.master.cfg.j2
@@ -175,9 +175,7 @@ factory.addStep(ShellCommand(command=["runtask",
Interpolate('%(prop:taskname)s.yml')],
descriptionDone=[Interpolate('%(prop:taskname)s on %(prop:item)s')],
name='runtask',
-{% if deployment_type in ['dev', 'stg'] %}
timeout=2400,
-{% endif %}
logfiles={'taskotron.log': {'filename': '/var/log/taskotron/taskotron.log',
7 years, 11 months
Plan for tomorrow's Fedora Infrastructure meeting (2015-04-09)
by Kevin Fenzi
The infrastructure team will be having it's weekly meeting tomorrow,
2015-04-09 at 18:00 UTC in #fedora-meeting on the freenode network.
This week we are continuing to try something new.
We have a gobby document
(see: https://fedoraproject.org/wiki/Gobby )
fedora-infrastructure-meeting-next is the document.
Please try and review and edit that document before the meeting and we
will use it to have our agenda of things to discuss. A copy as of this
morning is included in this email.
kevin
--
#startmeeting Infrastructure (2015-04-09)
#meetingname infrastructure
#topic aloha
#chair smooge relrod nirik abadger1999 lmacken dgilmore mdomsch threebean pingou puiterwijk
#topic New folks introductions / Apprentice feedback
= Status / information / Trivia / Announcements =
(We put things here we want others on the team to know, but don't need to discuss)
(Please use #info <the thing> - your name)
#topic announcements and information
#info New release of Fedora Badges deployed with updated leaderboard, profiles, and frontpage - ralph
#link https://badges.fedoraproject.org/
#info two new pkgdb release (bug fixes on pkgdb-sync-bugzilla) - pingou
#info new anitya release (mostly bug fix) - pingou
#info
= Things we should discuss =
We use this section to bring up discussion topics. Things we want to talk about
as a group and come up with some consensus or decision or just brainstorm a
problem or issue. If there are none of these we skip this section.
(Use #topic your discussion topic - your username)
#topic do we need warm spare hosted/collab instances anymore? - kevin
#topic
= Learn about some application or setup in infrastructure =
(This section, each week we get 1 person to talk about an application or setup
that we have. Just going over what it is, how to contribute, ideas for improvement,
etc. Whoever would like to do this, just add the info in this section. In the
event we don't find someone to teach about something, we skip this section
and just end the meeting.)
#topic Learn about
= Meeting end stuff =
#topic Open Floor
#endmeeting
7 years, 11 months
Freeze break request: Resolve beaker-project.org
by Patrick Uiterwijk
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Hi,
Any +1s for the following patch?
commit 07ea05c95471dd4e0a9eb666652f69d6a77ebc5e
Author: Patrick Uiterwijk <puiterwijk(a)redhat.com>
Date: Wed Apr 8 15:12:08 2015 +0000
Also forward beaker-project.org
Signed-off-by: Patrick Uiterwijk <puiterwijk(a)redhat.com>
diff --git a/roles/dns/files/named.conf b/roles/dns/files/named.conf
index 8e118cd..c9e636b 100644
- --- a/roles/dns/files/named.conf
+++ b/roles/dns/files/named.conf
@@ -103,6 +103,12 @@ view "PHX2" {
forwarders { 10.5.26.20; 10.5.26.21; };
};
+ zone "beaker-project.org" {
+ type forward;
+ forward only;
+ forwarders { 10.5.26.20; 10.5.26.21; };
+ };
+
# also, we need to forward some jboss.org for fuse-fabric/bugzilla2fedmsg
zone "jboss.org" {
type forward;
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
iQIcBAEBCgAGBQJVJUYlAAoJEIZXmA2atR5Q6f8P/37aR5pFNFr7l++auKdM9nh/
IXDuiKGzXIagfCmE9X1yAVAwvedjiiUcatu0h04+gbvGeR2shopTBy8s0R6pmYum
OR2EHRW2pNC5wUWsW7Vr7eyInKoWuTmtd8sZfwYS5nTWA0gfj4kw7UIgcQk7kllH
WmmDHAL3d4X+mLSFxT0PTkDZLYyYpQT3LhIvkVjTvvFciCUJ4bP3jOG7LN431BeW
fQLJvyQUm0/poPspsnb/sQrDS0mvXtTXlDk+hdqsvaZ0W08rdNqyY/g0ur9PE9KK
C3hwLBAEPX4RKkQ0MaJSiNXSy7FUol+ycKPE8czUubv5V4vvFFoCNC8Bo30rzjlr
vSZ4LNsLlZjgDINMMM4zRRtR006pVltyqHWQvjFuZf9m45hXyFJAK1ksyd0p6T/U
9NozYmHsD7aM9zuq/tp7ZsQvYsUZtSd3VDG1MTHYjIXa8J3vrzmeQ+MiAKTxJFfX
8dRQaxjnrTogaN4eHp2iZ/4MCv928eK0FK2rL+w4tdRSNkh64hftv4dLwytRUMsu
TU1lNRwTksTQ3+nP6atVFbaGUzFaEZ3en57cVa0IyhZjhCYx+iEHeVHtpK2bixOs
repZkedjZaUeVAdSh73PdUP6JcIFgVdCV/IXJvjy5W+U+Mor6ZtIaPI8fVK/1Mmp
T706zxX4QLIILIV1YJbL
=kAPP
-----END PGP SIGNATURE-----
7 years, 11 months
[release] pkgdb2: 1.24.3
by Pierre-Yves Chibon
Hi all,
With the two +1 I just pushed a new release of pkgdb2: 1.24.3
Here is its changelog:
* Wed Apr 08 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 1.24.3-1
- Update to 1.24.3
- Fix the pkgdb-sync-bugzilla script to notify the user only once per hour
Thanks,
Pierre
7 years, 11 months
Freeze Break Request - pkdb2 (2)
by Pierre-Yves Chibon
Hi all,
Yesterday I pushed a new release of pkgdb2 fixing a bug in the
pkgdb-sync-bugzilla script. This fix actually put Kevin and I in CC to the
emails sent to the user.
This has lead to finding another bug in that script making it send an email to
the user for each package that this person maintains in pkgdb (and that we thus
cannot update in bugzilla).
The number of emails sent to the user is a little too much and not what we want.
I have proposed a fix at: https://github.com/fedora-infra/pkgdb2/pull/176 and
would like to cut a new release and to push it.
+1/-1/thoughts?
Thanks,
Pierre
7 years, 11 months
[release] anitya 0.4.0
by Pierre-Yves Chibon
Good morning everyone,
I just released a new version of anitya: 0.4.0
Here is its changelog:
* Sun Apr 05 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 0.4.0-1
- Fix the search to uniquify the results
- Prevent the keyboard shortcuts to work is the control key was hold
- Sort versions consistently (Ralph Bean)
- Fix GitHub capitalization (Piotr Popieluch)
- Fix the pagination when browsing the list of projects (limit was wrongly set)
As you can see, mostly bug fixes and a couple of fixes :)
This is now live.
Thanks,
Pierre
7 years, 11 months
Freeze Break Request - anitya/the-new-hotness
by Ralph Bean
We need to cut a new release of the-new-hotness to deal with a change
in anitya's api. The 'Github' backend got renamed to the 'GitHub'.
(see the difference?).
The new release would include only these changes:
https://github.com/fedora-infra/the-new-hotness/pull/41/files
---
hotness/anitya.py | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/hotness/anitya.py b/hotness/anitya.py
index 883589a..7d3b6d5 100644
--- a/hotness/anitya.py
+++ b/hotness/anitya.py
@@ -15,7 +15,7 @@
'ftp.debian.org': 'Debian project',
'drupal.org': 'Drupal7',
'freecode.com': 'Freshmeat',
- 'github.com': 'Github',
+ 'github.com': 'GitHub',
'download.gnome.org': 'GNOME',
'ftp.gnu.org': 'GNU project',
'code.google.com': 'Google code',
@@ -46,7 +46,7 @@
'Debian project',
'Drupal7',
'Freshmeat',
- 'Github',
+ 'GitHub',
'GNOME',
'GNU project',
'Google code',
Can I get two +1s?
7 years, 11 months
[release] pkgdb2: 1.24.2
by Pierre-Yves Chibon
Hi everyone,
Following on the freeze break request sent earlier, I just released and pushed
to stg and prod a new pkgdb2 release: 1.24.2
Here is its changelog:
* Tue Apr 07 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 1.24.2-1
- Update to 1.24.2
- Fix the pkgdb-sync-bugzilla script to actually CC who it says it is CC'ing
Thanks,
Pierre
7 years, 11 months
