infrastructure November 2016

infrastructure@lists.fedoraproject.org

58 participants
65 discussions

Planned Outage: General Services Environment - 2016-11-30 21:00 UTC
by Stephen John Smoogen 28 Nov '16

28 Nov '16

There will be an outage starting at 2016-11-30 21:00 UTC, which will last approximately 4 hours. To convert UTC to your local time, take a look at https://fedoraproject.org/wiki/UTCHowto or run: date -d '2016-11-30 21:00 UTC' Reason for outage: We have been in a freeze for the release of Fedora 25 and have multiple updates across the systems needed to occur. Part of these are to bring RHEL-7 systems to 7.3 and others are to bring some systems to Fedora 25. Affected Services: Bodhi - https://admin.fedoraproject.org/updates/ Buildsystem - http://koji.fedoraproject.org/ Package Database - https://admin.fedoraproject.org/pkgdb/ BFO - https://boot.fedoraproject.org/ GIT / Source Control DNS - ns1.fedoraproject.org, ns2.fedoraproject.org Docs - https://docs.fedoraproject.org/ Email system Fedora Account System - https://admin.fedoraproject.org/accounts/ Fedora Community - https://admin.fedoraproject.org/community/ Fedora Hosted - https://fedorahosted.org/ Fedora Insight - https://insight.fedoraproject.org/ Fedora People - https://fedorapeople.org/ Main Website - https://fedoraproject.org/ Mirror List - https://mirrors.fedoraproject.org/ Mirror Manager - https://admin.fedoraproject.org/mirrormanager/ QA Services Secondary Architectures Spins - https://spins.fedoraproject.org/ Start - https://start.fedoraproject.org/ Torrent - https://torrent.fedoraproject.org/ Translation Services - https://translate.fedoraproject.org/ Wiki - https://fedoraproject.org/wiki/ Unaffected Services: Staging - .stg.fedoraproject.org, .stg.phx2.fedoraproject.org Ticket Link: TBA Contact Information: infrastructure @lists.fedoraproject.org Please join #fedora-admin in irc.freenode.net or add comments to the ticket for this outage above. -- Stephen J Smoogen.

1 0

Planned Outage: 2016-11-29 21:00 UTC Build Environment
by Stephen John Smoogen 28 Nov '16

28 Nov '16

There will be an outage starting at 2016-11-29 21:00 UTC, which will last approximately 4 hours. To convert UTC to your local time, take a look at https://fedoraproject.org/wiki/UTCHowto or run: date -d '2016-11-29 21:00 UTC' Reason for outage: We have been in a freeze for the release of Fedora 25 and have multiple updates across the systems needed to occur. Part of these are to bring RHEL-7 systems to 7.3 and others are to bring some systems to Fedora 25. Affected Services: Bodhi - https://admin.fedoraproject.org/updates/ Buildsystem - http://koji.fedoraproject.org/ Package Database - https://admin.fedoraproject.org/pkgdb/ Unaffected Services: BFO - https://boot.fedoraproject.org/ GIT / Source Control DNS - ns1.fedoraproject.org, ns2.fedoraproject.org Docs - https://docs.fedoraproject.org/ Email system Fedora Account System - https://admin.fedoraproject.org/accounts/ Fedora Community - https://admin.fedoraproject.org/community/ Fedora Hosted - https://fedorahosted.org/ Fedora Insight - https://insight.fedoraproject.org/ Fedora People - https://fedorapeople.org/ Main Website - https://fedoraproject.org/ Mirror List - https://mirrors.fedoraproject.org/ Mirror Manager - https://admin.fedoraproject.org/mirrormanager/ QA Services Secondary Architectures Spins - https://spins.fedoraproject.org/ Start - https://start.fedoraproject.org/ Torrent - https://torrent.fedoraproject.org/ Translation Services - https://translate.fedoraproject.org/ Wiki - https://fedoraproject.org/wiki/ Staging - .stg.fedoraproject.org, .stg.phx2.fedoraproject.org Ticket Link: https://pagure.io/fedora-infrastructure/issue/5579 Contact Information: infrastructure @lists.fedoraproject.org Please join #fedora-admin in irc.freenode.net or add comments to the ticket for this outage above. -- Stephen J Smoogen.

1 0

Planned Outage: Staging Environment - 2016-11-28 21:00 UTC
by Stephen John Smoogen 28 Nov '16

28 Nov '16

There will be an outage starting at 2016-11-28 21:00 UTC, which will last approximately 4 hours. To convert UTC to your local time, take a look at https://fedoraproject.org/wiki/UTCHowto or run: date -d '2016-11-28 21:00 UTC' Reason for outage: We have been in a freeze for the release of Fedora 25 and have multiple updates across the systems needed to occur. Part of these are to bring RHEL-7 systems to 7.3 and others are to bring some systems to Fedora 25. Affected Services: Staging - .stg.fedoraproject.org, .stg.phx2.fedoraproject.org Unaffected Services: BFO - https://boot.fedoraproject.org/ Bodhi - https://admin.fedoraproject.org/updates/ Buildsystem - http://koji.fedoraproject.org/ GIT / Source Control DNS - ns1.fedoraproject.org, ns2.fedoraproject.org Docs - https://docs.fedoraproject.org/ Email system Fedora Account System - https://admin.fedoraproject.org/accounts/ Fedora Community - https://admin.fedoraproject.org/community/ Fedora Hosted - https://fedorahosted.org/ Fedora Insight - https://insight.fedoraproject.org/ Fedora People - https://fedorapeople.org/ Main Website - https://fedoraproject.org/ Mirror List - https://mirrors.fedoraproject.org/ Mirror Manager - https://admin.fedoraproject.org/mirrormanager/ Package Database - https://admin.fedoraproject.org/pkgdb/ QA Services Secondary Architectures Spins - https://spins.fedoraproject.org/ Start - https://start.fedoraproject.org/ Torrent - https://torrent.fedoraproject.org/ Translation Services - https://translate.fedoraproject.org/ Wiki - https://fedoraproject.org/wiki/ Ticket Link: TBA Contact Information: infrastructure @lists.fedoraproject.org Please join #fedora-admin in irc.freenode.net or add comments to the ticket for this outage above. -- Stephen J Smoogen.

1 0

Torrent trackers intermittent error issue
by Michael Simms 28 Nov '16

28 Nov '16

Hello, I keep getting intermittent torrent tracker errors (Tracker gave an error: "Tracker gave HTTP response code 0 (No Response)") in Transmission for some (not all) Fedora torrents. It is never the same ones if I start a new Transmission session. Typically the PC is powered down over night. The torrents are not stalling out when this error happens, they continue to seed. Eventually Transmission manages to get hold of the peer list and the error message goes. So it seems the torrent tracker host server itself is not responding in a timely manner and causing these errors. Additionally I would like to know if there are any backup trackers I can add to the configuration for the Fedora torrents? Also, since I have active seeding connections I believe it isn't down to a firewall issue or Transmission configuration problem. Any clues though? My TDF LibreOffice torrents do not exhibit the same behaviour.

1 0

Meeting Agenda Item: Introduction Davide Olivieri
by daleko＠yahoo.com 28 Nov '16

28 Nov '16

Hello everyone, My name is Davide and I am writing from Poland. I would like to join the Fedora infrastructure team to learn new things and contribute to the distribution. I have some experience in dealing with production servers as I'm currently working as an application support/maintenance engineer for a solution for security financing running on RedHat. In the past I worked in similar roles for enterprise backup/restore and cryptography solutions (Backup Exec and PGP). For about half a year I also worked in a data center mainly dealing with alerts incoming from monitoring tools. I hold a RHCSA certification (license 160-036-125), I am familiar with perl 5 and bash and occasionally package software with RPM for personal use. I would be happy to perform any task but I am really interested in acquiring knowledge on the following stuff: * Fedora services and ecosystem * Ansible * OS deployment* Work with file servers* Advanced configuration of http servers (Apache already gave me some headaches) * Enhance servers security As of now the time I could dedicate to Fedora is about 4/5 hours per week.I have a home server used as KVM hyper-visor that I could use for testing out things. My registered nick on freenode is daleko, I hope to hear from any of you. Thank you! Cheers,Davide

2 1

Nagios and epylog now Kerberos-based
by Patrick Uiterwijk 24 Nov '16

24 Nov '16

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Just thought I'd also drop this to the infra list, but as of today, Nagios and Epylog are using Kerberos for authentication. This means that as long as you have a ticket for @FEDORAPROJECT.ORG, logging in to Nagios and Epylog should be automatic. For instructions on how to use the Infrastructure Kerberos services, please see [1]. [1]: https://fedoraproject.org/wiki/Infrastructure_kerberos_authentication Regards, Patrick Uiterwijk -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJYN2DkAAoJEIZXmA2atR5QmGYP/RR05WdqqJ+jstQ6lucZnMxb omylfx/0aQ/FHo5vC56eLy4tJhz26asscs6mn5AiTsURaxoxwZoXiWIyH3MVhKzv fs+xOrIS1FgUfXCu/D2CKg8VTDu/80p7sLMw20l4rdW/Uopnur+AlUarssN7xu3/ vcqniv6anoxbt/wkyEEsMbPtTzfpCZcuJc4zyG065ROB/6XRb0fRlIJvAQTOwdfn 4V6BGsSQchQ76SLQtox+B335YpASYcQtkJIPzZNmacDJ/6hDucY5IaiYSWNIlLQM g61CAa6J3K4yJp92T0G8N7bGTys9q2cbvd+iVljSOrXuswds8uWm/Lh61DSCvZkT tNvnJ48iALvWKbBxs7+B0ZqO1pGGTiVCZ9du+VVMubRP2t0Y/rCbOSHTn4vsP456 bIK5K5UCLdW1pVaNnFl03gDIlCW/cB4KKOU5RLEi+P8+q3FipXkjtzVrw/fTE5hA m9A4ZFJoQas5Jchi3YGzyuW7Rm0/RT/34LqCTw2H3WtMzoAnxUGSQyuhC6p38HED thM36dL66H/XVg6yLB930eGvmzAgnDJ3bvJ19y/zXmUWVY2M47kI9IuWqtNMKbTt pfngCmu1M/UwGXyVjQzfaeB5V3QVhw3Cyvub2NcAoWdO1LiAy0D1XvqWK5gbM9mr aNVGmYtM4t/JoZm7FbAf =whW7 -----END PGP SIGNATURE-----

1 0

Fedora 25 Final freeze now in effect
by Kevin Fenzi 23 Nov '16

23 Nov '16

Greetings. we are now in the infrastructure freeze leading up to the Fedora 25 Final release. This is a final freeze. We do this to ensure that our infrastructure is stable and ready to release the Fedora 25 when it's available. You can see a list of hosts that do not freeze by checking out the ansible repo and running the freezelist script: git clone https://infrastructure.fedoraproject.org/infra/ansible.git scripts/freezelist -i inventory Any hosts listed as freezes is frozen until 2016-11-15. (or later if Beta slips). Frozen hosts should have no changes made to them without a sign-off on the change from at least 2 sysadmin-main or rel-eng members, along with (in most cases) a patch of the exact change to be made to this list. Thanks, kevin

1 1

Freeze break request: refine the filterlist stuff (make it an imagelist using productmd)
by Adam Williamson 22 Nov '16

22 Nov '16

The main problem here is the 'archive' filterlist is still pretty big, over 20MiB. I don't want to push the fedfind changes out to the public until it's smaller. With this change the imagelist files are all tiny, under 250KiB. pr #26 is an alternative to this which just extends the exclusion list of the previous approach, but nirik says he prefers this approach. From 5b7169688a1732f49ff0bb6320fa34e641b363de Mon Sep 17 00:00:00 2001 From: Adam Williamson <awilliam(a)redhat.com> Date: Mon, 21 Nov 2016 19:36:49 -0800 Subject: [PATCH] turn 'filterlist' into 'imagelist', using productmd This adopts https://pagure.io/quick-fedora-mirror/pull-request/27 and adapts to it, so we get `imagelist` files rather than `filterlist` files (see recent commits for this). The rationale is more fully explained in that PR (and in PR #26 also) - on further inspection it turns out that we have to filter out an awful lot of extensions to create small filterlists for all three modules, and I'm worried that other file extensions may appear in the future and cause the filterlists to suddenly get bigger again. Instead, we have create-filelist use the productmd constant that defines valid image formats, and only include files that match those formats in the list. The downside of this approach is we have to ensure productmd on all the systems that run `create-filelist` is kept up to date if the list of valid image formats changes. --- files/scripts/create-filelist | 15 ++++++++------- files/scripts/update-fullfiletimelist | 26 +++++++++++++------------- playbooks/groups/secondary.yml | 1 + roles/bodhi2/backend/tasks/main.yml | 1 + roles/releng/tasks/main.yml | 1 + 5 files changed, 24 insertions(+), 20 deletions(-) diff --git a/files/scripts/create-filelist b/files/scripts/create-filelist index e485efb..0beaced 100755 --- a/files/scripts/create-filelist +++ b/files/scripts/create-filelist @@ -12,6 +12,7 @@ import argparse import hashlib import os import sys +from productmd.images import SUPPORTED_IMAGE_FORMATS from scandir import scandir @@ -58,8 +59,8 @@ def parseopts(): null = open(os.devnull, 'w') p = argparse.ArgumentParser( description='Generate a list of files and times, suitable for consumption by quick-fedora-mirror, ' - 'and a much smaller list with packages, Device Tree boot files, HTML files, pictures ' - 'and directories filtered out, for consumption by fedfind.') + 'and a much smaller list of only files that match one of the productmd supported ' + 'image types, for use by fedfind.') p.add_argument('-c', '--checksum', action='store_true', help='Include checksums of all repomd.xml files in the file list.') p.add_argument('-C', '--checksum-file', action='append', dest='checksum_files', @@ -75,8 +76,8 @@ def parseopts(): help='Filename of the file list with times (default: stdout).') p.add_argument('-f', '--filelist', type=argparse.FileType('w'), default=null, help='Filename of the file list without times (default: no plain file list is generated).') - p.add_argument('-F', '--filterlist', type=argparse.FileType('w'), default=null, - help='Filename of the filtered file list for fedfind (default: not generated).') + p.add_argument('-i', '--imagelist', type=argparse.FileType('w'), default=null, + help='Filename of the image file list for fedfind (default: not generated).') opts = p.parse_args() @@ -112,9 +113,9 @@ def main(): # opts.filelist.write(entry.path + '\n') print(entry.path, file=opts.filelist) # write to filtered list if appropriate - skips = ('.rpm', '.drpm', '.dtb', '.html', '.png', '.jpg') - if not any(entry.path.endswith(skip) for skip in skips) and not (entry.is_dir()): - print(entry.path, file=opts.filterlist) + imgs = ['.{0}'.format(form) for form in SUPPORTED_IMAGE_FORMATS] + if any(entry.path.endswith(img) for img in imgs): + print(entry.path, file=opts.imagelist) if entry.name in opts.checksum_files: checksums[entry.path[2:]] = True info = entry.stat(follow_symlinks=False) diff --git a/files/scripts/update-fullfiletimelist b/files/scripts/update-fullfiletimelist index f6c225a..c0439da 100755 --- a/files/scripts/update-fullfiletimelist +++ b/files/scripts/update-fullfiletimelist @@ -25,7 +25,7 @@ CREATE=/usr/local/bin/create-filelist # context. FILELIST=fullfilelist TIMELIST='fullfiletimelist-$mod' -FILTERLIST='filterlist-$mod' +IMAGELIST='imagelist-$mod' usage () { echo @@ -108,12 +108,12 @@ cd $tmpd for mod in $MODS; do currentfl=$TOPD/$mod/${FILELIST/'$mod'/$mod} currenttl=$TOPD/$mod/${TIMELIST/'$mod'/$mod} - currentsl=$TOPD/$mod/${FILTERLIST/'$mod'/$mod} + currentil=$TOPD/$mod/${IMAGELIST/'$mod'/$mod} flname=$(basename $currentfl) tlname=$(basename $currenttl) - slname=$(basename $currentsl) + ilname=$(basename $currentil) - $CREATE -c -s -d $TOPD/$mod -f $flname -t $tlname -F $slname + $CREATE -c -s -d $TOPD/$mod -f $flname -t $tlname -i $ilname # If a file list exists and doesn't differ from what we just generated, # delete the latter. @@ -123,8 +123,8 @@ cd $tmpd if [[ -f $currenttl ]] && diff -q $currenttl $tlname > /dev/null; then rm -f $tlname fi - if [[ -f $currentsl ]] && diff -q $currentsl $slname > /dev/null; then - rm -f $slname + if [[ -f $currentil ]] && diff -q $currentil $ilname > /dev/null; then + rm -f $ilname fi done @@ -134,13 +134,13 @@ cd $tmpd for mod in $MODS; do currentfl=$TOPD/$mod/${FILELIST/'$mod'/$mod} currenttl=$TOPD/$mod/${TIMELIST/'$mod'/$mod} - currentsl=$TOPD/$mod/${FILTERLIST/'$mod'/$mod} + currentil=$TOPD/$mod/${IMAGELIST/'$mod'/$mod} flname=$(basename $currentfl) fldir=$(dirname $currentfl) tlname=$(basename $currenttl) tldir=$(dirname $currenttl) - slname=$(basename $currentsl) - sldir=$(dirname $currentsl) + ilname=$(basename $currentil) + ildir=$(dirname $currentil) if [[ -f $flname ]]; then tmpf=$(mktemp -p $fldir $flname.XXXXXXXXXX) @@ -154,11 +154,11 @@ cd $tmpd chmod 644 $tmpf mv $tmpf $currenttl fi - if [[ -f $slname ]]; then - tmpf=$(mktemp -p $sldir $slname.XXXXXXXXXX) - cp -p $slname $tmpf + if [[ -f $ilname ]]; then + tmpf=$(mktemp -p $ildir $ilname.XXXXXXXXXX) + cp -p $ilname $tmpf chmod 644 $tmpf - mv $tmpf $currentsl + mv $tmpf $currentil fi done diff --git a/playbooks/groups/secondary.yml b/playbooks/groups/secondary.yml index e4a49a8..1d6f545 100644 --- a/playbooks/groups/secondary.yml +++ b/playbooks/groups/secondary.yml @@ -58,6 +58,7 @@ - createrepo - koji - python-scandir + - python2-productmd - name: add create-filelist script from quick-fedora-mirror copy: src="{{ files }}/scripts/create-filelist" dest=/usr/local/bin/create-filelist mode=0755 diff --git a/roles/bodhi2/backend/tasks/main.yml b/roles/bodhi2/backend/tasks/main.yml index 08105b5..674b03a 100644 --- a/roles/bodhi2/backend/tasks/main.yml +++ b/roles/bodhi2/backend/tasks/main.yml @@ -24,6 +24,7 @@ - sigul - python-alembic - python-scandir + - python2-productmd tags: - packages - bodhi diff --git a/roles/releng/tasks/main.yml b/roles/releng/tasks/main.yml index d02fbea..f85ebd2 100644 --- a/roles/releng/tasks/main.yml +++ b/roles/releng/tasks/main.yml @@ -117,6 +117,7 @@ - pungi - compose-utils - python-scandir + - python2-productmd when: ansible_distribution_major_version|int > 21 # add sigul to secondary arch compose boxes -- 2.10.2 -- Adam Williamson Fedora QA Community Monkey IRC: adamw | Twitter: AdamW_Fedora | identi.ca: adamwfedora http://www.happyassassin.net

3 3

Freeze break request: fix f24 references in f25-updates-testing atomic updates
by Kevin Fenzi 21 Nov '16

21 Nov '16

From f55c6f20bc5676f62a50535dbe5c1d1eb74aae4b Mon Sep 17 00:00:00 2001 From: Kevin Fenzi <kevin(a)scrye.com> Date: Mon, 21 Nov 2016 16:42:19 +0000 Subject: [PATCH] fix fedora-25-updates-testing to have correct f25 references for bodhi atomic updates composing --- roles/bodhi2/backend/templates/atomic-config.py.j2 | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/roles/bodhi2/backend/templates/atomic-config.py.j2 b/roles/bodhi2/backend/templates/atomic-config.py.j2 index 7a10d92..99e3977 100644 --- a/roles/bodhi2/backend/templates/atomic-config.py.j2 +++ b/roles/bodhi2/backend/templates/atomic-config.py.j2 @@ -45,7 +45,7 @@ config = dict( 'treefile': { 'include': 'fedora-atomic-docker-host.json', 'ref': 'fedora-atomic/25/x86_64/testing/docker-host', - 'repos': ['fedora-24', 'fedora-24-updates', 'updates-testing'], + 'repos': ['fedora-25', 'fedora-25-updates', 'updates-testing'], 'packages': [], }, -- 1.8.3.1

3 2

FBR: apply patch to bodhi-backend03
by Patrick Uiterwijk 20 Nov '16

20 Nov '16

Hi, Can I get +1s for applying the patch at [1] to bodhi-backend03? This should fix the SSL problem that occurs during mashing. [1]: https://github.com/fedora-infra/bodhi/pull/1122 Regards, Patrick

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure November 2016