infrastructure August 2019

infrastructure@lists.fedoraproject.org

30 participants
38 discussions

Planned Outage - PHX2-Production - 2019-08-21 20:00 UTC
by Stephen John Smoogen 19 Aug '19

19 Aug '19

=== Planned Outage - PHX2-Production - 2019-08-21 20:00 UTC There will be an outage starting at 2019-08-21 20:00 UTC, which will last approximately 6 hours. To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run: date -d '2019-08-21 20:00UTC' Reason for outage: RHEL-7.7 came out and a lot of other updates for various Fedora issues will need updates and reboots of systems. Affected Services: All staging/production and related services will be affected. Ticket Link: https://pagure.io/fedora-infrastructure/issue/8107 Please join #fedora-admin or #fedora-noc on irc.freenode.net or add comments to the ticket for this outage above. -- Stephen J Smoogen.

1 0

Meeting Agenda Item: Introduction Scott
by Scott Lee 15 Aug '19

15 Aug '19

Hello, I'd like to start contributing to Fedora Infrastructure. I have a operations engineer background and I am familiar with Bash, Python, AWS, Kubernetes, Ansible, Terraform. I'm in the PST time zone (California). I've created a Fedora account (slee), signed the FPCA, and subscribed to the Fedora Infrastructure Mailing List. I'm squishedlunch on IRC and I've been lurking a bit on #fedora-admin. Unfortunately I missed the weekly meeting this morning but I'll be sure to catch future sessions. Can someone invite me to the 'fi-apprentice' group? Also I've seen references to various tools like release-monitoring.org and https://jenkins-fedora-infra.apps.ci.centos.org, is there a central place where all these tools/endpoints are listed? Looking forward to working with everyone!

1 0

Bot Account for Bodhi Karma
by Tim Flink 15 Aug '19

15 Aug '19

After the Flock talk from the Facebook folks, they approached QA about the idea of submitting karma and/or test results from their internal testing as a bot account. Is this something that is possible? I know that we have done bot accounts at various points in time but I don't remember if automated karma is allowed or what the other restrictions on that were. Thanks, Tim

4 4

[Fedocal] Reminder meeting : Fedora Infrastructure
by smooge＠gmail.com 14 Aug '19

14 Aug '19

Dear all, You are kindly invited to the meeting: Fedora Infrastructure on 2019-08-15 from 15:00:00 to 16:00:00 UTC At fedora-meeting-1(a)irc.freenode.net The meeting will be about: Weekly Fedora Infrastructure meeting. See infrastructure list for agenda a day before or view it at https://infinote.fedoraproject.org/cgit/infinote/tree/fedora-infrastructure… Source: https://apps.fedoraproject.org/calendar/meeting/22/

1 0

RHEL-7 reposync directories to remove ? Feedback requested
by Stephen John Smoogen 12 Aug '19

12 Aug '19

So we do a reposync of RHEL-7 trees every night. For the x86_64 we have been keeping track of a lot of repositories which may not make sense to keep. I have broken it into 3 types: We need to Keep, no idea, and nope. Please look over these and let me know where the others go as I am fixing the rhel7-sync script to be a bit more maintainable. Need to Keep ./rhel-7-extras-for-x86_64-server-rpms ./rhel-7-for-x86_64-server-rpms ./rhel-7-ha-for-x86_64-server-rpms ./rhel-7-optional-for-x86_64-server-rpms ./rhel-7-rhscl-for-x86_64-server-rpms ./rhel-7-openshift-3.11-rpms Which of these make sense to keep syncing? ./jb-eap-7.1-for-rhel-7-server-rpms ./rhel-7-fast-datapath ./rhel-7-server-ansible-2-rpms ./rhel-7-openshift-3.10-rpms ./rhel-7-openshift-3.4-rpms ./rhel-7-openshift-3.5-rpms ./rhel-7-openshift-3.6-rpms ./rhel-7-openshift-3.7-rpms ./rhel-7-openshift-3.8-rpms ./rhel-7-openshift-3.9-rpms ./rhel-7-openstack-10-rpms ./rhel-7-openstack-13-rpms ./rhel-7-openstack-5.0-rpms ./rhel-7-openstack-8-rpms ./rhel-7-server-atomic-host-rpms ./rhel-7-server-rhv-4-manager-tools-rpms ./rhel-7-server-rhv-4-mgmt-agent-rpms ./rhel-7-server-rhv-4.2-manager-rpms To Be Deleted ./rhel-7-server-extras-rpms.old ./rhel-7-server-optional-rpms.old ./rhel-7-server-rpms.old ./rhel-ha-for-rhel-7-server-rpms.old ./rhel-server-rhscl-7-rpms.old -- Stephen J Smoogen.

1 0

Transtats 0.7.5 deployed on production
by Sundeep Anand 12 Aug '19

12 Aug '19

Hi, Transtats[1] latest release has been deployed on production: https://transtats.fedoraproject.org/ Major changes include: - New sections on landing page: global map, trending languages, out-of-sync packages. - Add language detail page and job output analysis section. - Coverage rules revamp - add, edit, delete and view pages, few bug fixes. - Transifex and Weblate support, alongwith Zanata and DamnedLies. Changelog: https://github.com/transtats/transtats/blob/devel/CHANGELOG.md Folks here may find "fedora release readiness" feature[2] interesting. Demo: https://www.youtube.com/watch?v=xpCudZDyb4g (2.16 Minutes) Quick start page is here: https://transtats.fedoraproject.org/quick-start (Transtats sync with translation platform and build system at intervals to keep stats latest.) thanks, sundeep [1] http://transtats.org [2] https://speakerdeck.com/sundeep/use-cases-for-transtats-in-the-fedora-commu…

1 0

A Friday with Infra
by Michal Konecny 10 Aug '19

10 Aug '19

Good Morning Everyone, As you may remember from [1] the CPE team has started categorizing its applications into the following categories: 1. We maintain it, we run it 2. We don’t maintain it, we run it 3. We don’t maintain it, we don’t run it 4. We turn it off In this process we picked the following four applications that we want to move from the first category to the third: * elections [2] * fedocal * nuancier * badges However, we do not want to throw code over the wall to anyone, so we’re setting up something we called “A Friday with Infra”. The goal is to help on-boarding anyone interested in picking up the maintenance of any of these apps by taking time on Friday to work on these apps with them. We have prepared a wiki page describing this proposal, how to get involved in it as well as all the work we believe should be done to have a smooth hand-over of the applications: https://fedoraproject.org/wiki/Infrastructure_2020/Friday_with_Infra Let us know if you have any questions or (even better) want to be involved with any of them :) Michal – On behalf of the CPE team ------------------------------------------------------------------------ [1] https://communityblog.fedoraproject.org/application-service-categories-and-… [2] elections has actually already found a new maintainer

6 13

[Fedocal] Reminder meeting : Fedora Infrastructure
by smooge＠gmail.com 07 Aug '19

07 Aug '19

Dear all, You are kindly invited to the meeting: Fedora Infrastructure on 2019-08-08 from 15:00:00 to 16:00:00 UTC At fedora-meeting-1(a)irc.freenode.net The meeting will be about: Weekly Fedora Infrastructure meeting. See infrastructure list for agenda a day before or view it at https://infinote.fedoraproject.org/cgit/infinote/tree/fedora-infrastructure… Source: https://apps.fedoraproject.org/calendar/meeting/22/

1 0

Congrats to our new sysadmin-mainers
by Kevin Fenzi 06 Aug '19

06 Aug '19

I'm happy to announce that We have approved several folks into the sysadmin-main group: mohanboddu 'Mohan Boddu' cverna 'Clement Verna' bowlofeggs 'Randy Barlow' This is the core group of trusted folks that high level access to most everything in fedora infrastructure. All these folks have done great work over the last few years on various big projects, proving their dedication, trustworthiness, and ability. Congrats to them all! Use your powers for good! :) kevin

4 3

Meeting Agenda Item: Introduction Adam Stackhouse
by Adam Stackhouse 05 Aug '19

05 Aug '19

Hi everyone, I am looking to help the infrastructure team at fedora so hopefully you will welcome me in and help me get stuck in. So I will begin with introducing my self a bit: Name: Adam Stackhouse IRC Handle: adstak I have been a Linux sys admin now for about 6 and a half years in the web hosting industry. I currently work for Godaddy EMEA and work on roughly 2000 of their Centos servers on their UK brands. This covers everything from mail servers to web servers and I would like to offer back some of my skills to fedora and hopefully pick up a thing or two along the way. I have quite allot of experience in bash, Python and Perl from everything from sys tools to back end API's. In terms of technologies I would like to learn etc I am pretty open and want to learn as much as I can. currently I am working with technologies such as ansible, haproxy, buidling RPM's and openstack but I have pretty much had to deal with many services and technologies in Linux due to the size of the company I work and happy to get stuck in with what ever I can :) In terms of open source work this would be a first for me so any advice anyone can give into how I can get involved and be of help would be great. The only thing close to this I have done in the past is some development for the pebble watch a feew years ago with a few people on github so bit of a noob in the open source world so hopefully everyone here can help me out at any point if I need it. So I guess in terms of questions if anyone could give me some advice on where to go next I would love to just follow that and see where this goes. I have seen there is an apprentice group which seems like a good place to start to get an idea of the platforms you have etc Any help you can give would be great and I look forward to working with everyone

2 1

koji build archiving
by Kevin Fenzi 03 Aug '19

03 Aug '19

Koji.fedoraproject.org currently stores every rpm ever shipped to users since the Fedora 7 days, along with a lot of information about every build it’s ever made, even if not distributed. We have continued to grow the storage backing koji over time, but it is close to reaching a size we can no longer expand (75TB). We are going to start moving builds off our main storage volume on to slower (but still accessible) volumes in order to shrink our main volume of active releases and make it easier to move and expand. There may be slowdowns of builds and composes during the time we are moving builds, but we will try and make it as transparent as possible. All builds will continue to be available via koji.fedoraproject.org, but you may notice a new volume name in the download path of some older packages. As part of initial testing of this move, we moved the *fc6* tagged builds and this generated a number of 'buildsys.state.changed' notifications to maintainers. We have since corrected the koji fedora-messaging plugin to not emit these volume change events. Sorry for the extra emails. Please let us know if you experience excessive slowdowns or issues related to this move. This work is being tracked in https://pagure.io/fedora-infrastructure/issue/8065 Thanks, kevin

1 0

[PATCH] Add a nagios check for each rabbitmq server
by Jeremy Cline 03 Aug '19

03 Aug '19

Commit eae92f73e95 installed the nagios scripts[0] that are packaged for epel7-infra on the RabbitMQ hosts. This is an attempt to use them with nagios. I don't know anything about nagios though, so I have no idea if this is even close to right, or if it works. [0] https://github.com/nagios-plugins-rabbitmq/nagios-plugins-rabbitmq Signed-off-by: Jeremy Cline <jcline(a)redhat.com> --- roles/nagios_client/tasks/main.yml | 15 +++++++++++++ .../templates/check_rabbitmq_server.cfg.j2 | 1 + roles/nagios_server/tasks/main.yml | 22 +++++++++++++++++++ .../nrpe/check_rabbitmq_server.cfg.j2 | 1 + 4 files changed, 39 insertions(+) create mode 100644 roles/nagios_client/templates/check_rabbitmq_server.cfg.j2 create mode 100644 roles/nagios_server/templates/nrpe/check_rabbitmq_server.cfg.j2 diff --git a/roles/nagios_client/tasks/main.yml b/roles/nagios_client/tasks/main.yml index 0259a43ca..65a60a7c3 100644 --- a/roles/nagios_client/tasks/main.yml +++ b/roles/nagios_client/tasks/main.yml @@ -233,6 +233,21 @@ tags: - nagios_client +- name: install nrpe checks for the RabbitMQ cluster + template: + src: "{{ item }}.j2" + dest: "/etc/nrpe.d/{{ item }}" + owner: root + group: root + mode: 0600 + with_items: + - check_rabbitmq_server.cfg + when: inventory_hostname.startswith('rabbitmq') + notify: + - restart nrpe + tags: + - nagios_client + - name: nrpe service start service: name=nrpe state=started enabled=true tags: diff --git a/roles/nagios_client/templates/check_rabbitmq_server.cfg.j2 b/roles/nagios_client/templates/check_rabbitmq_server.cfg.j2 new file mode 100644 index 000000000..498a8757e --- /dev/null +++ b/roles/nagios_client/templates/check_rabbitmq_server.cfg.j2 @@ -0,0 +1 @@ +command[check_nrpe_check_rabbitmq_server]=exec /usr/lib64/nagios/plugins-rabbitmq/check_rabbitmq_server -H localhost --password "{{ (env == 'production')|ternary(rabbitmq_monitoring_password_production, rabbitmq_monitoring_password_staging) }}" --user nagios-monitoring diff --git a/roles/nagios_server/tasks/main.yml b/roles/nagios_server/tasks/main.yml index 2d6d50c31..f61584ed6 100644 --- a/roles/nagios_server/tasks/main.yml +++ b/roles/nagios_server/tasks/main.yml @@ -110,6 +110,28 @@ - config - nagios_server +- name: Ensure the nrpe.d directory exists for nrpe configs + file: + dest: /etc/nrpe.d + state: directory + tags: + - nagios_server + +- name: Add nrpe configurations to /etc/nrpe.d + template: + src: "/nrpe/{{ item }}.j2" + dest: "/etc/nrpe.d/{{ item }}" + owner: root + group: root + mode: 0600 + with_items: + - check_rabbitmq_server.cfg + notify: + - restart nrpe + tags: + - config + - nagios_server + ## Copy over the nagios configs - name: Copy /etc/nagios/conf.d/*cfg files copy: src=nagios/configs/{{ item }} dest=/etc/nagios/conf.d/{{ item }} diff --git a/roles/nagios_server/templates/nrpe/check_rabbitmq_server.cfg.j2 b/roles/nagios_server/templates/nrpe/check_rabbitmq_server.cfg.j2 new file mode 100644 index 000000000..498a8757e --- /dev/null +++ b/roles/nagios_server/templates/nrpe/check_rabbitmq_server.cfg.j2 @@ -0,0 +1 @@ +command[check_nrpe_check_rabbitmq_server]=exec /usr/lib64/nagios/plugins-rabbitmq/check_rabbitmq_server -H localhost --password "{{ (env == 'production')|ternary(rabbitmq_monitoring_password_production, rabbitmq_monitoring_password_staging) }}" --user nagios-monitoring -- 2.21.0

3 7

Please have a look at this python-docutils bug
by Miro Hrončok 01 Aug '19

01 Aug '19

Hey Infra SIG! I've previously sent this to infra-sig(a)lists.fedoraproject.org but that list is private, so reposting here: -------- Forwarded Message -------- This bugzilla is assigned to the Fedora Infrastructure SIG. There has been no response for a month. Please, could you have a look? https://bugzilla.redhat.com/show_bug.cgi?id=1716532 Thanks, -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

2 1

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure August 2019