infrastructure September 2011

infrastructure@lists.fedoraproject.org

32 participants
40 discussions

todo: ask everyone what their todo is for the week
by Kevin Fenzi 13 Sep '11

13 Sep '11

Greetings. I thought I would try a little something out this week. For folks working in infrastructure, what are you working on this week? Note that I am not looking for some detailed todo list, just after having fought your monday and read your emails and looked at tickets and bugs and requests, what kind of things are you going to try and work on this week? On friday, if you looked and finished X, you would feel happy about the week. whats X? Here's mine: - Document bastion machines and their oddities in infa-docs. - Going to try and fix syslog from non vpn machines. - Get our Beta tickets filed and the freeze setup tomorrow (announce it, etc) - Look at updating CSI - Work on askbot in stg some more. - Continue new machine (rhel6) plans. - Typical putting out fires, fixing things as they break, fixing things that send me email. anyone else have any goals for the week? kevin

5 4

Proposal for action: SSH Key, User Cert and Password Flag Day
by Seth Vidal 13 Sep '11

13 Sep '11

Given recent events in the linux-y world I think it might do us a service to impose an ssh-key, user cert and password enforced change flag day. The idea would be everyone would be required to change their passwords, ssh keys and any user certs they have before being allowed to do anything else on our systems. Anyone failing to change them would be locked out after a specific date. In particular I would like to make sure that ssh keys get changed - so much so that I would want to keep a copy of the existing ssh keys and verify that the new one does not match the old one before allowing it to be used. I'd like to discuss the efficacy and timing of this. If anyone has perspective that is helpful, please share it. I think this should be done soon, personally. -sv

5 6

Introduction
by Magyar Zoltán 13 Sep '11

13 Sep '11

Hi All! My name is Zoltán Magyar. Basically I live in Hungary (but for now I'm in Ireland until 1st of March, 2012). I'm using fedora since 4 or 5 years now, and I pretty like it so far. I guess it's time for me to take part in helping this OS to get even better. I have some knowledge in software development in general, I'm currently learning Java, Python, have used SQL a bit. I'm mostly looking for some programming tasks, but I'm also interested in networking and cluster and HA stuff. I work as a full-time software developer at Ericsson, mainly doing function test related stuff. Hard to tell the time I could contribute, but I hope I can free up at least 3-4 hours a week! I'm happy to listen to any pointers about where/how to start contributing! :-) Cheers, Zoli

2 2

new hosts plans and thoughts
by Kevin Fenzi 13 Sep '11

13 Sep '11

As some of you may have noted, I've been building up some new hosts of late. I thought I would give an overview here and plans moving forward and provide a list left to do for those folks in sysadmin-main who wish to help out. :) We have 4 old xen boxes that are going out of service at the end of next month, so we need to get all guests off them before then. Those are: xen03, xen05, xen09, xen15. We have new machines: virthost05-10 and bvirthost04 On the rel-eng side: * I have setup a releng03 to replace releng01 on bvirthost04 * I have setup a releng04 to replace releng02 on bvirthost01 * I have setup a kojipkgs02 to replace kojipkgs02 on bvirthost04 I need to get them finished up and access to the netapp mounts, then we can look at migrating over to them. Once we migrate, bxen03 will be empty and can be re-installed as bvirthost05. We might look then at moving things around a bit to take advantage of bvirthost05. The only outage here would be kojipkgs, and we could make that pretty short/fast. On the staging front: * We need to make a db02.stg thats rhel6. Soon all our db's will be rhel6, and we want staging to match up. I think we should use virthost10 for this. * We need to migrate fas01.stg and pkgs01.stg to virthost10. These are already rhel6. I suppose we could re-install them, but migrating seems reasonable to me. * We may want to migrate some or all the stg on virthost13. virthost13 is now out of warentee. We might not care too much since it's only stg there. Thoughts? On the production front: * I have made a db01 on virthost04. This will replace db02. I'd like to look at doing this wed next week. (2011-09-07). This WILL require an outage, since db02 has fas on it along with many other things. Should we do this outage in the evening? Other thoughts on time? * I have made a bastion03 on virthost04. This will replace bastion02. We will need to swap IP's for it to work with the external IP in phx2. I figure we can do this at the same time as the db outage above. * Machines that still need building/setting up for you sysadmin-main folks who want to help out: - bastion04 to replace bastion01. Should be on a different virthost from bastion03. - proxy08 to replace proxy1 (rhel5). - value03 and value04 (on different virthosts) to replace value01/02. - app02 and app04 are on those xen boxes, so we need to move them. We can't do RHEL6 yet however. So, we could wait a bit more in hopes of being able to rebuild them as RHEL6, or just migrate them, or rebuild them as RHEL5. Once this is all done that leaves us with just xen04 as a xen box in phx2. We can then look at moving stuff off it and repaving it as virthost11. kevin

2 2

infrastructure
by rexchou 11 Sep '11

11 Sep '11

Hello Does fedora on the C language project?

4 3

Help get fpaste.org (fpaste-server) into Fedora Infrastructure
by Clint Savage 10 Sep '11

10 Sep '11

Today, I deployed the latest fpaste-server[1] package on a development box[2] within Fedora Infrastructure. I’d like to get some folks to hit it and do some testing. If you have time, I would love it if you could take a moment, read below and help. To help, just point your browser to http://paste01.dev.fedoraproject.org/ and add some pastes. In fact, it should be pretty sturdy. If you do happen to find a bug, please file it on our fedorahosted.org[3] trac instance. Or you can roll your own. Install your own instance of fpaste-server. I’ve posted some simple installation instructions[4] for anyone who is interested. We are always looking for helpers to make fpaste-server better. Please contact me if you are interested in helping improve or maintain this simple and fun project. Thanks a ton! herlo 1 - http://koji.fedoraproject.org/koji/packageinfo?packageID=11844 2 - http://paste01.dev.fedoraproject.org/ 3 - https://fedorahosted.org/fpaste-server/ 4 - https://fedorahosted.org/fpaste-server/browser/INSTALL.rst

3 3

bastion03 outage/issue tonight
by Kevin Fenzi 09 Sep '11

09 Sep '11

At around 05:20 UTC there were vpn issues. bastion03 (the current vpn hub) was only sporadically reachable. It wasn't clear if this was a network issue, or something with the instance. I was able to login, but then it would just not respond for minutes at a time, then recover. I got in and upped it's cpus (it had only 1, I changed to 4) and rebooted it and everything came back up and was working again at around 5:40 UTC. I couldn't find much in the logs, but more eyes on it welcome. Hopefully it was just a network issue (although I could get to bastion02 fine), or a lack of cpu power. kevin

1 0

Plan for tomorrow's Fedora Infrastructure meeting (2011-09-08)
by Kevin Fenzi 09 Sep '11

09 Sep '11

The infrastructure team will be having it's weekly meeting tomorrow 2011-09-08 at 1900 UTC in #fedora-meeting on the freenode network. Suggested topics (suggested by whom): * New folks introductions and Apprentice tasks. * Upcoming new machine plans. * Upcoming Tasks/Items (nirik) 2011-09-13 - 27: Beta change freeze 2011-09-09 Remove inactive fi-apprentice people. 2011-09-27: Fedora 16 Beta 2011-10-01 mail fi-apprentice folks. 2011-10-09 Remove inactive fi-apprentice people. 2011-10-18 - 2011-11-01: Final change freeze 2011-11-01: Fedora 16 release. * Meeting tagged tickets: https://fedorahosted.org/fedora-infrastructure/report/10 NOTE: I have cleaned out the ones that have been sitting around with this tag. Anytime anyone would like to discuss a ticket, just add the meeting keyword and we will get to it in this section. Submit your agenda items, as tickets in the trac instance and send a note replying to this thread. More info here: https://fedoraproject.org/wiki/Infrastructure/Meetings#Meetings Thanks kevin

1 1

bastion changes
by Kevin Fenzi 08 Sep '11

08 Sep '11

Just a heads up about bastion changes with today's outage: bastion03 is currently the primary vpn hub as well as the default when you go to 'bastion.fedoraproject.org'. This used to be bastion02 before today, so you will note that ssh host key fingerprints have changed since this cutover. bastion01 has been retired. bastion02 will be retired in favor of bastion04 sometime in the next few days. kevin

1 0

AUTO: Shannon Mcleod is out of the office (returning 09/08/2011)
by Shannon Mcleod 07 Sep '11

07 Sep '11

I am out of the office until 09/08/2011. I am attending to personal business today and will be back in the office on Thursday. Tim Blow is my backup. Thanks, Shannon McLeod Unix System Administrator Dubuque GDF Note: This is an automated response to your message "infrastructure Digest, Vol 64, Issue 5" sent on 9/7/11 6:00:23. This is the only notification you will receive while this person is away.

1 0

New python-fedora and you
by Toshio Kuratomi 07 Sep '11

07 Sep '11

I've just updated python-fedora on the app servers to 0.3.25. This update has quite a few changes to the server helpers. For people watching for end user issues, if someone reports problems with logging in and out of the turbogears web apps on admin.fedoraproject.org or having their csrf token cause problems it is possible that the python-fedora update is to blame. Please let me know if you spot something like that and I'll try to troubleshoot. (abadger1999 on irc). For web application developers there have been a few deprecations and additions. * The fedora.tg.tg1utils and fedora.tg.tg2utils modules have been deprecated. tg1 and tg2 have their own hierarchy now: fedora.tg.utils (for TG1) and fedora.tg2.utils (for tg2). * The TG2 auth middleware has been reworked a bit. It should no longer log you out if you don't have a CSRF token. You should be able to regain your logged in status simply by clicking on a link. Links should have the CSRF token embedded in them in these instances. * Additionally, the TG2 fas auth middleware has had its metadata updated so that it is compatible with the default TG2 auth provider. This should make it possible to write code that is compatible with both out-of-the-box TG2 auth and the faswho auth middleware. * Provisions for testing web applications with the faswho auth provider have been made and documented. You should now be able to set faswho to use tes fas servers for authentication. Details of setting this up are in the updated documentation. https://fedorahosted.org/releases/p/y/python-fedora/doc/faswho.html#authent… * One last, untested feature is that the CSRF middleware that faswho uses to protect against CSRF attacks has been made independent of faswho. You should be able to combine it with other repoze.who auth providers (like the TG2 default auth provider) to have CSRF protection in your application. If you are working on an app that should be able to auth against both fas and some other repoze.who auth source, please feel free to test this and report any bugs to me. This is a desirable feature and I want to make it work. https://fedorahosted.org/releases/p/y/python-fedora/doc/faswho.html#using-c… * Last but not least, just as we have genshi templates for TG1 for CSRF enabled login forms and buttons we now have mako templates for TG2 that do the same. With all the other changes in this release, it shouldn't be hard to make a TG2 version of the genshi templates if those are needed. https://fedorahosted.org/releases/p/y/python-fedora/doc/faswho.html#templat… -Toshio

1 0

Meeting Agenda Item: Introduction batnomuun
by Nomuun.B 06 Sep '11

06 Sep '11

Hi all, My IRC handle: batnomuun I new user fedora. I study IT university in Mongolia. I know python, sql little lol. Hopeful, I will learn lot of things this project. It's very important to my future job career.

2 1

Ask Fedora SOP complete
by Rahul Sundaram 02 Sep '11

02 Sep '11

Hi All settings, customizations are now fully documented at https://fedoraproject.org/wiki/Ask_Fedora_SOP Next step would be to use Puppet to automate all of this and we are good to go although I am going to continue to update to the latest versions from upstream for a while since I have a bunch of feature requests that upstream has committed to implementing or already been implemented in the git head. I haven't yet tested with memcached but I expect the production launch would need this. When I did test it earlier, it seemed buggy although it might have been just my misconfiguration. I will test again soon. I hope to do the initial production launch before Fedora 16 release. http://fedoraproject.org/wiki/Releases/16/Schedule Rahul

2 2

serverbeach maint window: 2011-09-12/13
by Kevin Fenzi 02 Sep '11

02 Sep '11

From an email from serverbeach: > 70103::serverbeach4, 70104::serverbeach5 > > Please be advised that on September 12th starting at 22:00CT > and ending on September 13 at 05:00CT, we will be continuing our > planned ServerBeach Network Upgrades in the SAT Data Center that will > provide you with a more robust and scalable network and enable us to > better server your needs using our new Juniper Routing equipment. > > This maintenance will last approximately 7 hours, during > which your server will experience up to 5 minutes of network downtime > as your gateway is moved to the new Juniper routing equipment. Once > this is done, we will be configuring the newer routers and you will > see 6 brief periods of latency/packet loss as we redirect traffic to > the newer systems. This maintenance will ensure that the networking > systems are standardized and will allow us to use more supported > commands for configuring and investigating issues at the networking > level. Serverbeach04 and 05 are hosted01 and 02. So, just a head up that we may see some short network outages in that window. kevin

1 0

Plan for tomorrow's Fedora Infrastructure meeting (2011-09-01)
by Kevin Fenzi 02 Sep '11

02 Sep '11

The infrastructure team will be having it's weekly meeting tomorrow 2011-09-01 at 1900 UTC in #fedora-meeting on the freenode network. Suggested topics (suggested by whom): * New folks introductions and Apprentice tasks. * Upcoming new machine plans. * Upcoming Tasks/Items (nirik) 2011-08-31: send out outage announcement for next week 2011-09-01 infra meeting 2011-09-01 mail fi-apprentice folks. 2011-09-06: Outage to migrate from db02 to db01 and bastion02 -> bastion03 2011-08-31 send infra meeting agenda 2011-09-13 - 27: Beta change freeze 2011-09-09 Remove inactive fi-apprentice people. 2011-09-27: Fedora 16 Beta 2011-10-01 mail fi-apprentice folks. 2011-10-09 Remove inactive fi-apprentice people. 2011-10-18 - 2011-11-01: Final change freeze 2011-11-01: Fedora 16 release. * Meeting tagged tickets: https://fedorahosted.org/fedora-infrastructure/report/10 NOTE: I have cleaned out the ones that have been sitting around with this tag. Anytime anyone would like to discuss a ticket, just add the meeting keyword and we will get to it in this section. Submit your agenda items, as tickets in the trac instance and send a note replying to this thread. More info here: https://fedoraproject.org/wiki/Infrastructure/Meetings#Meetings Thanks kevin

1 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure September 2011