Anonymized access log from a fedora mirror
by Lukas Zapletal
Hello,
I have two students interested in diploma thesis called Yum plugin for
suggesting packages based on usage:
http://bit.ly/18hrHbL
TL;DR - from anonymized access log, create a database of suggested
packages using data mining techniques and provide a Yum plugin that
would suggest "Users of vim also installed: ctags, git, ..."
I am gonna create a Fedora Feature wiki page shortly describing this in
more detail. Our goal is to offer this project for integration into
Fedora later on, at least provide Fedora packages for it.
To do that, we need good source of data. It would be best to collect
access logs from one or two main Fedora mirrors. We would provide short
script in Python that would parse access logs and anonymize the data (IP
address hash-salted) and filtered only relevant data (RPM files from
latest Fedora release or updates repositories). That would be phase one
which should give us a sample data.
Phase two would be to integrate this script with logrotate and for one
Fedora release cycle (Fedora 19) the script would collect relevant
anonymized data into a file. Final suggested package database would be
created from this file (or maybe files to allow us to move them on the
fly out of the stat directory).
The big (legal) question is if we are able to provide this anonymized
data to public, or if we want to sign NDA with all people involved. I am
CCing Tom for this question.
I need your help with connecting to relevant people. Any comments are
appreciated.
Many thanks and I hope this effort will lead to improving user
experience with Fedora packaging.
--
Later,
Lukas "lzap" Zapletal
irc: lzap #theforeman
9 years, 12 months
Fedora 20 Beta Freeze now in effect
by Kevin Fenzi
Greetings.
we are now in the infrastructure freeze leading up to the Fedora 20
Beta release. This is a pre-release freeze.
You can see a list of hosts that do not freeze by checking out the
ansible repo and running the freezelist script:
git clone http://infrastructure.fedoraproject.org/infra/ansible.git
scripts/freezelist -i inventory/inventory
Anything listed as freezes is frozen until 2013-10-29 (or later if Beta
slips). Frozen hosts should have no changes made to them without a
signoff on the change from at least 2 sysadmin-main or rel-eng members.
Thanks,
kevin
10 years
Plan for tomorrow's Fedora Infrastructure meeting (2013-10-31)
by Kevin Fenzi
The infrastructure team will be having it's weekly meeting tomorrow,
2013-10-31 at 19:00 UTC in #fedora-meeting on the freenode network.
Suggested topics:
#topic New folks introductions and Apprentice tasks.
If any new folks want to give a quick one line bio or any apprentices
would like to ask general questions, they can do so in this part of the
meeting. Don't be shy!
#topic Applications status / discussion
Check in on status of our applications: pkgdb, fas, bodhi, koji,
community, voting, tagger, packager, dpsearch, etc.
If there's new releases, bugs we need to work around or things to note.
#topic Sysadmin status / discussion
Here we talk about sysadmin related happenings from the previous week,
or things that are upcoming.
#topic Upcoming Tasks/Items
https://apps.fedoraproject.org/calendar/list/infrastructure/
#topic Open Floor
Submit your agenda items, as tickets in the trac instance and send a
note replying to this thread.
More info here:
https://fedoraproject.org/wiki/Infrastructure/Meetings#Meetings
Thanks
kevin
10 years, 1 month
Fedora search
by Frankie
Hi guys,
I hope all is well.
I am writing in regards to something I had written about two months ago.
This in regards to the search engine.
https://fedorahosted.org/fedora-infrastructure/ticket/1055#trac-add-comment
I think we need to seriously fix this thing once and for all.
I am looking at designing a solution for us.
I however would like to start from the basics.
We will need to look at the solutions that are present at the current time.
This should allow us to critic and analyse them.
I will then take this issue into the meeting for voting and whatever is
decided is what I shall implement.
Kindly do advice if you have any pointers on this project.
I however must be honest and say it will take me about 2 months to complete
when i start because I have a day job elsewhere.
This does not mean I will not want assistance. As always assistance is
highly appreciated.
I hope this will be fruitful so we can close this once and for all. Or
should I say until we need a revision done.
Thanks,
Kind Regards,
--
Skype: Frankie Onuonga
twitter: Frankie.onuonga
irc #freenode: Frankie.onuonga
10 years, 1 month
Meeting Agenda Item: Introduction Jon Disnard
by Jon
Your IRC handle
IRC: masta
FAS: parasense
What skills you have to offer and which you would like to learn
[So I stared at the screen for about 3 minutes, and blanked out.]
Got just the usual skills.
Many years of system administration, managed hosting, and development.
lots and lots of scripting experience: bash, ksh, perl, php, expect.
Currently learning python
What you would like to work on and quite possibly which outstanding
issues you would like to help resolve
Fedora is in the process of bootstrapping a new 64 bit ARM
(secondary) architecture.
I'm here to help with the koji instance relating to 64 bit ARM.
As an active participant in the Fedora-arm community, I'm well
suited for this task.
Would be happy to assist with any activities, react to alerts, fix
trouble, etc.
Thanks!
--
-Jon Disnard
10 years, 1 month
Freeze break request: drop http requests from abusive ip
by Kevin Fenzi
Greetings.
The last few days we have been getting 1000's of connections to
dl.fedoraproject.org from a .ru ip address. They seem to launch
thousands of downloads at once. This is causing download servers to
alert about max processes and possibly not serve content to others.
I'd like to block them in httpd for now:
(note, IP changed below, since I dont think we want to point out this IP address
for all time in our mail archives. The NN.NN.NN.NN will be replaced with the final IP
when the commit is pushed)
+1's?
kevin
--
diff --git a/modules/fedora-web/files/redirects.conf b/modules/fedora-web/files/redirects.conf
index bbd3ced..717c3fe 100644
--- a/modules/fedora-web/files/redirects.conf
+++ b/modules/fedora-web/files/redirects.conf
@@ -15,6 +15,10 @@ RewriteCond %{HTTP_REFERER} ^http://.*/feed/index\.php\?pid2=.*&sid2=.*&mb2=.*&p
RewriteCond %{HTTP_REFERER} ^http://playdot.net/.*$
RewriteRule .* - [F]
+# Drop connections from .ru site thats spawning thousands of connections at a time.
+RewriteCond %{REMOTE_ADDR} ^NN\.NN\.NN\.NN$
+RewriteRule .* - [F]
+
# Comment this when there is a prerelease available
#RewriteRule ^(/.*)?/get-prerelease.*$ $1/get-fedora [R=302]
10 years, 1 month
Jenkins updates
by Pierre-Yves Chibon
Hi all,
I have spent some time updating our jenkins server today.
- we are now running the latest version
- we have a brand new F19 builder (which builds fedocal fine)
- all plugins have been updated to their latest versions (although some of them
seems to not agree that they are)
The F19 builder seems to have a problem, some package conflicting when trying to
install the list of packages we ask. I have not looked into this yet.
Let me know if you see any problem,
Pierre
10 years, 1 month
Hello World!
by Sirnam Swetha
Hello everyone my name is Sirnam Swetha (swetha) and I would like to
be part of the infrastructure team,I am a student and I have good coding
and debugging skills and would like to work for open source projects.
*Name: Sirnam Swetha
*Time Zone / Country : GMT + 5
*Basic skills and experiences: I have good coding and debugging skills,
worked with C, C++, python, Java, JUnit, HTML, CSS, Javascript, PHP...
*Why you're joining: I would like to contribute the knowledge I have and
in turn learn from other people too. :)
*What you're looking to do: I would like to work with infrastructure team,
preferred project Fedora Infrastructure Upstream.
*How much time you can contribute: 3-4 hours per day.
--
With regards,
*Swetha
*
10 years, 1 month
Hello World!
by Sirnam Swetha
Hello.
--
With regards,
*swetha.*
10 years, 1 month
Hello Word
by Anthony Mogrovejo
Hello everyone my name is Anthony Mogrovejo (Perú) am and I would like to
be part of the infrastructure team, I have seven years using gnu / linux,
centos servers I manage / RHEL and unix (solaris / freebsd) currently I
have been working with puppet, chef and mcolletive. I hope to be helpful
*Name: Anthony Mogrovejo
*Time Zone / Country : GMT - 5
*Basic skills and experiences: Administration Servers with CentOS/RHEL,
Unix (FreeBSD/Solaris), administration/deployment with Puppet-Mcollective,
cheff.
*Why you're joining: I would like to contribute to the knowledge that I
have and in turn continue to learn from other people too.
*What you're looking to do: server administration, management and like
puppet.
*How much time you can contribute: 3 hours per day, Monday through Friday
Regards
--
Anthony Mogrovejo
Consultor IT
Linux User # 433253
Ubuntu User # 9562
www.anferinux.blogspot.com
www.kdetony.com
twitter: @kde_tony
------------------------------------
10 years, 1 month
