November 2015 - infrastructure - Fedora Mailing-Lists

Re: FAS2 to FAS3 DB migration - state and questions

by SmootherFrOgZ

On Tue, Nov 17, 2015 at 2:58 PM Xavier Lamien <laxathom(a)fedoraproject.org> wrote: > On Tue, Nov 17, 2015 at 11:38 AM Pierre-Yves Chibon <pingou(a)pingoured.fr> > wrote: > >> On Tue, Nov 17, 2015 at 11:04:20AM +0100, Pierre-Yves Chibon wrote: >> > This is without checking the changes in unique constraints where we >> might have >> > a few other surprises. >> >> After looking more into this, it seems the only fields where we will run >> into >> 'problems' are `ircnick` and `email_token` that FAS3 requires to be >> unique while >> FAS2 doesn't. >> >> I run the following query on the DB: >> SELECT username, ircnick, status >> FROM people >> WHERE ircnick IS NOT NULL >> AND ircnick != '' >> AND status = 'active' >> AND ircnick IN ( >> SELECT ircnick >> FROM people >> WHERE status = 'active' >> GROUP BY ircnick >> HAVING COUNT(ircnick) > 1 >> ) >> ORDER BY ircnick, username; >> >> This returned 70 rows, so at least 35 persons have at minimum 2 accounts, >> active, set with the same ircnick. >> >> I propose that we contact them and kindly ask that they either remove the >> ircnick from one of the accounts or just deactivate it. >> >> For the email_token, we have two different account with the same token, >> and a >> few with a token's whose value is ''. >> (Also: FAS3 requires email_token to be unique, but not password_token, >> should we >> make this consistent?) >> >> >> >> Some more questions for the migration: >> - Do we migrate disabled accounts? >> > yes. > >> - Do we migrate accounts who last_seen date == the creation date ? >> > yes, since they will be set as inactive. > > globally, as we do not delete any account, we should keep them. > They will no showed up in the UI for en-users but admin's panel. > > Or were you thinking about clean up accounts? > >> >> -- Xavier

8 years

1
0
0 / 0

Re: FAS2 to FAS3 DB migration - state and questions

by SmootherFrOgZ

On Tue, Nov 17, 2015 at 2:56 PM Xavier Lamien <laxathom(a)fedoraproject.org> wrote: > On Tue, Nov 17, 2015 at 11:05 AM Pierre-Yves Chibon <pingou(a)pingoured.fr> > wrote: > >> Good morning everyone, >> >> I started looking at what it will take to migrate data from FAS2 to FAS3. >> >> Here are my findings. >> >> First of all the DB schemas: >> FAS2: http://ambre.pingoured.fr/public/FAS2.png >> FAS3: http://ambre.pingoured.fr/public/FAS3.png >> >> >> * Tables to delete in FAS2: >> - session >> - migration_version >> - visit >> - vistit_identity >> - configs >> - requests >> - samadhi_associations >> - samadhi_nonces >> - group_roles >> >> * Tables of FAS2 I do not know what to do with: >> - Log >> We have some logs in the DB, we might be able to convert them but the >> amount >> of information missing for the new log table (people_activity_log) >> might not >> make it worth >> - bugzilla_queue >> There are a few entries in there, but I do not know what it is meant >> for nor >> used by >> >> * Tables to migrate >> - person_roles -> group_membership in FAS3 >> - person_roles_fpca -> group_membership in FAS3 >> -> I guess created when we changed from CLA to FPCA so to be merged >> in the >> same one as above >> - groups -> group in FAS3 >> - people -> people in FAS3 >> >> * Fields that changed >> people >> username : FAS2 = varchar(32) -> FAS3 = varchar(255) >> fullname : FAS2 = human_name -> FAS3 = fullname >> avatar : FAS2 = blog_avatar? -> FAS3 = avatar >> password : FAS2 = varchar(127) -> FAS3 = text >> gpg_id : FAS2 = gpg_id -> FAS3 = gpg_keyid >> emailtoken: FAS2 = emailtoken -> FAS3 = email_token >> passwordtoken: FAS2 = passwordtoken -> FAS3 = password_token >> status : FAS2 = text -> FAS3 = int >> alias_enabled: FAS2 = alias_enabled -> FAS3 = email_alias >> last_seen : FAS2 = last_seen -> FAS3 = last_logged >> >> group >> name : FAS2 = varchar(32) -> FAS3 = varchar(40) >> url : FAS2 = url -> FAS3 = web_link >> groupe_type: FAS2 = varchar(16) -> FAS3 = int (Foreign Key) >> creation : FAS2 = creation -> FAS3 = created >> joinmsg : FAS2 = joinmsg -> FAS3 = join_msg >> user_can_remove: FAS2 = user_can_remove -> FAS3 = self_removal >> >> For this table I have a problem with these fields in FAS3: >> ``need_approval`` and ``requires_sponsorship``? >> What is the difference? Which corresponds to ``needs_sponsor``? >> > > There were no real difference in between those two in FAS2 both were doing > the same thind. > In FAS3, the need_approval boolean is used when the group doesn't provide > "sponsor" role. > in this context, groud's admin can approve users without having (or being) > a sponsor's role (like in fas2) which actually doesn't mean anything for > this group's purpose. > > > >> >> group_membership >> role_type: FAS2 = role_type (text) -> FAS3: role (int) >> role_status: FAS2 = role_status (text)-> FAS3: status (int) >> sponsor_id: FAS2 = sponsor_id -> FAS3: sponsor >> person_id: FAS2 = person_id -> FAS3: people_id >> creation: FAS2 = creation -> FAS3: creation_timestamp >> approval: FAS2 = approval -> FAS3: approval_timestamp >> >> >> Xavier, could you confirm that this mapping is correct? Should we look >> into >> being a little closer to the FAS2 model? (For example in the >> group_membership >> table) >> > > I don't think we should. This will make think more complicated by adapting > fas3 code > which come with a new architecture. > > Also for change such as the length of the password field, since we hash the >> password, does it make sense to use a text field there since they will >> all be >> of the same size? >> > > If the the length from fas2 is the same as fas3, not really. > > >> >> Then there is the question of the integer-based status (in the `people` >> table >> and in the `group_membership` table). Is the mapping documented somewhere? >> Does it fit with the old status model? >> >> Another question will be regarding the certificates, Xavier, will we be >> able to >> migrate certificates information to the new tables? >> > > We should be able to. what king of info is being missed in fas3? > -- Xavier

8 years

1
0
0 / 0

[release] bodhi: 2.1.3

by Luke Macken

Hi folks, I just pushed out a new release of Bodhi to production. This contains a number of bug fixes and user-facing enhancements that have piled up since the freeze. If you recently had trouble editing an update to add a newer build, please give it another shot. A number of people have hit this bug recently, and it happens when the older build has a corresponding buildroot override. This issue has since been resolved. Thanks, luke 2.1.3 ----- Pull Requests - (@farhaanbukhsh) #648, Fixing issue #646 Edit page should have [Save] button not [Edit] button https://github.com/fedora-infra/bodhi/pull/648 - (@ralphbean) #651, Include url to an update in JSON body. https://github.com/fedora-infra/bodhi/pull/651 - (@farhaanbukhsh) #650, Fixing issue #649 giving different title to different updates open in… https://github.com/fedora-infra/bodhi/pull/650 - (@trishnaguha) #657, Information in README https://github.com/fedora-infra/bodhi/pull/657 - (@ralphbean) #663, Let people get quick search results when they press enter. https://github.com/fedora-infra/bodhi/pull/663 - (@ralphbean) #662, Add in the temporary taskotron logo. https://github.com/fedora-infra/bodhi/pull/662 - (@tyll) #668, Use https for comps Repo https://github.com/fedora-infra/bodhi/pull/668 - (@ralphbean) #669, Clarify ejection reason. https://github.com/fedora-infra/bodhi/pull/669 - (@lmacken) #670, Allow the same people to give karma to an update that has had it's karma reset https://github.com/fedora-infra/bodhi/pull/670 - (@ralphbean) #676, Add convenience links from the update page to override management. https://github.com/fedora-infra/bodhi/pull/676 - (@ralphbean) #673, Remove extra unnecessary float class from the build list. https://github.com/fedora-infra/bodhi/pull/673 - (@ralphbean) #674, Provide a more useful message when the csrf check fails. https://github.com/fedora-infra/bodhi/pull/674 - (@ralphbean) #675, Explicitly namespace the white-space css rule. https://github.com/fedora-infra/bodhi/pull/675 - (@ralphbean) #681, Hide the js warning as early as possible. https://github.com/fedora-infra/bodhi/pull/681 - (@ralphbean) #682, Show the list of builds in a nested table. https://github.com/fedora-infra/bodhi/pull/682 - (@ralphbean) #683, Include other font types from fontawesome in our dist. https://github.com/fedora-infra/bodhi/pull/683 - (@ralphbean) #680, Log a little more information about unhandled errors. https://github.com/fedora-infra/bodhi/pull/680 - (@ralphbean) #684, Allow users to disable global popups. https://github.com/fedora-infra/bodhi/pull/684 - (@ralphbean) #685, Add more info to the mash summary logging. https://github.com/fedora-infra/bodhi/pull/685 - (@pypingou) #689, Add the possibility to ignore the comments made by a specific user https://github.com/fedora-infra/bodhi/pull/689 - (@pypingou) #687, Specify for which field we are returning a notification https://github.com/fedora-infra/bodhi/pull/687 - (@pypingou) #688, Allow users to select the content of the notifications https://github.com/fedora-infra/bodhi/pull/688 - (@pypingou) #686, Ensure there is an user before we try to access show_popups https://github.com/fedora-infra/bodhi/pull/686 - (@remicollet) #690, Add perl# schema for bug links https://github.com/fedora-infra/bodhi/pull/690 - (@pypingou) #691, Couple of fixes regarding sending emails. https://github.com/fedora-infra/bodhi/pull/691 - (@lmacken) #700, Don't delete Build objects if they have a corresponding BuildrootOverride https://github.com/fedora-infra/bodhi/pull/700 Commits - 2ad694a7c Fixing issue #646 Edit page should have [Save] button not [Edit] button https://github.com/fedora-infra/bodhi/commit/2ad694a7c - 99793f019 Fixing issue #649 giving different title to different updates open in different tabs https://github.com/fedora-infra/bodhi/commit/99793f019 - 78811e4fe Include url to an update in JSON body. https://github.com/fedora-infra/bodhi/commit/78811e4fe - f05ef11fc Improved html title to display package name with -Fedora Updates System https://github.com/fedora-infra/bodhi/commit/f05ef11fc - 4759c186a Improved html title to display package name with - Fedora Updates System and added space for readability https://github.com/fedora-infra/bodhi/commit/4759c186a - b5b3310ef cli: Allow the 'obsolete' and 'revoke' requests https://github.com/fedora-infra/bodhi/commit/b5b3310ef - 7e3aad7ff Informations in README https://github.com/fedora-infra/bodhi/commit/7e3aad7ff - d473cc50e Add in the temporary taskotron logo. https://github.com/fedora-infra/bodhi/commit/d473cc50e - f696b4f06 Let people get quick search results when they press enter. https://github.com/fedora-infra/bodhi/commit/f696b4f06 - 4e44deaf2 Use https for comps Repo https://github.com/fedora-infra/bodhi/commit/4e44deaf2 - b7926ebd3 tests: Add a test to reproduce the incorrect karma bug from #659 https://github.com/fedora-infra/bodhi/commit/b7926ebd3 - 380d4d3fb Clarify ejection reason. https://github.com/fedora-infra/bodhi/commit/380d4d3fb - 391a548ea tests: Silence some SA Unicode warnings https://github.com/fedora-infra/bodhi/commit/391a548ea - 43b220eda models: Allow the same people to give karma after it was reset (fixes #659) https://github.com/fedora-infra/bodhi/commit/43b220eda - 4debd83af tests: Reset the karma twice for good measure https://github.com/fedora-infra/bodhi/commit/4debd83af - 5cdbb47d2 Add some missing deps to the README. https://github.com/fedora-infra/bodhi/commit/5cdbb47d2 - 5b43eea18 Merge branch 'develop' of github.com:fedora-infra/bodhi into develop https://github.com/fedora-infra/bodhi/commit/5b43eea18 - cd5995be3 Fix incorrect package name. https://github.com/fedora-infra/bodhi/commit/cd5995be3 - d92eeef77 Remove extra unnecessary float class from the build list. https://github.com/fedora-infra/bodhi/commit/d92eeef77 - ac766188c Provide a more useful message when the csrf check fails. https://github.com/fedora-infra/bodhi/commit/ac766188c - 4a6673ed4 Explicitly namespace the white-space css rule. https://github.com/fedora-infra/bodhi/commit/4a6673ed4 - 308c49292 Add convenience links from the update page to override management. https://github.com/fedora-infra/bodhi/commit/308c49292 - f1dcf392f Log a little more information about unhandled errors. https://github.com/fedora-infra/bodhi/commit/f1dcf392f - d2a4842ed Hide the js warning as early as possible. https://github.com/fedora-infra/bodhi/commit/d2a4842ed - bfe3f57e0 Show the list of builds in a nested table. https://github.com/fedora-infra/bodhi/commit/bfe3f57e0 - d7bc48d9e Include other font types from fontawesome in our dist. https://github.com/fedora-infra/bodhi/commit/d7bc48d9e - bce00b6ba Allow users to disable global popups. https://github.com/fedora-infra/bodhi/commit/bce00b6ba - 88bc20b0d Add more info to the mash summary logging. https://github.com/fedora-infra/bodhi/commit/88bc20b0d - e4d45cad5 Ensure there is an user before we try to access show_popups https://github.com/fedora-infra/bodhi/commit/e4d45cad5 - 4678151eb Allow users to select the content of the notifications https://github.com/fedora-infra/bodhi/commit/4678151eb - 61a1cc42d Specify for which field we are returning a notification https://github.com/fedora-infra/bodhi/commit/61a1cc42d - f9a5e7ce3 Add the possibility to ignore the comments made by a specific user https://github.com/fedora-infra/bodhi/commit/f9a5e7ce3 - 0c18fc717 Add unit-tests for the ignore_user filter of the comments returned https://github.com/fedora-infra/bodhi/commit/0c18fc717 - 817642ac3 Add perl# schema for bug links https://github.com/fedora-infra/bodhi/commit/817642ac3 - 5283ca58e Do not specify the sender when announcing a new comment on an update https://github.com/fedora-infra/bodhi/commit/5283ca58e - ec9e2ee3b Always include an X-Bodhi header when sending emails https://github.com/fedora-infra/bodhi/commit/ec9e2ee3b - 70b4237e9 tests: Fix a broken unit tests from PR#691 https://github.com/fedora-infra/bodhi/commit/70b4237e9 - 0ecde2fc9 Don't delete Build objects if they have a corresponding BuildrootOverride (issue #697) https://github.com/fedora-infra/bodhi/commit/0ecde2fc9

8 years

1
0
0 / 0

[release] the-new-hotness: 0.6.4

by Ralph Bean

Small release of the-new-hotness here with a bugfix for anitya interactions. 0.6.4 ----- Pull Requests - (@pypingou) #81, When sending a comment to bugzilla add a link to the project in anitya https://github.com/fedora-infra/the-new-hotness/pull/81 - (@ralphbean) #86, Fix release-monitoring.org html scraping. https://github.com/fedora-infra/the-new-hotness/pull/86 Commits - d900b9de9 Specbump. https://github.com/fedora-infra/the-new-hotness/commit/d900b9de9 - a8903fa06 When sending a comment to bugzilla add a link to the project in anitya https://github.com/fedora-infra/the-new-hotness/commit/a8903fa06 - 47c5f9d55 Fix release-monitoring.org html scraping. https://github.com/fedora-infra/the-new-hotness/commit/47c5f9d55 - 54c132d60 Look just for the csrf_token field. https://github.com/fedora-infra/the-new-hotness/commit/54c132d60

8 years

1
0
0 / 0

[release] mdapi: 2.2.3

by Pierre-Yves Chibon

Good morning, Another day, another release. I just cut and pushed a new release of mdapi: 2.2.3 It's a simple bugfix release, making official a hotfix I made yesterday that fixed displaying the /branches endpoint. Here is the changelog: * Tue Nov 24 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 2.2.3-1 - Update to 2.2.3 - Fix the branches endpoint (un-instantiated variable) Happy querying! Pierre

8 years

1
0
0 / 0

[release] fedora-packages: 3.0.2

by Ralph Bean

Small followup to the last release earlier today. This includes an optimization to make the fedmsg cache worker hustle up. 3.0.2 ----- Pull Requests - (@ralphbean) #209, Use a threadpool when refreshing cache items. https://github.com/fedora-infra/fedora-packages/pull/209

8 years

1
0
0 / 0

[release] fedora-packages: 3.0.1

by Ralph Bean

Hey all, after the deployment of 3.0.0 on Thursday[1], I have a followup release here with some minor bugfixes and enhancements. [1] - http://threebean.org/blog/history-of-fedora-packages/ 3.0.1 ----- Pull Requests - (@ralphbean) #204, Log a warning, but don't email us. https://github.com/fedora-infra/fedora-packages/pull/204 - (@ralphbean) #199, Fix icon suffix. https://github.com/fedora-infra/fedora-packages/pull/199 - (@ralphbean) #201, Remove broken/unused rhbz stuff. https://github.com/fedora-infra/fedora-packages/pull/201 - (@ralphbean) #202, Fix .spec pygments lexer. https://github.com/fedora-infra/fedora-packages/pull/202 - (@ralphbean) #203, Fix git scraping. https://github.com/fedora-infra/fedora-packages/pull/203 - (@ralphbean) #207, Remove rhel5 links. https://github.com/fedora-infra/fedora-packages/pull/207 - (@ralphbean) #208, Change text from Owner to Point of Contact. https://github.com/fedora-infra/fedora-packages/pull/208 - (@ralphbean) #200, Fix up links to bodhi and koji. https://github.com/fedora-infra/fedora-packages/pull/200 Commits - 600480058 Raise a keyerror just to make this simpler. https://github.com/fedora-infra/fedora-packages/commit/600480058 - 0c5ab0a58 Move xapian document preparation out of the threadpool. The bindings aren't threadsafe on el6. https://github.com/fedora-infra/fedora-packages/commit/0c5ab0a58 - a891c2938 Also, log, so we know where we are on the fan-in thread. https://github.com/fedora-infra/fedora-packages/commit/a891c2938 - 7202059f4 Fix icon suffix. https://github.com/fedora-infra/fedora-packages/commit/7202059f4 - 1dfb63dbb Add build links on the Active Releases page. https://github.com/fedora-infra/fedora-packages/commit/1dfb63dbb - 777f0ea55 Make koji builds a link to koji. https://github.com/fedora-infra/fedora-packages/commit/777f0ea55 - 1651a67a4 Remove broken/unused rhbz stuff. https://github.com/fedora-infra/fedora-packages/commit/1651a67a4 - e4e6cb79e Fix .spec pygments lexer. https://github.com/fedora-infra/fedora-packages/commit/e4e6cb79e - 6d9dd0da7 Fix git scraping. https://github.com/fedora-infra/fedora-packages/commit/6d9dd0da7 - 84ddb19a4 Log a warning, but don't email us. https://github.com/fedora-infra/fedora-packages/commit/84ddb19a4 - dcdeaaf90 Remove rhel5 links. Fixes #205. https://github.com/fedora-infra/fedora-packages/commit/dcdeaaf90 - 954b76de3 Change text from Owner to Point of Contact. https://github.com/fedora-infra/fedora-packages/commit/954b76de3

8 years

3
4
0 / 0

[release] mdapi: 2.2.1 and 2.2.2

by Pierre-Yves Chibon

Good morning everyone, Yesterday and this morning I cut a new version of mdapi: 2.2.1 and 2.2.2. The version 2.2.1 made it to stg, where we spot a bug which got fixed in 2.2.2. The basis for these two versions was simply to have the links on the front page work, whether you're accessing the application via: https://apps.fedoraproject.org/mdapi/ or https://apps.fedoraproject.org/mdapi Here are the changelogs: * Mon Nov 23 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 2.2.2-1 - Update to 2.2.2 - Fix accessing the configuration to adjust the link on the front page * Sun Nov 22 2015 Pierre-Yves Chibon <pingou(a)pingoured.fr> - 2.2.1-1 - Update to 2.2.1 - Fix the links in the front page with it's accessed without trailing slash (Patrick Uiterwijk) Happy querying, Pierre

8 years

1
0
0 / 0

Self introduction

by Gaurav Kumar

Hi all, I am Gaurav Kumar and I would like to introduce myself. Currently, I am working on PHP, MySQL, JavaScript, jQuery, HTML and CSS full-time. During free time, I have also contributed to CakePHP documentation and built PHP projects. I am using different flavors of Linux for six years now with Fedora as my primary choice. Being a Linux user and a programmer myself I planned to start contributing and involve with the Fedora community. I have started learning Python for last few days and would like to involve in Python based projects in Fedora. It would be great someone guide me on how can I get started? -- Thanks, Gaurav Kumar +91-8446213680

8 years

2
1
1 / 0

Some notes on CSI variables

by Kevin Fenzi

Just some quick notes on CSI variables as may people are submitting them. ;) They can't contain : in them as thats used as a variable seperator. If you want to do multiple lines, thats ok, but you have to do: variablename: | one two three (the | is important there, it tells jinja that there's mutiple lines there). Also, you can't use * in the multiline ones, use - instead as a bullet). Thanks, kevin

8 years

3
2
0 / 0

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

infrastructure November 2015