Re: #5846: move away from md5 for look-aside cache

[Fedora Release Engineering]

#5846: move away from md5 for look-aside cache
-------------------+-----------------------
  Reporter:  till  |      Owner:  rel-eng@…
      Type:  task  |     Status:  new
 Milestone:        |  Component:  other
Resolution:        |   Keywords:
Blocked By:        |   Blocking:  6111
-------------------+-----------------------

Comment (by bochecha):

 Lots of things have been happening for this ticket, but I never really
 mentioned it in here.

 We're getting close to the point where we could actually migrate, most of
 the preparation work has been done.

 So here's a long-overdue status report, with as much detail as possible.

 *

[https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/roles/di...
 server-side: Be able to handle sha512 hashes]
  * Deployed in prod
 *

[https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/roles/di...
 server-side: Store sources in /$module/$source/$hashtype/$hash/$sources if
 the hashtype is not 'md5']
  * Deployed in prod
 * [https://github.com/fedora-
 infra/fedmsg_meta_fedora_infrastructure/pull/170 fedmsg: Be able to handle
 new messages containing the hashtype]
  * Deployed in prod
 *

[https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/roles/di...
 server-side: Start emitting those new messages]
  * Deployed in prod
 *
 [https://lists.fedoraproject.org/pipermail/buildsys/2015-February/004536.html
 pyrpkg: Be able to read/write 'sources' files containing the hashtype]
  * Merged upstream, released as 1.32
  * Package updated in all Fedora and EPEL branches
 * [https://lists.fedoraproject.org/pipermail/rel-
 eng/2014-March/017458.html fedpkg: Be able to upload with a hashtype which
 is not 'md5']
  * Merged upstream, released as 1.20
  * Package updated in all Fedora and EPEL branches
 * [https://lists.fedoraproject.org/pipermail/rel-eng/2015-May/019998.html
 pyrpkg: Redo the lookaside cache handling]
  * Merged upstream, released as 1.35
  * Package updated in all Fedora and EPEL branches
 *
 [https://lists.fedoraproject.org/pipermail/infrastructure/2015-May/016322....
 server-side: Put new archives both in the new and old path, even for md5]
  * Deployed in prod
 * fedpkg: Be able to download from
 /$module/$source/$hashtype/$hash/$sources
  * Patches done: https://pagure.io/fork/bochecha/fedpkg/branch/lookaside
  * '''TODO:''' Merge upstream
  * '''TODO:''' Get an upstream release including this change
  * '''TODO:''' Update the package in all Fedora branches, as well
as in
 EPEL6 and EPEL7
 * server-side: [optional] Hardlink all existing sources to the new md5
 location
  * '''TODO:''' Send the script (ansible repo)
  * '''TODO:''' Run in prod
 * fedpkg: Use the new sources file format and switch to sha512
  * '''Not before all the above is done'''
  * '''We might bundle that with the CA-related changes from ticket
 #6111'''
  * Patches done:
 https://pagure.io/fork/bochecha/fedpkg/branch/lookasidehash
  * '''TODO:''' Merge upstream
  * '''TODO:''' Get an upstream release including this change
  * '''TODO:''' Update the package in all Fedora branches, as well
as in
 EPEL6 and EPEL7
 * server-side: [optional] Hardlink all existing sources to the new sha512
 location
  * '''TODO:''' Send the script (ansible repo)
  * '''TODO:''' Run in prod
 * server-side: Remove support for new md5 uploads from the CGI script
  * '''Not before all the above is done'''
  * '''TODO:''' Deploy in prod
 * server-side: Remove support for the old path from the CGI script
  * '''Not before all the above is done'''
  * '''TODO:''' Deploy in prod

-- 
Ticket URL: <https://fedorahosted.org/rel-eng/ticket/5846#comment:23>
Fedora Release Engineering <http://fedorahosted.org/rel-eng>
Release Engineering for the Fedora Project