January 2018 - rel-eng - Fedora Mailing-Lists

[releng] Issue #6999: A static index for registry.fedoraproject.org [placeholder]

by Clement Verna

cverna added a new comment to an issue you are following: `` Thanks @otaylor, I ll look at the metastore and try to get it running on my machine. `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/6999

6 years, 4 months

1
0
0 / 0

[Fedocal] Reminder meeting : Fedora Release Engineering

by ausil＠fedoraproject.org

Dear all, You are kindly invited to the meeting: Fedora Release Engineering on 2018-01-11 from 17:00:00 to 18:00:00 UTC At fedora-meeting-2(a)irc.freenode.net The meeting will be about: Fedora Release Engineering weekly meeting Source: https://apps.fedoraproject.org/calendar/meeting/8666/

6 years, 4 months

1
0
0 / 0

[releng] Issue #7257: Fedora 28 Change: Avoid /usr/bin/python in RPM build

by Miro Hrončok

churchyard reported a new issue against the project: `releng` that you are following: `` Hi, please check your impact with https://fedoraproject.org/wiki/Changes/Avoid_usr_bin_python_in_RPM_Build Thank you `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7257

6 years, 4 months

2
2
0 / 0

[releng] Issue #7258: Fedora 28 change: rename "nobody" user

by Zbigniew Jędrzejewski-Szmek

zbyszek reported a new issue against the project: `releng` that you are following: `` https://fedoraproject.org/wiki/Changes/RenameNobodyUser `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7258

6 years, 4 months

3
3
0 / 0

[releng] Issue #7256: Fedora 28 Change: NIS switching to new libnsl to support IPv6

by Honza Horak

hhorak reported a new issue against the project: `releng` that you are following: `` https://fedoraproject.org/wiki/Changes/NISIPv6 This change does not need a mass rebuild. We can rebuild packages as needed because we can easily find all packages which use the deprecated interfaces. `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/7256

6 years, 4 months

2
2
0 / 0

[releng] Issue #6999: A static index for registry.fedoraproject.org [placeholder]

by Owen Taylor

otaylor added a new comment to an issue you are following: `` I actually got pretty far with this in the fall - there's a fairly complete solution at: https://github.com/owtaylor/metastore/ I started off looking at 'reg' or writing a similar static approach by hand, but it didn't seem convincing to me that it would scale even to the anticipated needs of registry.fedoraproject.org - the basic problem is that you need a *lot* of HTTP requests to get all the data you need: A) List all the repositories B) List all the tags in each repositories C) Get the manifest for each tag D Get the config for the manifest to find out labels I *want* to get to the point where we have ~1000 flatpaks in the Fedora registry, in addition to all the server side containers - multiply that out by different version tags, etc, and we're talking 10k+ requests at a minimum to do a complete scan. That's going to put a lot of load on the registry for multiple minutes, at my estimation. (A complete scan of the *current* registry contents to this level of detail takes several minutes, though it would likely be faster collocated.) So how often could we run such a scan? Every 30 minutes? Every hour? For the candidate registry, we'd like new builds to visible be not in an hour, but ideally within seconds so that after a build a maintainer can immediately test out if it works. The other problem is that you end up hardcoding in the server config the metadata and containers you need, or generating gigantic output files with ALL the metadata for ALL the containers. The basic principles of metastore are: * Harvest metadata out of the registry via the http API * Update it incrementally triggered by webhooks * Store it in a database * Allow arbitrary queries, but pay a lot of attention to being able to cache them with a frontend cache I've been holding off on pushing to deploy this to try and get some feedback internally/externally first, but haven't succeeded so far - partly because of lack of bandwidth to bug people. In terms of appstream, I think we just put it into a OCI annotation at build time - though digging inside the container to extract when indexing is theoretically possible. `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/6999

6 years, 4 months

1
0
0 / 0

[releng] Issue #6999: A static index for registry.fedoraproject.org [placeholder]

by Clement Verna

cverna added a new comment to an issue you are following: `` So using the docker registry HTTP APIs we should be able to get something. After digging a little bit we have : * List the repositories : https://registry.fedoraproject.org/v2/_catalog * Get tags for a repository : https://registry.fedoraproject.org/v2/f26/mariadb/tags/list * Get the manifest for a repository and a tag : https://registry.fedoraproject.org/v2/f26/mariadb/manifests/latest Regarding the appstream metadata I am not sure yet how we could get them. Any ideas ? @otaylor Do you know exactly which OCI metadata gnome-software would need ? Maybe you already have an example of json file used by gnome-software ? `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/6999

6 years, 4 months

1
0
0 / 0

[releng] Issue #6999: A static index for registry.fedoraproject.org [placeholder]

by Patrick "マルタインアンドレアス" Uiterwijk

puiterwijk added a new comment to an issue you are following: `` I would like to point out that we *have* a piece of software that will generate a static index, though for now it's human-readable HTML. If you can tell us what information you need and in what format (json, xml, ...), I can easily add it to that same system... `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/6999

6 years, 4 months

1
0
0 / 0

[releng] Issue #6846: PHP 7.2 mass rebuild

by Remi Collet

The status of the issue: `PHP 7.2 mass rebuild` of project: `releng` has been updated to: Closed as Fixed by remi. https://pagure.io/releng/issue/6846

6 years, 4 months

1
0
0 / 0

[releng] Issue #6846: PHP 7.2 mass rebuild

by Mohan Boddu

mohanboddu added a new comment to an issue you are following: `` @remi Can we close this ticket now? `` To reply, visit the link below or just reply to this email https://pagure.io/releng/issue/6846

6 years, 4 months

1
0
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

rel-eng January 2018