koji-devel March 2023

koji-devel@lists.fedorahosted.org

8 participants
9 discussions

Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Miroslav Suchý 04 Apr '23

04 Apr '23

Dne 30. 03. 23 v 9:36 Joe (Jun-Yan) Chen napsal(a): > Hi, > > I tried mock's feature and plugins "nosync", "tmpfs", "use_bootstrap_image", > > but still stuck in "dnf installroot"'s "dnf makecache" process for 7 minutes everytime, > > Is there any methods to not pull a brand new image every time?(reuse image every task instead) This is weird. The root-cache should be preserved and reused. Unless you modify the config (mtime). Then Mock assume configuration changed and rebuild the root-cache. You may as well experiment with # config_opts['plugin_conf']['root_cache_opts']['age_check'] = True # config_opts['plugin_conf']['root_cache_opts']['max_age_days'] = 15 # config_opts['plugin_conf']['yum_cache_opts']['max_age_days'] = 30 # config_opts['plugin_conf']['yum_cache_opts']['max_metadata_age_days'] = 30 Miroslav

2 7

Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Joe (Jun-Yan) Chen 30 Mar '23

30 Mar '23

Hi, I tried mock's feature and plugins "nosync", "tmpfs", "use_bootstrap_image", but still stuck in "dnf installroot"'s "dnf makecache" process for 7 minutes everytime, Is there any methods to not pull a brand new image every time?(reuse image every task instead) <https://www.ambarella.com> Best Regards, Junyan CHEN [Ambarella AI Envisioned] <https://www.ambarella.com> Junyan(Joe) CHEN Software Engineer | SDK Team Phone: +86-021-60880608-265 Email: jychena(a)ambarella.com<mailto:jychena@ambarella.com> <https://www.ambarella.com> ********************************************************************** This email and attachments contain Ambarella Proprietary and/or Confidential Information and is intended solely for the use of the individual(s) to whom it is addressed. Any unauthorized review, use, disclosure, distribute, copy, or print is prohibited. If you are not an intended recipient, please contact the sender by reply email and destroy all copies of the original message. Thank you.

1 0

Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Miroslav Suchý 17 Mar '23

17 Mar '23

Dne 17. 03. 23 v 9:53 Joe (Jun-Yan) Chen napsal(a): > Dear Koji Development Team, > > > I hope this email finds you well. I am writing to seek your expertise about using QEMU as a Koji Builder to build > packages for the aarch64 on the fedora platform. > > When Koji invokes mock for building, it spends *a significant amount of time updating yum metadata*(≈15mins, > <mirrors.kernel.org> set as external repo) resulting in taking 30 minutes to init buildroot alone (download > speed≈2.8MB/s). I tried to use squid to cache mirror of fedora by modify /etc/kojid.com: yum_proxy = http://xxx:3128 > but the "--installroot" process still costs a lot of time. > > > I would like to know if there is any information that I may have overlooked or any guidance or recommendations you may > have to speed up init buildroot process on QEMU builder. > > Thank you in advance for your time and consideration. This is still valid and we use this setup in Copr builders http://miroslav.suchy.cz/blog/archives/2015/05/28/increase_mock_performance… The other thing that speed Mock a lot is container image and nosync https://rpm-software-management.github.io/mock/Feature-container-for-bootst… https://rpm-software-management.github.io/mock/Feature-nosync Miroslav

1 0

Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Michael McLean 17 Mar '23

17 Mar '23

When using the external repos feature, it is generally best practice to mirror the external repos you want to use (e.g. with a tool like repomirror), and use your local mirror url for the external repo in Koji. On Fri, Mar 17, 2023 at 9:09 AM Joe (Jun-Yan) Chen <jychena(a)ambarella.com> wrote: > Dear Koji Development Team, > > > I hope this email finds you well. I am writing to seek your expertise > about using QEMU as a Koji Builder to build packages for the aarch64 on the > fedora platform. > > When Koji invokes mock for building, it spends *a significant amount of > time updating yum metadata*(≈15mins, <mirrors.kernel.org> set as external > repo) resulting in taking 30 minutes to init buildroot alone (download > speed≈2.8MB/s). I tried to use squid to cache mirror of fedora by modify > /etc/kojid.com: yum_proxy = http://xxx:3128 but the "--installroot" > process still costs a lot of time. > > > I would like to know if there is any information that I may have > overlooked or any guidance or recommendations you may have to speed up init > buildroot process on QEMU builder. > > Thank you in advance for your time and consideration. > > <https://www.ambarella.com> > > Best Regards, > Junyan CHEN > > > [image: Ambarella AI Envisioned] <https://www.ambarella.com> *Junyan(Joe) > CHEN* > Software Engineer | SDK Team > *Phone:* +86-021-60880608-265 > Email: jychena(a)ambarella.com > <https://www.ambarella.com> > ------------------------------ > This email and attachments contain Ambarella Proprietary and/or > Confidential Information and is intended solely for the use of the > individual(s) to whom it is addressed. Any unauthorized review, use, > disclosure, distribute, copy, or print is prohibited. If you are not an > intended recipient, please contact the sender by reply email and destroy > all copies of the original message. Thank you. > _______________________________________________ > koji-devel mailing list -- koji-devel(a)lists.fedorahosted.org > To unsubscribe send an email to koji-devel-leave(a)lists.fedorahosted.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedorahosted.org/archives/list/koji-devel@lists.fedorahosted.… > Do not reply to spam, report it: > https://pagure.io/fedora-infrastructure/new_issue >

1 0

Seeking Advice on Speeding Up Koji Builds with QEMU
by Joe (Jun-Yan) Chen 17 Mar '23

17 Mar '23

Dear Koji Development Team, I hope this email finds you well. I am writing to seek your expertise about using QEMU as a Koji Builder to build packages for the aarch64 on the fedora platform. When Koji invokes mock for building, it spends a significant amount of time updating yum metadata(≈15mins, <mirrors.kernel.org> set as external repo) resulting in taking 30 minutes to init buildroot alone (download speed≈2.8MB/s). I tried to use squid to cache mirror of fedora by modify /etc/kojid.com: yum_proxy = http://xxx:3128 but the "--installroot" process still costs a lot of time. I would like to know if there is any information that I may have overlooked or any guidance or recommendations you may have to speed up init buildroot process on QEMU builder. Thank you in advance for your time and consideration. <https://www.ambarella.com> Best Regards, Junyan CHEN [Ambarella AI Envisioned] <https://www.ambarella.com> Junyan(Joe) CHEN Software Engineer | SDK Team Phone: +86-021-60880608-265 Email: jychena(a)ambarella.com<mailto:jychena@ambarella.com> <https://www.ambarella.com> ********************************************************************** This email and attachments contain Ambarella Proprietary and/or Confidential Information and is intended solely for the use of the individual(s) to whom it is addressed. Any unauthorized review, use, disclosure, distribute, copy, or print is prohibited. If you are not an intended recipient, please contact the sender by reply email and destroy all copies of the original message. Thank you.

1 0

Fedora RISC V distribution on Koji
by Tanvi Sheth 15 Mar '23

15 Mar '23

Me & my team were trying to set up Koji on Local server. We followed the guide https://docs.pagure.org/koji/server_howto/ We followed SSL Authentication. We are constantly getting an error message after we type "koji moshimoshi" 2023-03-06 11:03:10,150 [ERROR] koji: (gssapi auth failed: requests.exceptions.SSLError: HTTPSConnectionPool(host='koji.fedoraproject.org', port=443): Max retries exceeded with url: /kojihub/ssllogin (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:992)')))) Use following documentation to debug kerberos/gssapi auth issues. https://docs.pagure.org/koji/kerberos_gssapi_debug/ Can anyone please guide us on how to solve the issue? We've tried multiple resources but none seemed to work. Any help would be appreciated.

4 13

Updated invitation with note: Koji Community Meeting @ Thu Mar 9, 2023 11am - 12pm (EST) (koji-devel@lists.fedorahosted.org)
by lismith＠redhat.com 09 Mar '23

09 Mar '23

This event has been updated with a note: "Corrected Google Meet link" Changed: conferencing Koji Community Meeting Thursday Mar 9, 2023 ⋅ 11am – 12pm Eastern Time - New York Join with Google Meet https://meet.google.com/gez-utno-nqj?hs=224 Join by phone (US) +1 401-702-0515 PIN: 559411672 More joining options https://tel.meet/gez-utno-nqj?pin=1008899449135&hs=0 Join using SIP 1008899449135(a)gmeet.redhat.com ID: 1008899449135 The Koji Community Meeting is to collect feedback from the community on Koji. We also use this meeting to sync the Koji roadmap and released features. All are welcome to join. Agenda: https://docs.google.com/document/d/1RwnK0orw90lA_bwzHq5cdZYGMZh--EK8t65ePI4… Organizer lismith(a)redhat.com lismith(a)redhat.com Guests lismith(a)redhat.com - organizer Ken Dreyer ngompa13(a)gmail.com nburr(a)redhat.com cobrien(a)redhat.com ahills(a)redhat.com puiterwi(a)redhat.com koji-devel(a)lists.fedorahosted.org sruikar(a)redhat.com jdisnard(a)redhat.com kevin(a)scrye.com alemay(a)redhat.com pingou(a)fedoraproject.org amoloney(a)redhat.com foraker1(a)llnl.gov mfaruga(a)redhat.com brew-devel lrossett(a)redhat.com agonsorc(a)redhat.com rcallicotte(a)gmail.com kostadinkr.bukov(a)gmail.com View all guest info https://calendar.google.com/calendar/event?action=VIEW&eid=NDNzZXA1cXNyYm4x… Reply for koji-devel(a)lists.fedorahosted.org and view more details https://calendar.google.com/calendar/event?action=VIEW&eid=NDNzZXA1cXNyYm4x… Your attendance is optional. ~~//~~ Invitation from Google Calendar: https://calendar.google.com/calendar/ You are receiving this email because you are an attendee on the event. To stop receiving future updates for this event, decline this event. Forwarding this invitation could allow any recipient to send a response to the organizer, be added to the guest list, invite others regardless of their own invitation status, or modify your RSVP. Learn more https://support.google.com/calendar/answer/37135#forwarding

1 0

Updated invitation with note: Koji Community Meeting @ Thu Mar 9, 2023 11am - 12pm (EST) (koji-devel@lists.fedorahosted.org)
by lismith＠redhat.com 09 Mar '23

09 Mar '23

This event has been updated with a note: "Agenda added" Changed: description Koji Community Meeting Thursday Mar 9, 2023 ⋅ 11am – 12pm Eastern Time - New York Join with Google Meet https://meet.google.com/brs-dgvf-wsf?hs=224 Join by phone (CZ) +420 234 610 212 PIN: 711111981 More joining options https://tel.meet/brs-dgvf-wsf?pin=5434319929003&hs=0 Join using SIP 5434319929003(a)gmeet.redhat.com ID: 5434319929003 The Koji Community Meeting is to collect feedback from the community on Koji. We also use this meeting to sync the Koji roadmap and released features. All are welcome to join. Agenda: https://docs.google.com/document/d/1RwnK0orw90lA_bwzHq5cdZYGMZh--EK8t65ePI4… Organizer lismith(a)redhat.com lismith(a)redhat.com Guests lismith(a)redhat.com - organizer Ken Dreyer ngompa13(a)gmail.com nburr(a)redhat.com cobrien(a)redhat.com ahills(a)redhat.com puiterwi(a)redhat.com koji-devel(a)lists.fedorahosted.org sruikar(a)redhat.com jdisnard(a)redhat.com kevin(a)scrye.com alemay(a)redhat.com pingou(a)fedoraproject.org amoloney(a)redhat.com foraker1(a)llnl.gov mfaruga(a)redhat.com brew-devel lrossett(a)redhat.com agonsorc(a)redhat.com View all guest info https://calendar.google.com/calendar/event?action=VIEW&eid=NDNzZXA1cXNyYm4x… Reply for koji-devel(a)lists.fedorahosted.org and view more details https://calendar.google.com/calendar/event?action=VIEW&eid=NDNzZXA1cXNyYm4x… Your attendance is optional. ~~//~~ Invitation from Google Calendar: https://calendar.google.com/calendar/ You are receiving this email because you are an attendee on the event. To stop receiving future updates for this event, decline this event. Forwarding this invitation could allow any recipient to send a response to the organizer, be added to the guest list, invite others regardless of their own invitation status, or modify your RSVP. Learn more https://support.google.com/calendar/answer/37135#forwarding

2 1

Fedora RISC V distribution on Koji
by Tanvi Sheth 06 Mar '23

06 Mar '23

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

koji-devel March 2023