Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Miroslav Suchý
Dne 30. 03. 23 v 9:36 Joe (Jun-Yan) Chen napsal(a):
> Hi,
>
> I tried mock's feature and plugins "nosync", "tmpfs", "use_bootstrap_image",
>
> but still stuck in "dnf installroot"'s "dnf makecache" process for 7 minutes everytime,
>
> Is there any methods to not pull a brand new image every time?(reuse image every task instead)
This is weird. The root-cache should be preserved and reused. Unless you modify the config (mtime). Then Mock assume
configuration changed and rebuild the root-cache.
You may as well experiment with
# config_opts['plugin_conf']['root_cache_opts']['age_check'] = True
# config_opts['plugin_conf']['root_cache_opts']['max_age_days'] = 15
# config_opts['plugin_conf']['yum_cache_opts']['max_age_days'] = 30
# config_opts['plugin_conf']['yum_cache_opts']['max_metadata_age_days'] = 30
Miroslav
1 month, 4 weeks
Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Joe (Jun-Yan) Chen
Hi,
I tried mock's feature and plugins "nosync", "tmpfs", "use_bootstrap_image",
but still stuck in "dnf installroot"'s "dnf makecache" process for 7 minutes everytime,
Is there any methods to not pull a brand new image every time?(reuse image every task instead)
<https://www.ambarella.com>
Best Regards,
Junyan CHEN
[Ambarella AI Envisioned] <https://www.ambarella.com> Junyan(Joe) CHEN
Software Engineer | SDK Team
Phone: +86-021-60880608-265
Email: jychena(a)ambarella.com<mailto:jychena@ambarella.com>
<https://www.ambarella.com>
**********************************************************************
This email and attachments contain Ambarella Proprietary and/or Confidential Information and is intended solely for the use of the individual(s) to whom it is addressed. Any unauthorized review, use, disclosure, distribute, copy, or print is prohibited. If you are not an intended recipient, please contact the sender by reply email and destroy all copies of the original message. Thank you.
2 months
Re: Seeking Advice on Speeding Up Koji Builds with QEMU
by Michael McLean
When using the external repos feature, it is generally best practice to
mirror the external repos you want to use (e.g. with a tool like
repomirror), and use your local mirror url for the external repo in Koji.
On Fri, Mar 17, 2023 at 9:09 AM Joe (Jun-Yan) Chen <jychena(a)ambarella.com>
wrote:
> Dear Koji Development Team,
>
>
> I hope this email finds you well. I am writing to seek your expertise
> about using QEMU as a Koji Builder to build packages for the aarch64 on the
> fedora platform.
>
> When Koji invokes mock for building, it spends *a significant amount of
> time updating yum metadata*(≈15mins, <mirrors.kernel.org> set as external
> repo) resulting in taking 30 minutes to init buildroot alone (download
> speed≈2.8MB/s). I tried to use squid to cache mirror of fedora by modify
> /etc/kojid.com: yum_proxy = http://xxx:3128 but the "--installroot"
> process still costs a lot of time.
>
>
> I would like to know if there is any information that I may have
> overlooked or any guidance or recommendations you may have to speed up init
> buildroot process on QEMU builder.
>
> Thank you in advance for your time and consideration.
>
> <https://www.ambarella.com>
>
> Best Regards,
> Junyan CHEN
>
>
> [image: Ambarella AI Envisioned] <https://www.ambarella.com> *Junyan(Joe)
> CHEN*
> Software Engineer | SDK Team
> *Phone:* +86-021-60880608-265
> Email: jychena(a)ambarella.com
> <https://www.ambarella.com>
> ------------------------------
> This email and attachments contain Ambarella Proprietary and/or
> Confidential Information and is intended solely for the use of the
> individual(s) to whom it is addressed. Any unauthorized review, use,
> disclosure, distribute, copy, or print is prohibited. If you are not an
> intended recipient, please contact the sender by reply email and destroy
> all copies of the original message. Thank you.
> _______________________________________________
> koji-devel mailing list -- koji-devel(a)lists.fedorahosted.org
> To unsubscribe send an email to koji-devel-leave(a)lists.fedorahosted.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedorahosted.org/archives/list/koji-devel@lists.fedorahoste...
> Do not reply to spam, report it:
> https://pagure.io/fedora-infrastructure/new_issue
>
2 months, 2 weeks
Seeking Advice on Speeding Up Koji Builds with QEMU
by Joe (Jun-Yan) Chen
Dear Koji Development Team,
I hope this email finds you well. I am writing to seek your expertise about using QEMU as a Koji Builder to build packages for the aarch64 on the fedora platform.
When Koji invokes mock for building, it spends a significant amount of time updating yum metadata(≈15mins, <mirrors.kernel.org> set as external repo) resulting in taking 30 minutes to init buildroot alone (download speed≈2.8MB/s). I tried to use squid to cache mirror of fedora by modify /etc/kojid.com: yum_proxy = http://xxx:3128 but the "--installroot" process still costs a lot of time.
I would like to know if there is any information that I may have overlooked or any guidance or recommendations you may have to speed up init buildroot process on QEMU builder.
Thank you in advance for your time and consideration.
<https://www.ambarella.com>
Best Regards,
Junyan CHEN
[Ambarella AI Envisioned] <https://www.ambarella.com> Junyan(Joe) CHEN
Software Engineer | SDK Team
Phone: +86-021-60880608-265
Email: jychena(a)ambarella.com<mailto:jychena@ambarella.com>
<https://www.ambarella.com>
**********************************************************************
This email and attachments contain Ambarella Proprietary and/or Confidential Information and is intended solely for the use of the individual(s) to whom it is addressed. Any unauthorized review, use, disclosure, distribute, copy, or print is prohibited. If you are not an intended recipient, please contact the sender by reply email and destroy all copies of the original message. Thank you.
2 months, 2 weeks
Fedora RISC V distribution on Koji
by Tanvi Sheth
Me & my team were trying to set up Koji on Local server.
We followed the guide https://docs.pagure.org/koji/server_howto/
We followed SSL Authentication.
We are constantly getting an error message after we type "koji moshimoshi"
2023-03-06 11:03:10,150 [ERROR] koji: (gssapi auth failed: requests.exceptions.SSLError: HTTPSConnectionPool(host='koji.fedoraproject.org', port=443): Max retries exceeded with url: /kojihub/ssllogin (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:992)'))))
Use following documentation to debug kerberos/gssapi auth issues. https://docs.pagure.org/koji/kerberos_gssapi_debug/
Can anyone please guide us on how to solve the issue? We've tried multiple resources but none seemed to work. Any help would be appreciated.
2 months, 2 weeks
Fedora RISC V distribution on Koji
by Tanvi Sheth
Me & my team were trying to set up Koji on Local server.
We followed the guide https://docs.pagure.org/koji/server_howto/
We followed SSL Authentication.
We are constantly getting an error message after we type "koji moshimoshi"
2023-03-06 11:03:10,150 [ERROR] koji: (gssapi auth failed: requests.exceptions.SSLError: HTTPSConnectionPool(host='koji.fedoraproject.org', port=443): Max retries exceeded with url: /kojihub/ssllogin (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:992)'))))
Use following documentation to debug kerberos/gssapi auth issues. https://docs.pagure.org/koji/kerberos_gssapi_debug/
Can anyone please guide us on how to solve the issue? We've tried multiple resources but none seemed to work. Any help would be appreciated.
2 months, 3 weeks
