Backend storage clean-up
by Jakub Kadlcik
Hello,
we have decided that it is a time to go through Copr backend data and
clean it up a little. Due to several bugs forgetting to remove backend
data after removing their records from the database, _temporarily_
backing up some folder here and there, etc, we ended up with a lot of
unknown data, that should have been already deleted.
So, we wrote a script [1] to find data that should be deleted, and we
... haven't deleted it yet. Instead, we put it aside in a case there
were any false-positives by the script. If you want to be extra safe,
I am attaching a list of all of those files, you may check it.
If you find out, that we accidentally want to remove any of your data
that is still being used, please contact us immediately! Otherwise, we
are going to delete it once we are running out of disk space (which
may not take a lot of time)
[1] https://pagure.io/copr/copr/blob/master/f/backend/run/copr_print_results_...
Thank you for understanding,
Jakub
4 years
epel-8-{x86_64,ppc64le,aarch64} chroots enabled in copr
by Pavel Raiskup
CentOS 8 repositories are now available, so @msuchy released new
`mock-core-configs` (see updates-testing), and so we were allowed to enable
epel-8 chroots in Copr! Feel free to build against them.
Note that it doesn't make sense to support `rhelbeta-8-*` chroots anymore,
so we plan to disable them after in 14 days. Please stop using them.
Also note that so far 'dnf copr enable <user>/<project>' command executed
on RHEL 8 box actually enabled the `rhelbeta-8-$basearch` repository. We
need to fix this so it enables `epel-8-$basearch` repo instead; this
change will happen at the same time when we'll disable the rhelbeta-8
chroots in Copr.
The build results in rhelbeta chroots will be handled using our standard
retention policy process, i.e. - unless specified otherwise - the builds
will be removed after 6 months.
Happy building!
Pavel
4 years, 2 months
F31+ i386 chroots build against Koji buildroots [was Re: Fedora 31 System-Wide Change proposal (late): No i686 Repositories]
by Pavel Raiskup
On Tuesday, September 10, 2019 3:23:29 PM CEST Miroslav Suchý wrote:
> Dne 09. 09. 19 v 21:01 Kevin Fenzi napsal(a):
> > The koji buildroot repo will continue to be available if you want to
> > copy something, but as far as work to be done to move back to
> > distributing a i686 set of trees? I guess doing the release blocking
> > tests on i686 at Beta and Final might be a good start, but thats a ton
> > of work for one person... is there anyone else you have talked to that
> > wants to do this?
>
> I want to state one consequence. As there is no compose, the mock configs fedora-31-i386 and fedora-rawhide-i386 will
> point directly to Koji.
>
> https://github.com/rpm-software-management/mock/commit/a0c5d493c362c993d6...
>
> All local builds into this chroot will likely be slow.
> And I will likely remove (or move to /etc/mock/eol/ ) those files in near future.
>
> This may affect CI of 3rd parties.
FTR, we changed this in Copr as well - otherwise _all_ the builds in
fedora-31-i386+ would already fail. So please note that the fedora 31+
`i386` build chroot are _different_ from other architectures (in
copr/mock), and really re-consider whether you want to build against them.
Pavel
4 years, 2 months
Hardlinked files
by Miroslav Suchý
Hi.
The hardlink task finished. For the record, this is what I run:
cd /var/lib/copr/public_html/results
for i in *; do pushd "$i" && for ii in *; do hardlink -vv "$ii"; done; popd >/dev/null; done
It run for more than two days. :)
As I watched the build most saved space come from:
1) chroot_scan/ - same libsolv and dnf logs for the same build in the same day
2) srpm_build/ - it has the same tar ball for resubmits
FYI we are now at
Filesystem Size Used Avail Use% Mounted on
/dev/vdc1 7.5T 5.7T 1.9T 76% /var/lib/copr/public_html
--
Miroslav Suchy, RHCA
Red Hat, Associate Manager ABRT/Copr, #brno, #fedora-buildsys
4 years, 2 months
Highlights from the latest Copr release
by Dominik Turecek
Hello.
Today, we have released a new version of Copr. Here is a list of changes in
this release.
New features:
- This release added discussion panels in Copr projects. You can now
discuss individual projects on their project pages or browse all
discussions here: https://discussion.fedoraproject.org/c/projects-in-copr
- Build detail now show how long ago a build started and finished. (issue
860)
- You can set how many builds are shown per page in copr/builds and task
queue tabs. (issue 709)
Fixes:
- When a project is deleted, it is removed from pinned projects
automatically. (issue 895)
- Task queue can now be sorted by project name. (issue 901).
- Monitor page no longer shows builds from PRs. (issue 807)
- Task queue no longer shows 300+ tasks when there are exactly 300. (issue
940)
- Public database dumps should now work properly after importing. (issue
912)
- Projects that are not listed on the homepage are no longer shown in the
RSS feed.
Performance optimizations
- Generating a list of pending jobs and iterating over build queue was
optimized. (issue 902)
- Deleting multiple builds in the same project is now done as a part of a
single action on the backend. (issue 688)
- Previously, the front page was slow. This was caused by "recent builds"
box. The query for showing recently finished builds has been optimized. The
recent build tab now shows builds from the last 2 days by everyone and
user's builds from the last 30 days. (issue 937)
Dominik
4 years, 2 months
