F35 Change proposal: RPM 4.17 (System-Wide Change proposal)
by Ben Cotton
https://fedoraproject.org/wiki/Changes/RPM-4.17
== Summary ==
Update RPM to the [https://rpm.org/wiki/Releases/4.17.0 4.17] release.
== Owner ==
* Name: [[User:pmatilai|Panu Matilainen]]
* Email: [pmatilai(a)redhat.com]
== Detailed Description ==
RPM 4.17 contains numerous improvements over previous versions
* More robust install failure handling
* Many macro improvements, in particular much improved Lua integration
* Strict checking for unpackaged content in builds
* Libraries no longer need executable permission for dependency
generation and is automatically removed for non-executable libraries
* Long needed transaction APIs enhancements
* Improved documentation
* Tentative (planned but not committed as of this writing)
** Split debugedit to its own project and package
** Split language-specific packaging aids to separate projects
(Python, Perl, Ocaml...)
** Dynamic spec generation
The plan is to get 4.17-alpha into rawhide as early as possible
(during April) to sort out any initial rough edges long before the
general feature deadline rush. Final version is expected to be
released well in time before F35 beta.
== Benefit to Fedora ==
See description for overall benefits, but in particular:
* All users benefit from the more robust installation
* Packaging sanity wrt libraries
* Macro authors will have a much saner experience creating complex macros in Lua
* DNF for the enhanced transaction APIs
== Scope ==
* Proposal owners:
** Rebase RPM
** Assist with dealing with incompatibilities
* Other developers:
** Test new release, report issues and bugs
** Adjust packaging to adhere to the strict buildroot content checking
* Release engineering: [https://pagure.io/releng/issue/10072 #10072]
* Policies and guidelines:
** Guidelines have nothing on unpackaged contents in buildroot, so
don't necessarily need updating. Many packages will fail to build
because of the stricter checking though: with rpm >= 4.17 unpackaged
content is not permitted in the buildroot at all.
** Libraries no longer need to be executable for dependency
generation, and executable bit will in fact be removed if invalidly
set on a library. Guidelines only have a vague "executable if
appropriate" mention so it does not *need* changing but could now be
clarified/tightened if desired.
* Trademark approval: N/A (not needed for this Change)
* Alignment with Objectives: no relation to current objectives
== Upgrade/compatibility impact ==
* Many existing packages will fail to build due to the stricter
buildroot content checking. Fixing this in the packaging is always
backwards compatible. We could temporarily set
`%_unpackaged_files_terminate_build 0` in rawhide to alleviate initial
impact if necessary.
* Rpm no longer implicitly creates databases on read-only access, this
may require changes to existing scripts/tooling. Ensuring mock/dnf
works is a pre-requisite to landing this change into rawhide, and will
be handled, one way or the other, by the rpm maintainers.
== How To Test ==
Rpm receives a thorough and constant testing via every single package
build, system installs and updates. New features can be tested
specifically as per their documentation.
== User Experience ==
The user-experience remains largely as-is, but install failures are
handled more gracefully.
== Dependencies ==
* dnf and/or mock will likely need some adjusting for the lack of
implicit database creation. If necessary, rpm maintainers will provide
patches prior to landing this change.
* soname bump is not expected so rebuilds should not be required
== Contingency Plan ==
* Contingency mechanism: Revert back to RPM 4.16, but the risk of
having to do should be negligible
* Contingency deadline: Beta freeze
* Blocks release? No
== Documentation ==
Work-in-progress release notes at https://rpm.org/wiki/Releases/4.17.0
and reference manual at
https://github.com/rpm-software-management/rpm/blob/master/doc/manual/ind...
--
Ben Cotton
He / Him / His
Senior Program Manager, Fedora & CentOS Stream
Red Hat
TZ=America/Indiana/Indianapolis
2 years, 8 months
Planned Outage - System upgrades - 2021-04-01 19:00 UTC
by Kevin Fenzi
There will be an outage starting at 2021-04-01 19:00 UTC,
which will last approximately 5 hours.
To convert UTC to your local time, take a look at
http://fedoraproject.org/wiki/Infrastructure/UTCHowto
or run:
date -d '2021-04-01 19:00UTC'
Reason for outage:
We will be updating and rebooting various servers to bring them up to date and confirm changes from the recent account system migration.
During the outage window services may be up or down as various systems reboot. No one service should be affected very long.
Affected Services:
Most services will be affected, with the exception of: mirrorlists, docs, hotspot, geoip, and getfedora.
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/9814
Please join #fedora-admin or #fedora-noc on irc.freenode.net
or add comments to the ticket for this outage above.
2 years, 8 months
Orphaned packages looking for new maintainers
by Miro Hrončok
The following packages are orphaned and will be retired when they
are orphaned for six weeks, unless someone adopts them. If you know for sure
that the package should be retired, please do so now with a proper reason:
https://fedoraproject.org/wiki/How_to_remove_a_package_at_end_of_life
Note: If you received this mail directly you (co)maintain one of the affected
packages or a package that depends on one. Please adopt the affected package or
retire your depending package to avoid broken dependencies, otherwise your
package will fail to install and/or build when the affected package gets retired.
Request package ownership via the *Take* button in he left column on
https://src.fedoraproject.org/rpms/<pkgname>
Full report available at:
https://churchyard.fedorapeople.org/orphans-2021-03-29.txt
grep it for your FAS username and follow the dependency chain.
For human readable dependency chains,
see https://packager-dashboard.fedoraproject.org/
For all orphaned packages,
see https://packager-dashboard.fedoraproject.org/orphan
Package (co)maintainers Status Change
================================================================================
CuraEngine-lulzbot orphan 3 weeks ago
OpenIPMI branto, jridky, orphan, 2 weeks ago
pknirsch
arp-scan moceap, orphan, xmrbrz 5 weeks ago
balance lbazan, orphan 5 weeks ago
bareftp chreide, orphan 5 weeks ago
bucardo lbazan, orphan 5 weeks ago
ccls orphan 2 weeks ago
connman orphan 1 weeks ago
cri-tools dwalsh, fkluknav, lsm5, 5 weeks ago
orphan, umohnani
ctorrent orphan 5 weeks ago
cura-lulzbot orphan, spot 3 weeks ago
dianara orphan 5 weeks ago
dionaea orphan 2 weeks ago
drehatlas-warender-bibliothek- orphan 5 weeks ago
fonts
drehatlas-xaporho-fonts orphan 5 weeks ago
ez-ipupdate abo, jlayton, orphan 5 weeks ago
fillets-ng-data orphan, thias 2 weeks ago
flexdock orphan 2 weeks ago
freeipmi branto, cicku, jridky, orphan, 2 weeks ago
pknirsch
grc orphan 2 weeks ago
gsignond orphan 2 weeks ago
gsignond-plugin-lastfm orphan 2 weeks ago
gsignond-plugin-mail orphan 2 weeks ago
gsignond-plugin-oauth orphan 2 weeks ago
gsignond-plugin-sasl orphan 2 weeks ago
httpunit fnasser, mizdebsk, orphan 5 weeks ago
ipmitool branto, jridky, orphan, 2 weeks ago
praveenp
jakarta-messaging orphan 3 weeks ago
jboss-el-3.0-api orphan 3 weeks ago
jboss-jsp-2.3-api orphan 1 weeks ago
jboss-jstl-1.2-api orphan 1 weeks ago
jboss-servlet-3.1-api orphan 3 weeks ago
kanjistrokeorders-fonts orphan 5 weeks ago
libaccounts-glib orphan 2 weeks ago
libarcus-lulzbot orphan 3 weeks ago
libmirage orphan 5 weeks ago
lulzbot-marlin-firmware orphan, spot 3 weeks ago
maven-verifier mizdebsk, orphan 3 weeks ago
mydns orphan 5 weeks ago
netresolve orphan, pemensik 1 weeks ago
pen cicku, danniel, orphan 5 weeks ago
perl-DBIx-Safe orphan 5 weeks ago
phpwapmail orphan 4 weeks ago
powermock jerboaa, lef, neugens, orphan 3 weeks ago
python-cocotb orphan 0 weeks ago
python-fasjson-client infra-sig, orphan 0 weeks ago
python-flask-babelex devrim, orphan 5 weeks ago
python-flask-gravatar devrim, orphan 5 weeks ago
python-flask-mail devrim, orphan 5 weeks ago
python-flask-paranoid devrim, orphan 5 weeks ago
python-flask-pymongo orphan 5 weeks ago
python-flask-security devrim, orphan 5 weeks ago
python-flask-sphinx-themes devrim, orphan 5 weeks ago
python-pytest4 churchyard, mrunge, orphan, 3 weeks ago
python-sig, radez, thm
python-sshtunnel orphan 5 weeks ago
python-uranium-lulzbot orphan 3 weeks ago
python-vcversioner fab, orphan 5 weeks ago
python3-simplepam leonn, orion, orphan 2 weeks ago
pyxtrlock leonn, orphan 2 weeks ago
quvi orphan 2 weeks ago
racoon2 orphan 1 weeks ago
reiserfs-utils cicku, orphan 5 weeks ago
rnv orphan 1 weeks ago
rubygem-net-ssh-gateway orphan, tdawson 2 weeks ago
rubygem-raindrops orphan 2 weeks ago
rubygem-recaptcha orphan 2 weeks ago
saxpath akurtakov, mizdebsk, orphan 3 weeks ago
signon-glib dvratil, kde-sig, orphan 2 weeks ago
sofia-sip orphan 5 weeks ago
sump-analyzer orphan 2 weeks ago
sumwars orphan 5 weeks ago
tlomt-junction-fonts orphan 5 weeks ago
trac-privateticketsplugin orphan 4 weeks ago
ttyd orphan 5 weeks ago
ubuntu-title-fonts orphan 5 weeks ago
vollkorn-fonts orphan 5 weeks ago
wput orphan 5 weeks ago
xiphos cicku, deji, orphan 2 weeks ago
yanone-tagesschrift-fonts orphan 5 weeks ago
The following packages require above mentioned packages:
Report too long, see the full version at
https://churchyard.fedorapeople.org/orphans-2021-03-29.txt
See dependency chains of your packages at
https://packager-dashboard.fedoraproject.org/
See all orphaned packages at https://packager-dashboard.fedoraproject.org/orphan
Affected (co)maintainers (either directly or via packages' dependencies):
abo: ez-ipupdate
akurtakov: saxpath
anvil: ipmitool
besser82: freeipmi, ipmitool
branto: freeipmi, OpenIPMI, ipmitool
charlesrose: freeipmi
cheeselee: ipmitool
chreide: bareftp
churchyard: python-pytest4, ipmitool
cicku: freeipmi, pen, ipmitool, xiphos, reiserfs-utils
cqi: python-fasjson-client
cwickert: ipmitool
danniel: pen
deji: xiphos
devrim: python-flask-mail, python-flask-babelex, python-flask-paranoid,
python-flask-sphinx-themes, python-flask-gravatar, python-flask-security
dsommers: freeipmi
dvratil: libaccounts-glib, signon-glib
dwalsh: cri-tools
fab: freeipmi, OpenIPMI, python-vcversioner
filiperosset: saxpath
fkluknav: cri-tools
fnasser: httpunit
gbcox: libaccounts-glib
germano: ipmitool
heliocastro: libaccounts-glib
ianweller: python-fasjson-client
ignatenkobrain: python-fasjson-client
infra-sig: python-flask-mail, python-fasjson-client
jcpunk: freeipmi, ipmitool
jerboaa: powermock
jgrulich: libaccounts-glib, signon-glib
jirka: freeipmi
jkastner: freeipmi
jlayton: ez-ipupdate
jreznik: kanjistrokeorders-fonts, libaccounts-glib, signon-glib
jridky: freeipmi, OpenIPMI, ipmitool
jsteffan: freeipmi, OpenIPMI
karsten: OpenIPMI
kde-sig: kanjistrokeorders-fonts, libaccounts-glib, signon-glib
kevin: freeipmi, OpenIPMI, python-fasjson-client, ipmitool
kkofler: libaccounts-glib
lbazan: balance, perl-DBIx-Safe, bucardo
lef: powermock
leigh123linux: freeipmi, ipmitool
leonn: pyxtrlock, python3-simplepam
liangsuilong: ipmitool
limb: python-fasjson-client, ipmitool
lmacken: python-fasjson-client
lsm5: cri-tools
martinkg: connman
marx: ipmitool
mbayer: freeipmi, OpenIPMI
mck182: libaccounts-glib, signon-glib
melmorabity: ipmitool
mhlavink: freeipmi, OpenIPMI
mizdebsk: httpunit, saxpath, maven-verifier
mkyral: libaccounts-glib
moceap: arp-scan
mohanboddu: python-fasjson-client
mprahl: python-fasjson-client
mrunge: freeipmi, OpenIPMI, python-pytest4
nb: ipmitool
neugens: powermock
ngompa: python-flask-mail
nonamedotc: freeipmi, ipmitool
nucleo: libaccounts-glib
nushio: ipmitool
oalbrigt: ipmitool
orion: freeipmi, OpenIPMI, python3-simplepam
pcpa: python-flask-sphinx-themes
pemensik: netresolve
pkfed: freeipmi
pknirsch: freeipmi, OpenIPMI
praiskup: rnv
praveenp: ipmitool
pwalter: ipmitool
pwu: ipmitool
python-sig: python-pytest4
radez: python-pytest4
ralph: python-fasjson-client
rathann: freeipmi, ipmitool
rdieter: kanjistrokeorders-fonts, libaccounts-glib, signon-glib
rdossant: OpenIPMI
ruben: freeipmi, OpenIPMI
sayanchowdhury: python-fasjson-client
sharkcz: freeipmi, OpenIPMI
slankes: libaccounts-glib
spot: CuraEngine-lulzbot, cura-lulzbot, libarcus-lulzbot,
python-uranium-lulzbot, lulzbot-marlin-firmware
stevetraylen: freeipmi, OpenIPMI
suve: connman
taaem: ipmitool
tagoh: ipmitool
tartare: freeipmi
tdawson: rubygem-net-ssh-gateway
tejas: libaccounts-glib
than: kanjistrokeorders-fonts, libaccounts-glib
thias: fillets-ng-data
thm: python-pytest4
tibbs: python-fasjson-client
tuxbrewr: freeipmi
umohnani: cri-tools
vascom: freeipmi, libaccounts-glib, ipmitool
vda: freeipmi
volter: OpenIPMI
wakko666: OpenIPMI
wolnei: libaccounts-glib
xaeth: freeipmi, OpenIPMI
xmrbrz: arp-scan
yanqiyu: ipmitool
zsun: ipmitool
--
The script creating this output is run and developed by Fedora
Release Engineering. Please report issues at its pagure instance:
https://pagure.io/releng/
The sources of this script can be found at:
https://pagure.io/releng/blob/main/f/scripts/find_unblocked_orphans.py
2 years, 8 months
Fedora Linux 34 Beta Release Announcement
by Mohan Boddu
Fedora Linux 34 Beta Released
------------------------------------------
The Fedora Project is pleased to announce the immediate availability
of Fedora 34 Beta, the next step towards our planned Fedora 34 release
at the end of April.
Download the prerelease from our Get Fedora site:
* Get Fedora 34 Beta Workstation: https://getfedora.org/workstation/download/
* Get Fedora 34 Beta Server: https://getfedora.org/server/download/
* Get Fedora 34 IoT: https://getfedora.org/iot/download/
Or, check out one of our popular variants, including KDE Plasma, Xfce,
and other desktop environments, as well as images for ARM devices:
* Get Fedora 34 Beta Spins: https://spins.fedoraproject.org/prerelease
* Get Fedora 34 Beta Labs: https://labs.fedoraproject.org/prerelease
* Get Fedora 34 Beta ARM: https://arm.fedoraproject.org/prerelease
## Beta Release Highlights
* BTRFS transparent compression
* Replacing PulseAudio with PipeWire
* Fedora 34 Workstation Beta includes GNOME 40
* A new i3 spin
* And more ...
For more details about the release, read the full announcement at
* https://fedoramagazine.org/announcing-the-release-of-fedora-34-beta/
or look for the prerelease pages in the download sections at
* https://getfedora.org/
Since this is a Beta release, we expect that you may encounter bugs or
missing features. To report issues encountered during testing, contact
the Fedora QA team via the test(a)lists.fedoraproject.org mailing list or
in #fedora-qa on Freenode.
Regards,
Mohan Boddu
Fedora Release Engineering.
2 years, 8 months
Planned outage for Fedora Account System 2021-03-24 10:30UTC
by Mark O'Brien
All,
Last week there was an announcement sent on the planned outage due to the
migration to the new Fedora Account System. Unfortunately, we made an error
in the starting date when writing the announcement.
We intend to start the outage on Wednesday 2021-03-24 10:30UTC which will
last for approximately two days. Having the outage on a Wednesday and
Thursday allows an extra working day before the weekend to address any
issues should they arise.
We know this is not ideal and apologize for the short notice of this
correction.
This outage has been planned to migrate systems with as little interruption
as possible to services for users. During this 'outage' time, you may
experience a sudden 'user unknown' scenario. In this case, please try to
re-authenticate into the service after an hour.
If this change causes a major issue please contact us as soon as possible
to let us try to address the situation in advance of the outage.
We had always planned for this outage to be on Wednesday and Thursday, but
misread our own calendar when sending the earlier announcement.
For details on how this effects you please see this mail
https://lists.fedoraproject.org/archives/list/devel-announce@lists.fedora...
Apologies,
The Fedora Account System team
2 years, 8 months
*UPDATE* Planned outage for Fedora Account System 2021-03-24
by Mark O'Brien
All,
A mail was sent last week about the planned outage due to the migration to
the new Fedora Account System. There was an error in the date presented in
the mail.
The outage will be for *two days beginning Wednesday 2021-03-24*
Apologies for any confusion or inconvenience caused.
Mark
2 years, 8 months
F35 Change proposal: Reduce dependencies on python3-setuptools
(System-Wide Change)
by Ben Cotton
https://fedoraproject.org/wiki/Changes/Reduce_dependencies_on_python3-set...
== Summary ==
We'll do two things to reduce the number of Python packages
unnecessarily Requiring python3-setuptools:
# python3-devel will no longer Require python3-setuptools
# packages with console_scripts/gui_scripts entry points will no
longer automatically Require python3-setuptools
== Owner ==
* Name: [[User:Thrnciar|Tomáš Hrnčiar]]
* Name: [[User:Churchyard|Miro Hrončok]]
* Email: python-maint(a)redhat.com
== Detailed Description ==
Historically, for over a decade, [https://pypi.org/project/setuptools/
setuptools] was omnipresent in Python packaging.
For that reason, the python3-devel package required python3-setuptools.
This is however changing, with
[https://www.python.org/dev/peps/pep-0517/ PEP517]- and
[https://www.python.org/dev/peps/pep-0518/ PEP518]-based upstream
packaging, setuptools changed to a very popular yet only optional way
of building packages, many upstreams switched to poetry or flit
instead.
Since we received multiple user reports about an unnecessary
dependency, we wanted to
[https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.o...
get rid of the dependency], but it was not possible until now.
We'll do the two following changes (neither one depends on the other):
=== python3-devel will stop Requiring python3-setuptools ===
When we wanted to remove the dependency before, we have encountered a
problem, which is best summarized in the Python spec file:
# This is not "API" (packages that need setuptools should still
BuildRequire it)
# However some packages apparently can build both with and without setuptools
# producing egg-info as file or directory (depending on setuptools presence).
# Directory-to-file updates are problematic in RPM, so we ensure setuptools is
# installed when -devel is required.
# See https://bugzilla.redhat.com/show_bug.cgi?id=1623914
# See https://fedoraproject.org/wiki/Packaging:Directory_Replacement
Requires: (python3-setuptools if rpm-build)
To avoid this problem, python3-devel currently requires
`(python3-setuptools if rpmbuild)` for backwards compatibility.
Other than that, python3-setuptools was always brought into the
buildroot transitively with python3-rpm-generators.
Since the [https://lists.fedoraproject.org/archives/list/python-devel@lists.fedorapr...
generators no longer use setuptools but packaging] we can finally
remove the dependency.
Packages that don't BuildRequire python3-setuptools but use setuptools
during the build will fall into one of the following three categories:
* They will fail to build from source with errors like:
`ModuleNotFoundError: No module named 'setuptools'`.
* They will successfully build from source because they will fallback
to the standard library distutils module - their `.egg-info` directory
will become a text file instead, causing errors when RPM tries to
update the package (and they will possibly miss some runtime
dependencies because the metadata generated by distutils is not
complete).
* They will continue to build unchanged because one or more packages
they BuildRequire pulls in python3-setuptools transitively - at any
point in the future, this can change and either (1) or (2) will
happen.
We tested this change in the past when we
[https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.o...
asked] other maintainers to explicitly BuildRequire
python3-setuptools. Some of them responded, but many did not. Our
analysis was based on grepping sources for any mention of setuptools,
such as `import setuptools` or `from setuptools import `. Nowadays,
the same grep-based query showed us roughly the same number (~350) of
packages relying on python3-setuptools without BuildRequiring it. To
see the direct impact, we have also briefly removed the Requires from
python3-devel package used in testing
[https://copr.fedorainfracloud.org/coprs/g/python/python3.10/packages/
python3.10] in COPR. It revealed only 140 packages that fail to build
from the source because of the change, however many packages bring in
python3-setuptools transitively. Some of the packages might build
successfully even without python3-setuptools, because they fallback to
distutils (from the Python standard library) if dependency on
setuptools is not satisfied.
To avoid such problems we will:
* Mass update packages we analyzed as impacted to add the missing
BuildRequires on python3-setuptools.
* Do the change while doing the [[Changes/Python3.10|update from
Python 3.9 to Python 3.10]] so the path of the `.egg-info` changes
from `/usr/lib(64)/python3.9/site-packages/...egg-info` to
`/usr/lib(64)/python3.10/site-packages/...egg-info`, hence no longer
causing troubles on upgrades if some packages actually do change it
from directory to file (and changing it the other way around in the
future is safe).
==== How do we mass update the spec files ====
We plan to write a script to detect what notation for BuildRequires
definition each spec file uses.
Example of the most common occurrences:
BuildRequires: python%{python3_pkgversion}-setuptools
BuildRequires: %{py3_dist setuptools}
BuildRequires: python3-setuptools
BuildRequires: python3dist(setuptools)
We will try to keep the added BuildRequires as much consistent as
possible with the existing Python-related BuildRequires (including
e.g. whitespace). We will not bump the release or add a changelog
entry (the Python 3.10 rebuild will take care of it). To show how the
proposed modifications will look like we plan to create a git
repository with all the spec files and commit the change there. The
diff will be shared on the devel and python-devel mailing lists, so
maintainers can easily see the upcoming change and can provide
feedback to us.
==== When do we update the spec files ====
We plan to mass update the spec files in the middle of April 2021, if
you wish to opt-out from the mass update, please let us know prior to
15th of April 2021.
==== What spec files we will update ====
Below is the list of packages we plan to add BuildRequires for
python3-setuptools to. If you wish to opt-out of this update, please
edit this page and move your package to the list of packages to be
ignored (listed below this one).
'''Packages to be updated:'''
* 0ad ignatenkobrain pcpa pwalter
* OpenMolcas jussilehtola
* PyGreSQL hhorak jmlich odubaj panovotn pkubat praiskup
* R2spec pingou
* ViTables tnorth zbyszek
* ansible-review dcallagh ttrinks
* barman slaanesh tsao
* blender design-sw hobbes1069 ignatenkobrain kwizart
luya roma s4504kr slaanesh
* btrfs-progs ignatenkobrain josef ngompa sandeen
* bumpversion duriantang jdornak
* calypso rathann
* cinch greghellings
* commissaire-client mbarnes smilner
* cppcheck c72578 jussilehtola sgrubb
* cranc lenkaseg
* crudini apevec jruzicka pbrady
* cxxtest mgieseki
* datanommer ralph
* dlib bizdelnick luya
* ec2-hibinit-agent davdunc
* electrum tredaell
* fbthrift dcavalca filbranden salimma
* fedora-messaging abompard
* firefox alexl caolanm erack gecko-maint jgrulich kalev
kengert mbarnes rhughes rstrode sharkcz stransky tpopela ueno xhorak
* folly dcavalca filbranden salimma
* fontforge frixxon kevin pnemade
* gajim michich suraia
* gau2grid jussilehtola
* gaupol music
* gfal2-python adev andreamanzi
* ginga lupinix
* git-filter-repo asn
* gns3-gui kwizart
* gns3-net-converter kwizart
* gns3-server kwizart nucleo
* gpsd fab mlichvar ttorling
* h5py stevetraylen terjeros
* khard mathstuf sdyroff
* kismon fab
* koji ausil kevin mikem puiterwijk
* lammps ellio167 junghans
* legofy lkf williamjmorenor
* libcaca hubbitus slaanesh thias
* libiptcdata dcm hobbes1069 jchaloup
* libnuml sagitter
* libreoffice caolanm dtardon erack sbergmann
* lldb airlied daveisfera jankratochvil
sergesanspaille siddharths tstellar
* llvm dmalcolm ignatenkobrain jakub jistone kyle
scottt sergesanspaille siddharths tstellar
* llvm10 sergesanspaille tstellar
* llvm11 sergesanspaille tstellar
* llvm7.0 jistone petersen sergesanspaille tstellar
* llvm9.0 jistone sergesanspaille tstellar
* mercurial kiilerix nbecker pstodulk
* mod_wsgi jdornak jkaluza jorton lmacken mrunge
* moose zbyszek
* mypaint avsej
* mysql-connector-python hhorak hubbitus hvad mschorm
* nototools mfabian pwu
* officeparser rebus
* offlineimap cicku dodji sergesanspaille teuf
* openbabel alexpl jussilehtola rathann
* percol hubbitus
* poetry churchyard thrnciar
* poezio fantom louizatakk
* porcupine kushal
* protontricks atim
* protonvpn-cli calexandru2018 jflory7
* prunerepo frostyx praiskup
* pyaudio chkr
* pyhunspell mfabian
* pyodbc fjanus hhorak
* pyscard orion sjenning
* pyserial stingray
* python-CommonMark jujens
* python-GridDataFormats rathann
* python-OBD rathann
* python-Pyped uggla
* python-Rtree volter
* python-acoustid terjeros
* python-agate jujens
* python-aiodns fantom
* python-ansicolors fab
* python-apprise lead2gold
* python-apsw cicku dfateyev maci
* python-arviz sergiopr
* python-astroplan sergiopr
* python-astropy-healpix lupinix
* python-astroquery lupinix
* python-astroscrappy lupinix
* python-asttokens zbyszek
* python-audioread terjeros
* python-autobahn fab jujens
* python-autopep8 mrunge ndipanov
* python-b2sdk jonny
* python-bloom cottsay rmattes
* python-blosc tnorth zbyszek
* python-box dmsimard fab
* python-btchip jonny xenithorb
* python-cached_property adamwill immanetize
* python-carbon jsteffan piotrp
* python-ccdproc lupinix
* python-certbot-apache nb
* python-chai kevin pingou ralph
* python-cmigemo hubbitus
* python-colorspacious rathann
* python-construct moezroy terjeros
* python-contextlib2 abompard pingou ralph tjikkun
* python-cookiecutter chedi wakko666
* python-crochet abompard
* python-css-parser zbyszek
* python-dbfread jujens
* python-debrepo ktdreyer
* python-decopatch zbyszek
* python-descartes qulogic
* python-dialog mjakubicek noodles raphgro sundaram zbyszek
* python-dijitso limb
* python-django-contact-form mrunge
* python-django-health-check dmsimard
* python-django-registration orphan
* python-django-reversion mrunge
* python-django-tagging jdornak mrunge piotrp
* python-django-tastypie bkabrda cquad mrunge stevetraylen
* python-docx kushal124
* python-dtfabric fab
* python-dukpy zbyszek
* python-editorconfig barracks510
* python-ephem fab
* python-et_xmlfile jujens
* python-etcd mbarnes smilner
* python-fasteners mrunge
* python-ffc zbyszek
* python-fields cottsay
* python-fisx zbyszek
* python-fitsio lupinix
* python-flake8-docstrings cottsay
* python-flask-gravatar devrim orphan
* python-flask-htmlmin devrim iztokf
* python-flask-paranoid devrim orphan
* python-flask-rstpages rmarko
* python-flask-security devrim orphan
* python-flask-sphinx-themes devrim orphan
* python-flask-wtf-decorators frostyx
* python-formats uggla
* python-fypp rathann
* python-gevent-eventemitter atim
* python-google-i18n-address pwouters
* python-googletrans lyessaadi
* python-graphql-relay fab
* python-heapdict qulogic
* python-html5-parser kevin
* python-htmlmin jujens
* python-humblewx rickardlindberg
* python-hupper kevin
* python-i3ipc alebastr
* python-inotify jfilak stevetraylen terjeros
* python-jep raphgro
* python-jinja2-cli jujens
* python-jinja2-time chedi wakko666
* python-jnius raphgro
* python-joblib besser82 ignatenkobrain sergiopr
* python-jsonmodels oanson
* python-jsonrpclib ihrachyshka jonny
* python-kerberos rcritten simo
* python-kitchen kevin pingou ralph
* python-landslide echevemaster salimma
* python-lark-parser totol
* python-leather jujens
* python-libsass nonamedotc
* python-libusb1 jonny
* python-lmdb jruzicka pspacek tkrizek
* python-logfury jonny
* python-makefun zbyszek
* python-managesieve stevetraylen
* python-matrix-nio ankursinha
* python-meld3 kevin stevetraylen tsao
* python-minibelt uggla
* python-mmtf rathann
* python-mnemonic jonny
* python-music21 zbyszek
* python-mwclient adamwill rdieter tuxbrewr
* python-myhdl filiperosset
* python-nbclient nonamedotc
* python-nbxmpp michich suraia
* python-networkmanager jdulaney
* python-notario ktdreyer
* python-oauth2 ignatenkobrain pjp spot sundaram
* python-openoffice sharkcz
* python-ouimeaux kni
* python-pandas-datareader sergiopr
* python-paste-script andreamanzi
* python-patsy sergiopr
* python-pbkdf2 jonny
* python-pecan-notario ktdreyer
* python-pelican firemanxbr mrunge
* python-pexpect amcnabb fabiand ignatenkobrain radez swt2c tomspur
* python-plaster-pastedeploy abompard
* python-plumbum greghellings lorenzodalrio
* python-poetry-core churchyard thrnciar
* python-polib cicku dchen diegobz dshea ivazquez moezroy suanand
* python-precis_i18n michich
* python-proteus sharkcz
* python-publicsuffix2 rathann
* python-pulsectl pfrields
* python-pvc raphgro
* python-pycares fantom
* python-pycha potty sharkcz
* python-pygeoip kevin ralph
* python-pylons-sphinx-themes abompard
* python-pymc3 sergiopr
* python-pynn ankursinha
* python-pyotp icon
* python-pypng kevin ralph
* python-pyqtgraph swt2c
* python-pyramid_sawing abompard
* python-pysb zbyszek
* python-pysignals kni
* python-pyswip pampelmuse
* python-pyte terjeros
* python-pytest-astropy-header sergiopr
* python-pytest-cases zbyszek
* python-pytest-harvest zbyszek
* python-pytest-mock fab jujens
* python-pytest-repeat cottsay
* python-pytest-steps zbyszek
* python-pytest-watch jujens
* python-pyvo lupinix
* python-readthedocs-sphinx-ext jjames
* python-recommonmark jujens
* python-relatorio sharkcz
* python-restructuredtext-lint jujens
* python-requests-cache codeblock hobbes1069
* python-retrying apevec
* python-rmtest lberk mgoodwin nathans
* python-rosdep cottsay rmattes thofmann
* python-sanction kevin ralph
* python-scikit-learn besser82 ignatenkobrain lupinix sergiopr
* python-scrapy echevemaster
* python-setuptools-lint jdulaney
* python-shamir-mnemonic jonny
* python-simplemediawiki lmacken potty ralph
* python-slixmpp fantom louizatakk
* python-smbc twaugh zdohnal
* python-snappy jujens
* python-social-auth-core cqi
* python-soupsieve zbyszek
* python-spdx jbertozzi
* python-spdx-lookup jbertozzi
* python-sphinxcontrib-bibtex jjames
* python-statsd pabelanger tdecacqu
* python-steam atim
* python-tables tnorth zbyszek
* python-tempdir rathann
* python-timeout-decorator jcapitao
* python-tinydb suanand
* python-tortilla uggla
* python-tqdm ignatenkobrain sgallagh
* python-tree-format chedi wakko666
* python-trezor jonny
* python-twilio mich181189
* python-txaio fab jujens
* python-unidecode pjp sundaram
* python-unidiff dcallagh
* python-upt-cpan jbertozzi
* python-upt-fedora jbertozzi
* python-upt-pypi jbertozzi
* python-upt-rubygems jbertozzi
* python-urwidtrees ttomecek
* python-vdf atim
* python-wand barracks510
* python-watchdog jsteffan jujens pingou
* python-webencodings abompard
* python-webpy mrunge
* python-wsaccel jujens
* python-xlwt leamas moezroy rathann
* python-xvfbwrapper mrunge totol
* python-yarl fab ignatenkobrain
* python-zstandard rathann
* python3-postgresql hhorak
* python3-pytest-asyncio jujens
* python3-saml dcallagh tchaikov
* qemu berrange bonzini crobinso dwmw2 ehabkost
jforbes lkundrak quintela rjones
* rdkit giallu
* root ellert
* rpmspectool nphilipp
* salt blarson dmurphy18 krionbsd
* sepolicy_analysis vmojzis
* solaar brouhaha rathann richardfearn tibbs
* spec2scl jstanek
* starcal hedayat
* stomppy stevetraylen
* sugar-speak callkalpa chimosky pbrobinson tuxbrewr
* swid-tools adelton
* swift-lang tachoknight
* terminator dmaphy mattrose ohaessler
* texlive-base spot
* toot alciregi
* translate-toolkit cicku dwayne petersen suanand
* trellis lkundrak somlo
* tryton sharkcz
* trytond sharkcz
* trytond-account sharkcz
* trytond-account-be sharkcz
* trytond-account-de-skr03 sharkcz
* trytond-account-invoice sharkcz
* trytond-account-invoice-history sharkcz
* trytond-account-invoice-line-standalone sharkcz
* trytond-account-product sharkcz
* trytond-account-statement sharkcz
* trytond-account-stock-anglo-saxon sharkcz
* trytond-account-stock-continental sharkcz
* trytond-analytic-account sharkcz
* trytond-analytic-invoice sharkcz
* trytond-analytic-purchase sharkcz
* trytond-analytic-sale sharkcz
* trytond-company sharkcz
* trytond-company-work-time sharkcz
* trytond-country sharkcz
* trytond-currency sharkcz
* trytond-dashboard sharkcz
* trytond-google-maps sharkcz
* trytond-ldap-authentication sharkcz
* trytond-party sharkcz
* trytond-party-siret sharkcz
* trytond-product sharkcz
* trytond-product-cost-fifo sharkcz
* trytond-product-cost-history sharkcz
* trytond-product-price-list sharkcz
* trytond-project sharkcz
* trytond-project-plan sharkcz
* trytond-project-revenue sharkcz
* trytond-purchase sharkcz
* trytond-purchase-invoice-line-standalone sharkcz
* trytond-sale sharkcz
* trytond-sale-opportunity sharkcz
* trytond-sale-price-list sharkcz
* trytond-stock sharkcz
* trytond-stock-forecast sharkcz
* trytond-stock-inventory-location sharkcz
* trytond-stock-location-sequence sharkcz
* trytond-stock-product-location sharkcz
* trytond-stock-supply sharkcz
* trytond-stock-supply-day sharkcz
* trytond-timesheet sharkcz
* ubertooth avsej
* uhd jskarvad
* upt jbertozzi
* uwsgi kad
* watchman dcavalca filbranden salimma
* wine-mono mooninite
* winpdb spot
* xrootd ellert simonm
* xtensor-python sergesanspaille
* yawn jsafrane miminar vcrhonek
'''Packages to be ignored:'''
* fontforge - false positive
* qemu - false positive
* xrootd - false positive
=== Packages with console_scripts/gui_scripts entry points will no
longer automatically Require python3.Xdist(setuptools) ===
Packages that use the `console_scripts` or `gui_scripts` entry points
used to generate scripts for them that imported `pkg_resources` (from
setuptools) on runtime and thus all such packages needed to Require
setuptools on runtime. This is an example of such generated script
from Fedora 32:
#!/usr/bin/python3
# EASY-INSTALL-ENTRY-SCRIPT: 'fedpkg==1.40','console_scripts','fedpkg'
__requires__ = 'fedpkg==1.40'
import re
import sys
from pkg_resources import load_entry_point
if __name__ == '__main__':
sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0])
sys.exit(
load_entry_point('fedpkg==1.40', 'console_scripts', 'fedpkg')()
)
The Python dist RPM dependency generator
(`/usr/lib/rpm/fileattrs/pythondist.attr`) hence generated a Requires
on `python3.Xdist(setuptools)` for all packages with scripts like the
one above.
Starting from Python 3.8 and setuptools 47, this is no longer
required, because the scripts will use `importlib.metadata` from the
standard library instead of `pkg_resources` from setuptools. The
scripts now looks like this:
#!/usr/bin/python3
# EASY-INSTALL-ENTRY-SCRIPT: 'fedpkg==1.40','console_scripts','fedpkg'
import re
import sys
# for compatibility with easy_install; see #2198
__requires__ = 'fedpkg==1.40'
try:
from importlib.metadata import distribution
except ImportError:
try:
from importlib_metadata import distribution
except ImportError:
from pkg_resources import load_entry_point
...
Since the scripts are generated during build, the packages no longer
need to Require setuptools on runtime.
The Python dist RPM dependency generator will no longer generate the
Requires on `python3.Xdist(setuptools)`.
The change is prepared in a pull request
(https://src.fedoraproject.org/rpms/python-rpm-generators/pull-request/38).
We plan to merge it as soon as it is ready. It only changes the
behavior for Python 3.10 or newer, hence it will take affect in the
Python 3.10 copr only, until Python is updated to 3.10 in Fedora
proper.
Packages that actually import from the `setuptools` or `pkg_resources`
module on runtime should explicitly require setuptools, but some of
the upstreams may not do that. We don't expect many packages
negatively affected by this, but since this is not strictly backwards
compatible, we are only planning to do it in Fedora 35+.
== Feedback ==
There was some discussion on various mailing list threads, but no
other alternatives were proposed.
* https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.o...
* https://lists.fedoraproject.org/archives/list/python-devel@lists.fedorapr...
* https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.o...
* https://lists.fedoraproject.org/archives/list/python-devel@lists.fedorapr...
== Benefit to Fedora ==
From [https://docs.fedoraproject.org/en-US/packaging-guidelines/#buildrequires
Fedora Packaging Guidelines]: ''It is important that your package list
all necessary build dependencies using the BuildRequires: tag.'' As
our testing showed, this is not true for many packages. Some of them
can successfully build either with or without setuptools (they use
try-except import and fallback to distutils from the standard
library). Such packages are especially dangerous when not
BuildRequiring setuptools -- they can produce different results
depending on the presence of setuptools: either an .egg-info metadata
directory (w/setuptools) or .egg-info text file (w/distutils). RPM has
troubles when [https://docs.fedoraproject.org/en-US/packaging-guidelines/Directory_Repla...
upgrading directories to files].
== Scope ==
Some packages use distutils as a fallback in case setuptools is
unavailable. The problem is that setuptools generates egg.info
directory and distutils creates egg.info file. This would lead to
failures caused by the known issue of RPM that cannot change directory
to file. To avoid this we plan to do a mass spec update before we
upgrade Python to version 3.10. This way we ensure that path will be
correct after the mass rebuild.
* Proposal owners:
# Test affected packages in Copr.
# Do the mass spec update to introduce missing BuildRequire to them.
* Other developers: If your package requires setuptools on runtime,
make sure it specifies it explicitly. There should be no additional
work for developers other than that. There is a possibility that some
packages will slip through our grep based query and fail to build, but
we'll detect this in our testing Copr and fix them.
* Release engineering: not needed for this Change
* Policies and guidelines: already exist
* Trademark approval: not needed for this Change
* Alignment with Objectives: minimization
== Upgrade/compatibility impact ==
All affected packages needs rebuild after the mass spec update but
since we plan to do it with the upgrade to Python 3.10 we will rebuild
it altogether.
Users should not be affected by upgrades in any way.
== How To Test ==
This does not work yet, but will soon:
Interested testers can push explicit BuildRequire on setuptools to the
distgit and see in our
[https://copr.fedorainfracloud.org/coprs/g/python/python3.10/ Python
3.10 COPR] whether the package starts to build again. Webhook should
trigger rebuild automatically on new commit in rawhide branch.
== User Experience ==
Regular distro users shouldn't notice any change in system behaviour,
except for packages that use setuptools or pkg_resources on runtime
and fail to specify that dependency.
Such packages will fail to run with ModuleNotFoundErrors and should be
fixed by their maintainers.
== Dependencies ==
300+ packages will need to BuildRequire setuptools explicitly. This
will be done by the mass spec update.
== Contingency Plan ==
* Contingency mechanism: Commit removing python3-devel Requires on
`(python3-setuptools if rpmbuild)` will be reverted. The change in
Python dist RPM depndency generator will be reverted (This mechanisms
can be applied independently.).
* Contingency deadline: mass rebuild
* Blocks release? No
== Documentation ==
This page is a documentation, this is not a user facing change.
--
Ben Cotton
He / Him / His
Senior Program Manager, Fedora & CentOS Stream
Red Hat
TZ=America/Indiana/Indianapolis
2 years, 8 months
New Fedora Account System Production Deployment - What this means for you
by Ant Carroll
Background
For the last 12 + months, the Community Platform Engineering team have
been developing a new service to replace the current FAS2 application
for the Fedora Account System.
The FAS2 application was written over 10 years ago with python2 and
TurboGears1 framework. Due to its dependencies, it is tied to a RHEL6
deployment and could not be moved to a newer OS without rewriting.
Finally FAS2 has a very small deployment base and we had to maintain
it all.
The new account system is based on the widely used IPA product. We
have created a community portal frontend for managing account details
(noggin). This means we only need to maintain the frontend and can
leave the high security parts to IPA. Additionally, noggin may be used
by many more community products.
Key Dates - Subject to Change*
Tuesday 23rd March: Data sync to IPA
Wednesday 24th & Thursday 25th March: System-Wide Outage for machine
config to Noggin
25th March: Final Run-Through of Production Rollout
26th March: Production Rollout Complete
29th March March onwards: Support for post deployment issues
We do not anticipate these dates to change, however our team will meet
for a final review of work on Tuesday 23rd March and once satisfied
all rollback paths are in place and risks have been mitigated, we
intend to deploy to production against the dates listed above. Please
keep an eye on this mail for any potential last minute updates
What This Means for You
Everyone
If you have an otp token enrolled it will be needed everywhere. This
will include logging in through ipsilon or getting a kerberos
ticket(kinit) which was not previously the case.
Outages and interruptions to services during migration dates
System Administrators
All system administrators will need to enroll a new otp token with noggin
Sudo command will ask for First factor and Second factor separately
which is a slight change from the previous password+otp prompt
Packagers & Package Maintainers
Any packager that has otp enabled will have to follow new process in
docs for kinit/pkinit
‘Drive-By’ Contributors
If you are a ‘drive-by’ or more casual contributor to the Fedora
project, you may have to reset your password. We anticipate the number
of people who will need to do this is low, depending on when you last
logged in.
Please re-sign into your Fedora account post migration date.
Post Deployment Support
If you experience issues with your workflow as a result of FAS
changing please log an issue on the fedora infra tracker
https://pagure.io/fedora-infrastructure/issues.
FAS will be left in a read-only state to support any applications that
you might not be in a position to migrate immediately. However, we
don’t recommend using it as the data it contains will quickly become
out of date.
Maintainer-test instances will be left in a “frozen” state which means
any user changes such as new users or new ssh keys will not be
reflected on these machines.
Further Information
Outage ticket link: https://pagure.io/fedora-infrastructure/issue/9747
Community blog post:
https://communityblog.fedoraproject.org/introducing-the-new-fedora-accounts/
Noggin Documentation:
https://noggin-aaa.readthedocs.io/en/latest/userguide.html#user-accounts
--
Ant Carroll
Associate Manager, Software Engineering
Red Hat Waterford
Communications House
Cork Road, Waterford City
ancarrol(a)redhat.com
M: +353876213163 IM: ancarrol
@redhatjobs redhatjobs @redhatjobs
2 years, 8 months
