F36 Change: Setuptools 58+ (Self-Contained Change proposal)
by Ben Cotton
https://fedoraproject.org/wiki/Changes/Setuptools_58%2B
== Summary ==
Update to a new upstream release of python-setuptools that is not
completely compatible with previous releases. Since version 58+
upstream removed support for 2to3 during builds. This is a breaking
change and projects are encouraged to port to a unified codebase.
== Owner ==
* Name: [[User:thrnciar| Tomáš Hrnčiar]]
* Email: thrnciar(a)redhat.com
== Detailed Description ==
Setuptools is a package development process library designed to
facilitate packaging Python projects by enhancing the Python standard
library distutils (distribution utilities). It changes fast and it
often introduces breaking changes such as the removal of support for
2to3 during the builds in version 58.0.0 which was
[https://github.com/pypa/setuptools/blob/main/CHANGES.rst#v4620
deprecated] since version 46.2.0 present in Fedora 33. `use_2to3` used
to help to translate Python 2.x programs to Python 3.x. But since
Python 2 reached its end of life on 1st January 2020 and lib2to3 was
removed from Python 3 in version 3.10, developers are encouraged to
drop support for Python 2 and migrate to Python 3. It is still
possible to use command line `2to3` tool in Python 3.10, but it will
be deprecated in 3.11 and removed in 3.13.
List of packages that will likely fail to build, because they use the
removed use_2to3 option.
Maintainers by package:
* fail2ban atkac hobbes1069 jgu orion
* playitagainsam churchyard
* pybluez limb
* pyp2rpm gordonmessmer kevin
* python-anyjson fab mrunge sundaram
* python-behave pschindl
* python-concurrentloghandler dcallagh
* python-deap zbyszek
* python-demjson lmacken thm
* python-flask-openid frantisekz pjp sundaram
* python-funcparserlib dridi
* python-jsmin ignatenkobrain
* python-libusb1 jonny
* python-mailer fab
* python-marathon apevec dmsimard
* python-nose-cover3 mrunge ngompa pingou
* python-parse_type ignatenkobrain
* python-proteus sharkcz
* python-pypng kevin ralph
* python-pysam davidsch
* python-relatorio sharkcz
* python-rnc2rng ignatenkobrain
* python-simpleeval sharkcz
* python-speaklater ondrejj
* python-sphinx-bootstrap-theme besser82 sic
* python-spyking-circus ankursinha
* python-suds jortel swt2c
* python-tempita jcapitao kylev
* python-vatnumber sharkcz
* python-xunitparser ignatenkobrain lbrabec tflink
* trytond sharkcz
* trytond-account sharkcz
* trytond-account-be sharkcz
* trytond-account-de-skr03 sharkcz
* trytond-account-invoice sharkcz
* trytond-account-invoice-history sharkcz
* trytond-account-invoice-line-standalone sharkcz
* trytond-account-product sharkcz
* trytond-account-statement sharkcz
* trytond-account-stock-anglo-saxon sharkcz
* trytond-account-stock-continental sharkcz
* trytond-analytic-account sharkcz
* trytond-analytic-invoice sharkcz
* trytond-analytic-purchase sharkcz
* trytond-analytic-sale sharkcz
* trytond-company sharkcz
* trytond-company-work-time sharkcz
* trytond-country sharkcz
* trytond-currency sharkcz
* trytond-dashboard sharkcz
* trytond-google-maps sharkcz
* trytond-ldap-authentication sharkcz
* trytond-party sharkcz
* trytond-party-siret sharkcz
* trytond-product sharkcz
* trytond-product-cost-fifo sharkcz
* trytond-product-cost-history sharkcz
* trytond-product-price-list sharkcz
* trytond-project sharkcz
* trytond-project-plan sharkcz
* trytond-project-revenue sharkcz
* trytond-purchase sharkcz
* trytond-purchase-invoice-line-standalone sharkcz
* trytond-sale sharkcz
* trytond-sale-opportunity sharkcz
* trytond-sale-price-list sharkcz
* trytond-stock sharkcz
* trytond-stock-forecast sharkcz
* trytond-stock-inventory-location sharkcz
* trytond-stock-location-sequence sharkcz
* trytond-stock-product-location sharkcz
* trytond-stock-supply sharkcz
* trytond-stock-supply-day sharkcz
* trytond-timesheet sharkcz
Packages by maintainer:
* ankursinha python-spyking-circus
* apevec python-marathon
* atkac fail2ban
* besser82 python-sphinx-bootstrap-theme
* churchyard playitagainsam
* davidsch python-pysam
* dcallagh python-concurrentloghandler
* dmsimard python-marathon
* dridi python-funcparserlib
* fab python-anyjson python-mailer
* frantisekz python-flask-openid
* gordonmessmer pyp2rpm
* hobbes1069 fail2ban
* ignatenkobrain python-jsmin python-parse_type python-rnc2rng
python-xunitparser
* jcapitao python-tempita
* jgu fail2ban
* jonny python-libusb1
* jortel python-suds
* kevin pyp2rpm python-pypng
* kylev python-tempita
* lbrabec python-xunitparser
* limb pybluez
* lmacken python-demjson
* mrunge python-anyjson python-nose-cover3
* ngompa python-nose-cover3
* ondrejj python-speaklater
* orion fail2ban
* pingou python-nose-cover3
* pjp python-flask-openid
* pschindl python-behave
* ralph python-pypng
* sharkcz python-proteus python-relatorio python-simpleeval
python-vatnumber trytond trytond-account trytond-account-be
trytond-account-de-skr03 trytond-account-invoice
trytond-account-invoice-history
trytond-account-invoice-line-standalone trytond-account-product
trytond-account-statement trytond-account-stock-anglo-saxon
trytond-account-stock-continental trytond-analytic-account
trytond-analytic-invoice trytond-analytic-purchase
trytond-analytic-sale trytond-company trytond-company-work-time
trytond-country trytond-currency trytond-dashboard trytond-google-maps
trytond-ldap-authentication trytond-party trytond-party-siret
trytond-product trytond-product-cost-fifo trytond-product-cost-history
trytond-product-price-list trytond-project trytond-project-plan
trytond-project-revenue trytond-purchase
trytond-purchase-invoice-line-standalone trytond-sale
trytond-sale-opportunity trytond-sale-price-list trytond-stock
trytond-stock-forecast trytond-stock-inventory-location
trytond-stock-location-sequence trytond-stock-product-location
trytond-stock-supply trytond-stock-supply-day trytond-timesheet
* sic python-sphinx-bootstrap-theme
* sundaram python-anyjson python-flask-openid
* swt2c python-suds
* tflink python-xunitparser
* thm python-demjson
* zbyszek python-deap
== Benefit to Fedora ==
Fedora offers cutting edge technologies for Python and Setuptools is
one of the most important Python packages. By doing this update we
bring users the latest features that Setuptools offers and also we
enable Fedora 36 to receive future updates as well.
== Scope ==
* Proposal owners: update python-setuptools to 58.x.x, provide help
* Other developers: report problems to the upstream and backport patch
to the affected packages. The impact can be tested using
[https://copr.fedorainfracloud.org/coprs/thrnciar/setuptools-impact-check/...
copr repository] where Setuptools 58.0.4 has been built.
* Release engineering: N/A
* Policies and guidelines: N/A (not needed for this Change)
* Trademark approval: N/A (not needed for this Change)
* Alignment with Objectives:
== Upgrade/compatibility impact ==
There is a clean upgrade path from current version to
python-setuptools 58.x.x. Fedora users using RPM-packaged Setuptools
will use Setuptools 58.x.x by default.
== How To Test ==
* Find the package you want to update in this
[https://copr.fedorainfracloud.org/coprs/thrnciar/setuptools-impact-check/...
copr repository] and check the build logs to determine the fail cause.
* Work with the upstream to resolve the issue or drop the need for
2to3 during the build of the package.
* When updating the package, you can test it using the same copr
repository where the latest version of Setuptools has been built.
* Let us know if something doesn't work as it should.
== User Experience ==
Regular distro users shouldn't notice any change in Setuptools
behaviour, except for packages that use 2to3 to transform Python 2.x
source code into Python 3.x source code. Such packages will fail with
`error in <package name> setup command: use_2to3 is invalid` and
should be fixed by their maintainers.
== Contingency Plan ==
* Contingency mechanism: (What to do? Who will do it?) N/A (not a
System Wide Change)
* Contingency deadline: N/A (not a System Wide Change)
* Blocks release? N/A (not a System Wide Change)
== Documentation ==
This page is the documentation.
--
Ben Cotton
He / Him / His
Fedora Program Manager
Red Hat
TZ=America/Indiana/Indianapolis
2 years, 6 months
F37 Change: Python 3.11 (System-Wide Change proposal)
by Ben Cotton
https://fedoraproject.org/wiki/Changes/Python3.11
== Summary ==
Update the Python stack in Fedora from Python 3.10 to Python 3.11, the
newest major release of the Python programming language.
== Owner ==
* Name: [[User:Thrnciar|Tomáš Hrnčiar]]
* Name: [[User:Churchyard|Miro Hrončok]]
* Email: python-maint(a)redhat.com
== Detailed Description ==
We would like to upgrade Python to 3.11 in Fedora 37 thus we are
proposing this plan early.
See the upstream notes at
[https://www.python.org/dev/peps/pep-0664/#features-for-3-11 Features
for 3.11] and [https://docs.python.org/3.11/whatsnew/3.11.html What's
new in 3.11].
=== Important dates and plan ===
* 2021-05-03: Python 3.11 development begins
* 2021-10-04: Python 3.11.0 alpha 1
** Package it as {{package|python3.11}} for testing purposes
** Start the bootstrap procedure in Copr
** Do a mass rebuild against every future release in Copr
* 2021-11-02: Python 3.11.0 alpha 2
* 2021-12-06: Python 3.11.0 alpha 3
* 2022-01-03: Python 3.11.0 alpha 4
* 2022-02-02: Python 3.11.0 alpha 5
* [2022-02-09]: Branch Fedora 36, Rawhide becomes future Fedora 37
** The earliest point when we can start rebuilding in Koji side-tag
* 2022-02-28: Python 3.11.0 alpha 6
* 2022-04-05: Python 3.11.0 alpha 7
* 2022-05-06: Python 3.11.0 beta 1
** No new features beyond this point
* 2022-05-30: Python 3.10.0 beta 2
** The ideal point when we can start rebuilding in Koji
* 2022-06-06: Expected side tag-merge (optimistic)
* 2022-06-16: Python 3.11.0 beta 3
* 2022-06-24: Expected side tag-merge (realistic)
* 2022-07-09: Python 3.11.0 beta 4
* 2022-07-18: Expected side tag-merge (pessimistic)
* [2022-07-21]: Fedora 37 Mass Rebuild
** The mass rebuild happens with the fourth beta. We might need to
rebuild Python packages later in exceptional case.
** If the Koji side-tag is not merged yet at this point, we defer the
change to Fedora 38.
* 2022-08-01: Python 3.11.0 candidate 1
** This serves as "final" for our purposes.
* [2022-08-10]: Branch Fedora 37, Rawhide becomes future Fedora 38
* [2022-08-10]: Fedora 37 Change Checkpoint: Completion deadline (testable)
* [2022-08-24]: Fedora Beta Freeze
** If rebuild with 3.11.0rc1 is needed, we should strive to do it
before the freeze - there is a window of 3 weeks.
* 2022-09-05: Python 3.11.0 candidate 2
* [2022-09-19]: Fedora 37 Beta Release (Preferred Target)
** Beta will likely be released with 3.11.0rc2.
* [2022-09-21]: Fedora 37 Beta Target date #1
* 2022-10-03: Python 3.11.0 final
* [2022-10-05]: Fedora 37 Final Freeze
** We'll update to 3.11.0 final using a freeze exception.
* [2022-10-19]: Fedora 37 Preferred Final Target date
* [2022-10-26]: Fedora 37 Final Target date #1
(From [https://www.python.org/dev/peps/pep-0664/#id4 Python 3.11
Release Schedule] and
[https://fedorapeople.org/groups/schedule/f-37/f-37-key-tasks.html
Fedora 37 Release Schedule] (dates in [] are based on Fedora 35
Release Schedule and will be adjusted accordingly when schedule for
Fedora 37 is available).)
The schedule might appear somewhat tight for Fedora 37, but Python's
[https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.o...
annual release cycle was adapted for Fedora] and this worked fine
since Python 3.9 and Fedora 33. It is now common that Python is
upgraded on a similar schedule in every odd-numbered Fedora release.
Note that upstream's "release candidates" are frozen except for
blocker bugs. Since we can and will backport blocker fixes between
Fedora and upstream, we essentially treat the Release Candidate as the
final release.
=== Notes from the previous upgrade ===
There are notes from the previous upgrade available, so this upgrade
may go smoother: [[SIGs/Python/UpgradingPython]]
== Benefit to Fedora ==
Fedora aims to showcase the latest in free and open-source software -
we should have the most recent release of Python 3. Packages in Fedora
can use the new features from 3.11.
There's also a benefit to the larger Python ecosystem: by building
Fedora's packages against 3.11 while it's still in development, we can
catch critical bugs before the final 3.11.0 release.
== Scope ==
We will coordinate the work in a side tag and merge when ready.
* Proposal owners:
*# Introduce {{package|python3.11}} for all Fedoras
*# Prepare stuff in Copr as explained in description.
*# Update {{package|python-rpm-macros}} so {{package|python3.11}}
builds {{package|python3}}
*# Build {{package|python3.11}} as the main Python
*# Mass rebuild all the packages that runtime require `python(abi) =
3.10` and/or `libpython3.10.so.1.0` (~3800 known packages in October
2021)
*# Build {{package|python3.11}} as a non-main Python
* Other developers: Maintainers of packages that fail to rebuild
during the rebuilds will be asked, using e-mail and bugzilla, to fix
or remove their packages from the distribution. If any issues appear,
they should be solvable either by communicating with the respective
upstreams first and/or applying downstream patches. Also, the package
maintainers should have a look at:
[https://docs.python.org/3.11/whatsnew/3.11.html#porting-to-python-3-11
Porting to Python 3.11]. The python-maint team will be available to
help with fixing issues.
* Release engineering: [https://pagure.io/releng/issue/10321 #10321]
A targeted rebuild for all python packages will be required, before
the mass rebuild.
* Policies and guidelines: nope
* Trademark approval: nope
== Upgrade/compatibility impact ==
All the packages that depend on Python 3 must be rebuilt. User written
Python 3 scripts/applications may require a small amount of porting,
but mostly Python 3.10 is forward compatible with Python 3.11.
== How To Test ==
Interested testers do not need special hardware. If you have a
favourite Python 3 script, module, or application, please test it with
Python 3.11 and verify that it still works as you would expect. If the
application you are testing does not require any other modules, you
can test it using {{package|python3.11}} even before this change is
implemented, in Fedora 34, 35 or 36.
In case your application requires other modules, or if you are testing
an rpm package, it is necessary to install the 3.11 version of the
python3 rpm. Right now that rpm is available in copr, along with all
other python packages that build successfully with python 3.11. See
https://copr.fedorainfracloud.org/coprs/g/python/python3.11/ for
detailed instructions on how to enable Python 3.11 copr for mock.
Once the change is in place, test if your favourite Python apps are
working as they were before. File bugs if they don't.
== User Experience ==
Regular distro users shouldn't notice any change in system behaviour
other than the Python 3 interpreter will be in version 3.11.
== Dependencies ==
4000+ packages depend on Python 3 and ~3800 packages need rebuilding
when Python is upgraded. See scope section.
== Contingency Plan ==
* Contingency mechanism: Do not merge the side tag with rawhide. If
the side tag has been merged and issues arise, that will justify a
downgrade, then use an epoch tag to revert to 3.10 version (never
needed before)
* Contingency deadline: TBD
* Blocks release? Yes, we'd like to block Fedora 37 release on at
least 3.11.0rc1
* Blocks product? See above
== Documentation ==
[https://www.python.org/dev/peps/pep-0664/ Python 3.11 Release Schedule]
[https://www.python.org/dev/peps/pep-0664/#features-for-3-11 Features for 3.11]
[https://docs.python.org/3.11/whatsnew/3.11.html What's new in 3.11]
[https://docs.python.org/3.11/whatsnew/3.11.html#porting-to-python-3-11
Porting to Python 3.11]
== Release Notes ==
* Migrating user installed packages -
https://pagure.io/fedora-docs/release-notes/issue/503
--
Ben Cotton
He / Him / His
Fedora Program Manager
Red Hat
TZ=America/Indiana/Indianapolis
2 years, 6 months