python-devel February 2019

python-devel@lists.fedoraproject.org

10 participants
13 discussions

Python 3.7's Deterministic pycs
by Petr Viktorin 15 Jul '19

15 Jul '19

Hello! The first beta for Python 3.7 is out. It will hopefully get into Fedora soon as python37. After it comes out of beta, we'll upgrade python3 to it. The What's New list is at: https://docs.python.org/3.7/whatsnew/3.7.html One thing that's interesting for packagers is PEP 552: Deterministic pycs: https://www.python.org/dev/peps/pep-0552/ Let me summarize in my own words. A new opt-in mode for byte-compilation makes .pyc (bytecode cache) files depend only on the contents of the corresponding source file. If we use this, it will slow down imports, because the whole source file would need to be read and hashed in order to verify if a .pyc file is valid. (Currently, metadata like the modification time and file size is used.) To speed things up, there's an option, UNCHECKED_HASH, which skips cache validation entirely. Using this would mean that if you modify a .py source file installed by RPM, the changes wouldn't take effect (the .py contents would only be shown in tracebacks). Modifying installed files in production is extremely bad practice, of course, but it's quite useful for debugging on throw-away systems. If we adopt UNCHECKED_HASH, anyone doing it will have to remember to remove the corresponding .pyc file. Honestly, I'm not sure we want to use this in Fedora. Is anyone here into reproducible builds, to make a better argument for this? -- Petr Viktorin

5 5

Fwd: [EPEL-devel] [Fedocal] Reminder meeting : Python34 to 36 mass build
by Miro Hrončok 28 Feb '19

28 Feb '19

-------- Forwarded Message -------- Subject: [EPEL-devel] [Fedocal] Reminder meeting : Python34 to 36 mass build Date: Thu, 28 Feb 2019 15:00:03 +0000 (UTC) From: smooge(a)gmail.com Reply-To: EPEL Development List <epel-devel(a)lists.fedoraproject.org> To: epel-devel(a)lists.fedoraproject.org Dear all, You are kindly invited to the meeting: Python34 to 36 mass build on 2019-03-07 from 15:00:00 to 22:00:00 UTC At epel(a)irc.freenode.net The meeting will be about: EPEL will begin a mass patching and rebuild of packages that rely on python34 to move them to python36. Source: https://apps.fedoraproject.org/calendar/meeting/9470/

1 0

We need to get rid of python2-flake8 on F30+
by Miro Hrončok 26 Feb '19

26 Feb '19

Long story short: - we've updated pycodestyle and broke flake8 - we need to update flake8 - we cannot update on python2 Hence, I'd like to get rid of python2-flake8. https://src.fedoraproject.org/rpms/python-flake8/pull-request/4 We will probably just do it and deal with the breakage later. Let me know if this is somehow problematic. -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

2 1

urlgrabber 4.0.0 released!
by Neal Gompa 25 Feb '19

25 Feb '19

Hey all, I've released urlgrabber 4.0.0, which is notable for being Python 3 compatible! We're still working out the kinks for getting it updated in all the right places (urlgrabber.baseurl.org, PyPI, etc.), but for now, the release source tarball can be downloaded from GitHub: https://github.com/rpm-software-management/urlgrabber/releases/tag/urlgrabb… It is also making its way into Fedora 30 and Rawhide now, so this should unblock efforts to port packages dependent on urlgrabber to Python 3. -- 真実はいつも一つ！/ Always, there's only one truth!

1 0

pypy
by Antonette Caldwell 21 Feb '19

21 Feb '19

Hi all I commented on https://bugzilla.redhat.com/show_bug.cgi?id=1673127 that I will be working on building pypy. So far, I was able to build pypy and pypy3 on rawhide, but this is my first time creating the package. I copied the spec from both of the rpms/pypy packages[1], but I wanted to know if I will have to create new spec, since I can see there are changes between the 6.0.0 and 7.0.0 versions. Here's what I have done so far from building pypy on rawhide pypy A build of pypy (with jit) on x86_64 [Timer] Timings: [Timer] annotate --- 990.8 s [Timer] rtype_lltype --- 1797.3 s [Timer] pyjitpl_lltype --- 2112.1 s [Timer] backendopt_lltype --- 400.0 s [Timer] stackcheckinsertion_lltype --- 995.6 s [Timer] database_c --- 907.0 s [Timer] source_c --- 413.2 s [Timer] compile_c --- 1274.7 s [Timer] build_cffi_imports --- 16.7 s [Timer] =========================================== [Timer] Total: --- 8907.5 s A build of pypy without jit on x86_64 [Timer] Timings: [Timer] annotate --- 1233.1 s [Timer] rtype_lltype --- 1554.2 s [Timer] backendopt_lltype --- 407.9 s [Timer] stackcheckinsertion_lltype --- 147.9 s [Timer] database_c --- 698.6 s [Timer] source_c --- 304.9 s [Timer] compile_c --- 700.5 s [Timer] build_cffi_imports --- 10.2 s [Timer] =========================================== [Timer] Total: pypy3 A build of pypy with jit on x86_64 [translation:info] usession directory: /tmp/usession-py3.5-0 [Timer] Timings: [Timer] annotate --- 260.5 s [Timer] rtype_lltype --- 342.1 s [Timer] pyjitpl_lltype --- 560.0 s [Timer] backendopt_lltype --- 106.2 s [Timer] stackcheckinsertion_lltype --- 53.4 s [Timer] database_c --- 232.3 s [Timer] source_c --- 101.7 s [Timer] compile_c --- 547.3 s [Timer] build_cffi_imports --- 17.9 s [Timer] =========================================== [Timer] Total: --- 2221.5 s Please let me know if I need to include devel in this email as well, since I am new and I have no built an rpm package, so I will not be able to push the new package once it is done. [1] https://src.fedoraproject.org/rpms/pypy/blob/master/f/pypy.spec Antonette Caldwell

2 1

sphinx-build conf.py circular dependency
by Gabriel L. Somlo 15 Feb '19

15 Feb '19

I'm trying to package 'migen': http://www.contrib.andrew.cmu.edu/~somlo/python-migen-rpm/python-migen.spec The sources come with a ./doc directory that uses sphinx-build to generate documentation, and a ./doc/conf.py file which imports the package being built, in order to automatically paste various code and doc bits from the module into the resulting documentation (see: https://github.com/m-labs/migen/blob/master/doc/conf.py, https://github.com/m-labs/migen/blob/master/doc/conf.py#L60, and https://github.com/m-labs/migen/blob/master/doc/conf.py#L259) Trouble is, I can't "BuildRequires:" the package I'm currently in the process of building, so the %make_build -C doc latexpdf man line under "%build" results in an error: make: Entering directory '/builddir/build/BUILD/migen-afe4405becdbc76539f0195c319367187012b05e/doc' sphinx-build -b man -d _build/doctrees . _build/man Running Sphinx v1.7.5 make: Leaving directory '/builddir/build/BUILD/migen-afe4405becdbc76539f0195c319367187012b05e/doc' Configuration error: There is a programable error in your configuration file: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/sphinx/config.py", line 161, in __init__ execfile_(filename, config) File "/usr/lib/python3.6/site-packages/sphinx/util/pycompat.py", line 150, in execfile_ exec_(code, _globals) File "conf.py", line 62, in <module> migen_version = pkg_resources.require("migen")[0].version File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 888, in require needed = self.resolve(parse_requirements(requirements)) File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 774, in resolve raise DistributionNotFound(req, requirers) pkg_resources.DistributionNotFound: The 'migen' distribution was not found and is required by the application make: *** [Makefile:112: man] Error 2 I've tried everything I can think of before running make on the doc directory: - adding "%{_builddir}/%{?buildsubdir}" to PYTHONPATH (contains the 'migen' module directory in the sources) - moving the call to make to %install and adding "%{buildroot}%{python3_sitelib}" to PYTHONPATH (where the 'migen' module is installed by %py3_install) - inserting "sys.path.insert(...)" and/or "sys.path.append(...)" statements (using sed) into doc/conf.py before running make during either %build or %install ... and nothing seems to help. Any clues as to what I may be missing much appreciated! Thanks, --Gabriel

3 4

Fedora 29 Python Classroom Lab testers needed
by Miro Hrončok 13 Feb '19

13 Feb '19

Hi. The Fedora 29 Python Classroom Lab was not built for the proper Fedora 29 release date. We now have some candidates builds to test, so I'm looking for volunteers to help uncover issues. https://pagure.io/releng/issue/7922 GNOME https://koji.fedoraproject.org/koji/taskinfo?taskID=32659167 Vagrant https://koji.fedoraproject.org/koji/taskinfo?taskID=32670129 Arm https://koji.fedoraproject.org/koji/taskinfo?taskID=32660565 See https://fedoraproject.org/wiki/Changes/PythonClassroomLab#How_To_Test Thanks for help. -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

1 0

Help needed: pypy 7.0.0
by Miro Hrončok 13 Feb '19

13 Feb '19

PyPy was updated to 7.0.0 with alpha Python 3.6 support: https://morepypy.blogspot.com/2019/02/pypy-v700-triple-release-of-27-35-and… https://bugzilla.redhat.com/show_bug.cgi?id=1673127 I'd very much want to see this in Fedora 30, but I'm overwhelmed by other things and will be on vacation next week. Is there a volunteer who would be able to do this? I will make time to review PRs. Nothing requires pypy3. pypy2 is only required by sfact & skeinforge (mine, rebuild needed) and buildrequired by asv (I assume for %check). Both PyPys are recommended by tox and asv and should be tested with them. Talk to me over e-mail, bugzilla or #fedora-python. Thanks! -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

2 3

HEADS UP: I plan to correct "python3 setup.py build" calls without proper flags
by Miro Hrončok 13 Feb '19

13 Feb '19

Hi, due to https://fedoraproject.org/wiki/Changes/Python_Extension_Flags it is no longer correct to just call `python3 setup.py build` or `python3 setup.py build_ext` in spec without setting the proper flags (for arched builds with Python extension modules at least). That is without setting both CFLAGS **and** LDFLAGS. I've grepped the usage and skimmed trough specs, destining the following list of packages that fail to properly set both flags. I intend to fix the packages using my provenpackager rights during next week. I plan to push directly. There is no automated script, I'll do the changes by hand. I will: 1) use %py3_build if possible 2) use %set_build_flags otherwise if possible 3) add the missing CFLAGS and/or LDFLAGS variables manually otherwise If you prefer to fix your package yourself, please do (I would appreciate this). If you need more time, let me know. If you prefer a Pull Request over a direct push, let me know. The change in python3 package did not yet happen, no rebuild is needed and I will not bump release or add a changelog entry for this. I will check if the package builds and I will not introduce a new FTBFS. I will not try to fix nontrivial already existing FTBFS. Maintainers by package: Mayavi orion PyMca cicku PyPAM msuchy tmraz PyX jamatos gpaw marcindulak libvirt-python berrange veillard m2crypto mitr marisa ueno nest ankursinha nml heffer numpy cstratak jspaleta limb orion rdieter tomspur ttomecek onboard nmilosev picard alexlan cicku gbcox ohaessler py-bcrypt kevin limb pybluez limb pygrib jdekloe pylibacl kevin szpak pyproj jdekloe python-apsw cicku dfateyev maci python-basemap jspaleta limb python-fastavro ankursinha python-gensim besser82 python-gssapi rharwood simo sross python-libdiscid ohaessler python-matplotlib cstratak jgu jspaleta pcpa rathann tomspur python-mistune lupinix python-mysql jdornak mschorm python-pivy hobbes1069 zultron python-plyvel dcallagh python-pycosat orion python-pyeclib hguemar zaitcev python-pygraphviz zbyszek python-pysctp nhorman python-setproctitle hguemar stevetraylen python-sysv_ipc tsao python-uinput fabiand python-wrapt chandankumar ralph python-zmq ralph tomspur python3-postgresql hhorak pyxattr kevin szpak qhexedit2 smani rpy alexlan jamatos sagemath pcpa setools alexl caillon caolanm dwalsh johnp mbarnes mgrepl pcmoore pebenito plautrba rhughes rstrode ssp vmojzis veusz jsanders xpra jgu sagitter sergiomb zinnia liangsuilong pwu zookeeper ctubbsii greghellings mluscon skottler tstclair Packages by maintainer: alexl setools alexlan picard rpy ankursinha nest python-fastavro berrange libvirt-python besser82 python-gensim caillon setools caolanm setools chandankumar python-wrapt cicku PyMca picard python-apsw cstratak numpy python-matplotlib ctubbsii zookeeper dcallagh python-plyvel dfateyev python-apsw dwalsh setools fabiand python-uinput gbcox picard greghellings zookeeper heffer nml hguemar python-pyeclib python-setproctitle hhorak python3-postgresql hobbes1069 python-pivy jamatos PyX rpy jdekloe pygrib pyproj jdornak python-mysql jgu python-matplotlib xpra johnp setools jsanders veusz jspaleta numpy python-basemap python-matplotlib kevin py-bcrypt pylibacl pyxattr liangsuilong zinnia limb numpy py-bcrypt pybluez python-basemap lupinix python-mistune maci python-apsw marcindulak gpaw mbarnes setools mgrepl setools mitr m2crypto mluscon zookeeper mschorm python-mysql msuchy PyPAM nhorman python-pysctp nmilosev onboard ohaessler picard python-libdiscid orion Mayavi numpy python-pycosat pcmoore setools pcpa python-matplotlib sagemath pebenito setools plautrba setools pwu zinnia ralph python-wrapt python-zmq rathann python-matplotlib rdieter numpy rharwood python-gssapi rhughes setools rstrode setools sagitter xpra sergiomb xpra simo python-gssapi skottler zookeeper smani qhexedit2 sross python-gssapi ssp setools stevetraylen python-setproctitle szpak pylibacl pyxattr tmraz PyPAM tomspur numpy python-matplotlib python-zmq tsao python-sysv_ipc tstclair zookeeper ttomecek numpy ueno marisa veillard libvirt-python vmojzis setools zaitcev python-pyeclib zbyszek python-pygraphviz zultron python-pivy -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

3 6

Python 3.8 package for review
by Miro Hrončok 07 Feb '19

07 Feb '19

Is here: https://bugzilla.redhat.com/show_bug.cgi?id=1672833 A review would be appreciated. Also, we'd like to target Fedora 31 with 3.8, see https://fedoraproject.org/wiki/Changes/Python3.8 -- Miro Hrončok -- Phone: +420777974800 IRC: mhroncok

1 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

python-devel February 2019