scm-commits September 2022

scm-commits@lists.fedoraproject.org

1 participants
39696 discussions

gotmax23 pushed to ansible-packaging (f35). "Refactor %ansible_collection_install (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:11:11 UTC From deee147c9518bb49974d96436ca11ce60345be17 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 26 2022 04:07:26 +0000 Subject: Refactor %ansible_collection_install This change removes %ansible_collection_install's dependence on the %collection_namespace and %collection_name macros. Now, the macro uses the new helper script which extracts this information from galaxy.yml. Parsing the galaxy.yml instead of using %{version} to determine the collection version also lends another benefit: it allows us to package pre-releases. Previously, discrepancies between %{version} and the upstream version (eg. "3.0.0~rc1" vs "3.0.0-rc1") broke the macro. --- diff --git a/macros.ansible b/macros.ansible index 5e2bc06..856688e 100644 --- a/macros.ansible +++ b/macros.ansible @@ -1,9 +1,18 @@ +# Stores ephemeral data that's created by %%ansible_collection_install +# and used by other macros. +%__ansible_builddir %{_builddir}/%{?buildsubdir:%{buildsubdir}/}.ansible-packaging + %ansible_roles_dir %{_datadir}/ansible/roles %ansible_collections_dir %{_datadir}/ansible/collections/ansible_collections %ansible_collection_build() ansible-galaxy collection build -%ansible_collection_install() ansible-galaxy collection install -n -p %{buildroot}%{_datadir}/ansible/collections %{collection_namespace}-%{collection_name}-%{version}.tar.gz +%ansible_collection_install() %{shrink: +%{_rpmconfigdir}/ansible_collection.py install +--collections-dir %{buildroot}%{ansible_collections_dir} +--filelist %{ansible_collection_filelist} +} + %ansible_test_unit() %{expand:\\\ mkdir -p ../ansible_collections/%{collection_namespace} https://src.fedoraproject.org/rpms/ansible-packaging/c/deee147c9518bb49974d…

1 0

fab uploaded graphql-relay-3.2.0.tar.gz for rpms/python-graphql-relay
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:09:20 UTC c3f269af5b7b623dc5261825253e7f6d8246e37bcbf26f1958f2a9d1383edeb205c11f0ca85ccb9d5b032fabab2ff50f91d8bb88343b85bdc0a2aca477063695 graphql-relay-3.2.0.tar.gz https://src.fedoraproject.org/lookaside/pkgs/rpms/python-graphql-relay/grap…

1 0

gotmax23 pushed to ansible-packaging (f36). "Update changelog"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From 7ea0e618c901051d80d2bddb8e87ade5631b4980 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:33:25 +0000 Subject: Update changelog --- diff --git a/ansible-packaging.spec b/ansible-packaging.spec index 26b648f..dd929fb 100644 --- a/ansible-packaging.spec +++ b/ansible-packaging.spec @@ -1,6 +1,6 @@ Name: ansible-packaging Version: 1 -Release: 7%{?dist} +Release: 8.1%{?dist} Summary: RPM packaging macros and generators for Ansible collections License: GPL-3.0-or-later @@ -149,6 +149,17 @@ echo "Ensure macro prefers the collection namespace and name passed as an argume %changelog +* Sat Sep 24 2022 Maxwell G <gotmax(a)e.email> - 1-8.1 +- Refactor %%ansible_collection_url, %%ansible_collection_install, + %%ansible_test_unit. +- Specfiles no longer need to define %%collection_namespace or %%collection_name + for the macros to work. +- Add new %%ansible_collections_dir, %%ansible_roles_dir, and + %ansible_collection_filelist macros. +- Prepare to deprecate %%ansible_collection_files +- Undefine %%_package_note_file to stop that file from leaking into collection + artifacts. + * Mon Aug 01 2022 Maxwell G <gotmax(a)e.email> - 1-7 - Implement %%ansible_test_unit and add ansible-packaging-tests metapackage. - Require ansible-core at buildtime https://src.fedoraproject.org/rpms/ansible-packaging/c/7ea0e618c901051d80d2…

1 0

gotmax23 pushed to ansible-packaging (f36). "Escape macro in changelog"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From f85cd2c4b6a4181991f08dc6930876634409613b Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:40:24 +0000 Subject: Escape macro in changelog --- diff --git a/ansible-packaging.spec b/ansible-packaging.spec index dd929fb..2bfb057 100644 --- a/ansible-packaging.spec +++ b/ansible-packaging.spec @@ -155,7 +155,7 @@ echo "Ensure macro prefers the collection namespace and name passed as an argume - Specfiles no longer need to define %%collection_namespace or %%collection_name for the macros to work. - Add new %%ansible_collections_dir, %%ansible_roles_dir, and - %ansible_collection_filelist macros. + %%ansible_collection_filelist macros. - Prepare to deprecate %%ansible_collection_files - Undefine %%_package_note_file to stop that file from leaking into collection artifacts. https://src.fedoraproject.org/rpms/ansible-packaging/c/f85cd2c4b6a4181991f0…

1 0

gotmax23 pushed to ansible-packaging (f36). "%ansible_collection_url: Don't require control macros (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From c67bd58e7937afa0cff3e9ce94e4d5d3a3a14a3d Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:33:25 +0000 Subject: %ansible_collection_url: Don't require control macros Reimplement %ansible_collection_url to accept the collection namespace and name as arguments instead of requiring oblique control macros. This also adds some basic tests to ensure that the macro behaves properly. --- diff --git a/ansible-packaging.spec b/ansible-packaging.spec index 4e2478c..26b648f 100644 --- a/ansible-packaging.spec +++ b/ansible-packaging.spec @@ -77,6 +77,57 @@ install -Dpm0644 -t %{buildroot}%{_rpmmacrodir} macros.ansible-srpm install -Dpm0755 -t %{buildroot}%{_rpmconfigdir} ansible-generator install -Dpm0755 -t %{buildroot}%{_rpmconfigdir} ansible_collection.py +%check +# TODO: Currently, this only tests %%{ansible_collection_url}. + +rpm_eval() { + default_macros_path="$(rpm --showrc | grep 'Macro path' | awk -F ': ' '{print $2}')" + rpm --macros="${default_macros_path}:%{buildroot}%{_rpmmacrodir}/macros.*" "$@" +} + +errors() { + error="error: %%ansible_collection_url: You must pass the collection namespace as the first arg and the collection name as the second" + "$@" && exit 1 + "$@" |& grep -q "${error}" +} + +echo "Ensure macro fails when only collection_namespace macro is defined" +errors rpm_eval -D 'collection_namespace cc' -E '%%ansible_collection_url' + +echo +echo "Ensure macro fails when only collection_name macro is defined" +errors rpm_eval -D 'collection_name cc' -E '%%ansible_collection_url' + +echo +echo "Ensure macro fails when second argument is missing" +errors rpm_eval -E '%%ansible_collection_url a' + +echo +echo "Ensure macro fails when second argument is missing" +errors rpm_eval -D 'collection_name b' -E '%%ansible_collection_url a' + +echo +echo "Ensure macro fails when neither the control macros nor macro arguments are passed" +errors rpm_eval -E '%%ansible_collection_url' + + +echo +echo +echo "Ensure macro works when both arguments are passed and no control macros are set" +[[ $(rpm_eval -E '%%ansible_collection_url community general') == \ + "https://galaxy.ansible.com/community/general" ]] + +echo +echo "Ensure macro works with the control macros" +[[ $(rpm_eval -D 'collection_namespace ansible' -D 'collection_name posix' \ + -E '%%ansible_collection_url') == "https://galaxy.ansible.com/ansible/posix" ]] + +echo +echo "Ensure macro prefers the collection namespace and name passed as an argument over the control macros" +[[ $(rpm_eval -D 'collection_namespace ansible' -D 'collection_name posix' \ + -E '%%ansible_collection_url community general') == "https://galaxy.ansible.com/community/general" ]] + + %files %license COPYING diff --git a/macros.ansible-srpm b/macros.ansible-srpm index 9b208b4..0adacd7 100644 --- a/macros.ansible-srpm +++ b/macros.ansible-srpm @@ -1 +1,25 @@ -%ansible_collection_url() https://galaxy.ansible.com/%{collection_namespace}/%{collection_name} +# Note(gotmax23): I'm trying to get rid of the need for control macros in favor +# of a metadata based approach. %%ansible_collection_url is the only macro that +# requires manually specifying the collection namespace and name, as it is used +# at the SRPM build stage. +# +# Currently, this macro supports either passing this information as arguments +# or defining the control macros. In order to reduce confusion, this is not an +# either or approach. Both arguments must be passed OR both control macros must +# be defined. + +%ansible_collection_url() %{lua: + local namespace_name = nil + if rpm.expand("%collection_namespace") ~= "%collection_namespace" + and rpm.expand("%collection_name") ~= "%collection_name" then + namespace_name = rpm.expand("%collection_namespace") .. "/" .. rpm.expand("%collection_name") + end + if rpm.expand("%1") ~= "%1" and rpm.expand("%2") ~= "%2" then + namespace_name = rpm.expand("%1") .. "/" .. rpm.expand("%2") + end + if not namespace_name then + rpm.expand("%{error:%%ansible_collection_url: You must pass the collection " .. + "namespace as the first arg and the collection name as the second}") + end + print("https://galaxy.ansible.com/" .. namespace_name) +} https://src.fedoraproject.org/rpms/ansible-packaging/c/c67bd58e7937afa0cff3…

1 0

gotmax23 pushed to ansible-packaging (f36). "Undefine %%_package_note_file (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From fc8efd22baac9128ba46ce0ce164c8fbc15cf5f3 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:33:25 +0000 Subject: Undefine %%_package_note_file to stop that file from leaking into collection artifacts --- diff --git a/macros.ansible b/macros.ansible index 57c89fe..db2269a 100644 --- a/macros.ansible +++ b/macros.ansible @@ -7,7 +7,10 @@ %ansible_collection_build() ansible-galaxy collection build +# On F36, package-notes-srpm-macros inserts a package note file into +# %%{buildsubdir} that ends up getting included in the collection builds. %ansible_collection_install() %{shrink: +%undefine _package_note_file %{_rpmconfigdir}/ansible_collection.py install --collections-dir %{buildroot}%{ansible_collections_dir} --filelist %{ansible_collection_filelist} https://src.fedoraproject.org/rpms/ansible-packaging/c/fc8efd22baac9128ba46…

1 0

gotmax23 pushed to ansible-packaging (f36). "Check if artifact exists before trying to install it"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From 5e5c534c320247ac15c4825d251e9130f9408291 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:14:22 +0000 Subject: Check if artifact exists before trying to install it --- diff --git a/ansible_collection.py b/ansible_collection.py index 18f04a9..17c6777 100755 --- a/ansible_collection.py +++ b/ansible_collection.py @@ -51,6 +51,14 @@ class AnsibleCollection: return load(file, Loader=CSafeLoader) def install(self, destdir: Union[str, Path]) -> None: + artifact = self.collection_srcdir / Path( + f"{self.namespace}-{self.name}-{self.version}.tar.gz" + ) + if not artifact.exists() and not artifact.is_file(): + raise CollectionError( + f"{artifact} does not exist! Did you run %ansible_collection_build?" + ) + args = ( "ansible-galaxy", "collection", @@ -58,11 +66,12 @@ class AnsibleCollection: "-n", "-p", str(destdir), - f"{self.namespace}-{self.name}-{self.version}.tar.gz", + str(artifact), ) print(f"Running: {args}") print() subprocess.run(args, check=True, cwd=self.collection_srcdir) + print() def write_filelist(self, filelist: Path) -> None: filelist.parent.mkdir(parents=True, exist_ok=True) @@ -134,5 +143,5 @@ def main(): if __name__ == "__main__": try: main() - except CollectionError as err: + except (CollectionError, subprocess.CalledProcessError) as err: sys.exit(err) https://src.fedoraproject.org/rpms/ansible-packaging/c/5e5c534c320247ac15c4…

1 0

gotmax23 pushed to ansible-packaging (f36). "Flush stdout before subprocess.run (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From e3d150ec904179fd2d529763491692ee3b192c44 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 30 2022 20:14:22 +0000 Subject: Flush stdout before subprocess.run This commit adds sys.stdout.flush() before subprocess.run() in ansible_collection.py. Without this, the print statements are shown after the command output when building in mock. --- diff --git a/ansible_collection.py b/ansible_collection.py index 17c6777..70093be 100755 --- a/ansible_collection.py +++ b/ansible_collection.py @@ -70,6 +70,9 @@ class AnsibleCollection: ) print(f"Running: {args}") print() + # Without this, the print statements are shown after the command + # output when building in mock. + sys.stdout.flush() subprocess.run(args, check=True, cwd=self.collection_srcdir) print() @@ -90,6 +93,9 @@ class AnsibleCollection: args = ("ansible-test", "units", *extra_args) print(f"Running: {args}") print() + # Without this, the print statements are shown after the command + # output when building in mock. + sys.stdout.flush() subprocess.run(args, cwd=temppath, check=True) https://src.fedoraproject.org/rpms/ansible-packaging/c/e3d150ec904179fd2d52…

1 0

gotmax23 pushed to ansible-packaging (f36). "Add new %ansible_collection_filelist macro (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From b1de39d9c64cabf7c40c29d445e135b0e41a3f0b Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 26 2022 04:07:27 +0000 Subject: Add new %ansible_collection_filelist macro %ansible_collection_files cannot be adapted to dynamically determine the collection namespace. We need to use a file list for that. %ansible_collection_install writes out a file list to %ansible_collection_filelist. Packagers would pass `%{ansible_collection_filelist}` to `%files -f`. Eventually, I'd like to deprecate %ansible_collection_files. That won't happen until the new approach has gotten more testing and adoption. --- diff --git a/macros.ansible b/macros.ansible index 0c81432..57c89fe 100644 --- a/macros.ansible +++ b/macros.ansible @@ -18,5 +18,11 @@ --python-interpreter %{__python3} --local %{?*} } +# TODO: Officially deprecate this macro and add the following line to the macro +# def after the new approach has gotten more testing and adoption: +# %%{warn: %%{ansible_collection_files} is deprecated. Use %%files -f %%{ansible_collection_filelist} instead.} +%ansible_collection_files %{shrink: +%{ansible_collections_dir}/%{collection_namespace}/ +} -%ansible_collection_files %{_datadir}/ansible/collections/ansible_collections/%{collection_namespace}/ +%ansible_collection_filelist %{__ansible_builddir}/ansible_collection_files https://src.fedoraproject.org/rpms/ansible-packaging/c/b1de39d9c64cabf7c40c…

1 0

gotmax23 pushed to ansible-packaging (f36). "Outsource %ansible_test_unit logic to helper script (..more)"
by notifications＠fedoraproject.org 30 Sep '22

30 Sep '22

Notification time stamped 2022-09-30 21:08:43 UTC From 78dcf4c992c5c3189675c7f579864c9140cf5898 Mon Sep 17 00:00:00 2001 From: Maxwell G <gotmax(a)e.email> Date: Sep 26 2022 04:07:27 +0000 Subject: Outsource %ansible_test_unit logic to helper script We want %ansible_test_unit to retrieve the collection name{,space} from galaxy.yml. This removes the need for the %collection_name{,space} macros and utilizes ansible_collection.py's more robust approach to running the tests. --- diff --git a/macros.ansible b/macros.ansible index 856688e..0c81432 100644 --- a/macros.ansible +++ b/macros.ansible @@ -13,12 +13,10 @@ --filelist %{ansible_collection_filelist} } +%ansible_test_unit() %{shrink: +%{_rpmconfigdir}/ansible_collection.py test -- +--python-interpreter %{__python3} --local %{?*} +} -%ansible_test_unit() %{expand:\\\ -mkdir -p ../ansible_collections/%{collection_namespace} -cp -a $(pwd) ../ansible_collections/%{collection_namespace}/%{collection_name} -pushd ../ansible_collections/%{collection_namespace}/%{collection_name} -ansible-test units --python-interpreter %{__python3} --local %{?*} -popd} %ansible_collection_files %{_datadir}/ansible/collections/ansible_collections/%{collection_namespace}/ https://src.fedoraproject.org/rpms/ansible-packaging/c/78dcf4c992c5c3189675…

1 0

← Newer
1
2
3
4
5
6
7
...
3970
Older →

Jump to page:

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

scm-commits September 2022