rel-eng November 2014

rel-eng@lists.fedoraproject.org

12 participants
189 discussions

[releng] Updated tag rawhide-stable
by Dennis Gilmore 07 Nov '14

07 Nov '14

The lightweight tag 'rawhide-stable' was updated to point to: e29e07f... attempt to make an atomic tree nightly for rawhide It previously pointed to: 3f95440... attempt to make an atomic tree nightly for branched NOTE: People pulling from the repository will not get the new tag. For more information, please see: http://live.gnome.org/Git/Help/TagUpdates

1 0

[releng] attempt to make an atomic tree nightly for rawhide
by Dennis Gilmore 07 Nov '14

07 Nov '14

commit e29e07f4bdd303bf22f57bda9140578816e49c02 Author: Dennis Gilmore <dennis(a)ausil.us> Date: Fri Nov 7 01:52:46 2014 -0600 attempt to make an atomic tree nightly for rawhide scripts/buildrawhide | 14 ++++++++++++++ 1 files changed, 14 insertions(+), 0 deletions(-) --- diff --git a/scripts/buildrawhide b/scripts/buildrawhide index 40af878..18a1497 100755 --- a/scripts/buildrawhide +++ b/scripts/buildrawhide @@ -26,6 +26,9 @@ TOMAIL="devel(a)lists.fedoraproject.org test(a)lists.fedoraproject.org" SUBJECT='rawhide report: '$DATE' changes' FROM="Fedora Rawhide Report <rawhide(a)fedoraproject.org>" RSYNCPREFIX="sudo -u ftpsync" +ATOMIC=$(mktemp -d /tmp/atomici.${DIST}.$DATE.XXXX) +ATOMICDEST="/mnt/fedora_koji/koji/mash/atomic/$BRANCHED/" + [ -n "$ARCH" ] && { TREEPREFIX="/mnt/koji/tree" EXPANDARCH="-$ARCH" @@ -136,6 +139,17 @@ log "starting spam-o-matic" $MOCK -r $MOCKCONFIG --uniqueext=$DATE --unpriv --chroot "/usr/share/mash/spam-o-matic $DEPOPTS ${MASHDIR}/$BRANCHED$EXPANDARCH >$logdir/depcheck" & log "finished spam-o-matic" +log "starting atomic tree creation" +git clone https://git.fedorahosted.org/git/fedora-atomic.git $ATOMIC +pushd $ATOMIC + sed -i -e 's|mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-21&arch…' fedora*repo + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --init + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --install rpm-ostree + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "if [ ! -d $ATOMICDEST ]; then ostree init --repo=$ATOMICDEST ;fi" + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "rpm-ostree compose tree --repo=$ATOMICDEST $ATOMIC/fedora-atomic-docker-host.json" +popd +log "finished atomic tree creation" + send_fedmsg start pungify.start log "starting critppath generation"

1 0

[releng] Updated tag rawhide-stable
by Dennis Gilmore 07 Nov '14

07 Nov '14

The lightweight tag 'rawhide-stable' was updated to point to: 3f95440... attempt to make an atomic tree nightly for branched It previously pointed to: 46a1fd5... adjust the url based on if its a nightly compose or TC/RC o NOTE: People pulling from the repository will not get the new tag. For more information, please see: http://live.gnome.org/Git/Help/TagUpdates

1 0

[releng] attempt to make an atomic tree nightly for branched
by Dennis Gilmore 07 Nov '14

07 Nov '14

commit 3f95440b3b3ddcddac9cc671ac8b1ca323d0b51d Author: Dennis Gilmore <dennis(a)ausil.us> Date: Fri Nov 7 01:40:27 2014 -0600 attempt to make an atomic tree nightly for branched scripts/buildbranched | 14 ++++++++++++++ 1 files changed, 14 insertions(+), 0 deletions(-) --- diff --git a/scripts/buildbranched b/scripts/buildbranched index 672e04d..229f38b 100755 --- a/scripts/buildbranched +++ b/scripts/buildbranched @@ -26,6 +26,9 @@ TOMAIL="devel(a)lists.fedoraproject.org test(a)lists.fedoraproject.org" SUBJECT='F-'$BRANCHED' Branched report: '$DATE' changes' FROM="Fedora Branched Report <rawhide(a)fedoraproject.org>" RSYNCPREFIX="sudo -u ftpsync" +ATOMIC=$(mktemp -d /tmp/atomici.${DIST}.$DATE.XXXX) +ATOMICDEST="/mnt/fedora_koji/koji/mash/atomic/$BRANCHED/" + [ -n "$ARCH" ] && { TREEPREFIX="/mnt/koji/tree" EXPANDARCH="-$ARCH" @@ -145,6 +148,17 @@ log "starting spam-o-matic" $MOCK -r $MOCKCONFIG --uniqueext=$DATE --unpriv --chroot "/usr/share/mash/spam-o-matic $DEPOPTS ${MASHDIR}/$BRANCHED$EXPANDARCH >$logdir/depcheck" & log "finished spam-o-matic" +log "starting atomic tree creation" +git clone https://git.fedorahosted.org/git/fedora-atomic.git $ATOMIC +pushd $ATOMIC + sed -i -e 's|mirrorlist=https://mirrors.fedoraproject.org/metalink?repo=fedora-21&arch…' fedora*repo + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --init + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --install rpm-ostree + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "if [ ! -d $ATOMICDEST ]; then ostree init --repo=$ATOMICDEST ;fi" + $MOCK -r $MOCKCONFIG --uniqueext=$DATE --shell "rpm-ostree compose tree --repo=$ATOMICDEST $ATOMIC/fedora-atomic-docker-host.json" +popd +log "finished atomic tree creation" + send_fedmsg start pungify.start log "starting critppath generation"

1 0

#6033: un-block picocontainer
by Fedora Release Engineering 06 Nov '14

06 Nov '14

#6033: un-block picocontainer -----------------------------+------------------------ Reporter: gil | Owner: rel-eng@… Type: task | Status: new Milestone: Fedora 21 Alpha | Component: koji Keywords: | Blocked By: Blocking: | -----------------------------+------------------------ Hi, picocontainer was retired but has now been re-reviewed and approved for inclusion in Fedora ( https://bugzilla.redhat.com/show_bug.cgi?id=819015) -- Ticket URL: <https://fedorahosted.org/rel-eng/ticket/6033> Fedora Release Engineering <http://fedorahosted.org/rel-eng> Release Engineering for the Fedora Project

1 3

#6028: process-git-requests is partially failing
by Fedora Release Engineering 06 Nov '14

06 Nov '14

#6028: process-git-requests is partially failing -----------------------------+------------------------ Reporter: limb | Owner: rel-eng@… Type: defect | Status: new Milestone: Fedora 20 Final | Component: git Keywords: | Blocked By: Blocking: | -----------------------------+------------------------ I've run this this morning over several packages, and after the run over 20+ packages it reported that I needed to run /usr/local/bin/pkgdb2branch.py on pkgs.fedoraproject.org on all of them. I did, and it reported that each package was not found, presumably in pkgdb. It is indeed failing to create the git repos/branches, so I suspect there was some change either in pkgdb, pkgdb2branch.py, or there's a problem connecting to it from pkgs. The process-git-requests script has not changed. This worked as of Thursday 10/30, and does not as of today, 11/3. -- Ticket URL: <https://fedorahosted.org/rel-eng/ticket/6028> Fedora Release Engineering <http://fedorahosted.org/rel-eng> Release Engineering for the Fedora Project

1 25

[releng] Expand the logging in process-git-requests
by Till Maas 05 Nov '14

05 Nov '14

commit 712f06112a67760bed822ebb005e665cb9389757 Author: Pierre-Yves Chibon <pingou(a)pingoured.fr> Date: Wed Nov 5 09:53:21 2014 +0100 Expand the logging in process-git-requests Add the --verbose argument Make the --debug argument do something (including incorporating the logs from pkgdb2client itself) Add more call to logging.log() scripts/process-git-requests/process-git-requests | 30 +++++++++++++++++++- 1 files changed, 28 insertions(+), 2 deletions(-) --- diff --git a/scripts/process-git-requests/process-git-requests b/scripts/process-git-requests/process-git-requests index c510f2a..068a481 100755 --- a/scripts/process-git-requests/process-git-requests +++ b/scripts/process-git-requests/process-git-requests @@ -58,6 +58,8 @@ PAGER = os.environ.get('PAGER') or '/usr/bin/less' EDITOR = os.environ.get('EDITOR') or '/bin/vi' logging.basicConfig() +PKGDBLOG = logging.getLogger("pkgdb2client") +LOG = logging.getLogger("process-git-requests") # Override a method in xmlrpclib so it doesn't blow up when getting crap data # from Red Hat's bugzilla. @@ -97,6 +99,11 @@ def parse_commandline(): help='Username for PackageDB connection', dest='user', default=default_user) + parser.add_option('--verbose', + action='store_true', + dest='verbose', + default=False, + help='Outputs more information (less than debug though)') parser.add_option('--debug', action='store_true', dest='debug', @@ -145,11 +152,13 @@ def encode_utf8(object, encoding='utf8', errors='replace'): # Get all valid branches for a package: # pkg_branches :: PkgDB -> String -> (IO) [String] def pkg_branches(pkgdb, pkg): + LOG.info('Getting branches of package %s from pkgdb', pkg) package = pkgdb.get_package(str(pkg)) valid_branches = filter(lambda x: x['collection']['branchname'] in branches.keys(), package['packages']) return map(lambda x: x['collection']['branchname'], valid_branches) def add_package(pkgdb, request, bug): + LOG.info('Adding package %s in pkgdb', request['pkg']) # A nested helper function to see if a package exists or not. # pkg_exists :: String -> (IO) Bool @@ -157,7 +166,7 @@ def add_package(pkgdb, request, bug): try: pkgdb.get_package(str(pkg)) except PkgDBException as err: - log.debug('Error when retrieving package %s: %s', str(pkg), err) + LOG.debug('Error when retrieving package %s: %s', str(pkg), err) # We get an error back if (at least) the package doesn't exist. return False return True @@ -198,7 +207,7 @@ def add_package(pkgdb, request, bug): 'Approved', i) except AuthError, e: - logging.debug('It says AuthError: %s', e) + LOG.debug('It says AuthError: %s', e) if sys.stdin.isatty(): if retry >= config['pkgdb.retries']: break @@ -210,6 +219,7 @@ def add_package(pkgdb, request, bug): break def edit_package(pkgdb, request): + LOG.info('Edit package %s in pkgdb', request['pkg']) for retry in range(1, config['pkgdb.retries'] + 1): try: for i in ([request['owner']] + request['comaintainers']): @@ -328,6 +338,7 @@ def parse_prefixed_lines(s): return items + def clean_branches(branches): '''Clean up a list of branches and turn them into what pkgdb expects.''' branches = branches.lower() @@ -388,6 +399,7 @@ def clean_request(items): return request + def new_request_string(items, bug): r = [] r.append("Bug URL: https://bugzilla.redhat.com/%d " % bug.id) @@ -404,6 +416,7 @@ def new_request_string(items, bug): r.append('') return '\n'.join(r) + def change_request_string(items, bug): r = [] r.append("Bug URL: https://bugzilla.redhat.com/%d" % bug.id) @@ -418,6 +431,7 @@ def change_request_string(items, bug): r.append('') return '\n'.join(r) + def get_pkgdb_owners(pkgdb, pkg): owners = {} o = '' @@ -451,6 +465,7 @@ def get_pkgdb_owners(pkgdb, pkg): return (owners, o) + def process_no_request(bug, allcomments): '''Deal with a ticket where no request was found.''' while 1: @@ -480,6 +495,7 @@ def process_no_request(bug, allcomments): webbrowser.open("https://bugzilla.redhat.com/" + str(bug.id), new=1) return True + def check_owners(fas, owner, comaintainers, cc_list): print "Checking owners..." warnings = [] @@ -518,6 +534,7 @@ def check_owners(fas, owner, comaintainers, cc_list): def process_new_request(bug, comment, allcomments, firstfound, pkgdb, fas, branches): '''Parse a new package request, try to repair line wrapping, and do some basic validity checks.''' + LOG.info('Processing new package requests') warned = False warnings = [] items = parse_prefixed_lines(comment['text']) @@ -663,6 +680,7 @@ def process_new_request(bug, comment, allcomments, firstfound, pkgdb, fas, branc def process_change_request(bug, comment, allcomments, firstfound, pkgdb, branches): '''Parse a change request, try to repair line wrapping, and do some basic validity checks.''' + LOG.info('Processing new branch requests') owned = False warned = False warnings = [] @@ -797,6 +815,7 @@ def process_change_request(bug, comment, allcomments, firstfound, pkgdb, branche def create_branches(package, pkghost, pkghostlocal, processed): '''If on pkgs01, run /usr/local/bin/pkgdb2branch.py directly. Otherwise, call ssh.''' + LOG.info('Create branches in git') hostname = os.uname()[1] cmd = [] if hostname != pkghostlocal: @@ -810,10 +829,17 @@ def create_branches(package, pkghost, pkghostlocal, processed): print return processed + if __name__ == '__main__': processed = [] options = parse_commandline() + if options.debug: + LOG.setLevel(logging.DEBUG) + PKGDBLOG.setLevel(logging.DEBUG) + elif options.verbose: + LOG.setLevel(logging.INFO) + print "Connecting to bugzilla..." try: bz = bugzilla.Bugzilla(url=options.url)

1 0

[releng] Log a little more info if an AuthError is catched
by Till Maas 05 Nov '14

05 Nov '14

commit 46379117094090053ba677d48b9cf3cba134431e Author: Pierre-Yves Chibon <pingou(a)pingoured.fr> Date: Mon Nov 3 17:53:00 2014 +0100 Log a little more info if an AuthError is catched scripts/process-git-requests/process-git-requests | 1 + 1 files changed, 1 insertions(+), 0 deletions(-) --- diff --git a/scripts/process-git-requests/process-git-requests b/scripts/process-git-requests/process-git-requests index 46e069e..c510f2a 100755 --- a/scripts/process-git-requests/process-git-requests +++ b/scripts/process-git-requests/process-git-requests @@ -198,6 +198,7 @@ def add_package(pkgdb, request, bug): 'Approved', i) except AuthError, e: + logging.debug('It says AuthError: %s', e) if sys.stdin.isatty(): if retry >= config['pkgdb.retries']: break

1 0

[releng] Add a little debugging when pkg_exists fails
by Till Maas 05 Nov '14

05 Nov '14

commit 5c22d5b1a3412ba58c70d3f6aa6fc2cac5ce8e95 Author: Pierre-Yves Chibon <pingou(a)pingoured.fr> Date: Mon Nov 3 17:50:02 2014 +0100 Add a little debugging when pkg_exists fails scripts/process-git-requests/process-git-requests | 3 ++- 1 files changed, 2 insertions(+), 1 deletions(-) --- diff --git a/scripts/process-git-requests/process-git-requests b/scripts/process-git-requests/process-git-requests index f308cd6..46e069e 100755 --- a/scripts/process-git-requests/process-git-requests +++ b/scripts/process-git-requests/process-git-requests @@ -156,7 +156,8 @@ def add_package(pkgdb, request, bug): def pkg_exists(pkg): try: pkgdb.get_package(str(pkg)) - except PkgDBException: + except PkgDBException as err: + log.debug('Error when retrieving package %s: %s', str(pkg), err) # We get an error back if (at least) the package doesn't exist. return False return True

1 0

[releng] sigulsign_unsigned: Fix --just-list
by Till Maas 05 Nov '14

05 Nov '14

commit f32f21a5c48bcc6494e76b4bcaaf3c2785811ef4 Author: Till Maas <opensource(a)till.name> Date: Wed Nov 5 21:58:05 2014 +0100 sigulsign_unsigned: Fix --just-list scripts/sigulsign_unsigned.py | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) --- diff --git a/scripts/sigulsign_unsigned.py b/scripts/sigulsign_unsigned.py index 3a9b185..ddb5c67 100755 --- a/scripts/sigulsign_unsigned.py +++ b/scripts/sigulsign_unsigned.py @@ -558,7 +558,7 @@ if __name__ == "__main__": # Get unsigned packages logging.info('Checking for unsigned rpms in koji') - unsigned = list(kojihelper.get_unsigned_rpms(rpmdict, sigul_helper.keyid)) + unsigned = list(kojihelper.get_unsigned_rpms(rpmdict, KEYS[key]['id'])) for rpm in unsigned: logging.debug('%s is not signed with %s' % (rpm, key))

1 0

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

rel-eng November 2014