March 2009 - buildsys - Fedora Mailing-Lists

unicode error with mergerepos against CentOS 5.

by Steve Traylen

Hi, $ rpm -qf /usr/libexec/kojid/mergerepos koji-builder-1.3.1-1.fc10.noarch Running agaist Fedora repositories all looks well but against CentOS. /usr/libexec/kojid/mergerepos -a x86_64 \ -o repo \ -r http://swissmirror.silyus.net/centos/5.2/os/i386/ Adding repo: http://swissmirror.silyus.net/centos/5.2/os/i386/ 1/400 - Deployment_Guide-or-IN-5.2-9.el5.centos.noarch 2/400 - 1:kde-i18n-Icelandic-3.5.4-1.noarch .... .... 328/400 - system-config-users-1.2.51-4.el5.noarch 329/400 - yum-priorities-1.1.10-9.el5.centos.noarch Traceback (most recent call last): File "/usr/libexec/kojid/mergerepos", line 241, in <module> main(sys.argv[1:]) File "/usr/libexec/kojid/mergerepos", line 236, in main merge.write_metadata() File "/usr/libexec/kojid/mergerepos", line 216, in write_metadata mdgen.doPkgMetadata() File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 332, in doPkgMetadata self.writeMetadataDocs(packages) File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 472, in writeMetadataDocs self.primaryfile.write(po.xml_dump_primary_metadata()) File "/usr/lib/python2.5/site-packages/yum/packages.py", line 943, in xml_dump_primary_metadata msg += misc.to_unicode(self._dump_format_items()) File "/usr/lib/python2.5/site-packages/yum/packages.py", line 809, in _dump_format_items msg += self._dump_pco('provides') UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 38: ordinal not in range(128) Tried with a few other repos as well, e.g the i386 one , the two merged , ... it fails the same though apparently at different packages. -- Steve Traylen

15 years, 1 month

2
7
0 / 0

Error from repoview when composing with pungi.

by William F. Acker WB2FLW +1 303 722 7209

Hi all, I'm not sure which new package might have broken this; I think I succeeded after upgrading yum, but I can't be sure. Here's the spewage. Pungi:ERROR: Got an error from /usr/bin/repoview Pungi:ERROR: Traceback (most recent call last): File "/usr/bin/repoview", line 926, in <module> main() File "/usr/bin/repoview", line 923, in main Repoview(opts) File "/usr/bin/repoview", line 191, in __init__ packages = self.do_packages(repo_data, group_data, pkgnames) File "/usr/bin/repoview", line 554, in do_packages if self.has_changed(pkg_filename, checksum): File "/usr/bin/repoview", line 607, in has_changed scursor.execute(query) sqlite3.IntegrityError: column filename is not unique Saving Primary metadata Saving file lists metadata Saving other metadata Generating sqlite DBs Sqlite DBs complete Traceback (most recent call last): File "/usr/bin/pungi", line 195, in <module> main() File "/usr/bin/pungi", line 99, in main mypungi.doCreaterepo() File "/usr/lib/python2.5/site-packages/pypungi/__init__.py", line 636, in doCreaterepo self._makeMetadata(self.topdir, cachedir, compsfile, repoview=True, repoviewtitle=repoviewtitle) File "/usr/lib/python2.5/site-packages/pypungi/__init__.py", line 612, in _makeMetadata pypungi.util._doRunCommand(repoview, self.logger) File "/usr/lib/python2.5/site-packages/pypungi/util.py", line 36, in _doRunCommand raise OSError, "Got an error from %s: %s" % (command[0], err) OSError: Got an error from /usr/bin/repoview: Traceback (most recent call last): File "/usr/bin/repoview", line 926, in <module> main() File "/usr/bin/repoview", line 923, in main Repoview(opts) File "/usr/bin/repoview", line 191, in __init__ packages = self.do_packages(repo_data, group_data, pkgnames) File "/usr/bin/repoview", line 554, in do_packages if self.has_changed(pkg_filename, checksum): File "/usr/bin/repoview", line 607, in has_changed scursor.execute(query) sqlite3.IntegrityError: column filename is not unique Any ideas? TIA. -- Bill in Denver

15 years, 1 month

2
6
0 / 0

bind-mounting files in mock

by Jay Greguske

Hello, While trying to get livecd-creator working in a mock-built chroot, I discovered that only directories could be bind-mounted using the bind_mount plugin. I made a few code changes and attached a patch for your consideration that enables the bind-mounting of files. Like directories, the bind-mounting of files will require 'internal_dev_setup' be set to False, otherwise the mount command will fail. In the chroot configuration file the following syntax would be allowed (which looks just like that which was used for bind-mounting directories): config_opts['plugin_conf']['bind_mount_opts']['files'].append(('/dev/loop0', '/dev/loop0')) Please let me know what you think, and thanks in advance for your time! - Jay

15 years, 1 month

4
6
0 / 0

mergerepos of f10 x86_64 release and updates does not contain perl or some other packages?

by Steve Traylen

Hi, Merging works fine for i386 f10 repositories but for x86_64 the following happens. The merged repository of f10's "Everything" and "updates" is created and then using this new repo mock tries to create and installroot. The problem is that this new repository is unable to provide some items, perl, /bin/bash and so the install root fails. Here are the details. The "blocklist" file following here is empty. $ /usr/libexec/kojid/mergerepos -a x86_64 \ -b /mnt/koji/repos/dist-f10-build/671/x86_64/blocklist \ -o /tmp/koji/tasks/2021/2021/repo \ -g /mnt/koji/repos/dist-f10-build/671/groups/comps.xml \ -r http://mirror.switch.ch/ftp/mirror/fedora/linux/updates/10/x86_64/ \ -r http://mirror.switch.ch/ftp/mirror/fedora/linux/releases/10/Everything/x8... Adding repo: http://mirror.switch.ch/ftp/mirror/fedora/linux/updates/10/x86_64/ Adding repo: http://mirror.switch.ch/ftp/mirror/fedora/linux/releases/10/Everything/x8... 1/12364 - openswan-doc-2.6.19-1.fc10.x86_64 2/12364 - ssm-0.1-12.fc10.x86_64 ... ... 1112/12364 - 4:perl-5.10.0-56.fc10.x86_64 ... ... 12363/12364 - libextractor-plugins-exiv2-0.5.20b-2.fc10.x86_64 12364/12364 - lwp-devel-2.4-1.fc10.x86_64 Saving Primary metadata Saving file lists metadata Saving other metadata Generating sqlite DBs Starting other db creation: Tue Mar 17 14:49:44 2009 Ending other db creation: Tue Mar 17 14:50:50 2009 Starting filelists db creation: Tue Mar 17 14:51:03 2009 Ending filelists db creation: Tue Mar 17 14:55:37 2009 Starting primary db creation: Tue Mar 17 14:55:40 2009 Ending primary db creation: Tue Mar 17 14:58:28 2009 Sqlite DBs complete The following is then tried from within mock. The chroot's yum.conf is definitely referencing the repository I just created (I've checked carefully and have recreated the repo a few times just to check this is consistent. ) /usr/bin/yum --installroot /var/lib/mock/dist-f10-build-13-671/root/ \ groupinstall build this results in EBUG util.py:256: redhat-rpm-config-9.0.3-3.fc10.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: /usr/bin/perl is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: redhat-rpm-config-9.0.3-3.fc10.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: perl(Getopt::Long) is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: redhat-rpm-config-9.0.3-3.fc10.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: /bin/sh is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: redhat-rpm-config-9.0.3-3.fc10.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: mktemp is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: fedora-release-notes-10.0.0-1.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: /bin/sh is needed by package fedora-release-notes-10.0.0-1.noarch (build) DEBUG util.py:256: redhat-rpm-config-9.0.3-3.fc10.noarch from build has depsolving problems DEBUG util.py:256: --> Missing Dependency: /bin/bash is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: Error: Missing Dependency: /bin/bash is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: Error: Missing Dependency: mktemp is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: Error: Missing Dependency: /bin/sh is needed by package fedora-release-notes-10.0.0-1.noarch (build) DEBUG util.py:256: Error: Missing Dependency: /usr/bin/perl is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: Error: Missing Dependency: /bin/sh is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) DEBUG util.py:256: Error: Missing Dependency: perl(Getopt::Long) is needed by package redhat-rpm-config-9.0.3-3.fc10.noarch (build) And indeed. /usr/bin/yum --installroot /var/lib/mock/dist-f10-build-13-671/root list perl Error: No matching Packages to list There are lots of packages in this repository, but no perl it seems. /usr/bin/yum --installroot /var/lib/mock/dist-f10-build-13-671/root list | wc -l shows 3483 packages. Note the main box I am working on is 32 bit F10 box which may be relevant and the reason why only subsequently the i386 build works? Steve -- Steve Traylen

15 years, 1 month

4
3
0 / 0

buildSRPMfromSCM issue

by Jitesh Shah

Hi all, I've been trying out some stuff on my own local koji instance. Recently, I added a new builder and all the builds using SCMs started to fail (although, scratch builds on SRPMs work just fine). buildSRPMfromSCM fails. The checkouts go through fine and "make sources" also works. Following is the tail of the root.log (after "make sources") DEBUG util.py:251: 3 2266k 73 1670k 0 0 239k 0 0:00:09 0:00:06 0:00:03 310k 87 2266k 87 1976k 0 0 247k 0 0:00:09 0:00:07 0:00:02 310k 100 2266k 100 2266k 0 DEBUG util.py:251: DEBUG util.py:251: 0 DEBUG util.py:251: DEBUG util.py:251: DEBUG util.py:251: DEBUG util.py:251: 253k 0 0:00:08 0:00:08 --:--:-- 307k DEBUG util.py:251: -rw-rw-r-- 1 mockbuild mockbuild 2321402 Jun 18 2007 libidn-0.6.14.tar.gz DEBUG util.py:312: Child returncode was: 0 DEBUG backend.py:484: umount -n /var/lib/mock/dist-f10-build-139-697/root/proc DEBUG util.py:273: Executing command: umount -n /var/lib/mock/dist-f10-build-139-697/root/proc DEBUG util.py:312: Child returncode was: 0 DEBUG backend.py:484: umount -n /var/lib/mock/dist-f10-build-139-697/root/sys DEBUG util.py:273: Executing command: umount -n /var/lib/mock/dist-f10-build-139-697/root/sys DEBUG util.py:312: Child returncode was: 0 DEBUG util.py:99: kill orphans <end of root.log> The task exits with "FAILED: BuildError: error building srpm, mock exited with status 2; see root.log for more information" But, there is nothing suspicious in root.log (yum succeeds, so does checkout and "make sources" and there are no errors after that too). state.log and kojid.log also give out nothing. I have enabled full debugging from kojihub.conf. How do I go about solving this issue? From where can I glean more information about the problem? What does "mock exited with status 2" mean? and more importantly, why does mock give up abruptly? Jitesh

15 years, 1 month

2
1
0 / 0

how to build srpms on koji?

by Chen Baozi

Hi, After long time fighting with koji configuration, I think the service is now running successfully. I added some srpms to it and saw its information on kojiweb. But it seems I can not build the srpms by koji (when I submit a build task to koji, it will "open" for a while, then it would finally come to be failed). I doubted if I have missed some configurations which connecting koji and mock.

15 years, 1 month

3
4
0 / 0

mergerepo fails with PCDATA invalid Char value 8

by Steve Traylen

Hi, Got koji basically working for me over the last couple of weeks. Was very keen to try its new external repository support. Starting with a fresh instance I made a tag (dist-slc5) containing two repos. koji add-external-repo -t dist-slc5 -p 10 "slc5-64-base" http://linuxsoft.cern.ch/cern/slc5X/x86_64/yum/os koji add-external-repo -t dist-slc5 -p 10 "slc5-32-base" http://linuxsoft.cern.ch/cern/slc5X/i386/yum/os and then tried to make a koji repo from that. koji regen-repo dist-slc5 This called /usr/libexec/kojid/mergerepos -a i386 -b /mnt/koji/repos/dist-slc5-build/189/i386/blocklist -o /tmp/koji/tasks/556/556/repo \ -g /mnt/koji/repos/dist-slc5-build/189/groups/comps.xml -r http://linuxsoft.cern.ch/cern/slc5X/x86_64/yum/os/ \ -r http://linuxsoft.cern.ch/cern/slc5X/i386/yum/os/ resulting in as below. Any ideas ? Steve process:19630): GLib-WARNING **: GError set over the top of a previous GError or uninitialized memory. This indicates a bug in someone's code. You must ensure an error is NULL before it's set. The overwriting error message was: Parsing other.xml error: PCDATA invalid Char value 8 Traceback (most recent call last): File "/usr/libexec/kojid/mergerepos", line 241, in <module> main(sys.argv[1:]) File "/usr/libexec/kojid/mergerepos", line 236, in main merge.write_metadata() File "/usr/libexec/kojid/mergerepos", line 216, in write_metadata mdgen.doPkgMetadata() File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 332, in doPkgMetadata self.writeMetadataDocs(packages) File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 475, in writeMetadataDocs clog_limit=self.conf.changelog_limit)) File "/usr/lib/python2.5/site-packages/yum/packages.py", line 959, in xml_dump_other_metadata msg += "%s\n</package>\n" % misc.to_unicode(self._dump_changelog(clog_limit)) File "/usr/lib/python2.5/site-packages/yum/packages.py", line 927, in _dump_changelog if not self.changelog: File "/usr/lib/python2.5/site-packages/yum/packages.py", line 423, in <lambda> changelog = property(fget=lambda self: self.returnChangelog()) File "/usr/lib/python2.5/site-packages/yum/sqlitesack.py", line 225, in returnChangelog self._loadChangelog() File "/usr/lib/python2.5/site-packages/yum/sqlitesack.py", line 202, in _loadChangelog self.sack.populate(self.repo, mdtype='otherdata') File "/usr/lib/python2.5/site-packages/yum/yumRepo.py", line 184, in populate dobj = repo_cache_function(xml, csum) File "/usr/lib/python2.5/site-packages/sqlitecachec.py", line 60, in getOtherdata self.repoid)) TypeError: Parsing other.xml error: PCDATA invalid Char value 8 Steve -- Steve Traylen

15 years, 1 month

2
3
0 / 0

epel mock-0.9.14 problem

by Chen Baozi

hello, I was trying mock-0.9.14 in EPEL on CentOS 5.2. It seems it has got something wrong. Since there is no buildsys-build package in CentOS repository, it reports the error "Could not find useradd in chroot, maybe the install failed?". So I add those buildsys-build, buildsys-macro and rpmdevtools packages into the repository, and it results: ERROR: Command failed: # /usr/bin/yum --installroot /var/lib/mock/centos/root/ install buildsys-build Traceback (most recent call last): File "/usr/bin/yum", line 29, in ? yummain.user_main(sys.argv[1:], exit_code=True) File "/usr/share/yum-cli/yummain.py", line 229, in user_main errcode = main(args) File "/usr/share/yum-cli/yummain.py", line 145, in main (result, resultmsgs) = base.buildTransaction() File "/usr/lib/python2.4/site-packages/yum/__init__.py", line 647, in buildTransaction (rescode, restring) = self.resolveDeps() File "/usr/lib/python2.4/site-packages/yum/depsolve.py", line 696, in resolveDeps CheckDeps, checkinstalls, checkremoves, missing = self._resolveRequires(errors) File "/usr/lib/python2.4/site-packages/yum/depsolve.py", line 779, in _resolveRequires thisneeds = self._checkInstall(txmbr) File "/usr/lib/python2.4/site-packages/yum/depsolve.py", line 851, in _checkInstall provs = self.tsInfo.getProvides(*req) File "/usr/lib/python2.4/site-packages/yum/transactioninfo.py", line 432, in getProvides result.update(self.getNewProvides(name, flag, version)) File "/usr/lib/python2.4/site-packages/yum/transactioninfo.py", line 414, in getNewProvides for pkg, hits in self.pkgSack.getProvides(name, flag, version).iteritems(): File "/usr/lib/python2.4/site-packages/yum/packageSack.py", line 300, in getProvides return self._computeAggregateDictResult("getProvides", name, flags, version) File "/usr/lib/python2.4/site-packages/yum/packageSack.py", line 470, in _computeAggregateDictResult sackResult = apply(method, args) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 861, in getProvides return self._search("provides", name, flags, version) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 43, in newFunc return func(*args, **kwargs) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 837, in _search for pkg in self.searchFiles(name, strict=True): File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 43, in newFunc return func(*args, **kwargs) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 586, in searchFiles self._sql_pkgKey2po(rep, cur, pkgs) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 470, in _sql_pkgKey2po pkg = self._packageByKey(repo, ob['pkgKey']) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 413, in _packageByKey po = self.pc(repo, cur.fetchone()) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 68, in __init__ self._read_db_obj(db_obj) File "/usr/lib/python2.4/site-packages/yum/sqlitesack.py", line 94, in _read_db_obj setattr(self, item, _share_data(db_obj[item])) TypeError: unsubscriptable object

15 years, 1 month

2
2
0 / 0

koji 1.3.0

by Mike McLean

The tarball is posted here: https://fedorahosted.org/koji/wiki/KojiRelease (created from koji-1.3.0 tag) Major Changes -------------- Support for external repos new cli commands createrepo tasks now have a higher weight Support for noarch subpackages Support larger hashes Handle different kinds of rpm signatures [mitr] (#127) support file digests other than md5 in the api and web UI Hub configuration via hub.conf use a hub config file instead of PythonOptions scan for handlers once at startup instead of each call now honors KojiDir Remove huge tables from db - rpmfiles, rpmdeps and changelog tables dropped - data pulled from rpms as needed Build srpms in chroots bump the weight of buildSRPMFromSCM Some web ui theming support SiteName option (the name that shows up in the title) move explicit image sizes to css make welcome message customizable Improved security add an auth token to defend against CSRF include the current time in the cookie some changes to the web UI to defend against XSS Hub policies configured in hub.conf enable verbose policy errors without full debug current policies: tag: controls tag, untag, move operations build_from_srpm: controls whether such builds are allowed build_from_repo_id: controls whether such builds are allowed Plugin support kojihub and kojid now have limited plugin support Other Changes ------------- Python-2.6-isms use hashlib if available use subprocess instead of popen2 Builder improved task cleanup check the load average before taking a task make use of createrepo --update optional choose a better arch for noarch builds update the buildArch task weight based on the average duration of a build of the package set %distribution the same way we set %vendor and %packager cleanup before re-taking a freed or reassigned task indicate which log people should look in for build failures make use of --skip-stat configurable use same repo for all buildArch subtasks more fully honor topdir option Web UI show summary and description for rpms and builds group rpms more sensibly (make the build log links correct) remove the dirtyness indicator from the buildrootinfo page (never used) enable displaying of only the latest builds in a tag use ids instead of names in the urls fix the "Watch logs" feature in the web UI to work over SSL cache compiled Cheetah templates update the web UI to conform to XHTML 1.0 Transitional tasks page: rework view selector use kojiweb.publisher (new location) Hub NotifyOnSuccess option honor KojiDir option DisableNotifications option don't blow up when the database contains older base64 encoded task data make a latest link when a new repo completes add createdBefore= and createdAfter= parameters to listBuilds() fix LoginCreatesUser check in resetBuild use CANCELED state instead of FAILED report offline status if: db connection fails there are errors on startup preserve old extra_arches during package list updates Command line new subcommand: search new subcommand: regen-repo new subcommand: remove-tag show package filters correctly in taginfo allow list-tagged to query at an event added --non-latest to untag-pkg subcommand added --old-user flag to set-pkg-owner-global subcommand show buildroot info in rpminfo output show arch in list-buildroot output handle chain-build cases where the build tag is the same as the dest tag Utils don't start kojira by default (#96) fix timestamp checks when deleting repos package koji-gc added purge option to koji-gc added koji-shadow utility for shadow builds Changes related to shadow builds koji-shadow utility allow creation of repos from a specified event allow building from a specific repo id (subject to policy) Miscellaneous add a strict option to multiCall() handle empty multicalls sensibly return a placeholder object while in a multicall enable building Koji from the Koji git repo with Koji [Jeffrey C. Ollie]

15 years, 1 month

3
2
0 / 0

Revisor (or Anaconda?) spin - unable to install on i586

by Martin Langhoff

[ resend - now to the appropriate Fedora list - apologies ] Hi everyone, the olpc XS spin is hitting a problem installing on i586s (and that includes our own XO). The problem seems to be well known -- anaconda composes based on the arch of the build host rather than on the arch requested, as described in: https://fedorahosted.org/revisor/wiki/AnacondaUpdates#TheUnabletoInstallo... The revisor conf says "architecture=386", yet we are getting _only_ openssl i686 on the iso, which won't get installed on 586, so everything breaks on the (partially installed) machine. I'm away from my buildbox today -- Jerry's been testing and reports that pungi-driven composes also put an openssl-i386 on the iso, while revisor-driven composes don't. So it sounds like the problem is perhaps in how revisor drives anaconda? Any hints or ideas? It seems to be a well known problem...? (the compose host is a Fedora-9 box, that follows updates.newkey) cheers, m -- martin.langhoff(a)gmail.com martin(a)laptop.org -- School Server Architect - ask interesting questions - don't get distracted with shiny stuff - working code first - http://wiki.laptop.org/go/User:Martinlanghoff

15 years, 2 months

2
11
0 / 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

buildsys March 2009