ascii mergerepo error in local koji instance

[Josh Boyer]

I'm seeing this error when trying to do a newRepo task on my local
koji server, using rawhide as an external repo:

2101/14674 - python-decoratortools-1.7-4.fc12.noarch
2102/14674 - ruby-atk-0.19.1-2.fc12.ppc
Traceback (most recent call last):
  File "/usr/libexec/kojid/mergerepos", line 241, in <module>
    main(sys.argv[1:])
  File "/usr/libexec/kojid/mergerepos", line 236, in main
    merge.write_metadata()
  File "/usr/libexec/kojid/mergerepos", line 216, in write_metadata
    mdgen.doPkgMetadata()
  File "/usr/lib/python2.6/site-packages/createrepo/__init__.py", line
364, in doPkgMetadata
    self.writeMetadataDocs(packages)
  File "/usr/lib/python2.6/site-packages/createrepo/__init__.py", line
527, in writeMetadataDocs
    self.primaryfile.write(po.xml_dump_primary_metadata())
  File "/usr/lib/python2.6/site-packages/yum/packages.py", line 1015,
in xml_dump_primary_metadata
    msg += misc.to_unicode(self._dump_format_items())
  File "/usr/lib/python2.6/site-packages/yum/packages.py", line 894,
in _dump_format_items
    msg += self._dump_pco('provides')
  File "/usr/lib/python2.6/site-packages/yum/packages.py", line 919,
in _dump_pco
    msg += pcostring
UnicodeDecodeError: 'ascii' codec can't decode byte 0xec in position
28: ordinal not in range(128)
[root@koji 97]#

The builders and hub are all running a fully updated F11.  This is the
first newRepo task after the repo addition, so it's all purely from
rawhide.

I see that there was a similar report of this in the past, but I don't
see a resolution?  Is there a patch I need to apply, or do I have to
block the erroring packages in koji, or?

Help would be appreciated.  (I'm also confused why the main koji
instance isn't hitting this).

josh

[Jeroen van Meeuwen]

On 09/18/2009 03:25 AM, Josh Boyer wrote:
> I'm seeing this error when trying to do a newRepo task on my local
> koji server, using rawhide as an external repo:

I've seen the exact same thing over and over again. I logged 
https://bugzilla.redhat.com/show_bug.cgi?id=495735 for this.

The main koji instance isn't hitting this because it doesn't use 
mergerepos against repos that have the latest nifty auto-font-provides 
in them, I think.

Kind regards,

Jeroen van Meeuwen
-kanarip

[Josh Boyer]

On Fri, Sep 18, 2009 at 10:28:37AM +0200, Jeroen van Meeuwen wrote:
> On 09/18/2009 03:25 AM, Josh Boyer wrote:
> > I'm seeing this error when trying to do a newRepo task on my local
> > koji server, using rawhide as an external repo:
>
> I've seen the exact same thing over and over again. I logged  
> https://bugzilla.redhat.com/show_bug.cgi?id=495735 for this.

Thanks.
> The main koji instance isn't hitting this because it doesn't use  
> mergerepos against repos that have the latest nifty auto-font-provides  
> in them, I think.

Having trouble parsing that.  I'm using rawhide packges.  How is the main
koji not using mergerepos there?  If it's not, is there some config switch
I need to flip or something like that?

josh

[Jeroen van Meeuwen]

On 09/18/2009 12:33 PM, Josh Boyer wrote:
> On Fri, Sep 18, 2009 at 10:28:37AM +0200, Jeroen van Meeuwen wrote:
> > On 09/18/2009 03:25 AM, Josh Boyer wrote:
> > > I'm seeing this error when trying to do a newRepo task on my local
> > > koji server, using rawhide as an external repo:
> >
> > I've seen the exact same thing over and over again. I logged
> > https://bugzilla.redhat.com/show_bug.cgi?id=495735 for this.
>
> Thanks.
> > The main koji instance isn't hitting this because it doesn't use
> > mergerepos against repos that have the latest nifty auto-font-provides
> > in them, I think.
>
> Having trouble parsing that.  I'm using rawhide packges.  How is the main
> koji not using mergerepos there?  If it's not, is there some config switch
> I need to flip or something like that?

Mergerepos is only used for external repository support, not for 
repositories internal to koji.

The only build-targets in the main koji instance that use mergerepos are 
the epel build-targets.

mergerepos or yum.packages does not have a problem with these packages, 
but it does have a problem with packages (apparently) that provide 
font(lang=some), where "some" is characters I don't know what they are.

My blocked packages now include:

3 	apanov-edrip-fonts
4 	apanov-heuristica-fonts
5 	baekmuk-ttf-fonts
6 	hanazono-fonts
13 	ipa-gothic-fonts
7 	ipa-mincho-fonts
8 	ipa-pgothic-fonts
9 	ipa-pmincho-fonts
10 	sazanami-fonts
16 	un-core-fonts
15 	un-core-gungseo-fonts
11 	vlgothic-fonts
12 	wqy-zenhei-fonts

And so they are not causing mergerepos to traceback anymore.

-- Jeroen