unicode error with mergerepos against CentOS 5.

Steve Traylen steve at traylen.net
Wed Mar 18 13:15:50 UTC 2009


On Mon, Mar 16, 2009 at 1:29 PM, Seth Vidal <skvidal at fedoraproject.org> wrote:
>
>
> On Mon, 16 Mar 2009, Steve Traylen wrote:
>
>> Hi,
>>
>> $ rpm -qf /usr/libexec/kojid/mergerepos
>> koji-builder-1.3.1-1.fc10.noarch
>>
>> Running agaist Fedora repositories all looks well but against CentOS.
>>
>> /usr/libexec/kojid/mergerepos -a x86_64 \
>>  -o repo  \
>>  -r  http://swissmirror.silyus.net/centos/5.2/os/i386/
>>
>> Adding repo: http://swissmirror.silyus.net/centos/5.2/os/i386/
>> 1/400 - Deployment_Guide-or-IN-5.2-9.el5.centos.noarch
>> 2/400 - 1:kde-i18n-Icelandic-3.5.4-1.noarch
>> ....
>> ....
>> 328/400 - system-config-users-1.2.51-4.el5.noarch
>> 329/400 - yum-priorities-1.1.10-9.el5.centos.noarch
>> Traceback (most recent call last):
>> File "/usr/libexec/kojid/mergerepos", line 241, in <module>
>>  main(sys.argv[1:])
>> File "/usr/libexec/kojid/mergerepos", line 236, in main
>>  merge.write_metadata()
>> File "/usr/libexec/kojid/mergerepos", line 216, in write_metadata
>>  mdgen.doPkgMetadata()
>> File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line
>> 332, in doPkgMetadata
>>  self.writeMetadataDocs(packages)
>> File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line
>> 472, in writeMetadataDocs
>>  self.primaryfile.write(po.xml_dump_primary_metadata())
>> File "/usr/lib/python2.5/site-packages/yum/packages.py", line 943,
>> in xml_dump_primary_metadata
>>  msg += misc.to_unicode(self._dump_format_items())
>> File "/usr/lib/python2.5/site-packages/yum/packages.py", line 809,
>> in _dump_format_items
>>  msg += self._dump_pco('provides')
>> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
>> 38: ordinal not in range(128)
>>
>> Tried with a few other repos as well, e.g the i386 one , the two
>> merged , ... it fails the same
>> though apparently  at different packages.
>>
>
> the metadata you're pulling in was written with a much older createrepo
> which was less picky about some of the data it wrote back out. So you end up
> with some pkgs with dodgy data in the changelogs.

Mirroring in CentOS5 and then recreating from scratch the repodirs with a Fedora
10 createrepo the the repository is created spitting out some warnings.

1556/2382 - CentOS/ghostscript-devel-8.15.2-9.1.el5_1.1.i386.rpm
iso-8859-1 encoding on /usr/lib/aspell-0.60/�slenska.alias
1598/2382 - CentOS/avalon-logkit-javadoc-1.2-4jpp.3.i386.rpm
iso-8859-1 encoding on Ville Skytt� <ville.skytta at iki.fi> - 1:0.2-1jpp

and then the merge fails with.

 /usr/libexec/kojid/mergerepos -a i386  \
    -o repo  \
    -r http://skojihub.cern.ch/mirror/centos/5/updates/i386 \
    -r http://skojihub.cern.ch/mirror/centos/5/os/i386

 Adding repo: http://skojihub.cern.ch/mirror/centos/5/updates/i386
 Adding repo: http://skojihub.cern.ch/mirror/centos/5/os/i386
 1/2607 - openssl-perl-0.9.8b-10.el5_2.1.i386
 2/2607 - 1:cups-1.2.4-11.18.el5_2.3.i386
 ....
1353/2607 - ImageMagick-c++-6.2.8.0-4.el5_1.1.i386
1354/2607 - mesa-libGL-6.5.1-7.5.el5.i386
Traceback (most recent call last):
  File "/usr/libexec/kojid/mergerepos", line 241, in <module>
    main(sys.argv[1:])
  File "/usr/libexec/kojid/mergerepos", line 236, in main
    merge.write_metadata()
  File "/usr/libexec/kojid/mergerepos", line 216, in write_metadata
    mdgen.doPkgMetadata()
  File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line
332, in doPkgMetadata
    self.writeMetadataDocs(packages)
  File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line
472, in writeMetadataDocs
    self.primaryfile.write(po.xml_dump_primary_metadata())
  File "/usr/lib/python2.5/site-packages/yum/packages.py", line 943,
in xml_dump_primary_metadata
    msg += misc.to_unicode(self._dump_format_items())
  File "/usr/lib/python2.5/site-packages/yum/packages.py", line 809,
in _dump_format_items
    msg += self._dump_pco('provides')
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position
38: ordinal not in range(128)

Have read around a bit on .spec file character and there looks to be some
recommendations but nothing concrete? e.g
http://wiki.mandriva.com/en/Policies/Charset#In_spec_file_itself

   Steve



>
> -sv
>
> --
> Fedora-buildsys-list mailing list
> Fedora-buildsys-list at redhat.com
> https://www.redhat.com/mailman/listinfo/fedora-buildsys-list
>



-- 
Steve Traylen




More information about the Fedora-buildsys-list mailing list