[Pulp-list] pulp failing to sync CentOS 6 and CentOS 7 base repos

Kodiak Firesmith kfiresmith at gmail.com
Thu Oct 12 13:23:25 UTC 2017


https://pulp.plan.io/issues/2346 - probably pile onto this one.
Ha!  Turns out at some point in the past I was also affected by this bug
and piled on.

On Thu, Oct 12, 2017 at 9:21 AM, Kodiak Firesmith <kfiresmith at gmail.com>
wrote:

> This smells like an ascii/unicode issue with the repoview creation portion
> of your sync.  I would turn off repoview and file an issue if one isn't
> already in place for this problem.
>  - Kodiak
>
> On Thu, Oct 12, 2017 at 8:32 AM, Joe Rhodes <jrhodes at fuze.com> wrote:
>
>> I'm running into an issue when trying to sync the CentOS 6 and CentOS 7
>> base repos to a newly build pulp server.  Repo view dies with:
>>
>> Generating HTML files
>> [/]
>>
>> Task Failed
>>
>> 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in
>> range(128)
>>
>>
>> Sometimes I can delete the repo and re-create it, in which case it will
>> work.  But I haven't figured out why it's happening.
>>
>> >From /var/log/messages:
>>
>> Writing package cdparanoia-devel.html\nWriting package
>> cdparanoia-libs.html\n\n::\nTraceback (most recent call last):\n  File
>> "/usr/bin/repoview", line 940, in <module>\n    main()\n  File
>> "/usr/bin/repoview", line 937, in main\n    Repoview(opts)\n  File
>> "/usr/bin/repoview", line 191, in __init__\n    packages =
>> self.do_packages(repo_data, group_data, pkgnames)\n  File
>> "/usr/bin/repoview", line 544, in do_packages\n    pkg_data =
>> self.get_package_data(pkgname)\n  File "/usr/bin/repoview", line 442, in
>> get_package_data\n    rows = pcursor.fetchall()\nsqlite3.OperationalError:
>> Could not decode to UTF-8 column \'location_href\' with text
>> \'\xc0\xb9\'\n', 79012, 79013, 'ordinal not in range(128)')
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368) Traceback (most recent call last):
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py",
>> line 240, in trace_task
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     R = retval = fun(*args, **kwargs)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/async/tasks.py", line 529, in __call__
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return super(Task, self).__call__(*args, **kwargs)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/async/tasks.py", line 107, in __call__
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return super(PulpTask, self).__call__(*args, **kwargs)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py",
>> line 438, in __protected_call__
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return self.run(*args, **kwargs)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/controllers/repository.py", line 1106, in publish
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     result = check_publish(repo_obj, dist_id, dist_inst,
>> transfer_repo, conduit, call_config)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/controllers/repository.py", line 1200, in check_publish
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     result = _do_publish(repo_obj, dist_id, dist_inst,
>> transfer_repo, conduit, call_config)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/controllers/repository.py", line 1252, in _do_publish
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     publish_report = publish_repo(transfer_repo, conduit,
>> call_config)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/async/tasks.py", line 732, in wrap_f
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return f(*args, **kwargs)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in
>> publish_repo
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return self._publisher.process_lifecycle()
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     super(PluginStep, self).process_lifecycle()
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     step.process()
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/plugins/util/publish_step.py", line 271, in process
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     self._record_failure(e, tb)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/plugins/util/publish_step.py", line 402, in _record_failure
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     error_details['error'] = str(e)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)   File "/usr/lib/python2.7/site-packa
>> ges/pulp/server/exceptions.py", line 96, in __str__
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368)     return msg.encode('utf-8')
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
>> (16183-94368) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc0 in
>> position 79012: ordinal not in range(128)
>> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:INFO: Task
>> pulp.server.async.tasks._release_resource[b2532289-bc58-4b05-b3d9-feb68f4e2c1b]
>> succeeded in 0.005379242s: None
>>
>>
>> The feed URLs I'm using:
>>
>> CentOS 7:  http://mirror.centos.org/centos/7/os/x86_64/
>> CentOS 6:  http://mirror.centos.org/centos/6/os/x86_64/
>>
>> I'm using CentOS 7.4 (with all updates applied).  The VM has 16 GB of RAM
>> and 4 CPUs.  Pulp packages I've got installed:
>>
>> python-pulp-client-lib-2.14.1-1.el7.noarch
>> python-pulp-repoauth-2.14.1-1.el7.noarch
>> pulp-rpm-plugins-2.14.1-1.el7.noarch
>> python-isodate-0.5.0-4.pulp.el7.noarch
>> python-kombu-3.0.33-8.pulp.el7.noarch
>> pulp-selinux-2.14.1-1.el7.noarch
>> python-pulp-bindings-2.14.1-1.el7.noarch
>> python-pulp-oid_validation-2.14.1-1.el7.noarch
>> pulp-server-2.14.1-1.el7.noarch
>> python-pulp-common-2.14.1-1.el7.noarch
>> pulp-admin-client-2.14.1-1.el7.noarch
>> pulp-rpm-admin-extensions-2.14.1-1.el7.noarch
>> python-pulp-rpm-common-2.14.1-1.el7.noarch
>>
>>
>> Python is reporting 2.7.5.
>>
>>
>> About the closest I've found to this would be:
>> https://bugs.centos.org/view.php?id=13272  But the fix (noted in the
>> "Notes" section) doesn't seem to help.
>>
>> Any suggestions?
>>
>> Thanks in advance!
>> -Joe Rhodes
>>
>>
>>
>> --
>> *Confidentiality Notice: The information contained in this e-mail and any
>> attachments may be confidential. If you are not an intended recipient, you
>> are hereby notified that any dissemination, distribution or copying of
>> this
>> e-mail is strictly prohibited. If you have received this e-mail in error,
>> please notify the sender and permanently delete the e-mail and any
>> attachments immediately. You should not retain, copy or use this e-mail or
>> any attachment for any purpose, nor disclose all or any part of the
>> contents to any other person. Thank you.*
>>
>> _______________________________________________
>> Pulp-list mailing list
>> Pulp-list at redhat.com
>> https://www.redhat.com/mailman/listinfo/pulp-list
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20171012/50c3bf43/attachment.htm>


More information about the Pulp-list mailing list