[Pulp-list] pulp failing to sync CentOS 6 and CentOS 7 base repos

Kodiak Firesmith kfiresmith at gmail.com
Thu Oct 12 13:21:15 UTC 2017 

This smells like an ascii/unicode issue with the repoview creation portion
of your sync.  I would turn off repoview and file an issue if one isn't
already in place for this problem.
 - Kodiak

On Thu, Oct 12, 2017 at 8:32 AM, Joe Rhodes <jrhodes at fuze.com> wrote:

> I'm running into an issue when trying to sync the CentOS 6 and CentOS 7
> base repos to a newly build pulp server.  Repo view dies with:
>
> Generating HTML files
> [/]
>
> Task Failed
>
> 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in
> range(128)
>
>
> Sometimes I can delete the repo and re-create it, in which case it will
> work.  But I haven't figured out why it's happening.
>
> >From /var/log/messages:
>
> Writing package cdparanoia-devel.html\nWriting package
> cdparanoia-libs.html\n\n::\nTraceback (most recent call last):\n  File
> "/usr/bin/repoview", line 940, in <module>\n    main()\n  File
> "/usr/bin/repoview", line 937, in main\n    Repoview(opts)\n  File
> "/usr/bin/repoview", line 191, in __init__\n    packages =
> self.do_packages(repo_data, group_data, pkgnames)\n  File
> "/usr/bin/repoview", line 544, in do_packages\n    pkg_data =
> self.get_package_data(pkgname)\n  File "/usr/bin/repoview", line 442, in
> get_package_data\n    rows = pcursor.fetchall()\nsqlite3.OperationalError:
> Could not decode to UTF-8 column \'location_href\' with text
> \'\xc0\xb9\'\n', 79012, 79013, 'ordinal not in range(128)')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368) Traceback (most recent call last):
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py",
> line 240, in trace_task
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     R = retval = fun(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
> line 529, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return super(Task, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
> line 107, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return super(PulpTask, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py",
> line 438, in __protected_call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return self.run(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1106, in publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     result = check_publish(repo_obj, dist_id, dist_inst,
> transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1200, in check_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     result = _do_publish(repo_obj, dist_id, dist_inst,
> transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 1252, in _do_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     publish_report = publish_repo(transfer_repo, conduit,
> call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
> line 732, in wrap_f
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return f(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/
> distributors/yum/distributor.py", line 174, in publish_repo
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return self._publisher.process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 572, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     super(PluginStep, self).process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 163, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     step.process()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 271, in process
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     self._record_failure(e, tb)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py",
> line 402, in _record_failure
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     error_details['error'] = str(e)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/exceptions.py",
> line 96, in __str__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368)     return msg.encode('utf-8')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR:
> (16183-94368) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc0 in
> position 79012: ordinal not in range(128)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:INFO: Task
> pulp.server.async.tasks._release_resource[b2532289-bc58-4b05-b3d9-feb68f4e2c1b]
> succeeded in 0.005379242s: None
>
>
> The feed URLs I'm using:
>
> CentOS 7:  http://mirror.centos.org/centos/7/os/x86_64/
> CentOS 6:  http://mirror.centos.org/centos/6/os/x86_64/
>
> I'm using CentOS 7.4 (with all updates applied).  The VM has 16 GB of RAM
> and 4 CPUs.  Pulp packages I've got installed:
>
> python-pulp-client-lib-2.14.1-1.el7.noarch
> python-pulp-repoauth-2.14.1-1.el7.noarch
> pulp-rpm-plugins-2.14.1-1.el7.noarch
> python-isodate-0.5.0-4.pulp.el7.noarch
> python-kombu-3.0.33-8.pulp.el7.noarch
> pulp-selinux-2.14.1-1.el7.noarch
> python-pulp-bindings-2.14.1-1.el7.noarch
> python-pulp-oid_validation-2.14.1-1.el7.noarch
> pulp-server-2.14.1-1.el7.noarch
> python-pulp-common-2.14.1-1.el7.noarch
> pulp-admin-client-2.14.1-1.el7.noarch
> pulp-rpm-admin-extensions-2.14.1-1.el7.noarch
> python-pulp-rpm-common-2.14.1-1.el7.noarch
>
>
> Python is reporting 2.7.5.
>
>
> About the closest I've found to this would be:
> https://bugs.centos.org/view.php?id=13272  But the fix (noted in the
> "Notes" section) doesn't seem to help.
>
> Any suggestions?
>
> Thanks in advance!
> -Joe Rhodes
>
>
>
> --
> *Confidentiality Notice: The information contained in this e-mail and any
> attachments may be confidential. If you are not an intended recipient, you
> are hereby notified that any dissemination, distribution or copying of this
> e-mail is strictly prohibited. If you have received this e-mail in error,
> please notify the sender and permanently delete the e-mail and any
> attachments immediately. You should not retain, copy or use this e-mail or
> any attachment for any purpose, nor disclose all or any part of the
> contents to any other person. Thank you.*
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20171012/ff41e647/attachment.htm>

More information about the Pulp-list mailing list