[Pulp-list] Pulp failed sync repository

Thu May 10 19:04:26 UTC 2018

Have you retried the same sync multiple times with the same result?  Have
you tried waiting a couple hours and retrying?  I ask because that kind of
just looks like an intermittent CDN issue upstream from your Pulp
installation.

On Thu, May 10, 2018, 12:00 Thiago do Carmo Campos <
thiago.campos at selic.anbima.com.br> wrote:

> Hi,
>
>
>
> I use pulp to maintain a local repository for RHEL  6 and 7 but now I am
> having an error with time out to download the packages. Someone can help or
> some glue?
>
>
>
> Thanks for any help.
>
>
>
> Bellow logs from pulp .
>
> ------
>
> May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)
> /usr/lib/python2.7/site-packages/pulp/server/db/model/__init__.py:552:
> DeprecationWarning: update is deprecated. Use replace_one, update_one or
> update_many instead.
>
> May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)
> TaskStatus._get_collection().update({'task_id': task_id}, update,
> upsert=True)
>
> May 10 12:21:23 vx970 pulp: py.warnings:WARNING: (1245-21568)
>
> May 10 12:21:23 vx970 pulp: kombu.transport.qpid:INFO: Connected to qpid
> with SASL mechanism ANONYMOUS
>
> May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task:
> pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74]
>
> May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task:
> pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff]
>
> May 10 12:21:23 vx970 pulp: celery.worker.strategy:INFO: Received task:
> pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5]
>
> May 10 12:21:23 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Downloading metadata from
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/
> .
>
> May 10 12:21:23 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (1): cdn.redhat.com
>
> May 10 12:21:23 vx970 pulp: celery.worker.job:INFO: Task
> pulp.server.async.tasks._queue_reserved_task[e5127b6a-d1e3-472c-b547-0b13a2908a74]
> succeeded in 0.0366941479997s: None
>
> May 10 12:21:23 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml
> .
>
> May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Parsing metadata.
>
> May 10 12:21:24 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Downloading metadata from
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/
> .
>
> May 10 12:21:24 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (1): cdn.redhat.com
>
> May 10 12:21:24 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml
> .
>
> May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Parsing metadata.
>
> May 10 12:21:25 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Downloading metadata from
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/
> .
>
> May 10 12:21:25 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (1): cdn.redhat.com
>
> May 10 12:21:26 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml
> .
>
> May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Parsing metadata.
>
> May 10 12:21:27 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Downloading metadata from
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/
> .
>
> May 10 12:21:27 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (1): cdn.redhat.com
>
> May 10 12:21:27 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/repomd.xml
> .
>
> May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Parsing metadata.
>
> May 10 12:21:28 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:INFO:
> [09dada05] Downloading metadata files.
>
> May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (2): cdn.redhat.com
>
> May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (3): cdn.redhat.com
>
> May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (4): cdn.redhat.com
>
> May 10 12:21:28 vx970 pulp: requests.packages.urllib3.connectionpool:INFO:
> Starting new HTTPS connection (5): cdn.redhat.com
>
> May 10 12:21:28 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/d46c1308bf90b73c5123ea340514e7cfddeb3e06-comps.xml
> .
>
> May 10 12:21:29 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/productid
> .
>
> May 10 12:21:31 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/7879810250e308b7fb4cce9645f74b836050f071-primary.xml.gz
> .
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816) HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read
> timed out.
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816) Traceback (most recent call last):
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)   File
> "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line
> 292, in _fetch
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)     for chunk in chunks:
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)   File
> "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line
> 226, in chunk_generator
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)     chunk = raw.read(chunk_size)
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)   File "/usr/lib/python2.7/site-packages/urllib3/response.py",
> line 227, in read
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
>
> May 10 12:22:37 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-86816) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com',
> port=443): Read timed out.
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760) HTTPSConnectionPool(host='cdn.redhat.com', port=443): Read
> timed out.
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760) Traceback (most recent call last):
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)   File
> "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line
> 292, in _fetch
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)     for chunk in chunks:
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)   File
> "/usr/lib/python2.7/site-packages/nectar/downloaders/threaded.py", line
> 226, in chunk_generator
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)     chunk = raw.read(chunk_size)
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)   File "/usr/lib/python2.7/site-packages/urllib3/response.py",
> line 227, in read
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760)     raise ReadTimeoutError(self._pool, None, 'Read timed out.')
>
> May 10 12:23:32 vx970 pulp: nectar.downloaders.threaded:ERROR:
> (1647-73760) ReadTimeoutError: HTTPSConnectionPool(host='cdn.redhat.com',
> port=443): Read timed out.
>
> May 10 12:23:54 vx970 pulp: nectar.downloaders.threaded:INFO: Download
> succeeded:
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/optional/os/repodata/55ce83e2be7f88021ddd30e159afa13d33a9eb811833f24ae23fe891133dc297-updateinfo.xml.gz
> .
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320) HTTPSConnectionPool(host='cdn.redhat.com',
> port=443): Read timed out.
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320) Traceback (most recent call last):
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)   File
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py",
> line 262, in run
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)     metadata_files =
> self.get_metadata(metadata_files)
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)   File
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py",
> line 449, in get_metadata
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)     metadata_files.download_metadata_files()
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)   File
> "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py",
> line 217, in download_metadata_files
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320)     raise IOError(error_report.error_msg)
>
> May 10 12:23:54 vx970 pulp: pulp_rpm.plugins.importers.yum.sync:ERROR:
> [09dada05] (1647-64320) IOError: HTTPSConnectionPool(host='cdn.redhat.com',
> port=443): Read timed out.
>
> May 10 12:23:54 vx970 pulp: pulp.server.async.tasks:INFO: [09dada05] Task
> failed : [09dada05-795b-4882-b5c5-76e19d269bff]
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320) Task
> pulp.server.managers.repo.sync.sync[09dada05-795b-4882-b5c5-76e19d269bff]
> raised unexpected: PulpExecutionException('Importer indicated a failed
> response',)
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> Traceback (most recent call last):
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File
> "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in
> trace_task
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)     R =
> retval = fun(*args, **kwargs)
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File
> "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in
> __call__
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> return super(Task, self).__call__(*args, **kwargs)
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File
> "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in
> __call__
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> return super(PulpTask, self).__call__(*args, **kwargs)
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File
> "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in
> __protected_call__
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> return self.run(*args, **kwargs)
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)   File
> "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py",
> line 827, in sync
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> raise pulp_exceptions.PulpExecutionException(_('Importer indicated a failed
> response'))
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:ERROR: (1180-64320)
> PulpExecutionException: Importer indicated a failed response
>
> May 10 12:23:54 vx970 pulp: celery.worker.job:INFO: Task
> pulp.server.async.tasks._release_resource[0099037d-4f12-4dbd-9ae5-6580ab0556f5]
> succeeded in 0.0047866509999s: None
>
>
>
> Regards,
>
>
>
> Thiago Campos
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20180510/751daa0b/attachment.htm>