[Pulp-list] pulp 3.2 rel 8 repo sync

Tatiana Tereshchenko ttereshc at redhat.com
Tue May 12 10:15:28 UTC 2020


Hi Bin,

Both look like Pulp issues to me, or at least it's worth investigating if
Pulp handles everything correctly.
With pulp_rpm 3.3.1, I was able to reproduce #1 but not #2. Could you file
a bug for #1?

If you are using pulp 3.2, consider upgrading to 3.3.1 and let us know if
you still encounter the issue #2.
There are many improvements and fixes in 3.3, including handling of
relative paths, so it's possible that you'll see it in 3.2 only.

Thank you,
Tanya

On Tue, May 12, 2020 at 3:30 AM Bin Li (BLOOMBERG/ 120 PARK) <
bli111 at bloomberg.net> wrote:

> Got two errors below to sync rel 8 repo that I haven't seen before. Are
> they related to upstream repo or it could be a pulp issue?
>
>
> 1.
> rhel-8.2-for-x86_64-appstream-source-rpms
> {
> "created_resources": [],
> "error": {
> "description": "integer out of range\n",
> "traceback": " File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/worker.py\",
> line 884, in perform_job\n rv = job.perform()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\",
> line 664, in perform\n self._result = self._execute()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\",
> line 670, in _execute\n return self.func(*self.args, **self.kwargs)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
> line 152, in synchronize\n dv.create()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py\",
> line 149, in create\n loop.run_until_complete(pipeline)\n File
> \"/opt/python/3.7.3/lib64/python3.7/asyncio/base_events.py\", line 584, in
> run_until_complete\n return future.result()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
> line 228, in create_pipeline\n await asyncio.gather(*futures)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
> line 43, in __call__\n await self.run()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
> line 219, in run\n
> RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n
> File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/models/content.py\",
> line 48, in bulk_get_or_create\n return super().bulk_create(objs,
> batch_size=batch_size)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/manager.py\",
> line 82, in manager_method\n return getattr(self.get_queryset(),
> name)(*args, **kwargs)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
> line 468, in bulk_create\n self._batched_insert(objs_with_pk, fields,
> batch_size, ignore_conflicts=ignore_conflicts)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
> line 1204, in _batched_insert\n ignore_conflicts=ignore_conflicts,\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
> line 1186, in _insert\n return
> query.get_compiler(using=using).execute_sql(return_id)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/sql/compiler.py\",
> line 1375, in execute_sql\n cursor.execute(sql, params)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
> line 67, in execute\n return self._execute_with_wrappers(sql, params,
> many=False, executor=self._execute)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
> line 76, in _execute_with_wrappers\n return executor(sql, params, many,
> context)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
> line 84, in _execute\n return self.cursor.execute(sql, params)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/utils.py\",
> line 89, in __exit__\n raise dj_exc_value.with_traceback(traceback) from
> exc_value\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
> line 84, in _execute\n return self.cursor.execute(sql, params)\n"
> },
>
> 2.
> rhel-8.2-for-x86_64-baseos-rpms
> "error": {
> "description": "No declared artifact with relative path
> \"repodata/adff8e65-8c3c-4ffb-bb72-5d4116fab7c9\" for content
> \"<RepoMetadataFile: pk=d55b4179-7423-44c2-832c-e6054a031fd3>\"",
> "traceback": " File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/worker.py\",
> line 884, in perform_job\n rv = job.perform()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\",
> line 664, in perform\n self._result = self._execute()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\",
> line 670, in _execute\n return self.func(*self.args, **self.kwargs)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
> line 152, in synchronize\n dv.create()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py\",
> line 149, in create\n loop.run_until_complete(pipeline)\n File
> \"/opt/python/3.7.3/lib64/python3.7/asyncio/base_events.py\", line 584, in
> run_until_complete\n return future.result()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
> line 228, in create_pipeline\n await asyncio.gather(*futures)\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
> line 43, in __call__\n await self.run()\n File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
> line 219, in run\n
> RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n
> File
> \"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
> line 263, in _needed_remote_artifacts\n c=d_content.content))\n"
> },
>
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20200512/e9bf23ca/attachment.htm>


More information about the Pulp-list mailing list