[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]

[Pulp-list] Errors syncing CentOS repos



Also having some Friday fun here. Two issues, one trying to sync CentOS
6.0 and another with CentOS 4.9 (don't ask).

Attaching exception errors from /var/log/pulp/pulp.log

When doing the sync in the foreground, the CentOS 6.0 sync errors out
with "error:  Exception: Cannot read from directory
/var/lib/pulp/distributions/ks-CentOS-None-6.0-x86_64"

The CentOS 4.9 sync errors out with "documents must have only string
keys, key was None"

The two commands I used to create the repos are:

pulp-admin repo create --id centos-6.0-x86_64 --name "CentOS 6.0 Base
x86_64" --gpgkeys /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-6 --arch x86_64
--feed http://mirror.cogentco.com/pub/linux/centos/6/os/x86_64/
--relativepath /centos/6/os/x86_64

and

pulp-admin repo create --id centos-4.9-x86_64 --name "CentOS 4.9 Base
x86_64" --arch x86_64 --feed
http://mirror.cogentco.com/pub/linux/centos/4/os/x86_64/ --relativepath
/centos/4/os/x86_64

I have tried using --preserve_metadata, but it didn't seem to make a
difference.

-- 
_____________________
Phil Gardner
PGP Key ID 0xFECC890C
OTR Fingerprint 6707E9B8 BD6062D3 5010FE8B 36D614E3 D2F80538

2011-11-18 21:17:34,380 13898:1133910336: pulp.server.util:INFO: util:450 started repo metadata update: ['createrepo', '--database', '--checksum', 'sha256', '--update', '/var/lib/pulp//repos/centos/4/os/x86_64']
2011-11-18 21:17:35,227 13898:1133910336: pulp.server.util:INFO: util:500 createrepo on /var/lib/pulp//repos/centos/4/os/x86_64 finished
2011-11-18 21:17:35,227 13898:1133910336: pulp.server.util:INFO: util:502 Nothing further to check; we got our fresh metadata
2011-11-18 21:17:38,726 13898:1207339328: pulp.server.webservices.controllers.repositories:INFO: repositories:801 sync timeout passed : None
2011-11-18 21:17:38,783 13898:1270278464: pulp.server.api.repo_sync:INFO: repo_sync:242 Sync invoked for repo <centos-4.9-x86_64>
2011-11-18 21:17:38,784 13898:1270278464: pulp.server.api.repo_sync:INFO: repo_sync:256 Sync of centos-4.9-x86_64 starting, skip_dict = {}
2011-11-18 21:17:38,786 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:569 cacert = <None>, cert = <None>
2011-11-18 21:17:38,786 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:617 Fetching repo to </var/lib/pulp//repos/centos/4/os/x86_64> with verify_options <{'checksum': True, 'size': True}>
2011-11-18 21:18:29,597 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:624 YumSynchronizer reported 1844 successes, 0 downloads, 0 errors
2011-11-18 21:20:48,105 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:303 No image files to import to repo..
2011-11-18 21:20:48,108 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:283 No metadata for 'File Sync' present; no files to import to repo..
2011-11-18 21:20:48,126 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:669 Running createrepo, this may take a few minutes to complete.
2011-11-18 21:20:48,127 13898:1270278464: pulp.server.util:INFO: util:467 metadata found; taking backup.
2011-11-18 21:20:48,738 13898:1270278464: pulp.server.util:INFO: util:450 started repo metadata update: ['createrepo', '--database', '--checksum', 'sha256', '-g', '/var/lib/pulp//repos/centos/4/os/x86_64/repodata/yumgroups.xml', '--update', '/var/lib/pulp//repos/centos/4/os/x86_64']
2011-11-18 21:22:42,237 13898:1270278464: pulp.server.util:INFO: util:500 createrepo on /var/lib/pulp//repos/centos/4/os/x86_64 finished
2011-11-18 21:22:42,278 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:673 Createrepo finished in 114.15101409 seconds
2011-11-18 21:22:42,284 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:254 Loading comps group info from: /var/lib/pulp//repos/centos/4/os/x86_64/repodata/yumgroups.xml
2011-11-18 21:22:42,345 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:275 Skipping errata imports from sync process
2011-11-18 21:22:42,532 13898:1270278464: pulp.server.tasking.task:ERROR: task:455 Task failed: Task be3adbc0-122a-11e1-b828-000c292e576c: _sync(centos-4.9-x86_64, synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at 0x2b69d030e210>, skip_dict={}, max_speed=None, threads=None, progress_callback=<bound method RepoSyncTask.progress_callback of <pulp.server.api.repo_sync_task.RepoSyncTask object at 0x2b69d030e990>>)
Traceback (most recent call last):
  File "/usr/lib/python2.4/site-packages/pulp/server/tasking/task.py", line 404, in run
    result = self.callable(*self.args, **self.kwargs)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line 260, in _sync
    progress_callback, synchronizer, max_speed, threads)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line 351, in fetch_content
    added_errataids = synchronizer.import_metadata(repo_dir, repo_id, skip_dict)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py", line 276, in import_metadata
    self.repo_api.collection.save(repo, safe=True)
  File "/usr/lib/python2.4/site-packages/pulp/server/db/connection.py", line 80, in retry
    return method(*args, **kwargs)
  File "/usr/lib64/python2.4/site-packages/pymongo/collection.py", line 211, in save
    manipulate, safe, **kwargs)
  File "/usr/lib/python2.4/site-packages/pulp/server/db/connection.py", line 80, in retry
    return method(*args, **kwargs)
  File "/usr/lib64/python2.4/site-packages/pymongo/collection.py", line 363, in update
    spec, document, safe, kwargs), safe)
  File "/usr/lib64/python2.4/site-packages/pymongo/message.py", line 94, in update
    data += bson.BSON.encode(doc)
  File "/usr/lib64/python2.4/site-packages/bson/__init__.py", line 462, in encode
    return cls(_dict_to_bson(document, check_keys))
InvalidDocument: documents must have only string keys, key was None
2011-11-18 21:26:06,220 13898:1207339328: pulp.server.api.keystore:INFO: keystore:200 mkdir: /var/lib/pulp//repos/centos/6/os/x86_64
2011-11-18 21:26:06,223 13898:1207339328: pulp.server.api.keystore:INFO: keystore:200 mkdir: /var/lib/pulp/published/gpg/centos/6/os/x86_64
2011-11-18 21:26:06,224 13898:1207339328: pulp.server.api.keystore:INFO: keystore:52 writing @: /var/lib/pulp//repos/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6
2011-11-18 21:26:06,227 13898:1207339328: pulp.server.api.keystore:INFO: keystore:175 linking: /var/lib/pulp/published/gpg/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6 --> /var/lib/pulp//repos/centos/6/os/x86_64/RPM-GPG-KEY-CentOS-6
2011-11-18 21:26:06,250 13898:1207339328: pulp.server.util:INFO: util:450 started repo metadata update: ['createrepo', '--database', '--checksum', 'sha256', '--update', '/var/lib/pulp//repos/centos/6/os/x86_64']
2011-11-18 21:26:07,044 13898:1207339328: pulp.server.util:INFO: util:500 createrepo on /var/lib/pulp//repos/centos/6/os/x86_64 finished
2011-11-18 21:26:07,044 13898:1207339328: pulp.server.util:INFO: util:502 Nothing further to check; we got our fresh metadata
2011-11-18 21:26:33,108 13898:1133910336: pulp.server.webservices.controllers.repositories:INFO: repositories:801 sync timeout passed : None
2011-11-18 21:26:33,159 13898:1270278464: pulp.server.api.repo_sync:INFO: repo_sync:242 Sync invoked for repo <centos-6.0-x86_64>
2011-11-18 21:26:33,160 13898:1270278464: pulp.server.api.repo_sync:INFO: repo_sync:256 Sync of centos-6.0-x86_64 starting, skip_dict = {}
2011-11-18 21:26:33,162 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:569 cacert = <None>, cert = <None>
2011-11-18 21:26:33,163 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:617 Fetching repo to </var/lib/pulp//repos/centos/6/os/x86_64> with verify_options <{'checksum': True, 'size': True}>
2011-11-18 21:29:17,321 13898:1270278464: pulp.server.api.synchronizers:INFO: synchronizers:624 YumSynchronizer reported 6022 successes, 0 downloads, 1 errors
2011-11-18 21:36:21,868 13898:1270278464: pulp.server.tasking.task:ERROR: task:455 Task failed: Task fcbefea1-122b-11e1-9f95-000c292e576c: _sync(centos-6.0-x86_64, synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at 0x2b69cee32dd0>, skip_dict={}, max_speed=None, threads=None, progress_callback=<bound method RepoSyncTask.progress_callback of <pulp.server.api.repo_sync_task.RepoSyncTask object at 0x2b69cee328d0>>)
Traceback (most recent call last):
  File "/usr/lib/python2.4/site-packages/pulp/server/tasking/task.py", line 404, in run
    result = self.callable(*self.args, **self.kwargs)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line 260, in _sync
    progress_callback, synchronizer, max_speed, threads)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/repo_sync.py", line 345, in fetch_content
    synchronizer.add_distribution_from_dir(repo_dir, repo_id, skip_dict)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py", line 229, in add_distribution_from_dir
    self._process_repo_images(dir, repo)
  File "/usr/lib/python2.4/site-packages/pulp/server/api/synchronizers.py", line 322, in _process_repo_images
    files = pulp.server.util.listdir(distro_path) or []
  File "/usr/lib/python2.4/site-packages/pulp/server/util.py", line 345, in listdir
    raise Exception("Cannot read from directory %s" % directory)
Exception: Cannot read from directory /var/lib/pulp/distributions/ks-CentOS-None-6.0-x86_64


[Date Prev][Date Next]   [Thread Prev][Thread Next]   [Thread Index] [Date Index] [Author Index]