[rhos-list] Unable to access Swift using Keystone on reboot

[Derek Higgins]

Hi David,
   see below

On 11/05/2012 09:05 PM, David Hernandez wrote:
> OK.  I believe my problem with the "swift list" command was due to a
> problem I had with my storage devices.  The original loopback devices
> that I used weren't working properly after I rebooted.  I used the
> loopback device option outlined in the Swift Folsom preview
> documentation for my storage device.  I reconfigured my storage devices
> using HPSS VFS mount points and then tried the "swift list" command and
> it worked properly with no errors.  I then tried to upload some files to
> Swift using the following commands:
> 
> head -c 1024 /dev/urandom > data.file ; swift upload c1 data.file
> head -c 1024 /dev/urandom > data2.file ; swift upload c1 data2.file
> head -c 1024 /dev/urandom > data3.file ; swift upload c2 data2.file
> 
> I encountered errors while trying to run these commands.  It was able to
> create the containers but no the objects within the containers.
> 
> Message from syslogd at addicks at Nov  5 14:45:35 ...
>  �<131>proxy-server ERROR 500 Traceback (most recent call last):#012
>  File "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 810,
> in __call__#012    res = getattr(self, req.method)(req)#012  File
> "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in
> PUT#012    file.put(fd, tmppath, metadata)#012  File
> "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__#012  
>  self.gen.throw(type, value, traceback)#012  File
> "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 251, in
> mkstemp#012    yield fd, tmppath#012  File
> "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 604, in
> PUT#012    file.put(fd, tmppath, metadata)#012  File
> "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 275, in
> put#012    write_metadata(fd, metadata)#012  File
> "/usr/lib/python2.6/site-packages/swift/obj/server.py", line 89, in
> write_metadata#012    setxattr(fd, '%s%s' % (METADATA_KEY, key or ''),
> metastr[:254])#012IOError: [Errno 22] Invalid argument#012 From Object
> Server re: /v1/AUTH_91186334603648d78602bf5481e9393f/c2/data2.file
> 127.0.0.1:6000 (txn: tx2c8deadbd8914ca08c93af9e35c75b53)

It looks like this error is being thrown when swift is trying to write
extended attributes to the file. Can you verify that the storage device
filesystem is mounted in such a way that allows extended attributes.

I'm not familiar with HPSS VFS but if you were using ext4 you would need
to mount the filesystem with the user_xattr option e.g.
mount -o noatime,nodiratime,nobarrier,user_xattr /dev/sdb /srv/node/device1

thanks,
Derek.