[Freeipa-users] Migrate from SunONE DS5.2 - UnicodeDecodeError

[Dmitri Pal]

On 09/21/2012 04:23 AM, Pieter Baele wrote:
> On Thu, Sep 20, 2012 at 3:49 PM, Martin Kosek <mkosek at redhat.com> wrote:
>
>> Since an Internal error was returned, there should at least be a traceback in
>> /var/log/httpd/error_log. This should help us narrow down the root cause of
>> this issue.
>>
>> Martin
>>
> Oops, I only sent to Rob.
>
> ====
>
>
> So that's temporarily copying schema from the old ldap right? Which one?
> If I can migrate this data, it's a big benefit (we've still to decide
> between FreeIPA and an OpenLDAP solution...)
>
> Thx a lot!
>
> the other errors related....
>
> [Thu Sep 20 15:02:21 2012] [error] ipa: ERROR: non-public:
> UnicodeDecodeError: 'utf8' codec can't decode byte 0xea in position
> 10: unexpected end of data
> [Thu Sep 20 15:02:21 2012] [error] Traceback (most recent call last):
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipaserver/rpcserver.py", line 320,
> in wsgi_execute
> [Thu Sep 20 15:02:21 2012] [error]     result =
> self.Command[name](*args, **options)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/frontend.py", line 438, in
> __call__
> [Thu Sep 20 15:02:21 2012] [error]     ret = self.run(*args, **options)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/frontend.py", line 716, in
> run
> [Thu Sep 20 15:02:21 2012] [error]     return self.execute(*args, **options)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/plugins/migration.py", line
> 791, in execute
> [Thu Sep 20 15:02:21 2012] [error]     ldap, config, ds_ldap,
> ds_base_dn, options
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/plugins/migration.py", line
> 635, in migrate
> [Thu Sep 20 15:02:21 2012] [error]     search_refs=True    # migrated
> DS may contain search references
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 190, in
> new_f
> [Thu Sep 20 15:02:21 2012] [error]     return f(*new_args, **kwargs)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 201, in
> new_f
> [Thu Sep 20 15:02:21 2012] [error]     return args[0].decode(f(*args, **kwargs))
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 141, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]     return tuple(self.decode(m) for m in var)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 141, in
> <genexpr>
> [Thu Sep 20 15:02:21 2012] [error]     return tuple(self.decode(m) for m in var)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 139, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]     return [self.decode(m) for m in var]
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 141, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]     return tuple(self.decode(m) for m in var)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 141, in
> <genexpr>
> [Thu Sep 20 15:02:21 2012] [error]     return tuple(self.decode(m) for m in var)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 159, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]     dct[k] = self._decode_dict_val(k, v)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 66, in
> _decode_dict_val
> [Thu Sep 20 15:02:21 2012] [error]     return self.decode(val)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 139, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]     return [self.decode(m) for m in var]
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib/python2.6/site-packages/ipalib/encoder.py", line 134, in
> decode
> [Thu Sep 20 15:02:21 2012] [error]
> var.decode(self.encoder_settings.decode_from)
> [Thu Sep 20 15:02:21 2012] [error]   File
> "/usr/lib64/python2.6/encodings/utf_8.py", line 16, in decode
> [Thu Sep 20 15:02:21 2012] [error]     return
> codecs.utf_8_decode(input, errors, True)
> [Thu Sep 20 15:02:21 2012] [error] UnicodeDecodeError: 'utf8' codec
> can't decode byte 0xea in position 10: unexpected end of data
>
> _______________________________________________
> Freeipa-users mailing list
> Freeipa-users at redhat.com
> https://www.redhat.com/mailman/listinfo/freeipa-users
It seems that we are choking on the attribute that we expected to be a
string and it is not.
But I do not see which one. Is there anything in the log that would give
a hint?

We should probably:
1) Catch such issues
2) If the attribute is optional warn and move on
3) If the attribute is required skip the user, report the error and move on

We should file a ticket about it.

-- 
Thank you,
Dmitri Pal

Sr. Engineering Manager for IdM portfolio
Red Hat Inc.


-------------------------------
Looking to carve out IT costs?
www.redhat.com/carveoutcosts/