[Freeipa-devel] [PATCH] 0488 tests: Create the testing service certificate on demand

[Jan Cholasta]

On 5.3.2014 17:38, Petr Viktorin wrote:
> Hello,
> This transforms the make-testcert command into a module that creates
> the certificate when it is first needed.
> As a result the tests are more self-contained, and can be run from
> a read-only location (such as from the freeipa-tests package).

Works for me, ACK.

>
> With 0235, 0487, and this patch, `ipa-run-tests` passes. (It logs too
> much so it doesn't look pretty, but it passes.)

I'm still getting these:

======================================================================
FAIL: test_old_permission[22]: permission_find: Search for permissions 
by attr with a limit of 1 (truncated)
----------------------------------------------------------------------
Traceback (most recent call last):
   File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in 
runTest
     self.test(*self.arg)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 291, in <lambda>
     func = lambda: self.check(nice, **test)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 309, in check
     self.check_output(nice, cmd, args, options, expected, extra_check)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 349, in check_output
     assert_deepequal(expected, got, nice)
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 344, 
in assert_deepequal
     assert_deepequal(e_sub, g_sub, doc, stack + (key,))
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 332, 
in assert_deepequal
     assert_deepequal(e_sub, g_sub, doc, stack + (i,))
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 338, 
in assert_deepequal
     doc, sorted(missing), sorted(extra), expected, got, stack
AssertionError: assert_deepequal: dict keys mismatch.
   test_old_permission[22]: permission_find: Search for permissions by 
attr with a limit of 1 (truncated)
   missing keys = ['memberindirect_role']
   extra keys = []
   expected = {'dn': ipapython.dn.DN('cn=Modify HBAC 
rule,cn=permissions,cn=pbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com'), 
'attrs': [u'servicecategory', u'sourcehostcategory', u'cn', 
u'description', u'ipaenabledflag', u'accesstime', u'usercategory', 
u'hostcategory', u'accessruletype', u'sourcehost'], 
'ipapermbindruletype': [u'permission'], 'ipapermtarget': 
[ipapython.dn.DN('ipauniqueid=*,cn=hbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com')], 
'cn': [u'Modify HBAC rule'], 'objectclass': [u'groupofnames', 
u'ipapermission', u'top', u'ipapermissionv2'], 'member_privilege': 
[u'HBAC Administrator'], 'memberindirect_role': [u'IT Security 
Specialist'], 'subtree': 
u'ldap:///dc=idm,dc=lab,dc=bos,dc=redhat,dc=com', 'permissions': [u'write']}
   got = {u'dn': u'cn=Modify SELinux User 
Maps,cn=permissions,cn=pbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com', 
u'ipapermbindruletype': (u'permission',), u'cn': (u'Modify SELinux User 
Maps',), u'ipapermtarget': 
(u'ipauniqueid=*,cn=usermap,cn=selinux,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com',), 
u'member_privilege': (u'SELinux User Map Administrators',), u'subtree': 
u'ldap:///dc=idm,dc=lab,dc=bos,dc=redhat,dc=com', u'objectclass': 
(u'ipapermission', u'top', u'groupofnames', u'ipapermissionv2'), 
u'attrs': (u'cn', u'ipaenabledflag', u'ipaselinuxuser', u'memberhost', 
u'memberuser', u'seealso'), u'permissions': (u'write',)}
   path = ('result', 0)

======================================================================
FAIL: test_permission[20]: permission_find: Search for permissions by 
attr with a limit of 1 (truncated)
----------------------------------------------------------------------
Traceback (most recent call last):
   File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in 
runTest
     self.test(*self.arg)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 291, in <lambda>
     func = lambda: self.check(nice, **test)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 309, in check
     self.check_output(nice, cmd, args, options, expected, extra_check)
   File 
"/usr/lib/python2.7/site-packages/ipatests/test_xmlrpc/xmlrpc_test.py", 
line 349, in check_output
     assert_deepequal(expected, got, nice)
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 344, 
in assert_deepequal
     assert_deepequal(e_sub, g_sub, doc, stack + (key,))
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 332, 
in assert_deepequal
     assert_deepequal(e_sub, g_sub, doc, stack + (i,))
   File "/usr/lib/python2.7/site-packages/ipatests/util.py", line 338, 
in assert_deepequal
     doc, sorted(missing), sorted(extra), expected, got, stack
AssertionError: assert_deepequal: dict keys mismatch.
   test_permission[20]: permission_find: Search for permissions by attr 
with a limit of 1 (truncated)
   missing keys = ['memberindirect_role']
   extra keys = []
   expected = {'dn': ipapython.dn.DN('cn=Modify HBAC 
rule,cn=permissions,cn=pbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com'), 
'ipapermright': [u'write'], 'ipapermtarget': 
[ipapython.dn.DN('ipauniqueid=*,cn=hbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com')], 
'cn': [u'Modify HBAC rule'], 'objectclass': [u'groupofnames', 
u'ipapermission', u'top', u'ipapermissionv2'], 'member_privilege': 
[u'HBAC Administrator'], 'ipapermlocation': 
[ipapython.dn.DN('dc=idm,dc=lab,dc=bos,dc=redhat,dc=com')], 
'memberindirect_role': [u'IT Security Specialist'], 
'ipapermbindruletype': [u'permission'], 'attrs': [u'servicecategory', 
u'sourcehostcategory', u'cn', u'description', u'ipaenabledflag', 
u'accesstime', u'usercategory', u'hostcategory', u'accessruletype', 
u'sourcehost']}
   got = {u'dn': u'cn=Modify SELinux User 
Maps,cn=permissions,cn=pbac,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com', 
u'ipapermright': (u'write',), u'ipapermbindruletype': (u'permission',), 
u'cn': (u'Modify SELinux User Maps',), u'ipapermtarget': 
(u'ipauniqueid=*,cn=usermap,cn=selinux,dc=idm,dc=lab,dc=bos,dc=redhat,dc=com',), 
u'member_privilege': (u'SELinux User Map Administrators',), 
u'objectclass': (u'ipapermission', u'top', u'groupofnames', 
u'ipapermissionv2'), u'attrs': (u'cn', u'ipaenabledflag', 
u'ipaselinuxuser', u'memberhost', u'memberuser', u'seealso'), 
u'ipapermlocation': (u'dc=idm,dc=lab,dc=bos,dc=redhat,dc=com',)}
   path = ('result', 0)

I have been getting them for quite some time now. Any idea what might be 
the cause?

-- 
Jan Cholasta