[Libguestfs] The latest v2v-server 0.8.5.1 blows up

[Greg Scott]

Here's some more ugly behavior.  The P2V we started several hours ago with 0.8.5.1 looks like it's hung.  It copied most of the source server and then apparently decided to go on strike.  The diagnostic log file is empty.  

I'm going to paste in what I see from both the migration server and the Fedora 16 server hosting the NFS service.

First the migration server.  Notice the ownership on the directory in the Export domain.  The migration server shows it as nobody.nobody, while the NFS server shows it as 36.36.  What's up with that?  And then look at the permissions - that explains the Permission Denied errors.

And then because the ownership from the NFS export is somehow messed up, the NFS client / migration server seizes up and here we sit. But how/why would the ownership become messed up most of the way through it? 

[root at Fedora16-64P2V log]# df -h
Filesystem                            Size  Used Avail Use% Mounted on
rootfs                                 47G  4.4G   41G  10% /
devtmpfs                              2.0G     0  2.0G   0% /dev
tmpfs                                 2.0G   72K  2.0G   1% /dev/shm
tmpfs                                 2.0G   48M  1.9G   3% /run
/dev/mapper/vg_fedora1664p2v-lv_root   47G  4.4G   41G  10% /
tmpfs                                 2.0G   48M  1.9G   3% /run
tmpfs                                 2.0G     0  2.0G   0% /sys/fs/cgroup
tmpfs                                 2.0G     0  2.0G   0% /media
/dev/vda2                             485M   81M  379M  18% /boot
175.10.0.95:/home/RHEVexports         212G   66G  136G  33% /tmp/aR_fSTb7EL
[root at Fedora16-64P2V log]# cd /tmp/aR_fSTb7EL
[root at Fedora16-64P2V aR_fSTb7EL]# ls
f76c1443-10d8-49a0-a140-2c0a2085acbe
[root at Fedora16-64P2V aR_fSTb7EL]# cd f76c1443-10d8-49a0-a140-2c0a2085acbe
-bash: cd: f76c1443-10d8-49a0-a140-2c0a2085acbe: Permission denied
[root at Fedora16-64P2V aR_fSTb7EL]# ls -al
total 12
drwxr-xr-x.  3 nobody nobody 4096 Dec  6 04:25 .
drwxrwxrwt. 16 root   root   4096 Dec 12 15:42 ..
drwxrwx---.  6 nobody nobody 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe
[root at Fedora16-64P2V aR_fSTb7EL]# ls -al -R
.:
total 12
drwxr-xr-x.  3 nobody nobody 4096 Dec  6 04:25 .
drwxrwxrwt. 16 root   root   4096 Dec 12 15:42 ..
drwxrwx---.  6 nobody nobody 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe
ls: cannot open directory ./f76c1443-10d8-49a0-a140-2c0a2085acbe: Permission denied
[root at Fedora16-64P2V aR_fSTb7EL]#
[root at Fedora16-64P2V aR_fSTb7EL]#
[root at Fedora16-64P2V aR_fSTb7EL]# ps ax | grep p2v
 4893 ?        Ss     6:14 /usr/bin/perl /usr/bin/virt-p2v-server
 5206 pts/0    S+     0:00 grep --color=auto p2v
[root at Fedora16-64P2V aR_fSTb7EL]#

And now the NFS server hosting the Export domain:

[root at IT ~]#
[root at IT ~]# more /etc/exports
/home/RHEVexports                       *(rw)
/home/testnfs                           *(rw)
[root at IT ~]# cd /home/RHEVexports
[root at IT RHEVexports]# ls -al -R
.:
total 12
drwxr-xr-x. 3   36   36 4096 Dec  6 04:25 .
drwxr-xr-x. 7 root root 4096 Dec  7 22:19 ..
drwxrwx---. 6   36   36 4096 Dec 12 15:40 f76c1443-10d8-49a0-a140-2c0a2085acbe

./f76c1443-10d8-49a0-a140-2c0a2085acbe:
total 24
drwxrwx---. 6 36 36 4096 Dec 12 15:40 .
drwxr-xr-x. 3 36 36 4096 Dec  6 04:25 ..
drwxrwx---. 2 36 36 4096 Dec  6 11:02 dom_md
drwxrwx---. 2 36 36 4096 Dec  9 16:49 images
drwxr-x---. 4 36 36 4096 Dec  5 20:30 master
drwx------. 3 36 36 4096 Dec 12 15:40 v2v.3R3Eo5HD

./f76c1443-10d8-49a0-a140-2c0a2085acbe/dom_md:
total 16
drwxrwx---. 2 36 36       4096 Dec  6 11:02 .
drwxrwx---. 6 36 36       4096 Dec 12 15:40 ..
-rw-rw----. 1 36 36    8388608 Dec  5 20:27 ids
-rw-rw----. 1 36 36   16777216 Dec  5 20:27 inbox
-rw-rw----. 1 36 36 2147483648 Dec  6 11:02 leases
-rw-rw----. 1 36 36        393 Dec  6 11:02 metadata
-rw-rw----. 1 36 36   16777216 Dec  5 20:27 outbox

./f76c1443-10d8-49a0-a140-2c0a2085acbe/images:
total 8
drwxrwx---. 2 36 36 4096 Dec  9 16:49 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..

./f76c1443-10d8-49a0-a140-2c0a2085acbe/master:
total 16
drwxr-x---. 4 36 36 4096 Dec  5 20:30 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
drwxrwx---. 2 36 36 4096 Dec  5 20:30 tasks
drwxrwx---. 2 36 36 4096 Dec  9 16:49 vms

./f76c1443-10d8-49a0-a140-2c0a2085acbe/master/tasks:
total 8
drwxrwx---. 2 36 36 4096 Dec  5 20:30 .
drwxr-x---. 4 36 36 4096 Dec  5 20:30 ..

./f76c1443-10d8-49a0-a140-2c0a2085acbe/master/vms:
total 8
drwxrwx---. 2 36 36 4096 Dec  9 16:49 .
drwxr-x---. 4 36 36 4096 Dec  5 20:30 ..

./f76c1443-10d8-49a0-a140-2c0a2085acbe/v2v.3R3Eo5HD:
total 12
drwx------. 3 36 36 4096 Dec 12 15:40 .
drwxrwx---. 6 36 36 4096 Dec 12 15:40 ..
drwxr-xr-x. 2 36 36 4096 Dec 12 15:40 ac8f73a6-6515-4797-91a4-fd2fc4bc4f56

./f76c1443-10d8-49a0-a140-2c0a2085acbe/v2v.3R3Eo5HD/ac8f73a6-6515-4797-91a4-fd2fc4bc4f56:
total 67043348
drwxr-xr-x. 2 36 36        4096 Dec 12 15:40 .
drwx------. 3 36 36        4096 Dec 12 15:40 ..
-rw-r--r--. 1 36 36 80000000000 Dec 12 17:19 7dccc45e-a86e-4056-b567-db36786cc03e
[root at IT RHEVexports]#

I wonder if that P2V would pick back up again if I liberalized the permissions by hand?

- Greg