[et-mgmt-tools] virt-install pxeboot issues

Brendan Wood bwood at responsys.com
Sat Nov 10 06:24:58 UTC 2007


Hello all,

I'm working on trying to build hvm xen guests based on our kickstart
servers, but it seems to be failing. I'm using CentOS 5, running kernel
2.6.18-8.1.15.el5.centos.plusxen and the xen 3.0.3-25.0.4.el5 rpm. I built
libvirt 0.3.3 and python-virtinst 0.300.1 in order to test the pxeboot
setup, but virt-install errors out and xm list shows the guest still
running, but state is just '------' and Time is '0.0'. Shutting it down and
creating it again causes it to shutdown immediately.

I have a feeling the issue is that my xen install isn't new enough to
support it. The qemu-dm log file says "qemu: invalid boot device in 'n'",
which makes me think that network booting isn't actually set up in my
installed version of qemu-dm. I just want to check to make sure it's not
something else before I go and backport xen 3.1 into the kernel rpm in
order to get the right qemu-dm binary.

I'm including the virt-install output as well as the xend.log and
relevant /var/log/messages entries. The xend-debug.log and xen-hotplug
didn't give any errors.

If anyone sees anything I've done wrong, would like more information, or
can give me general input on getting fully virtualized xen guests to
kickstart from pxeboot (or something similar), just let me know. I'd
really appreciate it.

Thanks,

Brendan Wood

---

Here is the command line I used and the resulting errors:

[root at molotov bwood]# virt-install --hvm --name xen-test2 --ram 512 --file
/space/xen/xen-test2.img --file-size 10  --vnc --mac 00:50:56:00:FF:02
--network bridge:xenbr0 --pxe
libvir: error : configuration file syntax error: expecting an assignment
libvir: error : configuration file syntax error: expecting an assignment
libvir: error : configuration file syntax error: expecting an assignment
libvir: error : configuration file syntax error: expecting an assignment


Starting install...
libvir: Xen error : Domain not found: xenUnifiedDomainLookupByUUID
libvir: Xen error : Domain not found: xenUnifiedDomainLookupByName
Creating storage file...  100% |=========================|  10 GB    00:00
Creating domain...                                                 0 B
00:00
[Errno 2] No such file or directory
Domain installation may not have been
 successful.  If it was, you can restart your domain
 by running 'virsh start xen-test2'; otherwise, please
 restart your installation.
Fri, 09 Nov 2007 16:19:50 ERROR    [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/usr/bin/virt-install", line 485, in ?
    main()
  File "/usr/bin/virt-install", line 449, in main
    dom = guest.start_install(conscb,progresscb)
  File "/usr/lib/python2.4/site-packages/virtinst/Guest.py", line 724, in
start_install
    return self._do_install(consolecb, meter)
  File "/usr/lib/python2.4/site-packages/virtinst/Guest.py", line 767, in
_do_install
    child = consolecb(self.domain)
  File "/usr/bin/virt-install", line 429, in show_console
    return vnc_console(dom, options.connect)
  File "/usr/bin/virt-install", line 314, in vnc_console
    os.execvp(args[0], args)
  File "/usr/lib64/python2.4/os.py", line 341, in execvp
    _execvpe(file, args)
  File "/usr/lib64/python2.4/os.py", line 367, in _execvpe
    func(file, *argrest)
OSError: [Errno 2] No such file or directory
Domain installation still in progress.  You can reconnect to
the console to complete the installation process.
libvir: Remote error : connection not open

Here's what /var/log/messages had to say at that point:

Nov  9 16:19:50 molotov kernel: device vif50.0 entered promiscuous mode
Nov  9 16:19:50 molotov kernel: ADDRCONF(NETDEV_UP): vif50.0: link is not ready

This is what shows up in /var/log/xen/xend.log:

[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:190) XendDomainInfo.create(['vm', ['name', 'xen-test2'], ['memory', '512'], ['maxmem', '512'], ['vcpus', '1'], ['uuid', '78ded68c-914b-a55d-7efc-53aa4a8ad0f0'], ['on_poweroff', 'destroy'], ['on_reboot', 'destroy'], ['on_crash', 'destroy'], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['vcpus', '1'], ['boot', 'n'], ['pae', '1'], ['usb', '1'], ['serial', 'pty'], ['vnc', '1'], ['vncunused', '1']]], ['device', ['vbd', ['dev', 'hda:disk'], ['uname', 'file:/space/xen/xen-test2.img'], ['mode', 'w']]], ['device', ['vif', ['mac', '00:50:56:00:FF:02'], ['bridge', 'xenbr0'], ['type', 'ioemu']]]])
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:296) parseConfig: config is ['vm', ['name', 'xen-test2'], ['memory', '512'], ['maxmem', '512'], ['vcpus', '1'], ['uuid', '78ded68c-914b-a55d-7efc-53aa4a8ad0f0'], ['on_poweroff', 'destroy'], ['on_reboot', 'destroy'], ['on_crash', 'destroy'], ['image', ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['vcpus', '1'], ['boot', 'n'], ['pae', '1'], ['usb', '1'], ['serial', 'pty'], ['vnc', '1'], ['vncunused', '1']]], ['device', ['vbd', ['dev', 'hda:disk'], ['uname', 'file:/space/xen/xen-test2.img'], ['mode', 'w']]], ['device', ['vif', ['mac', '00:50:56:00:FF:02'], ['bridge', 'xenbr0'], ['type', 'ioemu']]]]
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:397) parseConfig: result is {'shadow_memory': None, 'start_time': None, 'uuid': '78ded68c-914b-a55d-7efc-53aa4a8ad0f0', 'on_crash': 'destroy', 'on_reboot': 'destroy', 'localtime': None, 'image': ['hvm', ['kernel', '/usr/lib/xen/boot/hvmloader'], ['device_model', '/usr/lib64/xen/bin/qemu-dm'], ['vcpus', '1'], ['boot', 'n'], ['pae', '1'], ['usb', '1'], ['serial', 'pty'], ['vnc', '1'], ['vncunused', '1']], 'on_poweroff': 'destroy', 'bootloader_args': None, 'cpus': None, 'name': 'xen-test2', 'backend': [], 'vcpus': 1, 'cpu_weight': None, 'features': None, 'vcpu_avail': None, 'memory': 512, 'device': [('vbd', ['vbd', ['dev', 'hda:disk'], ['uname', 'file:/space/xen/xen-test2.img'], ['mode', 'w']]), ('vif', ['vif', ['mac', '00:50:56:00:FF:02'], ['bridge', 'xenbr0'], ['type', 'ioemu']])], 'bootloader': None, 'cpu': None, 'maxmem': 512}
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:1264) XendDomainInfo.construct: None
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:1296) XendDomainInfo.initDomain: 50 1.0
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: boot, val: n
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: fda, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: fdb, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: soundhw, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: localtime, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: serial, val: pty
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: std-vga, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: isa, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: vcpus, val: 1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: acpi, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: usb, val: 1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: usbdevice, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (image:329) args: k, val: None
[2007-11-09 16:19:50 xend 25184] DEBUG (balloon:127) Balloon: 542352 KiB free; need 541904; done.
[2007-11-09 16:19:50 xend 25184] INFO (image:136) buildDomain os=hvm dom=50 vcpus=1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:282) dom            = 50
[2007-11-09 16:19:50 xend 25184] DEBUG (image:283) image          = /usr/lib/xen/boot/hvmloader
[2007-11-09 16:19:50 xend 25184] DEBUG (image:284) store_evtchn   = 1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:285) memsize        = 512
[2007-11-09 16:19:50 xend 25184] DEBUG (image:286) vcpus          = 1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:287) pae            = 1
[2007-11-09 16:19:50 xend 25184] DEBUG (image:288) acpi           = 0
[2007-11-09 16:19:50 xend 25184] DEBUG (image:289) apic           = 0
[2007-11-09 16:19:50 xend 25184] DEBUG (image:435) hvm shutdown watch registered
[2007-11-09 16:19:50 xend 25184] DEBUG (blkif:24) exception looking up device number for hda: [Errno 2] No such file or directory: '/dev/hda'
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '768', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/50/768'} to /local/domain/50/device/vbd/768.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:112) DevController: writing {'domain': 'xen-test2', 'frontend': '/local/domain/50/device/vbd/768', 'dev': 'hda', 'state': '1', 'params': '/space/xen/xen-test2.img', 'mode': 'w', 'online': '1', 'frontend-id': '50', 'type': 'file'} to /local/domain/0/backend/vbd/50/768.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:110) DevController: writing {'state': '1', 'backend-id': '0', 'backend': '/local/domain/0/backend/vif/50/0'} to /local/domain/50/device/vif/0.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:112) DevController: writing {'bridge': 'xenbr0', 'domain': 'xen-test2', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': '/local/domain/50/device/vif/0', 'mac': '00:50:56:00:FF:02', 'online': '1', 'frontend-id': '50', 'type': 'ioemu'} to /local/domain/0/backend/vif/50/0.
[2007-11-09 16:19:50 xend 25184] INFO (image:418) spawning device models: /usr/lib64/xen/bin/qemu-dm ['/usr/lib64/xen/bin/qemu-dm', '-d', '50', '-m', '512', '-boot', 'n', '-serial', 'pty', '-vcpus', '1', '-usb', '-domain-name', 'xen-test2', '-net', 'nic,vlan=1,macaddr=00:50:56:00:FF:02,model=rtl8139', '-net', 'tap,vlan=1,bridge=xenbr0', '-vncunused', '-vnclisten', '0.0.0.0']
[2007-11-09 16:19:50 xend 25184] INFO (image:420) device model pid: 25263
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:715) Storing VM details: {'shadow_memory': '4', 'uuid': '78ded68c-914b-a55d-7efc-53aa4a8ad0f0', 'on_reboot': 'destroy', 'start_time': '1194653990.15', 'on_poweroff': 'destroy', 'name': 'xen-test2', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '512', 'on_crash': 'destroy', 'image': '(hvm (kernel /usr/lib/xen/boot/hvmloader) (device_model /usr/lib64/xen/bin/qemu-dm) (vcpus 1) (boot n) (pae 1) (usb 1) (serial pty) (vnc 1) (vncunused 1))', 'maxmem': '512'}
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:750) Storing domain details: {'console/port': '2', 'name': 'xen-test2', 'console/limit': '1048576', 'vm': '/vm/78ded68c-914b-a55d-7efc-53aa4a8ad0f0', 'domid': '50', 'cpu/0/availability': 'online', 'memory/target': '524288', 'store/ring-ref': '177173', 'store/port': '1'}
[2007-11-09 16:19:50 xend 25184] DEBUG (image:458) hvm_shutdown fired, shutdown reason=None
[2007-11-09 16:19:50 xend.XendDomainInfo 25184] DEBUG (XendDomainInfo:940) XendDomainInfo.handleShutdownWatch
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices vif.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:149) Waiting for 0.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/50/0/hotplug-status.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vif/50/0/hotplug-status.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:485) hotplugStatusCallback 1.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices usb.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices vbd.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:149) Waiting for 768.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:471) hotplugStatusCallback /local/domain/0/backend/vbd/50/768/hotplug-status.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:485) hotplugStatusCallback 1.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices irq.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices vkbd.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices vfb.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices pci.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices ioports.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices tap.
[2007-11-09 16:19:50 xend 25184] DEBUG (DevController:143) Waiting for devices vtpm.
[2007-11-09 16:19:50 xend 25184] INFO (XendDomain:370) Domain xen-test2 (50) unpaused.




More information about the et-mgmt-tools mailing list