[vfio-users] Unable to run two VMs at the same time

[David Reed]

I've successfully been able to get two VMs setup with GPU/USB pass-through
and individually they both work, but I can't run both of them at the same
time.  Virt-manager will complain that the other's PCI device (GPU) is
already in use even though they don't share the same GPU.

I suspect it is because both GPUs have the same IOMMU group that is being
assigned to the vfio driver.  I was hoping there would be some way to make
this work as they are both being controlled by vfio.

Here is my IOMMU grouping and I've attached my libvirt xmls

$ find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/17/devices/0000:07:00.0
/sys/kernel/iommu_groups/17/devices/0000:06:01.0
/sys/kernel/iommu_groups/7/devices/0000:00:1c.1
/sys/kernel/iommu_groups/15/devices/0000:04:00.0
/sys/kernel/iommu_groups/5/devices/0000:00:17.0
/sys/kernel/iommu_groups/23/devices/0000:0d:00.0
/sys/kernel/iommu_groups/13/devices/0000:00:1f.6
/sys/kernel/iommu_groups/3/devices/0000:00:14.2
/sys/kernel/iommu_groups/3/devices/0000:00:14.0
/sys/kernel/iommu_groups/21/devices/0000:06:07.0
/sys/kernel/iommu_groups/21/devices/0000:0b:00.0
/sys/kernel/iommu_groups/11/devices/0000:00:1d.4
*/sys/kernel/iommu_groups/1/devices/0000:02:00.1*
*/sys/kernel/iommu_groups/1/devices/0000:01:00.1*
*/sys/kernel/iommu_groups/1/devices/0000:00:01.2*
*/sys/kernel/iommu_groups/1/devices/0000:00:01.0*
*/sys/kernel/iommu_groups/1/devices/0000:02:00.0*
*/sys/kernel/iommu_groups/1/devices/0000:01:00.0*
/sys/kernel/iommu_groups/18/devices/0000:06:04.0
/sys/kernel/iommu_groups/8/devices/0000:00:1c.2
/sys/kernel/iommu_groups/16/devices/0000:05:00.0
/sys/kernel/iommu_groups/6/devices/0000:00:1c.0
/sys/kernel/iommu_groups/24/devices/0000:0e:00.0
/sys/kernel/iommu_groups/14/devices/0000:03:00.0
/sys/kernel/iommu_groups/4/devices/0000:00:16.0
/sys/kernel/iommu_groups/22/devices/0000:0c:00.0
/sys/kernel/iommu_groups/12/devices/0000:00:1f.3
/sys/kernel/iommu_groups/12/devices/0000:00:1f.4
/sys/kernel/iommu_groups/12/devices/0000:00:1f.2
/sys/kernel/iommu_groups/12/devices/0000:00:1f.0
/sys/kernel/iommu_groups/2/devices/0000:00:02.0
/sys/kernel/iommu_groups/20/devices/0000:0a:00.0
/sys/kernel/iommu_groups/20/devices/0000:06:06.0
/sys/kernel/iommu_groups/10/devices/0000:00:1d.0
/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/19/devices/0000:06:05.0
/sys/kernel/iommu_groups/19/devices/0000:09:00.0
/sys/kernel/iommu_groups/9/devices/0000:00:1c.4
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170210/2690b4ec/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: win10.xml
Type: text/xml
Size: 4829 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170210/2690b4ec/attachment.xml>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: steph-win10.xml
Type: text/xml
Size: 4956 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170210/2690b4ec/attachment-0001.xml>