[vfio-users] Trying to get VFIO working on my laptop

[Nicolas Roy-Renaud]

Hard to tell what the problem is at a glance, although I believe Quadro 
cards are a special case because they are meant to be passed-through 
like that, unlike Geforce cards where the hv_vendor spoofing is more of 
a workaround to get the drivers to load even though the card being 
detected isn't supposed to work in a virtual environnement.

Could you send us the output of those commands?

$ for iommu_group in $(find /sys/kernel/iommu_groups/ -maxdepth 1 -mindepth 1 -type d); do echo "IOMMU group $(basename "$iommu_group")"; for device in $(ls -1 "$iommu_group"/devices/); do echo -n $'\t'; lspci -nns "$device"; done; done

$ lspci -s 02:00 -nnk

$ cat /proc/cmdline

$ find /sys/bus/pci/devices/*/boot_vga -print -exec cat {} \;

$ cat /etc/modprobe.d/vfio.cfg

Pretty sure that last one should be vfio.conf, BTW. The manpage for 
modprobe.d says it only checks for files ending in .conf.

Also, looking at the comments in your script, you seem to have VFIO and 
VGA arbitration (x-vga) mixed up. You can't use the two methods at the 
same time, they're mutually exclusive.

On 2016-05-08 22:35, Daurnimator wrote:
> Hi all,
>
> I'm trying to get windows working inside QEMU on my laptop with
> passthrough of my gfx card.
> However, I seem to be running getting the infamous code 43 from the
> nvidia driver.
> Screenshot of device manager: https://i.imgur.com/YA2baaW.png
> The solutions I've found online so far don't seem to help, so I'm
> posting to this list.
>
> The following is a well commented shell script of how I've progressed
> so far (latest available at
> https://gist.github.com/daurnimator/01ae36e54eeb46668696468f18c1bfef):
>
> # About
>
> ## Hardware
> ### Dell Precision M3800 laptop
> #### Quad-core processor. Supports VT-d
> #### 16GB RAM
> #### Intel onboard GFX
> #### GPU: 02:00.0 3D controller [0302]: NVIDIA Corporation GK107GLM
> [Quadro K1100M] [10de:0ff6]
>
> ## Kernel
> ### Linux 4.5.1-1-ARCH #1 SMP PREEMPT Thu Apr 14 19:19:32 CEST 2016
> x86_64 GNU/Linux
>
>
> # Setup
>
> ## Make sure Virtualisation is turned on in BIOS
>
> ## Turn on IOMMU
> ### Need to add relevant iommu option to your kernel command line
> ### e.g. in /etc/defaults/grub
> ### For intel processors, add `intel_iommu=on`
> ### This resulted in a heap of errors in my kernel log like:
> ### 'DMAR: DMAR:[DMA Read] Request device [00:02.0] fault addr 2927799'
> ### Fixed this by adding igfx_off. so a total of: `intel_iommu=on,igfx_off`
>
> ## Permissions
> ### add udev rule to tag vfio device with 'kvm' group
> ### add self to kvm group
> ### Related: http://www.evonide.com/non-root-gpu-passthrough-setup/
>
> ## I got error 'No available IOMMU models'. Had to run:
> ### Found fix via: https://bugs.launchpad.net/qemu/+bug/1529187
> sudo modprobe vfio_iommu_type1
>
> ## I got error 'VFIO_MAP_DMA cannot allocate memory'
> ### need to increase locked memory ulimit
> ### https://bugzilla.redhat.com/show_bug.cgi?id=912277
> ### edited /etc/security/limits.conf, allowed 10GB (I guess it needs
> to be more than GFX card RAM?):
> ### daurnimator     hard    memlock     10485760
> ulimit -l 10485760
>
> ## I get error 'qemu-system-x86_64: vfio-pci: Cannot read device rom
> at 0000:02:00.0'
> ### In kernel log: 'vfio-pci 0000:02:00.0: Invalid PCI ROM header
> signature: expecting 0xaa55, got 0x0000'
>
>
> # Assemble qemu args
>
> ## Q35 is a good base chipset, run `qemu-system-x86_64 -machine help`
> to get a list
> opts="$opts -machine type=q35,accel=kvm"
> ## KVM allows for faster guests
> opts="$opts -enable-kvm"
> ## Guest gets same CPU model as host (only works with KVM enabled).
> ### Don't let guest use KVM itself. Also apparently solves an issue:
> #### From https://wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF#QEMU_commands:
> #### 'kvm=off is used for NVIDIA cards to stop it detecting a
> hypervisor and therefore exiting with an error.'
> #opts="$opts -cpu host,kvm=off"
> ### Fix from http://vfio.blogspot.com/2014/08/vfiovga-faq.html?showComment=1452870650776#c3703276360523701353
> opts="$opts -cpu
> host,kvm=off,hv_time,hv_relaxed,hv_vapic,hv_spinlocks=0x1fff,hv_vendor_id=Nvidia43FIX"
> ## I have a quad core processor. let guest have 6 CPUs (3 cores with
> hyperthreading)
> opts="$opts -smp 6,sockets=1,cores=3,threads=2"
> ## I have 16GB of RAM, let guest have 8GB.
> opts="$opts -m 8G"
> ## Give guest an emulated intel sound card
> opts="$opts -soundhw hda"
> ## Give guest video card.
> ### Need to add the vendor + product to /etc/modprobe.d/vfio.cfg
> ### Pass PCI Bridge the GFX card is on.
> ### XXX: Where are docs on multifunction and x-vga options??
> #### Info on x-vga:
> http://www.firewing1.com/howtos/fedora-20/create-gaming-virtual-machine-using-vfio-pci-passthrough-kvm
> #opts="$opts -device vfio-pci,host=00:01.0,multifunction=on,x-vga=on"
> ### Then the GFX card itself
> #### If you pass x-vga=on it complains: 'vfio: Device does not support
> requested feature x-vga'
> opts="$opts -device vfio-pci,host=02:00.0,multifunction=on"
>
> ## Hard Drive
> ### Created with 'qemu-img create -f raw win.img 16G' then installed
> windows onto it
> opts="$opts -drive file=win.img,format=raw"
>
> # Start Qemu
> exec qemu-system-x86_64 $opts $*
>
> _______________________________________________
> vfio-users mailing list
> vfio-users at redhat.com
> https://www.redhat.com/mailman/listinfo/vfio-users