[vfio-users] RX 480 vga passthrough 3D mode host hangs
Jiri Novak
jiri.novak at ghorland.net
Fri Aug 25 00:40:44 UTC 2017
Hi,
just tried clean install of a ovmf VM and still, it kills the host :(
what is your distro? maybe there's some different default in debian, or
some other incompatibilty. or maybe some HW incompatibility, I'm running
out of ideas :(
Gh.
Nick S wrote:
> I can confirm that it works with no issues with UEFI. I recently
> replaced R9 270 by RX 480 and it even worked with not issues after I
> forgot to update/remove the old ROM file for R9. Here is my command
> line. It uses a few variables for multiple GPU but you should get the
> base picture. I have both Windows 7 and WIndows 10 VMs and all of them
> work fine.
>
> qemu-system-x86_64 -enable-kvm -cpu host -m $memoryarg -smp
> sockets=1,cores=$corearg,threads=2 \
> -serial none \
> -ctrl-grab -no-quit \
> -parallel none \
> $soundarg \
> -name passthrough-$1 \
> -rtc base=localtime \
> -drive if=pflash,format=raw,readonly,file=$folder/OVMF_CODE-pure-efi.fd \
> -drive if=pflash,format=raw,file=$folder/OVMF_VARS-pure-efi.fd \
> -netdev bridge,id=hn0 -device e1000,netdev=hn0,id=nic1,mac=$macaddr \
> -drive file=$folder/W7_UEFI.qcow2,id=d0,if=none -device
> ide-hd,drive=d0,serial=$hddserial \
> -device vfio-pci,host=$vgapci \
> -device vfio-pci,host=$audiopci
>
>
> On Tue, Aug 22, 2017 at 8:22 AM, Quentin Deldycke
> <quentindeldycke at gmail.com <mailto:quentindeldycke at gmail.com>> wrote:
>
> Hi,
>
> Ovmf makes the process more easy. I don't remember exactly why,
> but before i was using a AMD HD 5870. Using old style bioses as it
> was not uefi. When i switched to the r9 290, i had to switch to
> uefi so ovmf.
>
> I experienced issues with the integrated sound card of my r9 (was
> all time default on windows...). I have the sound device linked to
> vfio-pci but never pass it to the virtual machine, you can
> possibly try like this also.
>
> For a more easy process i never disable the intergrated intel gpu
> of my cpu. It used plain old vga for bios post and cie.
>
>
>
> --
> Deldycke Quentin
>
>
> On 22 August 2017 at 16:57, Jiri Novak <jiri.novak at ghorland.net
> <mailto:jiri.novak at ghorland.net>> wrote:
>
> Hi,
>
> yes, not using OVMF, maybe that will fix it, not sure, I can try.
> I don't have any R9 card, I actually did have one before, but
> now I have R7 240 and RX 480 at hand. R9 did work fine before,
> like the R7 does.
> I pass in two (three) devices, one is the card (plus the
> integrated soundcard, you can't pass it without, right? it's
> the same iommu group always) and a USB controller to be able
> to connect kb+mouse.
> for the RX, the romfile has no effect obviously, though for
> the R7 it won't start without it (R9 didn't care either).
> no isolation so far, just taskset so it won't roam across numa
> nodes. might add later.
>
> my boot card is nvidia, so I have radeon and amdgpu
> blacklisted. also tried disabling "boot option rom" on the
> pcie ports so bios of the host doesn't try to initialize them.
> doesn't have effect, except that if it is allowed and the
> order of the cards is that amd is sooner, boot display will go
> to it. if disabled, it will go to the nvidia (I keep that one
> enabled at all cases, if I disable all, I'm doomed - bios
> reset needeed :))
>
> I think my only chance now is ovmf, I have no other idea.
>
> lspci for reference:
>
> 00:00.0 Host bridge: Intel Corporation Xeon E5/Core i7 DMI2
> (rev 07)
> 00:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 1a (rev 07)
> 00:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 2a (rev 07)
> 00:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 3a in PCI Express Mode (rev 07)
> 00:04.0 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 0 (rev 07)
> 00:04.1 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 1 (rev 07)
> 00:04.2 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 2 (rev 07)
> 00:04.3 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 3 (rev 07)
> 00:04.4 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 4 (rev 07)
> 00:04.5 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 5 (rev 07)
> 00:04.6 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 6 (rev 07)
> 00:04.7 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 7 (rev 07)
> 00:05.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Address Map, VTd_Misc, System Management (rev 07)
> 00:05.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Control Status and Global Errors (rev 07)
> 00:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07)
> 00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset
> PCI Express Virtual Root Port (rev 06)
> 00:16.0 Communication controller: Intel Corporation C600/X79
> series chipset MEI Controller #1 (rev 05)
> 00:16.1 Communication controller: Intel Corporation C600/X79
> series chipset MEI Controller #2 (rev 05)
> 00:1a.0 USB controller: Intel Corporation C600/X79 series
> chipset USB2 Enhanced Host Controller #2 (rev 06)
> 00:1b.0 Audio device: Intel Corporation C600/X79 series
> chipset High Definition Audio Controller (rev 06)
> 00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset
> PCI Express Root Port 1 (rev b6)
> 00:1c.5 PCI bridge: Intel Corporation C600/X79 series chipset
> PCI Express Root Port 6 (rev b6)
> 00:1c.6 PCI bridge: Intel Corporation C600/X79 series chipset
> PCI Express Root Port 7 (rev b6)
> 00:1d.0 USB controller: Intel Corporation C600/X79 series
> chipset USB2 Enhanced Host Controller #1 (rev 06)
> 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a6)
> 00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset
> LPC Controller (rev 06)
> 00:1f.2 SATA controller: Intel Corporation C600/X79 series
> chipset 6-Port SATA AHCI Controller (rev 06)
> 00:1f.3 SMBus: Intel Corporation C600/X79 series chipset SMBus
> Host Controller (rev 06)
> 00:1f.6 Signal processing controller: Intel Corporation
> C600/X79 series chipset Thermal Management Controller (rev 06)
> 01:00.0 Serial Attached SCSI controller: LSI Logic / Symbios
> Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
> 02:00.0 VGA compatible controller: Advanced Micro Devices,
> Inc. [AMD/ATI] Ellesmere [Radeon RX 470/480] (rev c7)
> 02:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI]
> Device aaf0
> 03:00.0 VGA compatible controller: Advanced Micro Devices,
> Inc. [AMD/ATI] Oland [Radeon HD 8570 / R7 240/340 OEM]
> 03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI]
> Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
> 04:00.0 Serial Attached SCSI controller: Intel Corporation
> C602 chipset 4-Port SATA Storage Control Unit (rev 06)
> 05:00.0 Ethernet controller: Intel Corporation I350 Gigabit
> Network Connection (rev 01)
> 05:00.1 Ethernet controller: Intel Corporation I350 Gigabit
> Network Connection (rev 01)
> 07:00.0 USB controller: NEC Corporation uPD720200 USB 3.0 Host
> Controller (rev 04)
> 08:00.0 USB controller: NEC Corporation uPD720200 USB 3.0 Host
> Controller (rev 04)
> 09:02.0 FireWire (IEEE 1394): Texas Instruments TSB43AB22A
> IEEE-1394a-2000 Controller (PHY/Link) [iOHCI-Lynx]
> 7f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link 0 (rev 07)
> 7f:08.3 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 0 (rev 07)
> 7f:08.4 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 0 (rev 07)
> 7f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link 1 (rev 07)
> 7f:09.3 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 1 (rev 07)
> 7f:09.4 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 1 (rev 07)
> 7f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 0 (rev 07)
> 7f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 1 (rev 07)
> 7f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 2 (rev 07)
> 7f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 3 (rev 07)
> 7f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Interrupt Control Registers (rev 07)
> 7f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Semaphore and Scratchpad Configuration Registers (rev 07)
> 7f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller System Address Decoder 0 (rev 07)
> 7f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7
> System Address Decoder (rev 07)
> 7f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> 7f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller System Address Decoder 1 (rev 07)
> 7f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Processor Home Agent (rev 07)
> 7f:0e.1 Performance counters: Intel Corporation Xeon E5/Core
> i7 Processor Home Agent Performance Monitoring (rev 07)
> 7f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Registers (rev 07)
> 7f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller RAS Registers (rev 07)
> 7f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 0 (rev 07)
> 7f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 1 (rev 07)
> 7f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 2 (rev 07)
> 7f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 3 (rev 07)
> 7f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 4 (rev 07)
> 7f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 0
> (rev 07)
> 7f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 1
> (rev 07)
> 7f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 0 (rev 07)
> 7f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 1 (rev 07)
> 7f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 2
> (rev 07)
> 7f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 3
> (rev 07)
> 7f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 2 (rev 07)
> 7f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 3 (rev 07)
> 7f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7
> DDRIO (rev 07)
> 7f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7
> R2PCIe (rev 07)
> 7f:13.1 Performance counters: Intel Corporation Xeon E5/Core
> i7 Ring to PCI Express Performance Monitor (rev 07)
> 7f:13.4 Performance counters: Intel Corporation Xeon E5/Core
> i7 QuickPath Interconnect Agent Ring Registers (rev 07)
> 7f:13.5 Performance counters: Intel Corporation Xeon E5/Core
> i7 Ring to QuickPath Interconnect Link 0 Performance Monitor
> (rev 07)
> 7f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)
> 80:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 1a (rev 07)
> 80:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 2a (rev 07)
> 80:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 3a in PCI Express Mode (rev 07)
> 80:03.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI
> Express Root Port 3c (rev 07)
> 80:04.0 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 0 (rev 07)
> 80:04.1 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 1 (rev 07)
> 80:04.2 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 2 (rev 07)
> 80:04.3 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 3 (rev 07)
> 80:04.4 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 4 (rev 07)
> 80:04.5 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 5 (rev 07)
> 80:04.6 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 6 (rev 07)
> 80:04.7 System peripheral: Intel Corporation Xeon E5/Core i7
> DMA Channel 7 (rev 07)
> 80:05.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Address Map, VTd_Misc, System Management (rev 07)
> 80:05.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Control Status and Global Errors (rev 07)
> 80:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07)
> 82:00.0 VGA compatible controller: NVIDIA Corporation G98
> [Quadro NVS 295] (rev a1)
> ff:08.0 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link 0 (rev 07)
> ff:08.3 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 0 (rev 07)
> ff:08.4 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 0 (rev 07)
> ff:09.0 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link 1 (rev 07)
> ff:09.3 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 1 (rev 07)
> ff:09.4 System peripheral: Intel Corporation Xeon E5/Core i7
> QPI Link Reut 1 (rev 07)
> ff:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 0 (rev 07)
> ff:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 1 (rev 07)
> ff:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 2 (rev 07)
> ff:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Power Control Unit 3 (rev 07)
> ff:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Interrupt Control Registers (rev 07)
> ff:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Semaphore and Scratchpad Configuration Registers (rev 07)
> ff:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0c.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller System Address Decoder 0 (rev 07)
> ff:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7
> System Address Decoder (rev 07)
> ff:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0d.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Unicast Register 0 (rev 07)
> ff:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller System Address Decoder 1 (rev 07)
> ff:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Processor Home Agent (rev 07)
> ff:0e.1 Performance counters: Intel Corporation Xeon E5/Core
> i7 Processor Home Agent Performance Monitoring (rev 07)
> ff:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Registers (rev 07)
> ff:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller RAS Registers (rev 07)
> ff:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 0 (rev 07)
> ff:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 1 (rev 07)
> ff:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 2 (rev 07)
> ff:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 3 (rev 07)
> ff:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Target Address Decoder 4 (rev 07)
> ff:10.0 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 0
> (rev 07)
> ff:10.1 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 1
> (rev 07)
> ff:10.2 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 0 (rev 07)
> ff:10.3 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 1 (rev 07)
> ff:10.4 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 2
> (rev 07)
> ff:10.5 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller Channel 0-3 Thermal Control 3
> (rev 07)
> ff:10.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 2 (rev 07)
> ff:10.7 System peripheral: Intel Corporation Xeon E5/Core i7
> Integrated Memory Controller ERROR Registers 3 (rev 07)
> ff:11.0 System peripheral: Intel Corporation Xeon E5/Core i7
> DDRIO (rev 07)
> ff:13.0 System peripheral: Intel Corporation Xeon E5/Core i7
> R2PCIe (rev 07)
> ff:13.1 Performance counters: Intel Corporation Xeon E5/Core
> i7 Ring to PCI Express Performance Monitor (rev 07)
> ff:13.4 Performance counters: Intel Corporation Xeon E5/Core
> i7 QuickPath Interconnect Agent Ring Registers (rev 07)
> ff:13.5 Performance counters: Intel Corporation Xeon E5/Core
> i7 Ring to QuickPath Interconnect Link 0 Performance Monitor
> (rev 07)
> ff:13.6 System peripheral: Intel Corporation Xeon E5/Core i7
> Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)
>
>
> Quentin Deldycke wrote:
>> If you want, here is a working i440fx libvirt xml file using
>> r9 290
>>
>> I would say much thing about your command line:
>>
>> * You are not using OVMF. For modern cards, i think it is
>> much more suitable.
>> * Is your R9 your boot card? If it is the case, it is
>> 'initailized' by linux a way or another. This is not good :/
>> * I would delete ALL unneeded devices like your second
>> passed through device, second drive, sound card... To
>> target only your problematic device
>> * Why providing the rom file of the card? Are you trying to
>> make it pass for another one? (like providing a r9 290x
>> rom for a r9 290?)
>> * Do you use isolcpu? Or any kind of cpu pinning?
>>
>>
>> Actually libvirt is quite easy to configure and provide much
>> more interesting features like cpu pinning...
>>
>> --
>> Deldycke Quentin
>>
>>
>> On 22 August 2017 at 16:12, Jiri Novak
>> <jiri.novak at ghorland.net <mailto:jiri.novak at ghorland.net>> wrote:
>>
>> Hi,
>>
>> not sure in this case, with other GPU, R7 240 it works
>> fine, there's nothing else on the same iommu group than
>> the gpu and it's soundcard.
>> When I started teting out things like this some time ago
>> libvirt didn't allow to set up all the things that were
>> needes for vga passthrough, so I've just trashed and
>> stayed like that :) Might retry now on debian 9, if it
>> supports what I need or not.
>> Anyway, with libvirt it's usually more difficult to fix
>> the wrong commandline so I'm trying to find out what is
>> actually wrong to be able to fix it, not to hope libvirt
>> will work out of the box and if not, I'm doomed :)
>>
>> Gh.
>>
>> Quentin Deldycke wrote:
>>> Hello,
>>>
>>> I think that first, you should use libvirt.
>>> I believe that most bugs are from a badly made qemu
>>> command line, bad isolations or stull like this.
>>>
>>> Libvirt => less pain, more working vms!
>>>
>>>
>>>
>>> --
>>> Deldycke Quentin
>>>
>>>
>>> On 22 August 2017 at 13:16, Jiri Novak
>>> <jiri.novak at ghorland.net
>>> <mailto:jiri.novak at ghorland.net>> wrote:
>>>
>>> Hi,
>>>
>>> I've got back again to testing the RX 480 setup
>>> with tips I got
>>> previously (like using i440fx instead of q35) and
>>> got a bit further, now
>>> I can run it at least in 2D mode (if I use driver
>>> from windows update)
>>> on windows 10 rev 1703.
>>>
>>> If I install full driver from AMD website, the host
>>> hangs during install
>>> and after that, it runs about 2-3minutes after boot
>>> until it hangs.
>>> With driver from windows update, it hangs when I run
>>> any game.
>>>
>>> Any ideas what to try next, how to find out what's
>>> wrong?
>>>
>>> Qemu commandline:
>>>
>>> LC_ALL=C
>>> PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
>>> QEMU_AUDIO_DRV=pa /usr/bin/taskset -c 4-7,20-23
>>> /usr/bin/qemu-system-x86_64 \
>>> -name 12-wingame \
>>> -machine pc-i440fx-2.8,accel=kvm,usb=off \
>>> -cpu host \
>>> -object
>>> memory-backend-file,id=mem0,size=16G,mem-path=/dev/hugepages1g,share=off
>>> \
>>> -numa node,nodeid=0,memdev=mem0 \
>>> -m 16G \
>>> -realtime mlock=off \
>>> -smp sockets=1,cores=4,threads=2 \
>>> -uuid 4baaaaaa-aaf5-aaaaaa-919d-aaaaaaacaaaa \
>>> -nographic -no-user-config -nodefaults -no-hpet \
>>> -rtc base=localtime,driftfix=slew \
>>> -global kvm-pit.lost_tick_policy=discard \
>>> -boot d \
>>> -drive
>>> file=/dev/Z-ssd/qemu/12-wingame,if=none,id=drive-virtio-disk0,format=raw,cache=none,aio=native
>>> \
>>> -drive
>>> file=/dev/Z-ssd/data/games-blizzard,if=none,id=drive-virtio-disk1,format=raw,cache=none,aio=native
>>> \
>>> -device virtio-scsi-pci,bus=pci.0,addr=0x5 \
>>> -device scsi-hd,drive=drive-virtio-disk0 \
>>> -device scsi-hd,drive=drive-virtio-disk1 \
>>> -netdev
>>> tap,id=netdev0,ifname=V0300t12,script=no,downscript=no \
>>> -device
>>> virtio-net-pci,netdev=netdev0,id=net0,mac=42:42:42:00:00:0c,bus=pci.0,addr=0x6
>>> \
>>> -device
>>> vfio-pci,host=02:00.0,id=hostdev6,bus=pci.0,multifunction=on,addr=0x3,x-vga=on,romfile=/root/roms/Sapphire.RX480.4096.161002.rom
>>> \
>>> -device
>>> vfio-pci,host=02:00.1,id=hostdev7,bus=pci.0,addr=0x3.0x1
>>> \
>>> -device
>>> vfio-pci,host=07:00.0,id=hostdev2,bus=pci.0,addr=0x4 \
>>> -vga none \
>>> -soundhw hda \
>>> -device virtio-rng-pci \
>>> -chardev stdio,id=seabios \
>>> -device isa-debugcon,iobase=0x402,chardev=seabios \
>>> -msg timestamp=on \
>>> >>/var/log/kvm/12-wingame.stdout
>>> 2>>/var/log/kvm/12-wingame.stderr &
>>>
>>> Usually I don't manage to get any error, though once
>>> the host managed to
>>> spit out this to console (when it crashed after 2
>>> minutes with amd driver)
>>>
>>> INFO: rcu_sched detected stalls on CPUs/tasks:
>>> [ 1558.573332] 2-...: (0 ticks this GP) idle=a16/0/0
>>> softirq=17601/17601 fqs=1
>>> [ 1558.573400] 17-...: (1 GPs behind) idle=9c8/0/0
>>> softirq=13311/13311 fqs=1
>>> [ 1558.573452] 20-...: (24 GPs behind) idle=be0/0/0
>>> softirq=30971/30972 fqs=1
>>> [ 1558.573505] 21-...: (4 GPs behind) idle=4a0/0/0
>>> softirq=26182/26183 fqs=1
>>> [ 1558.573557] 23-...: (0 ticks this GP)
>>> idle=b45/140000000000000/0
>>> softirq=30549/30549 fqs=1
>>> [ 1558.573615] (detected by 14, t=5252 jiffies,
>>> g=47014, c=47013,
>>> q=40045)
>>> [ 1558.573670] Task dump for CPU 2:
>>> [ 1558.573672] swapper/2 R running task
>>> 0 0 1
>>> 0x00200008
>>> [ 1558.573680] 0000000000000083 640fb4432252d28b
>>> 0000016601c54f00
>>> 0000000000000002
>>> [ 1558.573685] ffffffffb78b2320 0000000000000004
>>> ffffffffb7205d60
>>> ffffffffb78b2320
>>> [ 1558.573689] ffffc24a4028a0d0 ffffffffb78b2518
>>> 0000000000000005
>>> ffffffffb70cbb2a
>>> [ 1558.573693] Call Trace:
>>> [ 1558.573705] [<ffffffffb7205d60>] ?
>>> intel_idle+0x100/0x110
>>> [ 1558.573712] [<ffffffffb70cbb2a>] ?
>>> cpuidle_enter_state+0xea/0x2b0
>>> [ 1558.573717] [<ffffffffb6cb9504>] ?
>>> cpu_startup_entry+0x154/0x240
>>> [ 1558.573721] [<ffffffffb6c4805d>] ?
>>> start_secondary+0x14d/0x190
>>> [ 1558.573724] Task dump for CPU 17:
>>> [ 1558.573726] swapper/17 R running task
>>> 0 0 1
>>> 0x00200008
>>> [ 1558.573729] 0000000000000083 fc4308ad94b8ed74
>>> 0000016749d5af00
>>> 0000000000000011
>>> [ 1558.573734] ffffffffb78b2320 0000000000000004
>>> ffffffffb7205d60
>>> ffffffffb78b2320
>>> [ 1558.573737] ffffc24a4044a0d0 ffffffffb78b2518
>>> 0000000000000005
>>> ffffffffb70cbb2a
>>> [ 1558.573741] Call Trace:
>>> [ 1558.573746] [<ffffffffb7205d60>] ?
>>> intel_idle+0x100/0x110
>>> [ 1558.573750] [<ffffffffb70cbb2a>] ?
>>> cpuidle_enter_state+0xea/0x2b0
>>> [ 1558.573753] [<ffffffffb6cb9504>] ?
>>> cpu_startup_entry+0x154/0x240
>>> [ 1558.573756] [<ffffffffb6c4805d>] ?
>>> start_secondary+0x14d/0x190
>>> [ 1558.573758] Task dump for CPU 20:
>>> [ 1558.573759] swapper/20 R running task
>>> 0 0 1
>>> 0x00200008
>>> [ 1558.573763] 0000000000000083 39fde3c30b22afa7
>>> 0000016b9477af00
>>> 0000000000000014
>>> [ 1558.573767] ffffffffb78b2320 0000000000000004
>>> ffffffffb7205d60
>>> ffffffffb78b2320
>>> [ 1558.573771] ffffc24a4050a0d0 ffffffffb78b2518
>>> 0000000000000005
>>> ffffffffb70cbb2a
>>> [ 1558.573774] Call Trace:
>>> [ 1558.573778] [<ffffffffb7205d60>] ?
>>> intel_idle+0x100/0x110
>>> [ 1558.573782] [<ffffffffb70cbb2a>] ?
>>> cpuidle_enter_state+0xea/0x2b0
>>> [ 1558.573785] [<ffffffffb6cb9504>] ?
>>> cpu_startup_entry+0x154/0x240
>>> [ 1558.573788] [<ffffffffb6c4805d>] ?
>>> start_secondary+0x14d/0x190
>>> [ 1558.573790] Task dump for CPU 21:
>>> [ 1558.573792] swapper/21 R running task
>>> 0 0 1
>>> 0x00200008
>>> [ 1558.573795] 0000000000000083 6b8f35123dc25bdb
>>> 0000016b9477af00
>>> 0000000000000015
>>> [ 1558.573799] ffffffffb78b2320 0000000000000004
>>> ffffffffb7205d60
>>> ffffffffb78b2320
>>> [ 1558.573803] ffffc24a4054a0d0 ffffffffb78b2518
>>> 0000000000000005
>>> ffffffffb70cbb2a
>>> [ 1558.573806] Call Trace:
>>> [ 1558.573810] [<ffffffffb7205d60>] ?
>>> intel_idle+0x100/0x110
>>> [ 1558.573814] [<ffffffffb70cbb2a>] ?
>>> cpuidle_enter_state+0xea/0x2b0
>>> [ 1558.573817] [<ffffffffb6cb9504>] ?
>>> cpu_startup_entry+0x154/0x240
>>> [ 1558.573820] [<ffffffffb6c4805d>] ?
>>> start_secondary+0x14d/0x190
>>> [ 1558.573822] Task dump for CPU 23:
>>> [ 1558.573824] qemu-system-x86 R running task
>>> 0 18608 1
>>> 0x00000800
>>> [ 1558.573827] 0000000000000000 ffffffffc1551560
>>> 0000000000000000
>>> 0000000000000000
>>> [ 1558.573831] ffff9404e1c00040 ffffffffc153d9a7
>>> 0000000000000000
>>> ffff9404e1c02760
>>> [ 1558.573835] ffffffffc1519882 0000000000000000
>>> ffff9404e1c02760
>>> 0000000000000004
>>> [ 1558.573839] Call Trace:
>>> [ 1558.573882] [<ffffffffc153d9a7>] ?
>>> x86_emulate_insn+0x257/0xcf0 [kvm]
>>> [ 1558.573909] [<ffffffffc1519882>] ?
>>> emulator_pio_in_emulated+0x102/0x190 [kvm]
>>> [ 1558.573937] [<ffffffffc1539d31>] ?
>>> writeback+0x61/0x210 [kvm]
>>> [ 1558.573962] [<ffffffffc1535e1d>] ?
>>> writeback_registers+0x4d/0x60 [kvm]
>>> [ 1558.573972] [<ffffffffc09dc21f>] ?
>>> atomic_switch_perf_msrs+0x6f/0xa0
>>> [kvm_intel]
>>> [ 1558.574011] [<ffffffffc15252e3>] ?
>>> kvm_arch_vcpu_ioctl_run+0x6b3/0x1600 [kvm]
>>> [ 1558.574035] [<ffffffffc151f2fb>] ?
>>> kvm_arch_vcpu_load+0x5b/0x270 [kvm]
>>> [ 1558.574039] [<ffffffffb6c30765>] ?
>>> __kernel_fpu_end+0x35/0x100
>>> [ 1558.574059] [<ffffffffc150b4b5>] ?
>>> kvm_vcpu_ioctl+0x315/0x5d0 [kvm]
>>> [ 1558.574063] [<ffffffffb6ca1800>] ?
>>> wake_up_q+0x70/0x70
>>> [ 1558.574066] [<ffffffffb6cb8799>] ?
>>> __wake_up_common+0x49/0x80
>>> [ 1558.574069] [<ffffffffb6e1603f>] ?
>>> do_vfs_ioctl+0x9f/0x600
>>> [ 1558.574092] [<ffffffffc151b898>] ?
>>> kvm_on_user_return+0x68/0xa0 [kvm]
>>> [ 1558.574094] [<ffffffffb6e16614>] ?
>>> SyS_ioctl+0x74/0x80
>>> [ 1558.574111] [<ffffffffb720627b>] ?
>>> system_call_fast_compare_end+0xc/0x9b
>>> [ 1558.574116] rcu_sched kthread starved for 5248
>>> jiffies! g47014 c47013
>>> f0x2 RCU_GP_WAIT_FQS(3) ->state=0x100
>>> [ 1558.574186] rcu_sched W 0 8 2
>>> 0x00000000
>>> [ 1558.574189] ffff9414d1facc00 0000000000000000
>>> ffff9404f8c3e080
>>> ffff9404ffad8240
>>> [ 1558.574193] ffff9404f8c6f0c0 ffffa25a400b7db0
>>> ffffffffb72015d3
>>> ffffa25a400b7de0
>>> [ 1558.574197] 000000010004b899 ffff9404ffad8240
>>> 0000000000000003
>>> ffff9404f8c3e080
>>> [ 1558.574201] Call Trace:
>>> [ 1558.574205] [<ffffffffb72015d3>] ?
>>> __schedule+0x233/0x6d0
>>> [ 1558.574208] [<ffffffffb7201aa2>] ?
>>> schedule+0x32/0x80
>>> [ 1558.574211] [<ffffffffb7204dae>] ?
>>> schedule_timeout+0x17e/0x310
>>> [ 1558.574217] [<ffffffffb6ce3e50>] ?
>>> del_timer_sync+0x50/0x50
>>> [ 1558.574220] [<ffffffffb6cdd605>] ?
>>> rcu_gp_kthread+0x505/0x850
>>> [ 1558.574223] [<ffffffffb6cb8799>] ?
>>> __wake_up_common+0x49/0x80
>>> [ 1558.574226] [<ffffffffb6cdd100>] ?
>>> rcu_note_context_switch+0xe0/0xe0
>>> [ 1558.574230] [<ffffffffb6c965d7>] ? kthread+0xd7/0xf0
>>> [ 1558.574234] [<ffffffffb6c96500>] ?
>>> kthread_park+0x60/0x60
>>> [ 1558.574238] [<ffffffffb72064f5>] ?
>>> ret_from_fork+0x25/0x30
>>>
>>> Thanks,
>>> Gh.
>>>
>>>
>>> _______________________________________________
>>> vfio-users mailing list
>>> vfio-users at redhat.com <mailto:vfio-users at redhat.com>
>>> https://www.redhat.com/mailman/listinfo/vfio-users
>>> <https://www.redhat.com/mailman/listinfo/vfio-users>
>>>
>>>
>>
>>
>
>
>
> _______________________________________________
> vfio-users mailing list
> vfio-users at redhat.com <mailto:vfio-users at redhat.com>
> https://www.redhat.com/mailman/listinfo/vfio-users
> <https://www.redhat.com/mailman/listinfo/vfio-users>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170825/f27013b4/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 866 bytes
Desc: OpenPGP digital signature
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20170825/f27013b4/attachment.sig>
More information about the vfio-users
mailing list