[vfio-users] Unbind Vfio Passthrough = general protection fault

Thu Sep 17 22:08:34 UTC 2015

Vfio passthrough works really good but i have pci crash very often only when stop qemu vm/unbind card. Need to reboot host to recover card.
Another issue during update nvidia drivers in vm make freeze full host. Anyway no problems in games.
I have already tried change kernel and change modules config vfio.type1... 

Host : Ubuntu 14.04 LTS - Qemu 2.3/2.4
Intel 4790k + GTX 750

logs:

qemu-system-x86_64 \
        -serial none \
        -parallel none \
        -enable-kvm \
        -name Win8 \
        -cpu host,kvm=off,check \
        -smp threads=1,cores=4,sockets=1 \
        -m 3096 -mem-prealloc \
        -nodefconfig -nodefaults \
        -rtc base=localtime \
        -netdev type=tap,id=net0,ifname=tap0,vhost=on -device virtio-net-pci,netdev=net0,mac=00:26:22:D1:54:51 \
        -drive if=pflash,format=raw,readonly,file=ovmf.fd \
        -M q35 \
        -device ioh3420,bus=pcie.0,addr=1c.0,multifunction=on,port=1,chassis=1,id=root.1 \
        -device vfio-pci,host=01:00.0,bus=root.1,addr=00.0,multifunction=on,x-vga=on \
        -device vfio-pci,host=01:00.1,bus=root.1,addr=00.1 \
        -device virtio-scsi-pci,id=scsi \
        -nographic -vga none -daemonize \
        -net nic,model=virtio -net user \
        -drive file=/dev/sdd,id=disk0,cache=none,format=raw,if=none -device scsi-hd,drive=disk0 \

--------------------------------------------------------------

01:00.0 VGA compatible controller: NVIDIA Corporation GM107 [GeForce GTX 750] (rev a2)
01:00.1 Audio device: NVIDIA Corporation Device 0fbc (rev a1)

--------------------------------------------------------------

[ 2597.273856] device tap0 entered promiscuous mode
[ 2597.273887] br0: port 6(tap0) entered forwarding state
[ 2597.273898] br0: port 6(tap0) entered forwarding state
[ 2598.232285] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x1e at 0x258
[ 2598.232299] vfio_ecap_init: 0000:01:00.0 hiding ecap 0x19 at 0x900
[ 2600.010802] kvm: zapping shadow pages for mmio generation wraparound
[ 2600.010887] kvm: zapping shadow pages for mmio generation wraparound
[ 3086.637625] br0: port 6(tap0) entered disabled state
[ 3086.638738] device tap0 left promiscuous mode
[ 3086.638740] br0: port 6(tap0) entered disabled state
[ 3105.018253] vgaarb: device changed decodes: PCI:0000:01:00.0,olddecodes=io+mem,decodes=io+mem:owns=none
[ 3105.051041] general protection fault: 0000 [#1] SMP 
[ 3105.051068] Modules linked in: snd_hda_intel vhost_net vhost macvtap macvlan vfio_pci kvm_intel kvm ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs nfnetlink_queue nfnetlink cx8800 cx88_dvb cx8802 tda9887 tda8290 cx88_alsa cx88xx xt_nat veth xt_CHECKSUM xt_addrtype dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c xt_tcpudp xt_multiport iptable_filter iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat ip_tables bridge stp llc rfcomm bnep bluetooth xt_iprange xt_conntrack tuner_simple nf_conntrack tuner_types cx22702 isl6421 nls_iso8859_1 cx24116 ipt_REJECT cx88_vp3054_i2c nf_reject_ipv4 snd_soc_wm8776 snd_soc_core snd_hda_codec_realtek videobuf2_dvb snd_hda_codec_generic dvb_core snd_hda_codec_hdmi snd_compress ac97_bus snd_pcm_dmaengine ir_lirc_codec xt_mark xt_NFQUEUE x_tables ir_xmp_decoder ir_rc5_decoder ir_mce_kbd_decoder wm8775 ir_jvc_decoder ir_rc6_decoder ir_sony_decoder ir_sanyo_decoder lirc_dev ir_nec_decoder ir_sharp_decoder rc_hauppauge snd_hda_codec intel_rapl snd_hda_core tuner snd_hwdep pci_stub snd_pcm iosf_mbi x86_pkg_temp_thermal intel_powerclamp coretemp input_leds joydev tveeprom snd_seq_midi rc_core snd_seq_midi_event videobuf2_dma_sg snd_rawmidi videobuf2_memops vfio_iommu_type1 vfio_virqfd vfio videobuf2_core hid_wiimote snd_seq snd_seq_device snd_timer ff_memless ppdev parport_pc v4l2_common mei_me lp parport videodev snd mei soundcore serio_raw media dm_multipath tpm_infineon mac_hid scsi_dh lpc_ich shpchp 8250_fintek btrfs xor raid6_pq drbg ansi_cprng dm_crypt dm_mirror dm_region_hash dm_log hid_generic crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel i915 aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse ahci r8169 libahci mii i2c_algo_bit drm_kms_helper usbhid hid drm video [last unloaded: snd_hda_intel]
[ 3105.051703] CPU: 2 PID: 3251 Comm: win Tainted: G     U          4.2.0-040200-generic #201508301530
[ 3105.051727] Hardware name: Gigabyte Technology Co., Ltd. B85M-D3H/B85M-D3H, BIOS F14 09/19/2014
[ 3105.051751] task: ffff8801f1446e00 ti: ffff8801c931c000 task.ti: ffff8801c931c000
[ 3105.051771] RIP: 0010:[<ffffffff814ee445>]  [<ffffffff814ee445>] __rpm_callback+0x35/0x80
[ 3105.051800] RSP: 0018:ffff8801c931fc78  EFLAGS: 00010246
[ 3105.051816] RAX: f106132fe10b2558 RBX: ffff880234451098 RCX: 0000000000000000
[ 3105.051835] RDX: f106132fe10b2558 RSI: ffff880234451098 RDI: ffff880234451098
[ 3105.051855] RBP: ffff8801c931fc98 R08: 0000000000000002 R09: ffff8801c931fc44
[ 3105.051874] R10: 0000000000000001 R11: 0000000000000005 R12: ffff880234451148
[ 3105.051893] R13: 0000000000000004 R14: 0000000000000000 R15: ffffffffffffffed
[ 3105.051913] FS:  00007f052a570740(0000) GS:ffff88023e280000(0000) knlGS:0000000000000000
[ 3105.051934] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 3105.051951] CR2: 000000000069d0e0 CR3: 000000005ce93000 CR4: 00000000001406e0
[ 3105.051971] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 3105.051990] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 3105.052010] Stack:
[ 3105.052019]  ffff8801c931fca8 0000000000000008 ffff880234451098 0000000000000004
[ 3105.052045]  ffff8801c931fcc8 ffffffff814eed94 0000000000000004 ffff880234451098
[ 3105.052071]  ffff880234451148 0000000000000246 ffff8801c931fcf8 ffffffff814eee5c
[ 3105.052097] Call Trace:
[ 3105.052110]  [<ffffffff814eed94>] rpm_idle+0x194/0x200
[ 3105.052126]  [<ffffffff814eee5c>] __pm_runtime_idle+0x5c/0x80
[ 3105.052149]  [<ffffffff813e39b8>] pci_device_remove+0x78/0xc0
[ 3105.052169]  [<ffffffff814e50e6>] __device_release_driver+0x96/0x130
[ 3105.052187]  [<ffffffff814e51a3>] device_release_driver+0x23/0x30
[ 3105.052205]  [<ffffffff814e338a>] unbind_store+0xba/0xe0
[ 3105.052221]  [<ffffffff814e2884>] drv_attr_store+0x24/0x30
[ 3105.052240]  [<ffffffff812621ea>] sysfs_kf_write+0x3a/0x50
[ 3105.052256]  [<ffffffff81261880>] kernfs_fop_write+0x120/0x170
[ 3105.052275]  [<ffffffff811e9428>] __vfs_write+0x28/0xf0
[ 3105.052293]  [<ffffffff811ebf49>] ? __sb_start_write+0x49/0xf0
[ 3105.052312]  [<ffffffff8130af8d>] ? security_file_permission+0x3d/0xc0
[ 3105.052331]  [<ffffffff811e9b09>] vfs_write+0xa9/0x190
[ 3105.052347]  [<ffffffff811ea876>] SyS_write+0x46/0xa0
[ 3105.052366]  [<ffffffff817a8e32>] entry_SYSCALL_64_fastpath+0x16/0x75
[ 3105.052384] Code: 89 e5 41 55 41 54 4c 8d a6 b0 00 00 00 53 4c 89 e7 48 89 f3 48 83 ec 08 f6 86 99 01 00 00 02 74 41 c6 07 00 0f 1f 40 00 48 89 df <ff> d2 f6 83 99 01 00 00 02 41 89 c5 4c 89 e7 75 13 e8 a5 a4 2b 
[ 3105.052526] RIP  [<ffffffff814ee445>] __rpm_callback+0x35/0x80
[ 3105.052545]  RSP <ffff8801c931fc78>
[ 3105.052559] ---[ end trace ed04ec9d1ba99d42 ]---

- Btw i have audio issue also in win 8.1 guest vm. Sounds from nvidia hdmi become distorded after random vm uptime. Only solved by reboot vm.

Thanks in advance

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/vfio-users/attachments/20150918/0bdf39bd/attachment.htm>