[vfio-users] ACS capabitities for 1366 sockets

[sL1pKn07 SpinFlo]

2016-01-07 20:55 GMT+01:00 Alex Williamson <alex.l.williamson at gmail.com>:
> On Thu, Jan 7, 2016 at 12:48 PM, sL1pKn07 SpinFlo <sl1pkn07 at gmail.com>
> wrote:
>>
>> >I have an Intel Xeon X5660 and i'm
>> >trying to see if my processor has the feature. Maybe I just got lucky
>> > with
>> >my motherboard having each PCIe slot in its IOMMU group.
>>
>> how can search this?
>>
>> mi mobo is a little special (EVGA SR-2), because have 7 pci-e managed
>> by 2x Nvidia NF200 chipsets (apart of the main Intel 5520 Chipset)
>>
>> this is a optut of
>> lstopo (no gui): http://sl1pkn07.wtf/paste/view/b2ec7000
>> lstopo (gui): http://wstaw.org/m/2016/01/07/Screenshot_20160107_201934.png
>> lspci -nnk: http://sl1pkn07.wtf/paste/view/d465e511
>> dmesg: http://sl1pkn07.wtf/paste/view/d84384a1
>> /sys/kernel/iommu_groups/: http://sl1pkn07.wtf/paste/view/d3c317ec
>> (sorry, i don't know how interpret this)
>> my kernel is: Archlinux stock kernel 4.3.0-1
>
>
> Let's add 'lspci -tv' and 'sudo lspci -vvv' and then say what grouping
> you're asking about

i've make changes in my layout (movig devices)

/sys/kernel/iommu_groups:  http://sl1pkn07.wtf/paste/view/2a354adf
lspci -vt: http://sl1pkn07.wtf/paste/view/03c505d1
sudo lspci -vvv: http://sl1pkn07.wtf/paste/view/79cf804d
lstopo(gui): http://wstaw.org/m/2016/01/07/Screenshot_20160107_225933.png
lstopo(text): http://sl1pkn07.wtf/paste/view/1ebef006
dmesg: http://sl1pkn07.wtf/paste/view/47a6221a

because I found how is the pci layout of my mobo
(http://forums.evga.com/FindPost/1945895)

                           Odd slot use only        Even slots added
                        ---------------------------     -------------------
X16 -- NF200 -- X16 (Through NF200) -- X16(X8) SLOT 1
               |                                      |
               |                                      ------------- X8 SLOT 2
               |
               ------- X16 (Through NF200) -- X16(X8) SLOT 3
                                                      |
                                                      ------------- X8 SLOT 4

X16 -- NF200 -- X16 (Through NF200) -- X16(X8) SLOT 5
               |                                      |
               |                                      ------------- X8 SLOT 6
               |
               ------- X16 (Through NF200) -------- X16 SLOT 7

then, my new layout is: (older layout: http://sl1pkn07.wtf/paste/view/bf647f32)

slot1 -> GTX 770 (host)
slot2 -> empty
slot3 -> empty
slot4 -> LSI SAS controller (8x) (host)
slot5 -> empty
slot6 -> Asus U3S6 (USB3 and SATA6 card) (conected to VM disk)
slot7 -> GTX TITAN Black (guest)

then. have a good isolation like a newer machines? (each pci isolated)

i think (now) yes. but if any expert can confirm this....

Greetings