[fedora-virt] Fatal PCIe error 928 on KVM GPU Passthrough

[Cole Robinson]

On 06/20/2013 10:24 AM, Mario Ceresa wrote:
> Hi Cole, thanks for your mail.
> 
> I use:
> 
> * qemu-2:1.2.2-11.fc18
> * ibvirt 0.10.2.5-1.fc18
> 
> My second GPU is 04:00.0 and the associated sound device is 04:00.1
> 
> So I do:
> 
> sudo chmod 666 /dev/vfio/vfio
> echo "10de 06dd" > /sys/bus/pci/drivers/pci-stub/new_id
> echo 0000:04:00.0 > /sys/bus/pci/devices/0000\:04\:00.0/driver/unbind
> echo 0000:04:00.0 > /sys/bus/pci/drivers/pci-stub/bind
> echo 0000:04:00.1 > /sys/bus/pci/devices/0000\:04\:00.1/driver/unbind
> echo "1" > /sys/bus/pci/devices/0000:04:00.1/remove
> 
> Then I follow instructions in
> https://fedoraproject.org/wiki/QA:Testcase_Virtualization_KVM_PCI_Device_Assignment
> to assign the PCI slot.
> 

You might want to try with newer libvirt and qemu, like from the virt-preview
repo:

http://fedoraproject.org/wiki/Virtualization_Preview_Repository

> 
> On 20 June 2013 16:12, Cole Robinson <crobinso at redhat.com
> <mailto:crobinso at redhat.com>> wrote:
> 
>     On 06/20/2013 03:30 AM, Mario Ceresa wrote:
>     > Dear all,
>     > does anybody know if it is currently possible to do GPU passthrough in
>     kvm? I
>     > have access to a dual Quadro 4000 setup and I would like to pass the second
>     > one to kvm for use in a VM.
>     >
>     > I read a lot on internet and it seems feasible [1, 2, 3] and there is even a
>     > reported success case [5].
>     >
>     > However when I start the VM the host reboots with PCIe error 928: Completion
>     > timeout.
>     >
>     > My current setup is:
>     >
>     > * Fedora 18 with 3.9.4-200 x86_64
>     > * dmesg | grep -e DMAR -e IOMMU shows that they are both enabled
>     > * nvidia driver installed from rpmfusion
>     > * I use vfio assignment as per [4]
>     >
>     > Thanks and regards,
>     >
>     > Mario
>     >
>     >
>     > [1] http://www.linux-kvm.org/page/VGA_device_assignment
>     > [2] https://bbs.archlinux.org/viewtopic.php?id=162768
>     > [3]
>     >
>     http://samos-it.com/removedetach-a-pci-device-linux-kvm-vga-passthrgough-nvidia-quadro-2000/
>     > [4]
>     >
>     https://fedoraproject.org/wiki/QA:Testcase_Virtualization_KVM_PCI_Device_Assignment
>     > [5]
>     >
>     http://tavi-tech.blogspot.com.es/2012/05/vga-passthrough-kvm-fedora-17-and.html
>     >
> 
>     CC-ing Alex (the VFIO guy)
> 
>     What qemu and libvirt versions are you using?
> 
>     - Cole
> 
>