# 貌似，问题出在了 dmesg | grep 'remapping' # 按照官网的说法：

如果你看到以下一行：

　　　那么支持重映射。

然而，我的则输出：x2apic: IRQ remapping doesn't support X2APIC mode

那么我便开始尝试，官网给出的解决方案：

　　If your system doesn't support interrupt remapping, you can allow unsafe interrupts with:如果你的系统不支持中断重映射，你可以使用以下命令来允许不安全的中断：

　　　　echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf

然而输出结果仍是：

root@pve:~# dmesg | grep -e DMAR -e IOMMU[ 0.048333] DMAR: IOMMU enabledroot@pve:~# dmesg | grep 'remapping'[ 0.137838] x2apic: IRQ remapping doesn't support X2APIC moderoot@pve:~#

-------------------------------------------------------------------------

我去问了gpt，他给我的回答：

　　gtp:

　　根据您提供的dmesg输出，可以看到系统中的IOMMU已经被启用。这表明您的Proxmox Virtual Environment主机已经启用了IOMMU硬件虚拟化支持，这是硬件直通功能的前提之一。

　　关于"IRQ remapping doesn't support X2APIC mode"的消息，这个消息通常是由于系统检测到x2APIC模式下的IRQ重映射不受支持而引起的。x2APIC是一种高级的APIC（高级可编程中断控制器）模式，通常用于提高性能和扩展性。这个消息本身并不一定表示问题，只是系统提示IRQ重映射在x2APIC模式下不支持。

　　在大多数情况下，这个消息并不会导致硬件直通功能的问题。如果您在配置硬件直通或在使用虚拟机时遇到性能或稳定性问题，可以考虑将系统切换回传统的APIC模式，以查看是否有改善。

　　如果您有任何其他关于硬件直通或Proxmox Virtual Environment的问题，欢迎继续提问，我会尽力帮助您解决问题。

　　我：

　　如何切换：考虑将系统切换回传统的APIC模式

　　gpt:　

　　要将系统切换回传统的APIC模式，您可以在系统引导时通过内核参数来指定。下面是一般步骤：

　　1. **编辑GRUB配置**： 　　- 打开终端并编辑GRUB配置文件。通常，GRUB配置文件位于`/etc/default/grub`。 　　- 找到`GRUB_CMDLINE_LINUX`行，这里列出了内核启动参数。 　　- 在引号内添加`nox2apic`参数。确保在其他参数之间用空格分隔。

　　2. **更新GRUB配置**： 　　- 保存更改后，运行以下命令更新GRUB配置：`sudo update-grub`。

　　3. **重启系统**： 　　- 重新启动您的系统，以使更改生效。

　　在系统重新启动后，系统将以传统的APIC模式启动，而不是x2APIC模式。这可能会对硬件直通的性能或稳定性产生影响，具体影响可能因系统和硬件配置而异。如果您在切换回传统APIC模式后遇到任何问题，请记得可以随时再次编辑GRUB配置文件并删除`nox2apic`参数来恢复默认设置。

　　请在执行此操作之前确保您了解正在进行的更改，并根据您的具体情况谨慎操作。如果您需要更多帮助或有其他问题，请随时告诉我。

输出结果：

root@pve:~# dmesg | grep -e DMAR -e IOMMU[ 0.047596] DMAR: IOMMU enabledroot@pve:~# dmesg | grep 'remapping'root@pve:~#

是的，x2apic: IRQ remapping doesn't support X2APIC mode ，这行输出没有了。我把这个信息反馈给gpt，然后他并没给我有用的可行方案。

目前看来，我的IOMMU已经启用，除了，DMAR: IOMMU enabled，没有任何输出信息。是不是还没有进行分组呢？

官网给出的下一个步骤：

For working PCI passthrough, you need a dedicated IOMMU group for all PCI devices you want to assign to a VM.对于PCI直通，您需要一个专用的IOMMU组，用于所有您希望分配给VM的PCI设备。

root@pve:~# find /sys/kernel/iommu_groups/ -type l root@pve:~#

这将列出每个IOMMU组中的设备。如果每个组中只有一个设备，则表示IOMMU没有正确进行分组

没有任何输出信息，

To have separate IOMMU groups, your processor needs to have support for a feature called ACS (Access Control Services). Make sure you enable the corresponding setting in your BIOS for this.

要拥有独立的 IOMMU 组，您的处理器需要支持一个称为 ACS (访问控制服务)的特性。请确保您在 BIOS 中启用了相应的设置。

If you don't have dedicated IOMMU groups, you can try moving the card to another PCI slot.

如果您没有专用的 IOMMU 组，您可以尝试将该卡移动到另一个 PCI 插槽。

Should that not work, you can try using Alex Williamson's ACS override patch. However, this should be seen as a last option and is not without risks.

如果这不起作用，您可以尝试使用 Alex Williamson 的 ACS 覆盖补丁。然而，这应该被视为最后的选择，并且不是没有风险。

As of writing, the ACS patch is part of the Proxmox VE kernel and can be invoked via Editing the kernel command line. Addto the kernel boot command line (grub or systemd-boot) options.

在撰写本文时，ACS补丁是Proxmox VE内核的一部分，可以通过编辑内核命令行来调用。

随后我在，/etc/default/grub中，进行了修改：

　　GRUB_DEFAULT=0　　GRUB_TIMEOUT=5　　GRUB_DISTRIBUTOR=`lsb_release -i -s 2> /dev/null || echo Debian`　　GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on pcie_acs_override=downstream video=vesafb:off vide>　　GRUB_CMDLINE_LINUX="nox2apic"

　　#也尝试了，GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on pcie_acs_override=downstream,multifunction"

　然而并不起作用。只是给我这样的输出信息：

　　root@pve:~# dmesg | grep -e DMAR -e IOMMU　　[ 0.000000] Warning: PCIe ACS overrides enabled; This may allow non-IOMMU protected peer-to-peer DMA　　[ 0.047964] DMAR: IOMMU enabled　　root@pve:~# dmesg | grep 'remapping'　　root@pve:~# find /sys/kernel/iommu_groups/ -type l　　root@pve:~#

检查是否直接支持IOMMU分组，lspci -vv，如果设备信息中支持ACS（Access Control Services），便可直接通过设置开启IOMMU分组。若不支持ACS，需要更新内核，关闭ACS检查，开启IOMMU分组，

　　/* 检查是否存在Capabilities: Access Control Services*/

　　Capabilities: [2a0] Access Control Services

哪位大佬可以搞定，欢迎留言指出，我将会不胜感激。

------------------------------------------------------------------------------------------------------------------------

root@pve:~# dmesg | grep iommu[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-6.5.11-8-pve root=/dev/mapper/pve-root ro nox2apic quiet intel_iommu=on pcie_acs_override=downstream video=vesafb:off video=efifb:off[ 0.047783] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.5.11-8-pve root=/dev/mapper/pve-root ro nox2apic quiet intel_iommu=on pcie_acs_override=downstream video=vesafb:off video=efifb:off[ 0.569130] iommu: Default domain type: Translated[ 0.569130] iommu: DMA domain TLB invalidation policy: lazy moderoot@pve:~#

-----------------------------------------------------------------------------------------------------------------------　

root@pve:~# lspci00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers (rev 08)00:02.0 VGA compatible controller: Intel Corporation Skylake GT2 [HD Graphics 520] (rev 07)00:14.0 USB controller: Intel Corporation Sunrise Point-LP USB 3.0 xHCI Controller (rev 21)00:14.2 Signal processing controller: Intel Corporation Sunrise Point-LP Thermal subsystem (rev 21)00:15.0 Signal processing controller: Intel Corporation Sunrise Point-LP Serial IO I2C Controller #0 (rev 21)00:16.0 Communication controller: Intel Corporation Sunrise Point-LP CSME HECI #1 (rev 21)00:17.0 SATA controller: Intel Corporation Sunrise Point-LP SATA Controller [AHCI mode] (rev 21)00:1c.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #1 (rev f1)00:1c.4 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #5 (rev f1)00:1c.5 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #6 (rev f1)00:1f.0 ISA bridge: Intel Corporation Sunrise Point-LP LPC Controller (rev 21)00:1f.2 Memory controller: Intel Corporation Sunrise Point-LP PMC (rev 21)00:1f.3 Audio device: Intel Corporation Sunrise Point-LP HD Audio (rev 21)00:1f.4 SMBus: Intel Corporation Sunrise Point-LP SMBus (rev 21)01:00.0 3D controller: NVIDIA Corporation GK208BM [GeForce 920M] (rev a1)01:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1)02:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3165 Plus Bluetooth (rev 79)03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)root@pve:~#

----------------------------------------------------------------------------------------------------------------------- 

root@pve:~# lspci -k00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers (rev 08) Subsystem: Lenovo Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers Kernel driver in use: skl_uncore00:02.0 VGA compatible controller: Intel Corporation Skylake GT2 [HD Graphics 520] (rev 07) Subsystem: Lenovo Skylake GT2 [HD Graphics 520] Kernel driver in use: i915 Kernel modules: i91500:14.0 USB controller: Intel Corporation Sunrise Point-LP USB 3.0 xHCI Controller (rev 21) Subsystem: Lenovo Sunrise Point-LP USB 3.0 xHCI Controller Kernel driver in use: xhci_hcd Kernel modules: xhci_pci00:14.2 Signal processing controller: Intel Corporation Sunrise Point-LP Thermal subsystem (rev 21) Subsystem: Lenovo Sunrise Point-LP Thermal subsystem Kernel driver in use: intel_pch_thermal Kernel modules: intel_pch_thermal00:15.0 Signal processing controller: Intel Corporation Sunrise Point-LP Serial IO I2C Controller #0 (rev 21) Subsystem: Lenovo Sunrise Point-LP Serial IO I2C Controller Kernel driver in use: intel-lpss Kernel modules: intel_lpss_pci00:16.0 Communication controller: Intel Corporation Sunrise Point-LP CSME HECI #1 (rev 21) Subsystem: Lenovo Sunrise Point-LP CSME HECI Kernel driver in use: mei_me Kernel modules: mei_me00:17.0 SATA controller: Intel Corporation Sunrise Point-LP SATA Controller [AHCI mode] (rev 21) Subsystem: Lenovo Sunrise Point-LP SATA Controller [AHCI mode] Kernel driver in use: ahci Kernel modules: ahci00:1c.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #1 (rev f1) Subsystem: Lenovo Sunrise Point-LP PCI Express Root Port Kernel driver in use: pcieport00:1c.4 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #5 (rev f1) Subsystem: Lenovo Sunrise Point-LP PCI Express Root Port Kernel driver in use: pcieport00:1c.5 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port #6 (rev f1) Subsystem: Lenovo Sunrise Point-LP PCI Express Root Port Kernel driver in use: pcieport00:1f.0 ISA bridge: Intel Corporation Sunrise Point-LP LPC Controller (rev 21) Subsystem: Lenovo Sunrise Point-LP LPC Controller00:1f.2 Memory controller: Intel Corporation Sunrise Point-LP PMC (rev 21) Subsystem: Lenovo Sunrise Point-LP PMC00:1f.3 Audio device: Intel Corporation Sunrise Point-LP HD Audio (rev 21) Subsystem: Lenovo Sunrise Point-LP HD Audio Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel, snd_soc_skl, snd_soc_avs, snd_sof_pci_intel_skl00:1f.4 SMBus: Intel Corporation Sunrise Point-LP SMBus (rev 21) Subsystem: Lenovo Sunrise Point-LP SMBus Kernel driver in use: i801_smbus Kernel modules: i2c_i80101:00.0 3D controller: NVIDIA Corporation GK208BM [GeForce 920M] (rev a1) Subsystem: Lenovo GK208BM [GeForce 920M] Kernel modules: nvidiafb, nouveau01:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1) Kernel driver in use: snd_hda_intel Kernel modules: snd_hda_intel02:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3165 Plus Bluetooth (rev 79) Subsystem: Intel Corporation Dual Band Wireless-AC 3165 Kernel driver in use: iwlwifi Kernel modules: iwlwifi03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15) Subsystem: Lenovo RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller Kernel driver in use: r8169 Kernel modules: r8169root@pve:~#

------------------------------------------------------------------------------------------------------------------------

root@pve:~# lspci -vv00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers (rev 08) Subsystem: Lenovo Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast >TAbort- Capabilities: [70] Express (v2) Root Complex Integrated Endpoint, MSI 00 DevCap: MaxPayload 128 bytes, PhantFunc 0 ExtTag- RBE+ FLReset+ DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq- RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop- FLReset- MaxPayload 128 bytes, MaxReadReq 128 bytes DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend- DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR- 10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix- EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit- FRS- AtomicOpsCap: 32bit- 64bit- 128bitCAS- DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- 10BitTagReq- OBFF Disabled, AtomicOpsCtl: ReqEn- Capabilities: [ac] MSI: Enable+ Count=1/1 Maskable- 64bit- Address: fee08004 Data: 0024 Capabilities: [d0] Power Management version 2 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-) Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME- Capabilities: [100 v1] Process Address Space ID (PASID) PASIDCap: Exec+ Priv-, Max PASID Width: 14 PASIDCtl: Enable- Exec- Priv- Capabilities: [200 v1] Address Translation Service (ATS) ATSCap: Invalidate Queue Depth: 00 ATSCtl: Enable-, Smallest Translation Unit: 00 Capabilities: [300 v1] Page Request Interface (PRI) PRICtl: Enable- Reset- PRISta: RF- UPRGI- Stopped- Page Request Capacity: 00008000, Page Request Allocation: 00000000 Kernel driver in use: i915 Kernel modules: i915

00:14.0 USB controller: Intel Corporation Sunrise Point-LP USB 3.0 xHCI Controller (rev 21) (prog-if 30 [XHCI]) Subsystem: Lenovo Sunrise Point-LP USB 3.0 xHCI Controller Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- Capabilities: [600 v1] Vendor Specific Information: ID=0001 Rev=1 Len=024 Capabilities: [900 v1] Secondary PCI Express LnkCtl3: LnkEquIntrruptEn- PerformEqu- LaneErrStat: 0 Kernel modules: nvidiafb, nouveau

01:00.1 Audio device: NVIDIA Corporation GK208 HDMI/DP Audio Controller (rev a1) Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-