View source for POWER9 Hardware Compatibility List/PCIe Devices


==Compatibility rules==
In general, any PCIe device will work providing that an open source driver is available for your operating system. There are some exceptions:

* '''Hardware bugs.''' POWER does not permit errant DMA accesses. If a device tries to access areas of host memory which it is not permitted to access, the device is shut down immediately. This is dissimilar to x86 platforms, which simply silently ignore such attempts. Some badly designed I/O devices have bugs causing them to attempt DMA accesses to random areas of host memory; these devices are unlikely to function correctly on POWER systems unless a workaround is available.  Note that devices in full bypass mode may legally have access to all host memory, to avoid this and test driver IOMMU setup pass "iommu=nobypass" to the kernel at startup.
* '''I/O space.''' Starting with [[POWER9]], access to the legacy PCI I/O space is no longer supported; devices or drivers which rely on this will not function. The legacy I/O space has been deprecated for as long as PCIe has existed; generally this will only affect very old PCIe devices which use PCIe to PCI bridge chips to attach old PCI devices to the bus. A small subset of these devices may require legacy I/O space support.
* '''Incomplete memory addressing support.''' The PCIe architecture specifies a 64-bit address space. Some I/O devices try to economize on this by only implementing e.g. 40 bits for their addressing, rendering them incapable of addressing host memory which lies above address 2<sup>40</sup>. (Firmware patches to work around this are pending.)
* '''Bifurcation limits.''' Arbitrary PCIe lane bifurcation is not supported. Devices which split a PCIe slot into multiple connectors (for example, PCIe to M.2 adaptors) will not work unless they have a PCIe switch chip, although the first connector will generally work.

==Troubleshooting==

If a PCIe device is in a broken state due to being attached/detached from a VM, or due to a transition from Petitboot to the main OS, you may be able to fix it by issuing a hot reset.  A script for performing a PCIe hot reset is at [[File:Pcie_hot_reset.sh]].  For background on PCIe resets and how a hot reset differs from the function-level reset performed by <code>echo 1 > /sys/bus/pci/devices/$dev/reset</code>, see [https://unix.stackexchange.com/a/474378 Alex Forencich's explanation on Stack Exchange].

==NICs==
===Working===
* Broadcom [[BCM5719]]
* Chelsio T6225-SO-CR
* Mellanox ConnectX-6 EN 200Gb/s Adapter Card ''(supports [[CAPI]])''
* Silicom [https://www.silicom-usa.com/pr/server-adapters/networking-adapters/10-gigabit-ethernet-networking-adapters/pe310g4spi9-server-adapter/ PE310G4SPI9]/[https://www.silicom-usa.com/pr/server-adapters/networking-adapters/10-gigabit-ethernet-networking-adapters/pe310g4spi9la-quad-port-10-gigabit-nic-intel-based/ PE310G4SPI9LA] quad port 10 GbE SFP+ adapter (ixgbe driver)

===Non-working===
* Mellanox ConnectX IB QDR (mlx4 driver)

==Wireless Cards==
* [https://ark.intel.com/content/www/us/en/ark/products/75439/intel-dual-band-wireless-ac-7260.html Intel Dual-Band Wireless-AC 7260] (Bluetooth untested)
* Alfa AWUS036NHA Wireless USB Adaptor
** open source firmware (ath9k_htc) [https://github.com/qca/open-ath9k-htc-firmware]
* TP-Link TL WN823N RTL8192EU [https://github.com/Mange/rtl8192eu-linux-driver]
** remove "ARCH=$(ARCH)" on line 1710 of the makefile and it compiles fine

==NVMe Drives==
* Samsung 950 PRO (with M.2 to PCIe adapter)
* Samsung 960 EVO / PRO (with M.2 to PCIe adapter)
* Samsung 970 PRO (with M.2 to PCIe adapter)
* Samsung 970 EVO Plus (with M.2 to PCIe adapter)
* Intel Optane 900P NVMe XPoint PCIe
* Intel Optane 905P NVMe XPoint PCIe AIC
* WD Black PCIe (with M.2 to PCIe adapter)
* MyDigitalSSD BPX 480GB (with M.2 to PCIe adapter)

==PCIe to M.2 Adapters==
===Working===
* [http://ableconn.com/products_2.php?gid=62 Ableconn PEXM2-SSD M.2 NGFF PCIe SSD to PCI Express 3.0 x4 Host Adapter Card (M.2 to PCIe adapter)]
* [https://www.addonics.com/products/ad2m2nvmpx8.php Addonics AD2M2NVMPX8] Dual NVMe PCIe adapter 2x M.2 PCIe to PCIe x8
* [http://www.delock.com/produkte/G_89370/merkmale.html Delock PCI Express x4 Card > 1 x internal NVMe M.2 Key M 80 mm - Low Profile Form Factor; Item No. 89370]
* [https://www.newegg.com/Product/Product.aspx?Item=9SIA4RE5AU2769 JEYI SK4 M.2 NVMe(M Key) SSD to PCI-E 3.0 x4 Adapter Converter Card]
* [https://www.newegg.com/Product/Product.aspx?Item=N82E16815124167 SYBA SI-PEX40110 M.2 PCI-e To PCI-e 3.0 x4]
* [http://highpoint-tech.com/USA_new/series-ssd7101a-1-overview.htm HighPoint SSD7101A-1] 4x M.2 PCIe to PCIe 3.0 x16 (based on PLX PEX8747 PCIe switch)
** Works without special drivers as a PCIe switch. NVMEs are detected and work just fine. Petitboot is able to boot attached NVMEs with no problems. Tested in FreeBSD. -- [[User:Bdragon|Bdragon]] ([[User talk:Bdragon|talk]])
* [http://highpoint-tech.com/USA_new/series-ssd7102-overview.htm HighPoint SSD 7102] 4x M.2 PCIe to PCIe 3.0 x16 (with PCIe switch)
* [https://www.supermicro.com/en/products/accessories/addon/AOC-SHG3-4M2P.php Supermicro AOC-SHG3-4M2P] 4x M.2 PCIe to PCIe 3.0 x8 (using a PEX 8734 PCIe 3.0 (8.0GT/s) Switch). Draws 10 watts in idle. Requires one additional 4-pin 12V connector.

===Partially working===
* [https://www.amazon.com/gp/product/B074WV4ZN4 Aplicata Quad M.2 NVMe SSD PCIe x16 Adapter] (no PCIe switch; only lowest slot works)

==SAS/SATA Storage Controllers ==
===Working===
* IOCrest SI-PEX40062 (Chipset: Marvell 88SE9235, PCI id 1B4B:9235)
** Marvell 88SE9230 chipset also confirmed to work
* Kouwell PE-115H (Chipset: Marvell 88SE9130, PCI id 1b4b:9130)
* LSI 9300/9200 SAS HBAs
** May require updating to IT firmware on a x86 machine
* [[PM8068]]-based SAS HBAs 
* Supermicro AOC-SLG3-4E2P 4-port OCuLink adapter
* Jmicron JMB 363 SATA PCIe card. SATA ports work with Petitboot.
* MegaRAID 9460-8i

===Non-working===
* AXAGON PCES-SA2 (ASMedia chipset)
* SuperMicro AOC-SASLP-MV8 (mvsas driver)
* MegaRAID 9341-8i - probably a bug in the firmware

=== Unknown if working (good candidates to test) ===
* [http://highpoint-tech.com/USA_new/series_rr600-overview.htm HighPoint RocketRAID 642L] (Chipset: Marvell 88SE9235)
* [http://highpoint-tech.com/USA_new/series_rr600-overview.htm HighPoint RocketRAID 644L] (Chipset: Marvell 88SE9235)

== Graphics Cards ==

No display?  Check out the [[Troubleshooting/GPU|GPU Troubleshooting]] page.

=== AMD ===

All AMD GPUs currently have DMA issues (limited to 32-bit, which can cause crashes) due to missing Linux kernel support for DMA windows between 33 and 63 bits in length.  The root cause is GPU vendors (and occasionally some non-GPU vendors) cutting costs and only including 40-bit capable (Intel-style) DMA controllers.  A compatibility mode is expected to be included in Linux 5.4 and above that will resolve this issue.

* AMD Radeon HD 5570 - Archaic (1GB VRAM, PCI 2.1) but much faster than the AST. This card (ASUS EAH5570 Silent) is passively cooled.
* AMD Radeon HD 5850 - Must disable onboard VGA first. Currently has issues with only using 32-bit DMA.
* AMD Radeon HD 6450 - Works with default settings (kernel: radeon, X: modesetting or radeon), tested in BE mode
* AMD Radeon HD 6850 - Disable AST VGA with jumper. 32 bit.
* AMD Radeon HD 7850 - Disabled onboard VGA. Using amdgpu is highly unstable, radeon driver is usable but has issues with only using 32-bit DMA.
* AMD Radeon HD 7950 - Must disable onboard VGA first. Currently has issues with only using 32-bit DMA.
* AMD Radeon R5 220
* AMD Radeon R5 230 - Works in BE mode (use <code>Option "AccelMethod" "EXA"</code> for Xorg)
* AMD Radeon R7 240
* AMD Radeon R9 290X
* AMD Radeon RX 560X
* Sapphire GPRO 8200 (Polaris10 core) - Disable AST VGA with jumper, disabling in grub is not enough. Same form factor as WX7100, a single-slot RX 470 with 8GB of RAM and 4 DP outputs.
* AMD Radeon RX 480
* AMD Radeon RX 580 – Works with the amdgpu firmware from Ubuntu 19.04 and disabled onboard VGA
** You may also need a kernel parameter like <code>vga=797</code> if xinit complains about VESA[http://en.wikipedia.org/wiki/VESA_BIOS_Extensions]
* AMD Radeon RX Vega 56 - Works with Debian Buster with amdgpu. Requires patches to work, somewhat unstable but usable. Cannot use AST Integrated VGA and AMDGPU at the same time without causing conflict. Not tested at this moment for use in petitboot or firmware. 
* AMD Radeon Pro WX4100 (Polaris11 core) - May need at least linux 4.16 in order to get Xorg to work.
* AMD Radeon Pro WX5100
* AMD Radeon Pro WX7100 (Polaris10 core) - Available pre-installed on Talos II workstation, server, and desktop configurations.
* AMD Radeon RX 5700 (Navi 10) - Requires [https://lists.freedesktop.org/archives/amd-gfx/2019-December/043682.html kernel patches] to enable display output. 
* AMD Radeon RX 5700 XT (Navi 10) - Requires [https://lists.freedesktop.org/archives/amd-gfx/2019-December/043682.html kernel patches] to enable display output.

The core name is important when storing the firmware into the BOOTKERNFW partition in PNOR for use by skiroot.

=== NVIDIA ===
* NVIDIA Corporation G96 [GeForce 9500 GT] (rev a1) - Works in petitboot if onboard VGA is disabled. Currently has issues with only using 32-bit DMA. No firmware needed.
* NVIDIA RTX 2070 - usable for compute, but not 3D acceleration; integrated by Raptor as part of the Talos II PowerAI Development System configuration

=== Other ===
* [[AST2500|ASPEED AST2500]].  Works in both the main OS (LE mode) and Petitboot.  BE mode partially works (doesn't crash, but colors are wrong unless you apply a patch that is harmful to performance).
* [https://www.climaxdigital.co.uk/CUH195-USB-2-to-DVI-VGA-or-HDMI-Adaptor-1080p-full-hd ClimaxDigital CUH195 USB 2.0 Graphic Adapter] - Based on DisplayLink DL-3500 chipset.  Works in the main OS; not tested with Petitboot but is likely to work there too.
* EVGA 100-U2-UV12-A1 UV Plus USB VGA Adapter - DisplayLink Based - Petitboot shows up without loading firmware. Not tested in OS.

=== Unknown if working (good candidates to test) ===
* [https://www.aspeedtech.com/products.php?fPath=20&rId=455 ASPEED AST2510].  It's the GPU component of the [[AST2500]] without the BMC component.  Might be useful for users who want to add additional VGA displays beyond the single VGA display supported by the built-in AST2500, with similar freedom and performance properties as the AST2500.  Known suppliers of AST2510 devices are:
** [https://www.win-ent.com/1U-Rackmount-Platforms/pl-81280 WIN Enterprises IP-492B]
** [https://web.archive.org/web/20190505060931/http://www.aewin.com.tw/uploads/files/acbd8aee4c81584332ee56cf11ec230e.pdf AEWIN Technologies R492B (Warning: non-TLS link)]
* [https://www.aspeedtech.com/products.php?fPath=20&rId=377 ASPEED AST1400].  Older revision of the AST2510 (AST1400 is 5th generation; AST2510 is 6th generation).  Known suppliers of AST1400 devices are:
** [https://dls.ieiworld.com/IEIWeb/Reserved/0F233000410888189307/IGCME-1300%20QIG%20V1.10_20150819.pdf IEI Integration Corp IGCME-1300-R11]
* [https://www.aspeedtech.com/products.php?fPath=20&rId=244 ASPEED AST1300].  Older revision of the AST2510 (AST1300 is 4th generation; AST2510 is 6th generation).  Known suppliers of AST1300 devices are:
** [http://archivecaslytosk.onion/QZROL IEI Integration Corp IGCME-1300-R10]

== Sound Cards ==

===Working===
* Creative Sound Blaster Audigy FX SB1570 PCIe 5.1 Sound Card
* Creative Sound Blaster X-Fi Xtreme Fidelity PCIe Audio Sound Card (SB0880)
* AMD Radeon HD 5850 and 7950 (HDMI audio)
* [http://www.vantecusa.com/products_detail.php?p_id=156&p_name=+USB+Stereo+Audio+Adapter&pc_id=9&pc_name=Adapters&pt_id=3&pt_name=Audio+%2B++Video#tab-1 VANTEC NBA-120U (USB)]
* Sabrent USB External Stereo Sound Adapter (AU-MMSA)
* [http://mackie.com/products/onyx-blackjack Mackie Onyx Blackjack (USB) Recording Interface]
* RME HDSPe AIO (FreeBSD tested)
* Leveraged Sabrent Bluetooth 4.0 USB adapter (model BT-UB40) to connect to wireless Bluetooth headphones, specifically Bose Quiet Comfort 35.

===Non-working===
* ASUS Xonar SE - Contains ASMedia USB host controller with errant DMA access flaw
* Creative Sound Blaster Audigy PCIe RX 7.1 - unable to enable emu10k1 driver on little-endian power9 kernel as driver requires ZONE_DMA

==USB Host Controllers==
===Working===
* Insignia USB 3.0 PCI-e NS-PCCUP53 V1.0 (Chipset: NEC D720202)
* AGAXO PCEU-23R (Chipset: Renesas uPD720202, PCI id 1912:0015)
* Terminus Technology Inc. FE 2.1 7-port Hub
* [https://www.sonnettech.com/product/legacyproducts/allegroprousb3pcie.html Sonnet Allegro Pro USB 3.0 PCIe USB3-PRO-4PM-E] (Chipset: Four [http://www.frescologic.com/product/single/fl1100ex/ Fresco Logic FL1100EX] controllers behind one [https://www.broadcom.com/products/pcie-switches-bridges/pcie-switches/pex8608 PLX PEX 8608] switch)
* [http://www.vantecusa.com/products_detail.php?p_id=125&p_name=+4-Port+SuperSpeed+USB+3.0+PCIe+Host+Card+w%2F+Internal+20-Pin+Connector&pc_id=16&pc_name=USB&pt_id=4&pt_name=Add-on+Cards Vantec UGT-PC345 4 Port USB 3.0 PCIe w/ Internal 20 pin] (Chipset: Renesas uDP720201)
* [https://www.amazon.com/gp/product/B07H4HJNJC] (monster card with 8 ports of USB 3.0) four Renesas uPD720202 chips behind ASMedia 1806, card can be found under different brands but can be identified by the look. [http://sedna-shop.com/index.php?route=product/product&path=59_74&product_id=138 This should be the same card]

===Non-working===
In general, USB3 host controllers based on ASMedia chipsets are known to be problematic, due to ASMedia hardware or firmware bugs causing errant DMA accesses to invalid regions of host memory.

* AXAGON PCEU-43V - chipset Via VL805 - PCI id 1106:3483
* StarTech PEXUSB314A2V - 2x ASM1142 host controllers and a PCIe switch
* QNINE USB 3.1 Gen2 (Type-A and Type-C) - ASM1142
** It's based on the the same reference design as all the other cheap ASM1142 cards, so there's a good chance those won't work either.
* Rosewill RC-509 - ASM1142
* Ableconn PU31-2C-2 - ASM2142

=== Unknown if working (good candidates to test) ===
* [http://sedna-shop.com/index.php?route=product/product&product_id=54 SEDNA - PCIe 7 Port USB 3.0 Adapter Card] (Chipset: NEC)
* [http://sedna-shop.com/index.php?route=product/product&product_id=99 SEDNA - PCIe 4 Port USB 3.0 Adapter Card] (Chipset: NEC uPD720201)
* [https://www.startech.com/Cards-Adapters/USB-3.0/Cards/7-port-pci-express-usb-3-card~PEXUSB3S7 StarTech PCIe 7 Port USB 3.0 Adapter Card] (Chipset: NEC uPD720201)

==TV Tuners==
* Hauppauge WinTV-quadHD
* Hauppauge WinTV HVR-850 (2040:7240) - ATSC - using Kaffeine

==Firewire Host Controllers==
===Working===

* [https://www.sybausa.com/index.php?route=product/product&product_id=119 Syba SY-PEX30016] (Chipset: TI XIO2213B)
** Requires [https://marc.info/?l=linux1394-devel&m=157207806405627&q=mbox this patch] to work on kernels with a 64k page size.

=== Unknown if working (good candidates to test) ===

* [http://www.dawicontrol.com/index.php?cmd=proddet&id=media Dawicontrol DC-FW800] (Chipset: TI XIO2213B)
* [https://www.delock.de/produkte/G_89210/merkmale.html?setLanguage=en DeLOCK 3x FireWire 800, Item No. 89210] (Chipset: TI XIO2213B)
* [https://www.digitus.info/en/products/computer-components/computer-peripherals/serial-parallel-adapter/ds-30203-2/ DIGITUS Firewire 800 (1394b) PCIe Card] (Chipset: TI XIO2213B)
* [https://www.exsys.de/index.php?page=product&info=127 Exsys EX-16415] (Chipset: TI XIO2213)
* [https://www.exsys.de/index.php?page=product&info=366 Exsys EX-16512E] (Chipset: TI)
* [http://www.ioi.com.tw/products/proddetail.aspx?CatID=106&DeviceID=3021&HostID=2009&ProdID=1060100 IOI Technology FWB-PCIE1X11A] (Chipset: TI XIO2213B)
[[Category:Compatibility List]]

==Video Capture Cards==
* [https://www.avermedia.com/professional/product/ce310b/overview AVerMedia CE310B] (Chipset: Conexant CX23888)
** Requires [https://patchwork.linuxtv.org/patch/60199/ this patch] to enable it.