CodingBox Documentation

SmartNICs and DPUs: optics on programmable adapters

A data processing unit (DPU) or SmartNIC is a NIC with its own processors, memory and operating system, sitting between the server's PCIe bus and the network. For the optics nothing changes at the cage — the same QSFP56/QSFP112/OSFP modules and cables — but the entity that reads the module, applies policy and configures speed and FEC is now a small computer on the card, often running a Linux or SONiC-like stack. This page lists the current DPU families and their ports, explains where module management lives, and covers the optics-specific consequences: power, cooling, twin-port cages and AI back-end fabrics.

Families and ports

FamilyGenerationPortsCagesHost PCIeCores
Nvidia BlueField-220202 × 25/100G or 1 × 200GSFP56 / QSFP56Gen 4 x168 × Arm A72
Nvidia BlueField-320232 × 200G or 1 × 400G; SuperNIC variants 400GQSFP112 / OSFPGen 5 x1616 × Arm A78
Nvidia ConnectX-8 SuperNIC2024–251 × 800G or 2 × 400GOSFP (twin-port) / QSFP112Gen 6 x16(NIC + limited programmability)
AMD Pensando Elba / Giglio / Salina (400)2021–252 × 100/200G; 2 × 400GQSFP56 / QSFP112Gen 4/5 x1616 × Arm A72/N1 + P4 pipeline
Intel IPU E2000 (Mount Evans)20222 × 100G (200G total)QSFP28/56Gen 4 x1616 × Arm N1 + P4
Marvell Octeon 10 DPU2022up to 400G aggregateQSFP-DDGen 5Arm N2
Microsoft/Fungible, Napatech, Xilinx Alveo SN1000various2 × 100GQSFP28FPGA / MIPS

Port cages and speeds follow the same rules as plain NICs (NIC ports & PCIe).

Where module management lives

ModeWho reads the moduleTools
Embedded / DPU mode (Arm side owns the ports)the DPU's own OS (Ubuntu/DOCA, SONiC-DASH, vendor Linux) via its driverethtool -m, mlxlink on the Arm side; host sees virtual functions only
Separated host / NIC modehost driver, as on a ConnectXhost ethtool, mlxlink (NIC tools)
Restricted modeDPU controls, host cannot change link settingspolicy enforced on the DPU

Consequences: firmware and link settings (speed, FEC, breakout) are configured on the DPU (mlxconfig, DOCA tools, Pensando penctl) and survive host reboots; a module rejected or downgraded by the DPU is invisible to the host administrator until the DPU's logs are read. Module policy itself is permissive on Nvidia and AMD (parses any EEPROM), as on their NICs (Optics compatibility on NICs).

Power and cooling

ItemDPU reality
Card power75–150 W (BlueField-3 ~150 W with aux connector) — the card itself is hotter than any module on it
Cage budgetQSFP112/OSFP cages sized for 15–20 W modules; check the card's spec
Airflowfull-height cards in GPU servers share a hot aisle with GPUs; module DDM temperature 60–70 °C is normal, alarms at 75+ (Temperature grades)
Twin-port OSFPone OSFP cage carries 2 × 400G; the module (or twin-port DAC/AOC) is a single 800G-class device with its own heat sink (OSFP)
Optics choiceDAC where the ToR is within 2 m, otherwise AOC or 400G/800G DR/FR; LPO variants cut module power on short links (Power & consumption)

AI back-end fabrics

In GPU clusters a DPU or SuperNIC per GPU connects to the rail-optimised back-end fabric, InfiniBand or RoCE Ethernet (GPU fabrics):

LinkTypical optics
NDR 400G IB per GPUtwin-port OSFP 2 × 400G; DAC/ACC ≤ 3 m to rail leaf, AOC 3–50 m, DR4/SR4 optics further (IB cables)
XDR 800G IB / 800G Ethernet per GPUOSFP 800G twin-port, 2 × DR4 or SR8
Front-end / storageseparate 100/200G ports on the DPU or a second NIC

Cable identity and length are validated by the fabric manager; module firmware versions are part of the cluster's qualified bill of materials (Cabling an AI cluster, Link reliability & monitoring).

SONiC and P4 on the card

DPUs running SONiC-DASH or P4 pipelines treat their ports like a small switch: port breakout, FEC and speed are set in the DPU's configuration database, and transceiver EEPROM appears under the same show interfaces transceiver commands as on a SONiC switch (NOS landscape). Behaviour toward third-party modules is that of the platform plugin — permissive.

In CodingBox

A module destined for a DPU is qualified like one for a switch or NIC: form factor and compliance (QSFP112/OSFP, 400G/800G applications in CMIS), power class against the cage, and firmware version for the cluster's BOM — all readable on the bench before the card is installed (Check transceiver, CMIS).