ARCHITECTURE / 2015—2026
AI Infrastructure Library
中文
← All companiesDownload PDFMarkdown

Intel AI Infrastructure Architecture Evolution

2015-2026 | 2026-09-28

01 Executive synthesis and scope

Intel’s AI infrastructure history is a history of several interacting architectures, rather than a single accelerator succession. Xeon remains the general-purpose execution and orchestration layer. Gaudi builds a training system around matrix engines and integrated Ethernet. Ponte Vecchio pursues heterogeneous packaging and high-performance scientific computing. IPUs remove infrastructure work from tenant CPUs. The latest inference GPU direction emphasizes model capacity and deployment into air-cooled servers. The central architectural question is how these independently developed components form a useful system.

Coverage runs from 2015 to 28 September 2026, with a short Haswell baseline. The organizing unit is the product generation. CPU and accelerator sections receive the greatest depth; networking, IPUs, packaging, optics, FPGA, memory, software and systems complete the portfolio. Client and edge products appear where they explain shared technology or a distinct deployment model. This is a curated technical history, not an inventory of every SKU or every Intel-affiliated conference paper.

The most consequential CPU transitions are the move from ring to mesh, the separation of private-cache and last-level-cache roles, the arrival of AMX and integrated offload engines, and the split into performance-core and efficiency-core server products. Chiplets then change from a way to extend die area into a way to place cores, cache and I/O on different processes. Clearwater Forest makes that separation vertical; Diamond Rapids extends it into a new announced performance-core platform. On accelerators, continuity is weaker: technical achievement and commercial roadmap survival must be assessed separately.

Portfolio map at the cutoff

Layer Families Architectural role Status boundary
Host compute Xeon Scalable / Xeon 6 / 6+ General compute, AMX, orchestration Diamond Rapids disclosed; GA not established
Accelerators Gaudi / GPU Max / Flex / Crescent Island Training, HPC, media and inference Crescent Island announced; Falcon Shores internal only
Network / infrastructure E810 / E830 / E835; IPU E2000/E2100 RDMA, packet processing, storage isolation NIC and IPU are different device classes
Adjacent technology EMIB / Foveros / OCI / Altera / Optane Integration, optical links, programmable logic, memory OCI demonstration; Altera 49% retained; Optane exited

02 How to read the numbers

All bandwidths use decimal GB/s or TB/s. DRAM peak equals channels × transfer rate × eight data bytes; ECC bits do not add payload bandwidth. PCIe figures are per direction and precede protocol overhead. Ethernet Gb/s is divided by eight before comparison with memory bandwidth. A bidirectional aggregate is divided by two only when the source makes that convention explicit. HBM, package fabric, scale-up and scale-out bandwidth remain separate budgets.

CPU rows use representative high-end shipping configurations, not a composite assembled from different SKUs. Accelerator arithmetic is dense peak, with multiply-add counted as two operations. Tensor BF16 is not vector BF16; emulated formats are not native formats. Historical shipping does not mean currently orderable. Announcement, sampling and general availability are distinct. n/d means the reviewed evidence did not establish the value; n/a means the field does not apply. Sources are collected in the final source map and bibliography so the narrative can remain readable.

03 Xeon generation atlas

The table is a reference-SKU comparison: 8592+ is 350 W, while other Emerald Rapids SKUs have different power limits. Cooper Lake and Ice Lake are both called third-generation Xeon Scalable but address different socket segments and use different cores. Sierra Forest’s shipping 144-core reference must not be silently replaced by an earlier 288-core roadmap target. The Diamond Rapids row records the August 2026 disclosure, not final SKU specifications. Its memory figure is a channel-rate calculation; the reviewed announcement does not establish the final DIMM qualification matrix.

CPU reference configurations

Generation / reference SKU Codename GA Status Core µarch Cores / threads Process per die Dies / packaging L2 per core L3 / domain Memory: channels; rate; GB/s Sockets / links PCIe / CXL TDP Vector / matrix ISA
E5 v4 / 2699 v4 Broadwell-EP 2016 Historical shipping Broadwell 22 / 44 14 nm Monolithic; ring 256 KB 55 MB inclusive DDR4; 4; 2400; 76.8 2S; QPI 9.6 GT/s 40 PCIe 3; CXL n/a 145 W AVX2
1st / 8180 Skylake-SP 2017 Historical shipping Skylake 28 / 56 14 nm Monolithic; mesh 1 MB 38.5 MB non-inclusive DDR4; 6; 2666; ~128 2/4/8S; 3 UPI 10.4 GT/s 48 PCIe 3; CXL n/a 205 W AVX-512
2nd / 8280 Cascade Lake 2019 Historical shipping Skylake-derived 28 / 56 14 nm Monolithic; mesh 1 MB 38.5 MB DDR4; 6; 2933; ~140.8 2/4/8S; 3 UPI 10.4 GT/s 48 PCIe 3; CXL n/a 205 W AVX-512; VNNI
3rd / 8380HL Cooper Lake 2020 Historical shipping Skylake-derived 28 / 56 14 nm Monolithic; scale-up 1 MB 38.5 MB DDR4; 6; 3200; 153.6 4/8S; 6 UPI 10.4 GT/s 48 PCIe 3; CXL n/a 250 W AVX-512; BF16; VNNI
3rd / 8380 Ice Lake-SP 2021 Historical shipping Sunny Cove 40 / 80 10 nm Monolithic; mesh 1.25 MB 60 MB DDR4; 8; 3200; 204.8 2S; 3 UPI 11.2 GT/s 64 PCIe 4; CXL n/a 270 W AVX-512; VNNI
4th / 8490H Sapphire Rapids 2023 Historical shipping Golden Cove 60 / 120 Intel 7 4 compute tiles; EMIB 2 MB 112.5 MB DDR5; 8; 4800; 307.2 up to 8S; 4 UPI 16 GT/s 80 PCIe 5; CXL 1.1 350 W AVX-512; AMX INT8/BF16
Xeon Max / 9480 Sapphire Rapids HBM 2023 Historical shipping Golden Cove 56 / 112 Intel 7 4 tiles + 4 HBM stacks; EMIB 2 MB 112.5 MB DDR5; 8; 4800; 307.2 + HBM2e 64 GB ~1000 2S; UPI 16 GT/s 80 PCIe 5; CXL 1.1 350 W AVX-512; AMX INT8/BF16
5th / 8592+ Emerald Rapids 2023-12 Historical shipping Raptor Cove 64 / 128 Intel 7 2 tiles high-end; EMIB 2 MB 320 MB DDR5; 8; 5600; 358.4 2S; 4 UPI 20 GT/s 80 PCIe 5; CXL 1.1 350 W AVX-512; AMX INT8/BF16
6 E / 6780E Sierra Forest 2024-06 Shipping Crestmont 144 / 144 Intel 3 + Intel 7 I/O Compute + 2 I/O; EMIB 4 MB / 4-core cluster 108 MB DDR5; 8; 6400; 409.6 2S; UPI 24 GT/s 88 PCIe 5; CXL 2.0; shared lane budget 330 W AVX2; VNNI; no AMX
6 P / 6980P Granite Rapids 2024-09 Shipping Redwood Cove 128 / 256 Intel 3 + Intel 7 I/O 3 compute + 2 I/O; EMIB 2 MB 504 MB DDR5; 12; 6400; 614.4 / MRDIMM 8800; 844.8 2S; UPI 24 GT/s 96 PCIe 5; CXL 2.0 500 W AVX-512; AMX INT8/BF16/FP16
6+ / 6990E+ Clearwater Forest 2026-06 Shipping Darkmont 288 / 288 Intel 18A compute; Intel 3 base; Intel 7 I/O 12 compute + 3 base + 2 I/O; 3D + EMIB n/d 576 MB DDR5; 12; 8000; 768 2S; link details n/d 96 PCIe 5; CXL allocation n/d 450 W AVX2; no AMX
Next Xeon Diamond Rapids n/d Disclosed; GA n/d New performance core 256 / n/d Intel 18A-P Foveros Direct 3D; UCIe-S n/d 1.28 GB 16; 12800 MT/s; 1638.4 derived n/d 128 PCIe 6; CXL 3.0 n/d APX; enhanced AMX

04 Haswell and Broadwell: the monolithic baseline

Haswell-EP established the 2015 starting point with AVX2, DDR4 and a ring-connected server die. Broadwell-EP’s 2016 shrink to 14 nm raised the high-end E5 core count to 22 while retaining a 256 KB private L2 and a large inclusive LLC. The important constraint is the balance among cores, four memory channels and the ring. More cores increase aggregate execution demand without proportionately increasing off-chip bandwidth. Even before dedicated AI hardware, streaming and sparse workloads could run out of memory bandwidth before they ran out of arithmetic.

E5-2600 and E7 should be kept separate: E7 emphasized larger coherent socket domains and reliability, while E5 defined mainstream one- and two-socket servers. Xeon D brought related x86 technology into an integrated, lower-power SoC for network and edge systems. Desktop Core shared a core lineage but not the server’s memory-channel count, cache organization or socket interconnect. This distinction remains necessary throughout the report: core architecture is only one component of a server product.

05 Skylake, Cascade Lake and Cooper Lake

Skylake-SP’s 2017 change is architectural, not merely a core-count increment. A two-dimensional mesh replaces the ring. Private L2 grows from 256 KB to 1 MB, while the LLC becomes smaller per core and non-inclusive. Capacity comparisons that add or compare L3 alone therefore misread the hierarchy. The larger private cache retains active data closer to execution; the LLC can act more effectively as a shared capacity and victim resource. Mesh routing, directory behavior and sub-NUMA clustering make placement important even inside one socket.

Six DDR4 channels, UPI and AVX-512 accompany the mesh. AVX-512 doubles vector width relative to AVX2, but supported execution resources and operating frequency depend on SKU and instruction mix. Sustained application gain cannot be inferred from width alone. Cascade Lake keeps this broad organization and adds VNNI to reduce the instruction work for low-precision dot products. Its Optane persistent-memory support changes capacity and persistence semantics, not simply memory speed. The 9200-series Cascade Lake AP places two dies in one package; its 56-core headline is a separate product construction.

Cooper Lake adds AVX-512 BF16 and stronger multi-socket connectivity for scale-up systems. It is not the same silicon generation as Ice Lake, despite sharing the third-generation Xeon Scalable label. BF16 keeps FP32-like exponent range while shortening the significand, making it useful for neural-network arithmetic with appropriate accumulation. This is still vector execution, before AMX’s tile-based matrix datapath. Hot Chips’ Cascade Lake presentation supplies the feature transition; product and optimization documentation identify the actual deployment and programming constraints.

06 Ice Lake: a wider core and a wider server

Ice Lake-SP arrives in 2021 with Sunny Cove, up to 40 cores, eight DDR4 channels and PCIe 4. The core expands out-of-order resources and the memory subsystem relative to the Skylake family, while the server implementation supplies a 1.25 MB L2 per core. A client Sunny Cove block diagram is useful background but is not a substitute for server cache and uncore documentation. The shift to eight memory channels raises theoretical DDR bandwidth to 204.8 GB/s, a substantial system change alongside the process and core improvements.

The server gains a more useful I/O budget for storage and accelerators, while SGX and memory-protection features address cloud isolation requirements. Yet it remains a monolithic CPU with a conventional external accelerator relationship. PCIe 4 x16 offers about 31.5 GB/s in one direction before higher-level overhead, far below the local memory bandwidth of contemporary HBM accelerators. Offloading a small kernel can therefore lose to keeping the computation on the CPU once transfer and synchronization are included. Xeon D derivatives adapt related technology to edge connectivity and long-lived platforms rather than reproducing the full server socket.

07 Sapphire Rapids and Xeon Max: tiles and engines

Sapphire Rapids, commercially launched in January 2023, combines Golden Cove cores with DDR5, PCIe 5, CXL 1.1 and a four-tile EMIB construction in its high-end configuration. Each tile participates in a package-wide coherent system rather than exposing four independent processors. The ISSCC 2022 disclosure describes a quasi-monolithic integration approach and 10 TB/s of total die-to-die bandwidth across 20 interfaces at 0.5 pJ/bit. Those are implementation-level aggregate figures; they are not socket DRAM bandwidth or a software-visible remote-memory guarantee. Intel 7 is the commercial process name despite differing terminology in some conference summaries.

AMX changes CPU AI execution more fundamentally than another vector-width increase. Software configures tile registers and invokes matrix operations on blocks of INT8 or BF16 data. Libraries must select supported kernels, pack operands and manage tile state. Matrix peak rises faster than DRAM bandwidth, so cache reuse and batching become more valuable. AMX is therefore especially useful when a workload can retain data in cache or amortize weight reads; it does not make every inference workload compute-bound. CPU computation remains attractive for control-heavy operators and modest deployment sizes.

DSA, IAA, QAT and DLB target different kinds of overhead: data movement, analytics/compression, cryptography/compression, and event distribution. Their value comes from removing work and cache pollution from cores, but queue submission, completion, data locality and minimum useful transfer sizes still matter. The ASPLOS 2024 DSA study measures these tradeoffs on actual hardware. A block appearing on the package is not evidence that an application automatically uses it; software enablement and SKU licensing/configuration must be checked.

Xeon Max adds 64 GB of HBM2e around the CPU tiles, exposing HBM-only, flat and cache usage modes. This brings roughly 1 TB/s of local high-bandwidth memory to CPU code without converting the application to a GPU execution model. In flat mode, allocation policy determines which objects receive HBM service; in cache mode, locality and working-set behavior determine the benefit. HBM and DDR peaks cannot simply be added as the sustained bandwidth of one stream. Capacity-limited applications may still require DDR, while bandwidth-heavy scientific kernels can benefit substantially from the near-memory tier.

08 Emerald Rapids: cache and integration efficiency

Emerald Rapids launches in December 2023 on the established platform, with up to 64 cores and 320 MB LLC. The high-end implementation uses two larger tiles rather than Sapphire Rapids’ four-tile arrangement. Reducing tile boundaries changes fabric traffic, physical integration and cache organization without requiring a wholesale platform replacement. ISSCC 2024 is the useful implementation anchor: the disclosure emphasizes the Intel 7 multichip construction and substantially larger shared cache. Its reported iso-power workload gains are measured comparisons, not a universal IPC multiplier.

The representative 64-core part provides 5 MB of LLC per core, versus 1.875 MB for the 60-core Sapphire Rapids reference. That capacity increase can reduce expensive DRAM accesses for databases, graph structures and reused model data. DDR5-5600 also raises the channel peak, but the architectural gain depends on whether a workload was cache-capacity-limited, bandwidth-limited or compute-limited. This generation demonstrates why packaging and cache redesign can matter even when the process node and major matrix ISA remain unchanged.

09 Xeon 6: separating performance and density

Hot Chips 2023 disclosed the shared platform strategy behind Granite Rapids and Sierra Forest before their 2024 launches. Compute tiles and I/O tiles are separated, allowing Intel 3 cores to be combined with Intel 7 I/O. The server family offers common infrastructure with different compute choices; it is not a hybrid desktop CPU mixing P-cores and E-cores in one socket. DDR5, CXL 2.0 and built-in accelerators belong to the platform story, while vector capability, cache organization and thread behavior remain core-family-specific.

Granite Rapids’ high-end 6900P configuration reaches 128 Redwood Cove cores, three compute tiles, twelve memory channels and 500 W on the 6980P reference. MRDIMM raises the qualified memory data rate to 8800 MT/s, yielding 844.8 GB/s of theoretical channel bandwidth. AMX adds FP16 support. The engineering point is balanced throughput: a much larger core complex needs more memory bandwidth and package connectivity, not just faster cores. The 6700P expansion in 2025 serves a different platform and channel envelope; its specifications should not be mixed with 6900P.

Sierra Forest’s 144-core shipping reference uses Crestmont E-cores without SMT or AMX. Four-core clusters share L2. The intended gain is density for independent throughput-oriented services, not equivalence to 144 large vector cores. A cloud service with many small requests can exploit this configuration; a heavily vectorized AMX workload cannot assume the same instruction path as Granite Rapids. At full population, the reference has about 2.84 GB/s of DRAM channel bandwidth per core. Core count is therefore meaningful only alongside workload concurrency, cache behavior and memory demand.

10 Clearwater Forest and Diamond Rapids

Clearwater Forest was discussed at Hot Chips 2025 and MWC 2026, then launched as Xeon 6+ in June 2026. Its 288 Darkmont E-cores occupy twelve Intel 18A compute chiplets above three Intel 3 base dies, with Intel 7 I/O. Foveros Direct 3D and EMIB combine vertical and lateral integration. This separates dense compute from cache/fabric and I/O implementation. The architectural opportunity is process specialization and shorter dense vertical connections; the corresponding engineering burden includes assembly yield, thermal coupling, power delivery and fabric placement.

The 6990E+ reference has 576 MB LLC and twelve DDR5-8000 channels. Compared with Sierra Forest’s reference, core count doubles while DRAM peak rises from 409.6 to 768 GB/s. Per-core channel bandwidth therefore changes from about 2.84 to 2.67 GB/s, while average LLC capacity rises from 0.75 to 2 MB per core. This is a cache-and-density design, not a claim that every core receives more external bandwidth. Its 288 cores are 288 hardware threads; multiplying by two would incorrectly apply P-core SMT behavior.

At Hot Chips 2026, Intel disclosed Diamond Rapids with up to 256 new cores, 1.28 GB LLC, sixteen memory channels at 12800 MT/s, 128 PCIe 6 lanes and CXL 3.0. Intel 18A-P, Foveros Direct 3D, UCIe-S, a unified memory fabric, APX and enhanced AMX define the announced direction. The design moves performance-core Xeon toward a much larger distributed package. The public announcement establishes these headline parameters; it does not establish final SKU power, detailed queue sizes, thread count or commercial availability. Coral Rapids remains a subsequent roadmap name rather than a table of shipping specifications.

11 Accelerator generation atlas

Accelerator reference configurations

Product Architecture GA / milestone Status Process Dies / packaging Compute units Dense BF16 Dense FP8 Dense FP6 / FP4 FP64 vector / matrix Memory: type; stacks; GB; TB/s LLC / SRAM Scale-up: links; GB/s per direction; domain Host link Power / cooling Form factor
Xeon Phi 7290 Knights Landing 2016 Historical shipping 14 nm CPU + on-package MCDRAM 72 cores / 288 threads n/a n/a n/a ~3.46 TF / n/a MCDRAM; 8; 16; >0.4 measured STREAM; DDR4 separate 36 MB distributed L2 n/a; optional Omni-Path fabric Self-hosted; PCIe 3 245 W Socketed processor
Gaudi / HL-205 Gaudi 2021 AWS DL1 Historical shipping 16 nm 1 compute die + HBM 8 TPC; MME n/d n/a n/a n/a HBM2; n/d; 32; ~1 n/d 10 x 100GbE; 125 total; 8-device server PCIe 4 n/d OAM
Gaudi 2 Gaudi 2 2022 Historical shipping 7 nm 1 compute die + HBM 24 TPC / 2 MME 432 TF 865 TF n/a n/a HBM2e; 6; 96; 2.46 48 MB SRAM 24 x 100GbE; 300 total; 8-device server PCIe 4 x16 600 W OAM
Gaudi 3 / HL-325L Gaudi 3 2024 Shipping 5 nm 2 compute dies + HBM 64 TPC / 8 MME 1678 TF 1678 TF n/a n/a HBM2e; 8; 128; 3.7 96 MB SRAM 24 x 200GbE; 600 total; 8-device server PCIe 5 x16 Up to 900 W; air/liquid variants OAM
GPU Max 1550 Ponte Vecchio / Xe-HPC 2023 Historical shipping TSMC N5 compute; Intel 7 base; TSMC N7 link 47-tile integration; EMIB + Foveros 128 Xe cores / 1024 XMX 839 TF n/a n/a 52 TF native; split n/d HBM2e; 8; 128; 3.2 408 MB L2 Xe Link; 318 on Lenovo reference; 4-GPU domain PCIe 5 x16 600 W; platform-dependent OAM
GPU Flex 170 Xe-HPG 2022 Historical shipping TSMC N6 Single GPU 32 Xe cores n/d n/a n/a n/d GDDR6; n/a; 16; 0.576 n/d n/a PCIe 4 x16 150 W; passive air PCIe
Crescent Island Xe3P n/d Disclosed; GA n/d n/d n/d 32 Xe cores / 256 XMX n/d n/d n/d n/d LPDDR5X; n/a; up to 480; n/d n/d n/d PCIe; generation n/d 350 W; air PCIe

Gaudi 3 uses the retrieved architecture whitepaper’s 1678 TFLOPS BF16/FP8 values, not a mixture with other clock-point marketing figures. The 600 W HL-338 PCIe card is a separate configuration and should not inherit OAM peak numbers without verification. GPU Max’s 636 GB/s bidirectional Xe Link figure comes from the specific Lenovo system specification and is normalized to 318 GB/s per direction. It is not a claim that every Ponte Vecchio system exposes the same external link topology. Xeon Phi is included as a historical many-core accelerator lineage, although Knights Landing can boot its own operating system.

12 Xeon Phi and Nervana: earlier parallel-compute paths

Knights Landing, disclosed at Hot Chips 2015 and commercialized in 2016, combines many small x86 cores, four hardware threads per core, wide vector execution, a mesh and 16 GB of on-package MCDRAM. It is more than a PCIe coprocessor: a self-hosted system can run a conventional operating system and use DDR4 for capacity. Cache, flat and hybrid memory modes expose an early version of the placement problem later revisited by Xeon Max. The software appeal is x86 and familiar parallel programming; achieving throughput still requires vectorization, many concurrent threads and careful memory use.

Knights Mill redirected the many-core line toward deep learning with specialized vector instructions, but it did not become the AMX architecture used by later Xeons. Nervana’s NNP-T and NNP-I subsequently explored dedicated training and inference datapaths. Intel’s acquisition of Habana and the later concentration on Gaudi changed the commercial direction. These branches belong in the history because they reveal changing assumptions about programmability, numerical formats and interconnect, not because they form a continuous shipping sequence into current GPUs. A discontinued program’s projected successor must not appear as a delivered generation.

13 Gaudi 1, 2 and 3: Ethernet inside the accelerator

Gaudi begins with a different decomposition from a graphics-derived GPU. Matrix multiplication engines perform the dense linear algebra; programmable Tensor Processor Cores handle the surrounding operations; local HBM supplies capacity and bandwidth; integrated RoCE-capable Ethernet ports carry device communication. AWS DL1’s October 2021 general availability provides a concrete first-generation deployment milestone: eight Gaudi devices with 32 GB HBM each. Its 400 Gb/s instance networking is a cloud service limit and must not be confused with the sum of every on-chip Gaudi port.

Gaudi 2 scales the design to 24 TPCs, two MMEs, 96 GB HBM2e and 24 × 100 GbE ports. The matrix path supports BF16 and FP8 at different peak rates. A large software-managed SRAM helps reuse data and reduce HBM traffic, but it is not automatically equivalent to a CPU’s coherent last-level cache. The architecture depends on compiler scheduling across matrix, vector, DMA and communication resources. Its main system distinction is the ability to build both the local accelerator group and the external fabric from Ethernet mechanisms.

Gaudi 3 moves to two compute dies, eight MMEs, 64 TPCs, 128 GB HBM2e and 24 × 200 GbE. The two-die construction expands compute and memory interfaces, while communication must cross internal partitions when data is not local. On the eight-accelerator baseboard, 21 ports per device supply three links to each of seven peers, leaving three ports for scale-out. That partitions the 600 GB/s one-way all-port budget into 525 GB/s local peer traffic and 75 GB/s external traffic. The total cannot be counted independently in both directions and both roles.

Integrated networking removes the need for a separate NIC for these accelerator links, but it does not remove the Ethernet switching fabric, congestion control, cabling or collective algorithms. HCCL, SynapseAI and framework integration determine whether the hardware overlaps communication with computation and supports the needed operators. Gaudi 3’s PCIe variant extends deployment into more conventional servers with a different power envelope. The practical comparison with a GPU system is therefore a complete supported training or inference configuration, including software and network topology, rather than a single peak-FLOPS column.

14 Ponte Vecchio: a heterogeneous HPC package

Ponte Vecchio’s ISSCC 2022 disclosure is one of the clearest examples of implementation driving architecture. The 47-tile integration includes sixteen 5 nm compute tiles and multiple process technologies, connected through Foveros and EMIB. The count is not 47 compute dies. Compute tiles, base/cache resources, link tiles and HBM perform different roles. This lets each function use a suitable manufacturing and integration choice, at the cost of complex assembly, testing, power delivery and thermal management. The conference prototype’s measured figures and the later GPU Max SKU peaks are different evidence points.

The commercial Max 1550 combines 128 Xe-HPC cores, XMX matrix execution, strong native FP64, 128 GB HBM2e and a large distributed L2. Unlike an inference-only accelerator, it invests heavily in scientific arithmetic and HPC execution. Xe Link connects peer GPUs; PCIe connects the host. A unified programming abstraction does not make CPU DDR and GPU HBM physically uniform or equally fast. Aurora demonstrates a system built around CPU and GPU high-bandwidth memory, but its communication and placement costs still have to be managed by applications and runtimes.

Ponte Vecchio’s technical success as an integration vehicle should be separated from the breadth and longevity of the commercial line. Lenovo’s SD650-I V3 product guide is explicitly marked withdrawn, despite documenting a real four-GPU system. Falcon Shores was later designated an internal test chip rather than a marketed successor. Consequently, it is misleading to draw an uninterrupted arrow from Xeon Phi through GPU Max to a shipping Falcon Shores platform. Product continuity, software support and deployable system supply are architecture constraints in their own right.

15 Flex, Arc and Crescent Island: inference branches

Flex 140 and Flex 170 serve media processing, cloud graphics, virtualization and visual inference with Xe-HPG technology and GDDR6. Flex 140 places two small GPUs on a 75 W card, with separate 6 GB memories; these are not one coherent 12 GB GPU. Flex 170 uses one 32-core GPU with 16 GB and a 150 W board envelope. Shared technology with Arc explains the graphics and media engines, but server drivers, virtualization, cooling and supported workloads determine the datacenter product. A graphics-derived matrix engine does not imply GPU Max’s FP64 or HBM characteristics.

Crescent Island is a distinct inference-oriented direction. The October 2025 OCP announcement described 160 GB LPDDR5X and customer sampling targeted for the second half of 2026. By Computex and Hot Chips 2026, Intel described up to 480 GB, a 350 W air-cooled PCIe card, 32 Xe3P cores and 256 XMX engines. The later capacity disclosure supersedes the earlier headline rather than proving that every future SKU has 480 GB. Sampling expectations are not general availability. No unsupported memory-bandwidth or low-precision throughput figure is inferred from the core count.

The architectural inference is that Intel is prioritizing resident model capacity, long contexts and installation in existing air-cooled facilities. Large memory can avoid model sharding and repeated host transfers, but capacity alone does not establish token latency. Decode may remain bandwidth-bound, while prefill demands matrix throughput; concurrency changes both. LPDDR and HBM therefore occupy different design points. The meaningful test is tokens per second at a specified latency, model, context length, precision and power limit, not whether one memory capacity number exceeds an HBM GPU’s capacity.

Core Ultra extends the same heterogeneous-compute idea into the client and edge, combining CPU, integrated GPU and NPU. The NPU’s low-power inference role differs from a datacenter training accelerator, while Arc-derived graphics and media technology connects to the Flex lineage. OpenVINO provides an inference deployment layer across supported CPU, GPU and NPU devices. Model conversion and common APIs help portability, but device plugins, supported operators, memory limits and precision still differ. Shared branding or a common runtime must not be used to transfer server GPU bandwidth or matrix rates to a client part.

16 Ethernet NICs, IPUs and programmable networks

Network and infrastructure devices

Product GA / milestone Status Class Ports × speed SerDes Host interface Programmable engine Embedded CPU On-card memory Transport / RDMA Congestion control Key offloads Power
E810 2019 Historical shipping Ethernet NIC Up to 100GbE; card-dependent 25G NRZ PCIe 4 DDP pipeline profiles n/a n/d iWARP / RoCEv2 Protocol / driver-dependent Virtualization, RSS, timing n/d
E830-CQDA2 2025 Shipping Ethernet NIC 2 x 100GbE 50G PAM4 PCIe 5 x8 / PCIe 4 x16 DDP / packet classification n/a n/d Ethernet; RDMA SKU-dependent n/d Packet processing, timing, telemetry n/d
E835 2026-06 Shipping Ethernet NIC 1 x 200 / 2 x 100GbE; variants n/d n/d Configurable ports / packet processing n/a n/d iWARP + RoCEv2 n/d RDMA, timing, security n/d
IPU E2100-CCQDA2 2023-2024 documentation Shipping ASIC IPU 1 x 200 / 2 x 100GbE 50G PAM4 / 25G NRZ PCIe 4 x16 P4 pipeline 16 Arm Neoverse N1 48 GB LPDDR4x; 32 MB SLC Ethernet; programmable storage transport Traffic shaping; implementation-specific NVMe, IPsec, crypto, compression, isolation n/d
Gaudi 3 integrated NIC 2024 Shipping On-accelerator fabric 24 x 200GbE 48 x 112G PAM4 Internal to accelerator Communication engines n/a Uses accelerator memory RoCE Ethernet fabric configuration Device RDMA and collectives Included in accelerator power

Intel’s conventional Ethernet controllers evolve from E810’s 100 GbE generation toward E830 and E835 configurations reaching 200 GbE. These products support general server networking, virtualization, timing and selected RDMA capabilities. They should not be relabeled as dedicated AI collective engines merely because they can carry AI traffic. The host link, port allocation and transport configuration limit delivered bandwidth. A 200 Gb/s port is 25 GB/s in one direction before overhead; two connectors do not necessarily mean two independently available 200 Gb/s ports.

The IPU is a different architectural layer. Mount Evans/E2000 introduced an ASIC infrastructure processor co-developed with Google; E2100 adapter documentation specifies a 16-core Arm Neoverse N1 complex, a P4 packet pipeline, 48 GB LPDDR4x and hardware storage/security engines. The Arm cores run infrastructure software independently of the tenant host. The offload path can terminate virtual storage and networking while preserving a separate trust and management domain. E2000 denotes the family/architectural lineage; the E2100 adapter brief explicitly names an E2100 SoC, so those labels should not be collapsed into an unsupported silicon identity claim.

Google Cloud Next 2022 connected the IPU architecture to a real service: C3 combined fourth-generation Xeon with Google’s custom Intel IPU, initially in private preview and generally available in May 2023. This is stronger deployment evidence than a generic roadmap slide. FPGA-based IPU and SmartNIC designs represent another implementation branch, trading reconfigurability for a different power, cost and software profile. Tofino’s P4-programmable switch datapath is yet another class: switching and stateful packet processing do not make it a host IPU. Intel’s discontinuation of the Tofino line limits its role to historical infrastructure and deployed systems.

Architecture Day 2021 made the implementation branches explicit. Oak Springs Canyon combined Xeon D and Agilex FPGA as an IPU reference platform, while Arrow Creek became the N6000 FPGA-based acceleration development platform/SmartNIC. Mount Evans used an ASIC approach. The distinction matters when evaluating programmability: FPGA logic can change the datapath itself, whereas an ASIC packet pipeline exposes a bounded programming model and general-purpose cores handle exceptions and control. None of these names alone establishes a particular AI collective-offload capability.

17 Interconnect, memory, optics and programmable logic

Separate bandwidth domains

Interconnect Year / generation Lane rate Lanes / link GB/s per link per direction Links / device Topology Domain limit Coherence / semantics
PCIe 3 2010s 8 GT/s 16 15.75 Platform-dependent Root / switch tree n/a I/O; no general cache coherence
PCIe 4 Ice Lake / Gaudi 2 16 GT/s 16 31.51 Platform-dependent Root / switch tree n/a I/O DMA
PCIe 5 Sapphire / Gaudi 3 32 GT/s 16 63.02 Platform-dependent Root / switch tree n/a I/O; CXL is a separate protocol
CXL 1.1 → 2.0 → 3.0 SPR → Xeon 6 → Diamond PCIe PHY generation-dependent n/d n/d Shared physical lane budget Direct / switched by version n/d Cache / memory semantics by device type
Gaudi 3 Ethernet 2024 112G PAM4 SerDes 2 per 200GbE 25 24 3 links × 7 peers + 3 external 8 local RDMA; not CPU cache coherence
Xe Link / Max 1550 2023 n/d n/d n/d n/d System-wired GPU graph 4 GPU Lenovo reference Peer GPU memory traffic
Optical compute interconnect 2024 demo 32 Gb/s optical channel n/a 250 aggregate TX, derived n/a Optical chip-to-chip n/d Physical I/O demonstration, not a coherence protocol

UPI maintains CPU socket coherence, whereas PCIe is primarily an I/O transport and CXL adds defined cache and memory protocols over related physical links. Version support alone does not prove that every device type, switching configuration or pooling mode is enabled in a server. Real CXL measurements on Sapphire Rapids at MICRO 2023 show why latency, bandwidth asymmetry, placement and device implementation matter. A larger addressable memory tier is useful only if software places the right data there. The same reasoning applies to Optane: persistence requires crash-consistency mechanisms and has different read/write behavior from DRAM.

Intel’s OFC 2024 optical compute interconnect demonstration co-packaged an optical I/O chiplet with a CPU and carried live data. The disclosed 4 Tb/s bidirectional aggregate is 500 GB/s combined, or 250 GB/s per direction under the stated symmetric convention. Its purpose is to extend reach and improve electrical-to-optical integration as electrical package escape becomes expensive. It is a technology demonstration, not evidence that shipping Xeons already expose an optical coherent fabric. Optical I/O, Ethernet switching and memory coherence solve different layers of the system problem.

Altera’s Stratix and Agilex families bring reconfigurable datapaths, hardened interfaces and packaging experience into Intel’s historical infrastructure portfolio. FPGA acceleration is attractive when a streaming pipeline, protocol or low-latency operation can be specialized; it is not interchangeable with a general training GPU. EMIB’s role in FPGA integration also helps explain its later use in Xeon and GPU packages. Ownership changes the current portfolio boundary: the sale of 51% of Altera closed on 12 September 2025, leaving Intel with 49%. Treating Altera as a wholly owned Intel product group in 2026 would therefore be incorrect.

Optane was exited in 2022; a planned future persistent-memory module should not be counted as a shipped Sapphire Rapids feature. Omni-Path belongs to Intel’s earlier HPC fabric history, while subsequent Cornelis products belong to that company’s portfolio. Loihi 2 and Hala Point are neuromorphic research systems with event-driven computation and a different programming model, not drop-in datacenter GPUs. These technologies are important context, but none should be used to inflate the count of currently supported Intel AI training platforms.

18 Systems and software: the usable architecture

Representative deployed or documented systems

Platform Year / milestone CPU / accelerator count Scale-up domain Scale-out per accelerator Rack power Cooling
AWS DL1 2021 GA 2 Xeon; 8 Gaudi 8 Gaudi 400Gb/s instance ÷ 8 = 6.25 GB/s average; shared n/d n/d
Aurora 2023 installation; later user service 2 Xeon Max + 6 GPU Max / node 6 GPU node; Xe Link topology 8 x 200Gb/s NIC ÷ 6 = 33.3 GB/s average n/d Direct liquid
Lenovo SD650-I V3 2023; withdrawn 2024 Up to 2 Xeon + 4 GPU Max 4 GPU Adapter-dependent n/d Direct water cooling
Gaudi 3 HLB-325 2024 Host CPUs + 8 Gaudi 3 8 Gaudi 3 x 200GbE = 75 GB/s one-way n/d Air / liquid variants
Google C3 2023 GA Xeon 4th gen + custom IPU CPU virtual machine n/a n/d n/d

Aurora’s two CPU Max and six GPU Max devices per node demonstrate why system ratios matter. Eight Slingshot endpoints provide scale-out connectivity, but dividing their aggregate rate by six is an average budget, not six dedicated identical NIC paths. Affinity among CPU NUMA domains, GPU tiles and network endpoints affects real communication. Likewise, an eight-Gaudi baseboard’s local fully connected graph is not an entire datacenter fabric. Oversubscription, collective scheduling and failure recovery determine cluster behavior beyond the node.

Software milestones and hardware relationship

Stack / release Date / era Hardware enabled Key features / constraint
oneDNN / CPU framework libraries 2017-2026 Xeon AVX-512 / VNNI / AMX ISA dispatch, packing and kernel selection; application must use enabled path
oneAPI / SYCL / Level Zero 2020s Xe GPU / CPU Shared programming model; placement and device-specific tuning remain
SynapseAI / Gaudi software 1.24 2026 documentation Gaudi 2 / Gaudi 3 PyTorch integration, graph compilation, TPC kernels and HCCL
IPU SDK 2023-2024 documentation E2100 IPU P4 pipeline, infrastructure services and host integration
DSA / IAA software interfaces 2023 onward Xeon integrated engines Work queues, shared virtual addressing and asynchronous completion; overhead matters

The software lines are related but not interchangeable. oneAPI/SYCL and Level Zero expose Intel GPU execution; Gaudi uses its own compiler/runtime and communication stack; Xeon libraries dispatch to vector or AMX kernels; IPU software manages infrastructure services. A common framework frontend does not guarantee equal operator coverage, numerical behavior or performance. Evaluate complete model graphs, fallback behavior, quantization, checkpoint portability and distributed communication. This is especially important when a hardware roadmap changes: a technically portable source program may still depend on a vendor-specific optimized kernel ecosystem.

OpenVINO is the inference-oriented bridge across Intel’s CPU, GPU and NPU portfolio. It belongs alongside, rather than in place of, the lower-level compiler/runtime and mathematical libraries. For an enterprise inference deployment, supported model transformations, precision conversion, batching, device selection and profiling can matter more than the application seeing a particular instruction. Its hardware support matrix should be checked against the exact runtime release; a framework’s generic device name is not a promise that every older Intel accelerator remains supported.

19 Four system views

These diagrams summarize actual architectural relationships across four eras. Lines identify data paths, not necessarily coherent memory. A per-device bandwidth is not multiplied by device count unless an aggregate is explicitly requested. The drawings intentionally distinguish accelerator-local memory, host memory and external networking; none represents all memory as a uniform pool.

2015-2016: host CPU and self-hosted many-core

flowchart TD
  cpu["Broadwell Xeon / 22 cores / socket"]
  ddr["Host DDR4 / 4 channels"]
  phi["Knights Landing / 72 cores; self-hosted"]
  mc["MCDRAM 16 GB / local to Phi"]
  fabric["HPC network / optional Omni-Path"]
  far["Phi DDR4 / capacity tier"]
  cpu ---|"76.8 GB/s"| ddr
  phi ---|"400+ GB/s class"| mc
  phi ---|"Separate DDR controllers"| far
  phi ---|"Network endpoint"| fabric
  cpu ---|"Server network adapter"| fabric

Xeon and Phi are alternative node constructions here; the diagram does not imply Knights Landing is attached to Broadwell as a mandatory coprocessor.

2019-2021: CPU plus Ethernet-connected AI devices

flowchart TD
  cpu["Cascade Lake host"]
  ddr["DDR4 / optional Optane"]
  gpus["8 Gaudi devices / AWS DL1 example"]
  hbm["32 GB HBM per device"]
  net["External network"]
  peer["Integrated Ethernet / peer communication"]
  cpu ---|"Memory channels"| ddr
  cpu ---|"Host I/O path"| gpus
  gpus ---|"Local memory"| hbm
  gpus ---|"On-device RoCE ports"| peer
  gpus ---|"DL1: 400 Gb/s instance"| net

DL1’s external service bandwidth differs from Gaudi’s on-chip aggregate network port bandwidth. Optane is a CPU platform option, not Gaudi HBM.

2023-2024: Aurora’s heterogeneous memory hierarchy

flowchart TD
  cpu["2 Xeon Max / node"]
  ddr["CPU: HBM + DDR5"]
  gpus["6 GPU Max / node / Xe Link peer graph"]
  hbm["128 GB HBM / GPU"]
  net["8 Slingshot endpoints"]
  cluster["Dragonfly fabric"]
  cpu ---|"CPU memory tiers"| ddr
  cpu ---|"PCIe"| gpus
  gpus ---|"Device-local bandwidth"| hbm
  gpus ---|"Topology / affinity matter"| net
  net ---|"8 x 200 Gb/s"| cluster

An average 33.3 GB/s scale-out budget per GPU follows from 8 × 200 Gb/s divided by six; it is not a uniform dedicated link allocation.

2024-2026: specialized compute and infrastructure paths

flowchart TD
  cpu["Xeon 6 / 6+ / P-core or E-core host"]
  mem["DDR5 / MRDIMM / CXL expansion by platform"]
  gpus["8 Gaudi 3 / 21 local ports / device"]
  hbm["128 GB HBM2e / device / 3.7 TB/s"]
  net["3 x 200GbE / Gaudi / scale-out fabric"]
  ipu["Host NIC / IPU / infrastructure services"]
  cpu ---|"Platform-dependent"| mem
  cpu ---|"PCIe 5 x16"| gpus
  gpus ---|"Local HBM"| hbm
  gpus ---|"75 GB/s one-way / device"| net
  cpu ---|"Separate host I/O"| ipu

This is a role diagram, not a claim of one mandatory OEM configuration. Crescent Island is a separate announced PCIe inference branch with LPDDR5X; Diamond Rapids is a disclosed future host platform.

20 Normalized ratios and design implications

Derived ratios from stated reference configurations

Reference DRAM GB/s per core L3 MB per core Interpretation
Broadwell 2699 v4 3.49 2.50 22 cores share four channels
Skylake 8180 4.57 1.375 L2 grows; L3 changes inclusion policy
Sapphire 8490H 5.12 1.875 AMX raises arithmetic demand
Emerald 8592+ 5.60 5.00 Large LLC capacity increase
Sierra 6780E 2.84 0.75 Density-oriented reference
Granite 6980P / MRDIMM 6.60 3.9375 12 channels at 8800 MT/s
Clearwater 6990E+ 2.67 2.00 Double cores; more cache per core

Accelerator balance, dense BF16 basis

Device HBM bytes/FLOP All-port network / HBM BW External BW / device BF16 peak / device power
Gaudi 2 0.00569 0.122 37.5 GB/s, 3 x 100GbE allocation 0.720 TF/W at 600 W
Gaudi 3 0.00221 0.162 75 GB/s, 3 x 200GbE allocation 1.864 TF/W at 900 W
GPU Max 1550 0.00381 0.0994 Xe Link / HBM, Lenovo basis System-dependent 1.398 TF/W at 600 W

Gaudi 3 increases matrix peak more quickly than HBM bandwidth relative to Gaudi 2: the HBM bytes available per peak BF16 operation fall by more than half on the selected whitepaper basis. More reuse, larger useful tiles or greater batching is needed to approach compute peak. Network bandwidth also remains a fraction of local HBM bandwidth. Communication-heavy parallelism cannot be judged by arithmetic scaling alone. These ratios describe resource balance; they do not predict a model benchmark without its arithmetic intensity and communication pattern.

Peak FLOPS divided by board or device power is an upper-level arithmetic normalization, not measured energy efficiency. It omits host CPUs, DIMMs, switches, optics, cooling and utilization. No cross-vendor performance-per-watt ranking is inferred from this table. For CPUs, per-core memory bandwidth is similarly an equal-share budget, not a guaranteed allocation. The useful engineering question is which layer saturates first and whether software can increase locality or overlap before more hardware is added.

21 What the major architecture conferences add

Hot Chips and ISSCC answer complementary questions. Hot Chips usually exposes the block diagram, hierarchy, interfaces and product intent. ISSCC can explain the physical implementation that makes those blocks practical: multi-die signaling, energy per bit, package construction, clocking and power. The strongest examples here are Sapphire Rapids’ quasi-monolithic EMIB fabric, Ponte Vecchio’s multi-process 3D integration and Emerald Rapids’ cache-rich two-tile design. Conference numbers must remain attached to their prototype, measurement condition and disclosure date before being reconciled with commercial SKU data.

ISCA, MICRO, HPCA and ASPLOS are particularly valuable for testing how product mechanisms behave. LIA at ISCA 2025 uses AMX-enabled Xeons and a GPU cooperatively, showing that CPU matrix execution can change offloading decisions. MICRO 2023’s real-device CXL study distinguishes actual memory expansion from software emulation. ASPLOS 2024’s DSA analysis identifies when asynchronous data movement pays for its submission and completion overhead. HPCA 2020’s persistent-memory keynote examines the programming consequences of capacity, persistence and asymmetric access. These are research or measurement results, not proof that Intel adopted every proposed mechanism in silicon.

The conference index distinguishes direct product disclosure, implementation disclosure, independent measurement, and deployment evidence. DAC and Foundry Direct Connect are useful for design enablement, packaging and EDA context; MWC emphasizes telecom and edge; OCP emphasizes platform integration; Computex and Intel’s own launch events establish product positioning and availability. Cloud Next and AWS disclosures connect chips to services. No specific GTC, Microsoft Ignite or DAC product-architecture talk is asserted where a qualifying primary record was not established in this review. That is a bounded coverage gap, not evidence that Intel never participated.

Conference-to-product index

Venue Year Paper / talk / disclosure Presenter / authors Product Evidence type Source
Hot Chips 2015 Knights Landing Avinash Sodani Xeon Phi Product architecture C13
Hot Chips 2018 Cascade Lake Akhilesh Kumar Xeon 2nd gen Architecture / VNNI / memory C06
Hot Chips 2019 Nervana; packaging; Optane Intel NNP-T / NNP-I Official press release C14
HPCA 2020 Persistent Memory and the Path to Being Comfortably NUMB Steven Swanson Optane context Independent research keynote R05
ISSCC 2022 Ponte Vecchio: A Multi-Tile 3D Stacked Processor for Exascale Computing W. Gomes et al. Ponte Vecchio Implementation; paper 2.1 press kit C03
ISSCC 2022 Sapphire Rapids: Next-Generation Xeon Intel Sapphire Rapids Implementation; paper 2.2 press kit C03
Google Cloud Next 2022 C3 and custom Intel IPU Google / Intel Sapphire Rapids + IPU Preview; GA followed 2023 E15
Hot Chips 2023 Granite Rapids and Sierra Forest Intel Xeon 6 Architecture briefing slides C12
MICRO 2023 Demystifying CXL Memory with Genuine CXL-Ready Systems and Devices Yan Sun et al. Sapphire Rapids / CXL Real-device measurement R04
ISSCC 2024 Emerald Rapids: 5th-Generation Xeon Scalable Ashley O. Munch et al. Emerald Rapids Implementation; paper 2.3 press kit C04
ASPLOS 2024 A Quantitative Analysis and Guidelines of Data Streaming Accelerator in Modern Intel Xeon Scalable Processors Reese Kuper et al. DSA / Sapphire Rapids Measured offload behavior R02
Hot Chips 2024 Gaudi 3; Xeon 6; optical I/O Intel Gaudi 3 / Xeon 6 / OCI Architecture and demo summary E13
OFC 2024 Integrated optical compute interconnect Intel IPS OCI chiplet Live technology demonstration E12
Intel Vision 2024 Gaudi 3 architecture and open systems Intel Gaudi 3 Product announcement E20
ISCA 2025 LIA: cooperative AMX CPU-GPU computation and CXL offloading Hyungyo Kim et al. Sapphire / Granite Rapids Independent system research R01
Hot Chips / Tech Tour 2025 Clearwater Forest Intel Xeon 6+ Architecture / packaging P08
OCP Global Summit 2025 Crescent Island initial disclosure Intel Crescent Island Roadmap / sampling target E03
MWC 2026 Xeon 6+ network and edge positioning Intel Clearwater Forest Platform demonstration E16
Computex 2026 Xeon 6+ and E835 launch Intel Clearwater / E835 / Crescent Commercial launch / update E02
Hot Chips 2026 Diamond Rapids and Crescent Island Intel Diamond / Crescent Architecture announcement E01
Foundry Direct Connect 2024-2025 Process and packaging enablement Intel / EDA partners 18A / EMIB / Foveros Technology ecosystem E19

22 Architecture conclusions and remaining gaps

Intel’s durable architectural assets are the CPU software base, increasingly specialized host execution, heterogeneous packaging, and infrastructure offload. Its accelerator history is more fragmented. Gaudi offers a distinctive Ethernet-centered system; GPU Max demonstrates ambitious HPC integration; Crescent Island pursues capacity-oriented inference economics. These are complementary design points, not interchangeable generations of one GPU. The correct unit of comparison is the deployable workload system: compute format, memory residence, locality, fabric, power envelope and maintained software path.

The remaining material gaps are concentrated in final Diamond Rapids SKU and availability details, Crescent Island’s memory bandwidth and arithmetic rates, the precise shipping configuration matrix of newer NICs, and restricted conference slide or full-paper access. The report therefore uses official announcement-level claims for those products and leaves unsupported fields as n/d. Earlier packaging roadmaps are reconciled with later launch records rather than treated as actual shipment dates. The canonical data file preserves source IDs, claim scope, numerical basis and product status so these gaps can be updated without changing the report structure.

Source map

01 Executive synthesis and scope — C03, C12, E01, E02, E07, E11, E12, E17, P02, P03, P05, P06, P10, P14

02 How to read the numbers — P02, P05, P09, P16, P17

03 Xeon generation atlas — C03, C04, C06, C12, E01, E02, E16, P01, P03, P05, P06, P08, P13, P16, P17, P18, P19, P20, P21, P22, P23, P24, P25, P26, P35

04 Haswell and Broadwell: the monolithic baseline — P05, P07, P20

05 Skylake, Cascade Lake and Cooper Lake — C06, P05, P06, P22, P23

06 Ice Lake: a wider core and a wider server — P05, P07, P24

07 Sapphire Rapids and Xeon Max: tiles and engines — C03, P03, P05, P13, R01, R02

08 Emerald Rapids: cache and integration efficiency — C04, P03, P26

09 Xeon 6: separating performance and density — C12, E04, E06, P16, P17, P18

10 Clearwater Forest and Diamond Rapids — E01, E02, E08, E16, P01, P08, P17, P19, P35

11 Accelerator generation atlas — C03, C13, E01, E03, E05, E14, P02, P05, P09, P11, P27, P28, P29, P30, P37

12 Xeon Phi and Nervana: earlier parallel-compute paths — C13, C14, E17, P05, P28, P30

13 Gaudi 1, 2 and 3: Ethernet inside the accelerator — E09, E14, P02, P04, P09, P30

14 Ponte Vecchio: a heterogeneous HPC package — C03, E17, P11, P27, P31

15 Flex, Arc and Crescent Island: inference branches — E01, E02, E03, P11, P29, P38, R01

16 Ethernet NICs, IPUs and programmable networks — E02, E15, E18, E21, P02, P10, P14, P15, P32

17 Interconnect, memory, optics and programmable logic — C12, C14, E01, E07, E10, E11, E12, E13, E17, P02, P03, P05, P24, P27, P33, R04, R05

18 Systems and software: the usable architecture — E14, E15, P02, P03, P05, P10, P11, P27, P30, P31, P34, P38, R02

19 Four system views — E01, P02, P05, P31

20 Normalized ratios and design implications — P01, P02, P03, P06, P16, P17, P18, P19, P20, P21, P25, P26, P27, P30

21 What the major architecture conferences add — C03, C04, C06, C12, C13, C14, E01, E02, E03, E12, E13, E14, E15, E16, E19, E20, P08, R01, R02, R04, R05

22 Architecture conclusions and remaining gaps — E01, E02, E03, E07, P02, P03, P10, P14

References

Product and technical documentation

[P01] Xeon 6+ product family and SKUs. https://www.intel.com/content/www/us/en/products/details/processors/xeon/6-plus-series.html. Primary source; accessed by 2026-09-28

[P02] Gaudi 3 architecture whitepaper. https://cdrdv2-public.intel.com/817486/gaudi-3-ai-accelerator-white-paper.pdf. Primary source; accessed by 2026-09-28

[P03] 4th generation Xeon architectural overview. https://www.intel.com/content/www/us/en/developer/articles/technical/fourth-generation-xeon-scalable-family-overview.html. Primary source; accessed by 2026-09-28

[P04] Intel internal Gaudi deployment. https://www.intel.com/content/dam/www/central-libraries/us/en/documents/2025-03/it-training-ml-on-gaudi-paper.pdf. Primary source; accessed by 2026-09-28

[P05] Intel optimization reference manual Volume 1. https://cdrdv2-public.intel.com/814198/248966-Optimization-Reference-Manual-V1-049.pdf. Primary source; accessed by 2026-09-28

[P06] Skylake-SP architecture overview. https://www.intel.com/content/www/us/en/developer/articles/technical/xeon-processor-scalable-family-technical-overview.html. Primary source; accessed by 2026-09-28

[P07] Xeon D-2100 architecture. https://www.intel.com/content/www/us/en/developer/articles/technical/intel-xeon-processor-d-2100-product-family-technical-overview.html. Primary source; accessed by 2026-09-28

[P08] Xeon 6+ product architecture deck. https://cdrdv2-public.intel.com/866623/xeon-6-plus-product-deck.pdf. Official indexed record or related announcement; full document download unavailable.

[P09] Gaudi 3 PCIe product brief. https://cdrdv2-public.intel.com/817488/Gaudi%203%20PCIe%20Product%20Brief_RB_1_V6.pdf. Primary source; accessed by 2026-09-28

[P10] IPU E2100-CCQDA2 product brief. https://cdrdv2-public.intel.com/816692/Intel%20Infrastructure%20Processing%20Unit%20Adapter%20E2100-CCQDA2.pdf. Primary source; accessed by 2026-09-28

[P11] Xe GPU architecture optimization guide. https://www.intel.com/content/www/us/en/docs/oneapi/optimization-guide-gpu/2024-1/xe-arch.html. Primary source; accessed by 2026-09-28

[P13] Xeon CPU Max product brief. https://www.intel.co.uk/content/dam/www/central-libraries/us/en/documents/2023-01/xeon-cpu-max-series-product-brief.pdf. Primary source; accessed by 2026-09-28

[P14] Ethernet 800 Series product guide. https://cdrdv2-public.intel.com/709766/Intel%20Ethernet%20800%20Series%20Product%20Guide.pdf. Primary source; accessed by 2026-09-28

[P15] E830 OCP adapter product brief. https://cdrdv2-public.intel.com/855027/Intel%20Ethernet%20Network%20Adapter%20E830-CQDA2%20for%20OCP%203.pdf. Primary source; accessed by 2026-09-28

[P16] Xeon 6980P specifications. https://www.intel.com/content/www/us/en/products/sku/240777/intel-xeon-6980p-processor-504m-cache-2-00-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P17] Xeon 6780E specifications. https://www.intel.com/content/www/us/en/products/sku/240362/intel-xeon-6780e-processor-108m-cache-2-20-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P18] Xeon 6 P-core SKU stack summary. https://cdrdv2-public.intel.com/860027/IntelXeon6withPcores_SKUStackSummary.pdf. Official indexed record or related announcement; full document download unavailable.

[P19] Xeon 6+ product brief. https://www.intel.com/content/www/us/en/content-details/918009/intel-xeon-6-product-brief-formerly-codenamed-clearwater-forest.html. Primary source; accessed by 2026-09-28

[P20] Xeon E5-2699 v4 specifications. https://www.intel.com/content/www/us/en/products/sku/91317/intel-xeon-processor-e52699-v4-55m-cache-2-20-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P21] Xeon 8180 specifications. https://www.intel.com/content/www/us/en/products/sku/120496/intel-xeon-platinum-8180-processor-38-5m-cache-2-50-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P22] Xeon 8280 specifications. https://www.intel.com/content/www/us/en/products/sku/192478/intel-xeon-platinum-8280-processor-38-5m-cache-2-70-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P23] Xeon 8380HL specifications. https://www.intel.com/content/www/us/en/products/sku/205684/intel-xeon-platinum-8380hl-processor-38-5m-cache-2-90-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P24] Xeon 8380 specifications. https://www.intel.com/content/www/us/en/products/sku/212287/intel-xeon-platinum-8380-processor-60m-cache-2-30-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P25] Intel Xeon family SKU registry. https://www.intel.com/content/www/us/en/ark/products/series/595/intel-xeon-processors.html. Primary source; accessed by 2026-09-28

[P26] Xeon 8592+ specifications. https://www.intel.com/content/www/us/en/products/sku/237261/intel-xeon-platinum-8592-processor-320m-cache-1-90-ghz/specifications.html. Primary source; accessed by 2026-09-28

[P27] Lenovo SD650-I V3 GPU Max system specifications. https://lenovopress.lenovo.com/lp1602-thinksystem-sd650-i-v3-server. Primary source; accessed by 2026-09-28

[P28] Xeon Phi Knights Landing product registry. https://www.intel.de/content/www/de/de/ark/products/codename/48999/products-formerly-knights-landing.html. Primary source; accessed by 2026-09-28

[P29] Data Center GPU Flex product brief. https://cdrdv2-public.intel.com/768797/intel-data-center-gpu-flex-series-product-brief-final.pdf. Primary source; accessed by 2026-09-28

[P30] Gaudi architecture documentation. https://docs.habana.ai/en/latest/Gaudi_Overview/Gaudi_Architecture.html. Primary source; accessed by 2026-09-28

[P31] Aurora machine overview, Argonne. https://docs.alcf.anl.gov/aurora/. Official indexed record or related announcement; full document download unavailable.

[P32] Intel IPU E2100 product and architecture documentation. https://www.intel.com/content/www/us/en/products/details/network-io/ipu/adapter-e2100.html. Primary source; accessed by 2026-09-28

[P33] Cornelis TACC case study and Omni-Path acquisition history. https://www.cornelis.com/pdf-archive/2023/10/TACC-Case-Study.pdf. Primary source; accessed by 2026-09-28

[P34] Gaudi software documentation 1.24. https://docs.habana.ai/en/latest/. Primary source; accessed by 2026-09-28

[P35] Intel Clearwater Forest process and packaging whitepaper. https://www.intel.com/content/dam/www/central-libraries/us/en/documents/2024-02/intel-tech-clearwater-wp.pdf. Primary source; accessed by 2026-09-28

[P37] Gaudi 2 original architecture whitepaper. https://habana.ai/wp-content/uploads/pdf/2021/gaudi2-whitepaper.pdf. Primary source; accessed by 2026-09-28

[P38] OpenVINO CPU, GPU and NPU deployment product brief. https://cdrdv2-public.intel.com/671060/OpenVINO-product-brief-2024.3-671060.pdf. Official indexed record or related announcement; full document download unavailable.

Conference records and implementation disclosures

[C03] ISSCC 2022 press kit: Ponte Vecchio and Sapphire Rapids. https://www.isscc.org/s/ISSCC2022PressKit.pdf. Official conference press kit; not the full paper.

[C04] ISSCC 2024 press kit: Emerald Rapids. https://static1.squarespace.com/static/6130ef779c7a2574bd4b8888/t/683f410397a851776dcd8fe3/1748975883344/ISSCC2024PressKit.pdf. Official conference press kit; not the full paper.

[C06] Cascade Lake Hot Chips 2018 slides. https://old.hotchips.org/hc30/2conf/2.15_Intel_Cascade_Lake_HC30.Intel.Akhilesh.CLXCPU.Final.pdf. Primary source; accessed by 2026-09-28

[C12] Granite Rapids and Sierra Forest Hot Chips 2023. https://download.intel.com/newsroom/2023/data-center-hpc/Hot_Chips_23_Granite_Rapids_Sierra_Forest_Xeon_Press_Briefing.pdf. Primary source; accessed by 2026-09-28

[C13] Knights Landing, Avinash Sodani, Hot Chips 2015. https://old.hotchips.org/wp-content/uploads/hc_archives/hc27/HC27.25-Tuesday-Epub/HC27.25.70-Processors-Epub/HC27.25.710-Knights-Landing-Sodani-Intel.pdf. Primary source; accessed by 2026-09-28

[C14] Intel press release: Nervana, packaging and Optane at Hot Chips 2019. https://www.hpcwire.com/off-the-wire/intel-presents-on-nervana-packaging-and-optane-memory-at-hot-chips-2019/. Official indexed record or related announcement; full document download unavailable.

Research papers and publication registries

[R01] LIA: cooperative AMX CPU-GPU inference, ISCA 2025. https://experts.illinois.edu/en/publications/lia-a-single-gpu-llm-inference-acceleration-with-cooperative-amx-/. Primary source; accessed by 2026-09-28

[R02] Quantitative Analysis and Guidelines of DSA, ASPLOS 2024. https://arxiv.org/pdf/2305.02480. Primary source; accessed by 2026-09-28

[R04] Demystifying CXL Memory, MICRO 2023. https://hxji.github.io/assets/pdf/cxl-micro23.pdf. Primary source; accessed by 2026-09-28

[R05] HPCA 2020 persistent-memory keynote. https://www.hpca-conf.org/2020/persistent-memory-and-the-path-to-being-comfortably-numb/. Primary source; accessed by 2026-09-28

Launches, ecosystem and deployment

[E01] Intel Hot Chips 2026 architecture disclosures. https://www.intel.com/content/www/us/en/newsroom/news/client-computing/intel-outlines-architectures-for-agentic-ai-at-hot-chips-2026.html. Primary source; accessed by 2026-09-28

[E02] Computex 2026 Xeon 6+, E835 and Crescent Island. https://www.intel.com/content/www/us/en/newsroom/news/data-center/intel-puts-agentic-ai-xeon-6-networking-ai-systems.html. Primary source; accessed by 2026-09-28

[E03] Crescent Island initial OCP announcement. https://www.intel.com/content/www/us/en/newsroom/news/artificial-intelligence/intel-to-expand-ai-accelerator-portfolio-with-new-gpu.html. Primary source; accessed by 2026-09-28

[E04] Xeon 6 press kit. https://newsroom.intel.com/press-kit/press-kit-intel-xeon-6-processors. Primary source; accessed by 2026-09-28

[E05] Xeon 6 P-core and Gaudi 3 launch. https://www.intc.com/news-events/press-releases/detail/1713/intel-unveils-next-generation-ai-solutions-with-the-launch. Primary source; accessed by 2026-09-28

[E06] Xeon 6 February 2025 expansion. https://newsroom.intel.com/data-center/intel-unveils-leadership-ai-networking-solutions-xeon-6-processors. Primary source; accessed by 2026-09-28

[E07] Intel 2025 annual report: product and ownership changes. https://www.intc.com/filings-reports/annual-reports/content/0000050863-26-000011/0000050863-26-000011.pdf. Primary source; accessed by 2026-09-28

[E08] Intel Q4 2025 prepared earnings remarks. https://download.intel.com/newsroom/2026/earnings/Intel-4Q2025-Earnings-Call.pdf. Primary source; accessed by 2026-09-28

[E09] Gaudi 3 availability expansion 2025. https://www.intel.com/content/www/us/en/newsroom/news/artificial-intelligence/intel-gaudi-3-expands-availability-drive-ai-innovation-scale.html. Primary source; accessed by 2026-09-28

[E10] Loihi 2 Hala Point research system. https://www.intel.com/content/www/us/en/newsroom/news/intel-builds-worlds-largest-neuromorphic-system.html. Primary source; accessed by 2026-09-28

[E11] Altera majority investment closes. https://www.altera.com/newsroom/news/press-release/altera-silver-lake. Primary source; accessed by 2026-09-28

[E12] Intel optical compute interconnect demonstration. https://www.intel.com/content/www/us/en/newsroom/news/intel-unveils-first-integrated-optical-io-chiplet.html. Primary source; accessed by 2026-09-28

[E13] Hot Chips 2024: Xeon 6, Gaudi 3 and optical I/O. https://www.intel.com/content/www/us/en/newsroom/news/hot-chips-2024-ai-architectural-expertise.html. Primary source; accessed by 2026-09-28

[E14] AWS DL1 general availability. https://aws.amazon.com/about-aws/whats-new/2021/10/amazon-ec2-dl1-instances-cost-efficient-training-deep-learning-models/. Primary source; accessed by 2026-09-28

[E15] Google Next 2022 C3 and co-developed Intel IPU. https://cloud.google.com/blog/products/compute/introducing-c3-machines-with-googles-custom-intel-ipu. Primary source; accessed by 2026-09-28

[E16] Intel at MWC 2026. https://newsroom.intel.com/press-kit/press-kit-intel-at-mwc-barcelona-2026. Primary source; accessed by 2026-09-28

[E17] Intel 2024 annual report: Falcon Shores and Optane exits. https://www.intc.com/filings-reports/all-sec-filings/content/0000050863-25-000009/intc-20241228.htm. Primary source; accessed by 2026-09-28

[E18] Intel support statement on Tofino discontinuation. https://community.intel.com/t5/Ethernet-Products/Setup-Tofino-Switch/m-p/1539149. Official indexed record or related announcement; full document download unavailable.

[E19] Intel Foundry Direct Connect 2025 technology disclosures. https://www.intel.com/content/www/us/en/newsroom/news/corporate/intel-foundry-gathers-customers-partners-outlines-priorities.html. Primary source; accessed by 2026-09-28

[E20] Intel Vision 2024 Gaudi 3 announcement. https://newsroom.intel.com/artificial-intelligence/vision-2024-gaudi-3-ai-accelerator. Primary source; accessed by 2026-09-28

[E21] Intel Architecture Day 2021 official press release. https://download.intel.com/newsroom/archive/2025/en-us-2021-08-19-intel-architecture-day-2021.pdf. Primary source; accessed by 2026-09-28