Skip to content

NewsGPU

AMD Instinct MI350P Comes to Windows Server: 144GB AI Cards for On-Premises Inference

AMD and Microsoft said on 17 November 2026 that the Instinct MI350P will be supported on Windows Server 2025 and the upcoming Windows Server 2028, with GPU partitioning and AMD Inference Microservices at launch. AMD lists the card with 144GB of HBM3E (4TB/s), 600W maximum board power, a 12V-2x6 connector and passive cooling. It's built for servers, not gaming PCs.

By , Editorial team

3 min read

AMD Instinct MI350P Comes to Windows Server: 144GB AI Cards for On-Premises Inference

AMD and Microsoft announced on 17 November 2026 that AMD's Instinct MI350P accelerator will be supported on Windows Server 2025 and the upcoming Windows Server 2028. The aim is to let businesses run AI models on their own Windows servers, close to their own data, instead of sending everything to a cloud service.

This isn't a graphics card you'll put in a gaming PC, and Forge PC hasn't tested it. But it's a useful signal for anyone following local AI: the same "keep the model on your own hardware" idea we cover for desktop PCs is now being pushed hard in business IT. This story is based on AMD's announcement and its official MI350P specification page.

What AMD and Microsoft announced

According to AMD's blog post:

  • Windows Server support: the Instinct MI350P will be supported on Windows Server 2025 and the upcoming Windows Server 2028, for GPU-accelerated AI inference.

  • AMD Inference Microservices (AIMs) and GPU partitioning are supported at launch. AMD says partitioning lets IT teams split one MI350P into supported partitions, so a small embedding model or language model doesn't need a whole card.

  • SQL Server and RAG: AMD highlights SQL Server 2025's built-in vector features, with locally hosted embedding models on the MI350P supplying vectors for retrieval-augmented generation (RAG) apps. AMD describes a demonstration with Microsoft's SQL Server team as "planned".

AMD's pitch is partly about cost and control: it argues that hosting suitable AI workloads on premises can help organisations manage cloud token spending and keep sensitive data in-house, while still using cloud models where they make sense. Those are AMD's claims; real savings will depend on each organisation's workloads.

The MI350P in numbers

AMD's specification page lists the MI350P as a full-height, double-slot, passively cooled PCIe card for servers:

Spec (AMD)

Instinct MI350P

Architecture

CDNA 4 (TSMC 3nm and 6nm)

Compute units / stream processors

128 / 8,192

Peak engine clock

2,200MHz

Memory

144GB HBM3E, 4,096-bit, up to 4TB/s

Peak FP16 matrix

1.15 PFLOPs (2.3 PFLOPs with structured sparsity)

Peak MXFP4 / MXFP6

4.6 PFLOPs

Typical board power

600W maximum; 450W configurable

Power connector

12V-2x6

Length

10.5in (267mm)

Two details stand out for PC builders. First, the card uses the same 12V-2x6 power connector found on high-end GeForce cards, which we explain in our guide to connecting a 12V-2x6 cable safely. Second, it's passively cooled: there's no fan, because it's designed for servers that push air through the card. In a normal desktop case it would overheat.

Note that AMD's specification page still listed Linux x86 64-bit under OS support when we checked; Windows Server support is what's new in this announcement.

Why it matters for local AI on desktops

The amount of fast memory is the main limit on which AI models you can run, whether that's a 16GB gaming card or a 144GB server accelerator. That's why our guides keep coming back to VRAM: see how much RAM you need for local AI and our explainer on LLM context length and VRAM.

For home users, the closest equivalents are workstation cards and unified-memory systems. Our Radeon AI PRO R9700 vs RTX 5090 for local AI comparison and our best GPU for local LLMs guide cover what's realistic in a desktop PC.

AMD hasn't given a price for the MI350P in this announcement, and it's designed for servers rather than desktop PCs.

Our verdict

The Instinct MI350P is a 144GB, 600W, passively cooled PCIe accelerator for servers, and AMD and Microsoft now say it will be supported on Windows Server 2025 and Windows Server 2028, with GPU partitioning and AMD Inference Microservices at launch. It isn't for gaming PCs, but it shows big vendors betting on on-premises AI. If you want local AI at home, focus on VRAM per pound on a desktop GPU instead. Forge PC hasn't tested the MI350P.

The bottom line

The Instinct MI350P is a 144GB, 600W, passively cooled PCIe accelerator for servers, and AMD and Microsoft now say it will be supported on Windows Server 2025 and Windows Server 2028, with GPU partitioning and AMD Inference Microservices at launch. It isn't for gaming PCs, but it shows big vendors betting on on-premises AI. If you want local AI at home, focus on VRAM per pound on a desktop GPU instead. Forge PC hasn't tested the MI350P.

Sources

  1. 01AMD, More AI. More Control. AMD Instinct MI350P Comes to Windows Server (17 November 2026)
  2. 02AMD, AMD Instinct MI350P PCIe Cards specifications

About the author

Forge PC Staff

Editorial team

The shared byline for articles researched, written and edited by the Forge PC editorial team. How we source, check and correct our work is set out in our editorial policy.

More from Forge PC Staff

Read next

Windows Hello Face vs Fingerprint: Which Is Better for a Desktop PC?

Versus

Windows Hello Face vs Fingerprint: Which Is Better for a Desktop PC?

Both work well on a desktop, but you need to add hardware. Face sign-in needs a Windows Hello infrared camera, not a normal webcam, and is the convenient choice if you want a webcam anyway. A USB fingerprint reader is the simpler add-on if you don't want a camera. Microsoft requires a false accept rate below 0.001% for face and large fingerprint sensors.

Forge PC Staff3 min

No Sound on Windows 11? How to Fix Speakers and Headsets

How-To

No Sound on Windows 11? How to Fix Speakers and Headsets

First check Windows is sending audio to the right device: on a desktop, a monitor connected over HDMI or DisplayPort is a common culprit. Then check cables, jacks, mute and volume, turn off audio enhancements, run the Get Help audio troubleshooter, check the volume mixer, install updates and restart, and finally update or reinstall the audio driver.

Forge PC Staff3 min

How to Check Your Motherboard Model in Windows 11

How-To

How to Check Your Motherboard Model in Windows 11

Press Windows + R, type msinfo32 and look for Baseboard Manufacturer and Baseboard Product on the System Summary page. For copyable text, run Get-CimInstance Win32_BaseBoard in PowerShell, or use CPU-Z's Mainboard tab for BIOS and chipset details too. On prebuilts and laptops, use the PC maker's model number and support page instead.

Forge PC Staff3 min

Best Free File Compression Software for Windows in 2026

Best Picks

Best Free File Compression Software for Windows in 2026

7-Zip is the best free archiver for most people: free for any use, it creates encrypted 7z and ZIP files and opens dozens of formats including RAR. NanaZip adds proper Windows 11 context-menu integration and extra formats, and PeaZip supports over 200 archive types. Windows 11 24H2 can open ZIP, RAR, 7z and TAR itself, but not encrypted archives.

Forge PC Staff3 min