Skip to content

How-ToGPU

How to Set an NVIDIA GPU Power Limit With nvidia-smi for Long Local AI Runs

Open Terminal as administrator and run nvidia-smi -q -d POWER to see your card's default, minimum and maximum power limits. Set a lower cap with nvidia-smi -i 0 -pl followed by a wattage within that range, watch it with the looping power query, and set the default back when you're done. Test your own AI workloads at each step.

By , Editorial team

3 min read

How to Set an NVIDIA GPU Power Limit With nvidia-smi for Long Local AI Runs

Running a local language model, generating batches of images or fine-tuning a model can keep a graphics card working flat out for hours. If you'd like it to draw less power and run cooler during those jobs, you can cap its power with nvidia-smi, the command-line tool NVIDIA installs with its driver. This guide follows NVIDIA's nvidia-smi documentation. Forge PC hasn't tested power limits on specific cards, so we can't tell you how much speed you'd lose at a given limit; test your own workload.

Why cap power for AI work?

NVIDIA's guide to LLM inference explains that the decode phase, where a model generates its reply one token at a time, is memory-bound: the speed at which data moves from memory dominates, rather than how fast the computation happens. That suggests a modest power cap may cost less speed in text generation than in compute-heavy work such as image generation or training, but it depends on the card and the job, so measure before and after. If you also game on the same PC, our GPU undervolting guide covers a different way to cut power with MSI Afterburner.

Step 1: Open an administrator terminal

NVIDIA's documentation says changing the power limit requires root, which on Windows means running as administrator. Right-click the Start button, choose Terminal (Admin) and accept the prompt.

Step 2: Check your card's allowed range

Type:

nvidia-smi -q -d POWER

The -d POWER option shows only power information. Look for these lines, which NVIDIA defines as:

  • Current Power Limit: the limit the power management algorithm is enforcing now.

  • Default Power Limit: the card's standard limit.

  • Min Power Limit and Max Power Limit: the lowest and highest values you're allowed to set.

Note the default figure, as you'll need it to undo the change. If you have more than one GPU, nvidia-smi lists each with an index number (0, 1 and so on).

Step 3: Set a lower limit

Use the -pl (power limit) option with a value in watts, and -i to choose the GPU. For example, to set GPU 0 to 250W:

nvidia-smi -i 0 -pl 250

NVIDIA says the value must be between the Min and Max Power Limit that nvidia-smi reports, and that power limits are only available on supported devices. If your card or driver doesn't support changing it, use the power limit slider in MSI Afterburner instead; our Afterburner overclocking guide shows where it is.

A sensible approach is to start a little below the default and work down in steps, running the same AI job each time and noting how long it takes.

Step 4: Watch what the card is doing

To check the limit is being applied while your job runs, repeat the power query every five seconds:

nvidia-smi -q -d POWER -l 5

Press Ctrl+C to stop. NVIDIA's documentation describes the readings as the average and instantaneous power draw for the whole board. If the card is hitting your cap, NVIDIA says the "SW Power Cap" throttle reason shows the driver reducing clocks because the GPU is consuming too much power. For temperatures and clocks in a friendlier view, use HWiNFO.

Step 5: Put it back

Set the limit back to the Default Power Limit you noted earlier. For example, if your card's default was 320W:

nvidia-smi -i 0 -pl 320

NVIDIA's documentation doesn't say whether a power limit set this way survives a restart (it notes that persistence mode, a separate setting, doesn't), so run nvidia-smi -q -d POWER after rebooting to see which limit is active and re-apply it if needed.

Things to keep in mind

  • A lower power limit reduces the maximum the card can draw; it doesn't replace a power supply that's too small. Our PSU guide covers sizing.

  • If you run two GPUs for local LLMs, set each one with its own -i index.

  • Don't set a limit above the card's default to try to overclock it: that's outside the scope of this guide, and the Max Power Limit is the most the driver allows.

Our verdict

Open Terminal as administrator, run nvidia-smi -q -d POWER to see your card's default, minimum and maximum limits, then set a lower cap with nvidia-smi -i 0 -pl <watts> and check it with the looping power query. Test your own AI workloads at each step, and note the default so you can put it back. Forge PC hasn't tested specific limits on specific cards.

The bottom line

Open Terminal as administrator, run `nvidia-smi -q -d POWER` to see your card's default, minimum and maximum limits, then set a lower cap with `nvidia-smi -i 0 -pl <watts>` and check it with the looping power query. Test your own AI workloads at each step, and note the default so you can put it back. Forge PC hasn't tested specific limits on specific cards.

Sources

  1. 01NVIDIA, nvidia-smi documentation
  2. 02NVIDIA Technical Blog, Mastering LLM Techniques: Inference Optimization

About the author

Forge PC Staff

Editorial team

The shared byline for articles researched, written and edited by the Forge PC editorial team. How we source, check and correct our work is set out in our editorial policy.

More from Forge PC Staff

Read next

Windows Hello Face vs Fingerprint: Which Is Better for a Desktop PC?

Versus

Windows Hello Face vs Fingerprint: Which Is Better for a Desktop PC?

Both work well on a desktop, but you need to add hardware. Face sign-in needs a Windows Hello infrared camera, not a normal webcam, and is the convenient choice if you want a webcam anyway. A USB fingerprint reader is the simpler add-on if you don't want a camera. Microsoft requires a false accept rate below 0.001% for face and large fingerprint sensors.

Forge PC Staff3 min

No Sound on Windows 11? How to Fix Speakers and Headsets

How-To

No Sound on Windows 11? How to Fix Speakers and Headsets

First check Windows is sending audio to the right device: on a desktop, a monitor connected over HDMI or DisplayPort is a common culprit. Then check cables, jacks, mute and volume, turn off audio enhancements, run the Get Help audio troubleshooter, check the volume mixer, install updates and restart, and finally update or reinstall the audio driver.

Forge PC Staff3 min

How to Check Your Motherboard Model in Windows 11

How-To

How to Check Your Motherboard Model in Windows 11

Press Windows + R, type msinfo32 and look for Baseboard Manufacturer and Baseboard Product on the System Summary page. For copyable text, run Get-CimInstance Win32_BaseBoard in PowerShell, or use CPU-Z's Mainboard tab for BIOS and chipset details too. On prebuilts and laptops, use the PC maker's model number and support page instead.

Forge PC Staff3 min

Best Free File Compression Software for Windows in 2026

Best Picks

Best Free File Compression Software for Windows in 2026

7-Zip is the best free archiver for most people: free for any use, it creates encrypted 7z and ZIP files and opens dozens of formats including RAR. NanaZip adds proper Windows 11 context-menu integration and extra formats, and PeaZip supports over 200 archive types. Windows 11 24H2 can open ZIP, RAR, 7z and TAR itself, but not encrypted archives.

Forge PC Staff3 min