Why Frame Time Variance Beats FPS in Hardware Benchmarking
This article explores why frame time variance is a significantly better metric than traditional frames per second (FPS) counters when benchmarking computer hardware. While a standard FPS counter only provides a broad average of performance over a full second, measuring the exact milliseconds between consecutive frames reveals micro-stuttering, hidden hardware bottlenecks, and the true visual smoothness of a system. Understanding this distinction allows hardware testers and consumers to accurately assess real-world computing performance rather than relying on flawed averages.
The Flaw with Simple FPS Counters
Frames per second (FPS) is a measurement of how many total images a computer can render and display in one second. Because it summarizes a full second of work into a single number, it acts as an average. Averages inherently hide extremes.
For a game running at a locked 60 FPS, the hardware should ideally deliver one frame every 16.67 milliseconds (1000 milliseconds in a second divided by 60 frames). However, a simple FPS counter only cares that 60 frames were completed before the one-second timer expired. It does not care when those frames were delivered within that second.
How Frame Time Variance Works
Frame time measures the exact duration, in milliseconds, it takes to render a single frame. Frame time variance measures the difference in rendering time between one frame and the very next frame.
To understand why this matters, consider this scenario: A computer renders 59 frames in just 500 milliseconds (about 8.47ms per frame). Suddenly, the system hits a snag, and the 60th frame takes the remaining 500 milliseconds to render.
- What the FPS counter says: 60 FPS. The benchmark looks flawless.
- What the user actually sees: Smooth motion followed by a massive, jarring half-second freeze.
- What frame time variance shows: A jump from 8.47ms to 500ms, immediately exposing a catastrophic performance issue.
Consistent frame times are required for the human eye to perceive smooth motion. Moving at a steady 45 FPS with near-zero frame time variance (every frame taking roughly 22.2ms) feels much smoother to a user than running at an average of 90 FPS where the frame times wildly fluctuate between 5ms and 50ms.
Exposing Micro-Stuttering
Micro-stuttering is the phenomenon where a game or application feels choppy despite reporting a high frame rate. This occurs when the pacing of frames is uneven.
Simple FPS counters are completely blind to micro-stuttering because the stutters happen in fractions of a second—often lasting only 30 to 50 milliseconds. By tracking the millisecond delta between consecutive frames, benchmarkers can graph these spikes. A flat frame time graph indicates a buttery-smooth experience, while a jagged graph resembling a heart monitor proves the system is struggling to pace its output, regardless of how high the average FPS might be.
Pinpointing Specific Hardware Bottlenecks
Measuring frame time variance is essential for diagnosing which specific component in a computer is failing to keep up. Different parts of a PC affect performance metrics in different ways:
- Graphics Card (GPU): The GPU primarily dictates the average FPS. If a GPU is weak, every frame takes longer to draw, resulting in consistently high frame times (low FPS), but not necessarily high variance.
- Processor (CPU) and RAM: The CPU prepares frame data before handing it to the GPU. If the CPU gets overloaded by background tasks, complex game physics, or slow system memory, it fails to feed the GPU on time. This causes sudden, sharp spikes in frame time variance.
- Storage (SSD/HDD): As a user moves through a digital environment, the system loads new assets from the storage drive. Slow storage causes brief pauses in frame delivery, instantly visible on a frame time graph as isolated spikes.
If you only benchmark using an FPS counter, a CPU bottleneck or a slow hard drive might only lower the average FPS by two or three frames, hiding the defect. A frame time variance chart will immediately highlight these hardware limitations as massive millisecond spikes.
The Connection to 1% and 0.1% Lows
Because raw frame time graphs can be difficult to summarize in a single chart, modern hardware reviewers convert frame time data into "1% low" and "0.1% low" FPS metrics.
To get the 1% low, benchmarking software takes all the individual frame times recorded during a test, isolates the worst 1% of those frames (the longest millisecond delays), and converts that specific group back into an FPS figure. If a processor has a high average FPS of 120, but a 1% low of 30 FPS, it means the frame time variance is high and the user will experience noticeable stuttering. This widely accepted industry standard is only possible by measuring individual frame times first.