Glossary

Active vs. total parameters

Total parameters describe the full set of model parameters and largely determine weight storage and memory demand. Active parameters are used for each token and largely determine compute demand. The counts are equal for dense models and can differ for Mixture-of-Experts models.

Average Intelligence

The equally weighted mean of the IFBench, IFStruct, GPQA Diamond, and MATH-500 scores for the same model, quantization, and thinking mode. It is shown only when all four scores exist, so a missing evaluation never shifts the average.

Benchmark configuration

The exact workload assigned to a benchmark: the prompt-token count and, when generation is measured, the output-token count. Vision benchmarks also fix the image size and image count, and audio benchmarks the clip length. For these, the prompt-token count covers only the text prompt, because the number of image or audio tokens depends on the model. Results with different configurations represent different amounts of work and are not directly comparable.

Decode / Decode throughput

The phase where the model generates output tokens one at a time, using the KV-cache and previously generated tokens.

End-to-end latency / E2E / E2E latency

Wall-clock time from submitting the prompt to receiving the complete response. Depending on the client path, this includes tokenization, prefill, decode, and local request/response overhead.

Evaluation / Eval

A quality benchmark that scores generated answers against a fixed dataset version with known ground truth. Pipette evaluations use deterministic task-specific scorers rather than judge models.

Approved evaluation result

An evaluation result eligible for the public accuracy charts. The dashboard publishes the latest approved score for each model and quantization, separately for each evaluation version and thinking mode. Approval is a publication policy, not a claim that generation is independent of hardware or runtime.

Greedy decoding

A deterministic generation method that always picks the highest-probability next token. Pipette's performance benchmarks use greedy decoding or run the model with no sampler, so random sampling does not change the workload.

GPQA Diamond

A graduate-level multiple-choice reasoning benchmark covering biology, physics, and chemistry.

Host memory

The device's main system memory used by the benchmark process. On unified-memory devices, CPU and GPU work share this physical memory pool. On Apple Silicon, the host measurement already includes GPU allocations. On the Ryzen AI Max+ 395, it misses most GPU memory, so GPU memory is measured separately, as it is on devices with a discrete GPU when the platform exposes both counters.

IFBench

Instruction Following Benchmark. Measures whether a model can follow natural-language instructions with verifiable constraints.

IFStruct

Instruction Following for Structured Output. Tests the model's ability to follow a provided schema to produce valid JSON or YAML without relying on constrained decoding.

KV-cache

The key-value cache. It stores attention states so the model does not need to recompute the full prompt every time it generates a new token. It grows with sequence length.

Convolution cache

A runtime cache used by architectures with convolutional sequence-mixing layers, including LFM models. Like the KV-cache, it stores state from previous tokens so generation can continue without recomputing the whole sequence.

Mantissa precision

The part of a floating-point format used to represent significant digits.

MATH-500

A multi-step competition mathematics benchmark covering algebra, geometry, number theory, precalculus, and other subjects.

Mixture-of-Experts / MoE

A model architecture where each token uses only some of the model's experts instead of the whole network. This lets a model have many total parameters while activating fewer parameters per token.

Pareto frontier

The set of models where no other model is better on both axes at once. Points on the frontier represent the best available trade-offs, usually between quality and speed.

Peak memory / Peak RAM

The highest value observed by a platform memory counter during a run. For vision and audio on the Ryzen AI Max+ 395, it is instead the sum of the host and GPU peaks, an upper bound. It can include model weights, KV-cache, convolution cache, activations, and runtime buffers, but it is not the device's total memory.

Prefill / Prefill throughput

The rate at which the model processes prompt tokens and fills the KV-cache, reported in tokens per second. The dashboard labels it Prefill Throughput, or Prefill where space is short.

Quantization / Quant

Compressing model weights to lower precision (for example, FP16 to Q4_0). This reduces model size and can improve runtime performance, with possible accuracy loss that depends on the model and quantization format. See Quantization for the full table of formats Pipette tracks.

Readiness gate

A platform-specific check applied before each measured timing repetition. It waits for the available thermal and load signals to enter their accepted ranges and fails the benchmark when the device does not become ready before the deadline.

Runtime

The inference engine that executes the model. Public device charts and leaderboards currently select llama.cpp results. The runtime implementation, version, and settings can affect throughput, peak memory, supported quantization formats, and generated outputs.

Sequence length / context length

The number of tokens the model has to keep track of: the prompt plus generated tokens so far. Longer sequences grow the KV-cache and usually slow inference.

Token

A subword unit produced by the tokenizer. Models read input and emit output one token at a time, so token counts (not character or word counts) drive prefill and decode time.

TTFT / TTFT label / isolated prefill time

TTFT conventionally means the time from prompt submission to the first output token. The dashboard's TTFT-labeled value is isolated prefill time: it excludes tokenization, request overhead, and delivery of the first generated token. Do not interpret it as caller-visible TTFT.

VRAM

VRAM is GPU memory. On a discrete GPU, such as an NVIDIA RTX or A100, it is separate from system RAM. The VRAM shown in a device's specification badges is the adapter's total memory capacity reported by the device probe, not a per-run measurement. On platforms that measure GPU memory separately, that measurement contributes to the peak-memory result.

On Apple Silicon, the GPU shares system RAM. Current clients submit only the host peak, which already includes GPU allocations. Legacy rows can still contain a diagnostic GPU peak. The Ryzen AI Max+ 395 also shares system RAM, but most of its GPU memory is outside the host peak, so vision and audio add the two as an upper bound. The VRAM field is empty when the probe reports no GPU, as on CPU-only devices.