AV1 Operating Points and Scalable Bitstreams

In the AV1 video codec, operating points serve as standardized identifiers that define specific combinations of spatial and temporal layers within a single scalable bitstream. They provide the necessary metadata for decoders, media servers, and extractors to isolate and parse a fully compliant sub-bitstream tailored to specific display capabilities, bandwidth constraints, or processing limitations without requiring re-encoding. By indexing target resolutions, frame rates, and decoding complexity levels, operating points make selective sub-bitstream extraction efficient and deterministic.

Scalability in AV1

AV1 natively supports Scalable Video Coding (SVC), allowing a single video stream to contain multiple overlapping layers:

• Temporal Layers: Represent different frame rates (for example, 15 fps, 30 fps, and 60 fps) where higher layers depend on lower base layers.
• Spatial Layers: Represent different resolutions (for example, 720p, 1080p, and 4K) using inter-layer prediction to improve compression efficiency.

Because a full scalable AV1 bitstream contains interdependent data for multiple visual presentations, downstream systems need a standardized way to decouple these layers.

The Role of Operating Points

An operating point in AV1 is represented by the 12-bit syntax element operating_point_idc located within the Sequence Header Open Bitstream Unit (OBU). It specifies:

1. Target Layers: A bitmask indicating which temporal and spatial layers must be decoded to produce a specific visual output.
2. Decoder Conformance: The specific profile, tier, and level required to decode that specific subset of layers.
3. Initial Display Delay: The buffer parameters and latency characteristics specific to that presentation layer.

The Extraction Process

When a client or a streaming server extracts a sub-bitstream, the operating point dictates the extraction workflow:

• OBU Filtering: AV1 organizes data into discrete OBUs (such as Sequence Headers, Frame Headers, and Tile Groups). Each frame OBU header contains temporal and spatial layer IDs. An extractor parses these headers and retains only the OBUs matching the layer mask defined by the selected operating point, safely discarding non-essential enhancement layers.
• Bitstream Conformance Preservation: Extracting arbitrary packets from a standard video stream typically invalidates decoder compliance. AV1 operating points ensure that any valid extracted sub-bitstream remains a fully syntactically valid AV1 bitstream capable of being parsed by any baseline-compliant decoder supporting the targeted level.
• Level and Tier Assignment: A single high-resolution scalable bitstream may require a Level 5.1 decoder. However, an operating point corresponding to a lower-resolution spatial sub-layer may only require Level 3.1. The operating point metadata allows an extractor to signal the appropriate decoder capabilities required for the sub-bitstream.

Practical Applications

Operating points streamline adaptive media delivery across multiple scenarios:

• Dynamic Video Conferencing: Selective Forwarding Units (SFUs) can discard spatial or temporal OBUs based on real-time network fluctuations or subscriber screen real estate without parsing pixel data.
• Bandwidth and Storage Optimization: A single encoding pipeline can produce a master archive from which multiple independent resolution tiers are extracted dynamically for storage or distribution.
• Client-Side Scalability: Resource-constrained devices can target lower operating points to conserve battery life and CPU/GPU usage by decoding only the base layers.