Shopping Cart

No products in the cart.

BSI 24/30478692 DC 2024

$54.81

BS EN ISO/IEC 14496-10 Information technology – Coding of audio-visual objects. – Part 10: Advanced video coding

Published By Publication Date Number of Pages
BSI 2024 887
Guaranteed Safe Checkout
Categories: ,

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. We’re here to assist you 24/7.
Email:[email protected]

PDF Catalog

PDF Pages PDF Title
8 Foreword
9 0 Introduction
0.1 Prologue
0.2 Purpose
0.3 Applications
0.4 Publication and versions of this document
11 0.5 Profiles and levels
0.6 Overview of the design characteristics
0.6.1 General
12 0.6.2 Predictive coding
0.6.3 Coding of progressive and interlaced video
13 0.6.4 Picture partitioning into macroblocks and smaller partitions
0.6.5 Spatial redundancy reduction
0.7 How to read this document
14 0.8 Patent declarations
15 1 Scope
2 Normative references
3 Terms and definitions
3.1 General terms related to advanced video coding
3.1.1
access unit
set of NAL units that are consecutive in decoding order and contain exactly one primary coded picture
Note 1 to entry: In addition to the primary coded picture, an access unit can also contain one or more redundant coded pictures, one auxiliary coded picture, or other NAL units not containing slices or slice data partitions of a coded picture. The dec…
3.1.2
AC transform coefficient
any transform coefficient for which the frequency index in one or both dimensions is non-zero
3.1.3
adaptive binary arithmetic decoding process
16 entropy decoding process that derives the values of bins from a bitstream produced by an adaptive binary arithmetic encoding process
3.1.4
adaptive binary arithmetic encoding process
entropy encoding process that codes a sequence of bins and produces a bitstream that can be decoded using the adaptive binary arithmetic decoding process
Note 1 to entry: The encoding process is not specified in this document.
3.1.5
alpha blending
process in which an auxiliary coded picture is used in combination with a primary coded picture and with other data in the display process
Note 1 to entry: In an alpha blending process, the samples of an auxiliary coded picture are interpreted as indications of the degree of opacity (or, equivalently, the degrees of transparency) associated with the corresponding luma samples of the prim…
Note 2 to entry: The alpha blending process and other data are not specified by this document.
3.1.6
arbitrary slice order
ASO
decoding order of slices in which the macroblock address of the first macroblock of some slice of a slice group may be less than the macroblock address of the first macroblock of some other preceding slice of the same slice group or, in the case of a …
3.1.7
auxiliary coded picture
picture that supplements the primary coded picture that may be used in combination with other data in the display process
Note 1 to entry: An auxiliary coded picture has the same syntactic and semantic restrictions as a monochrome redundant coded picture. An auxiliary coded picture shall contain the same number of macroblocks as the primary coded picture. Auxiliary coded…
Note 2 to entry: The other data is not specified by this document.
3.1.8
azimuth circle
circle on a sphere connecting all points with the same azimuth value
Note 1 to entry: An azimuth circle is always a great circle like a longitude line on the earth.
3.1.9
B slice
bi-predictive slice
slice that may be decoded using intra prediction or inter prediction using at most two motion vectors and reference indices to predict the sample values of each block
3.1.10
bin
one bit of a bin string
3.1.11
binarization
set of bin strings for all possible values of a syntax element
3.1.12
binarization process
unique mapping process of all possible values of a syntax element onto a set of bin strings
17 3.1.13
bin string
string of bins
intermediate binary representation of values of syntax elements from the binarization of the syntax element
3.1.14
bitstream
sequence of bits that forms the representation of coded pictures and associated data forming one or more coded video sequences
Note 1 to entry: Bitstream is a collective term used to refer either to a NAL unit stream or a byte stream.
3.1.15
block
MxN (M-column by N-row) array of samples, or an MxN array of transform coefficients
3.1.16
bottom field
one of two fields that comprise a frame
Note 1 to entry: Each row of a bottom field is spatially located immediately below a corresponding row of a top field.
3.1.17
bottom macroblock
macroblock within a macroblock pair that contains the samples in the bottom row of samples for the macroblock pair
Note 1 to entry: For a field macroblock pair, the bottom macroblock represents the samples from the region of the bottom field of the frame that lie within the spatial region of the macroblock pair. For a frame macroblock pair, the bottom macroblock r…
3.1.18
broken link
location in a bitstream at which it is indicated that some subsequent pictures in decoding order may contain serious visual artefacts due to unspecified operations performed in the generation of the bitstream
3.1.19
byte
sequence of 8 bits, written and read with the most significant bit on the left and the least significant bit on the right
Note 1 to entry: When represented in a sequence of data bits, the most significant bit of a byte is first.
3.1.20
byte-aligned
position in a bitstream is byte-aligned when the position is an integer multiple of 8 bits from the position of the first bit in the bitstream
Note 1 to entry: A bit or byte or syntax element is said to be byte-aligned when the position at which it appears in a bitstream is byte-aligned.
3.1.21
byte stream
encapsulation of a NAL unit stream containing start code prefixes and NAL units
Note 1 to entry: As specified in Annex B.
3.1.22
category
number associated with each syntax element
Note 1 to entry: The category is used to specify the allocation of syntax elements to NAL units for slice data partitioning. It can also be used in a manner determined by the application to refer to classes of syntax elements in a manner not specified…
18 3.1.23
chroma
adjective specifying that a sample array or single sample is representing one of the two colour difference signals related to the primary colours
Note 1 to entry: The symbols used for a chroma array or sample are Cb and Cr.
Note 2 to entry: The term chroma is used rather than the term chrominance in order to avoid the implication of the use of linear light transfer characteristics that is often associated with the term chrominance.
3.1.24
coded field
coded representation of a field
3.1.25
coded frame
coded representation of a frame
3.1.26
coded picture
coded representation of a picture
Note 1 to entry: A coded picture can be either a coded field or a coded frame. Coded picture is a collective term referring to a primary coded picture or a redundant coded picture, but not to both together.
3.1.27
coded picture buffer
CPB
first-in first-out buffer containing access units in decoding order specified in the hypothetical reference decoder
Note 1 to entry: The hypothetical reference decoder is specified in Annex C.
3.1.28
coded representation
data element as represented in its coded form
3.1.29
coded slice data partition NAL unit
NAL unit containing a slice data partition
3.1.30
coded slice NAL unit
NAL unit containing a slice that is not a slice of an auxiliary coded picture
3.1.31
coded video sequence
sequence of access units that consists, in decoding order, of an IDR access unit followed by zero or more non-IDR access units including all subsequent access units up to but not including any subsequent IDR access unit
3.1.32
component
array or single sample from one of the three arrays (luma and two chroma) that make up a field or frame in 4:2:0, 4:2:2, or 4:4:4 colour format or the array or a single sample of the array that make up a field or frame in monochrome format
3.1.33
complementary field pair
collective term for a complementary reference field pair or a complementary non-reference field pair
3.1.34
complementary non-reference field pair
two non-reference fields that are in consecutive access units in decoding order as two coded fields of opposite parity and share the same value of the frame_num syntax element, where the first field is not already a paired field
3.1.35
complementary reference field pair
two reference fields that are in consecutive access units in decoding order as two coded fields and share the same value of the frame_num syntax element, where the second field in decoding order is not an IDR picture and does not include a memory_mana…
19 3.1.36
constituent picture
part of a spatially frame-packed stereoscopic video picture that corresponds to one view, or a picture itself when frame packing is not in use or the temporal interleaving frame packing arrangement is in use
3.1.37
context variable
variable specified for the adaptive binary arithmetic decoding process of a bin by a formula containing recently decoded bins
3.1.38
DC transform coefficient
transform coefficient for which the frequency index is zero in all dimensions
3.1.39
decoded picture
picture derived by decoding a coded picture
Note 1 to entry: A decoded picture is either a decoded frame, or a decoded field. A decoded field is either a decoded top field or a decoded bottom field.
3.1.40
decoded picture buffer
DPB
buffer holding decoded pictures for reference, output reordering, or output delay specified for the hypothetical reference decoder
Note 1 to entry: The hypothetical reference decoder is specified in Annex C.
3.1.41
decoder
embodiment of a decoding process
3.1.42
decoder under test
DUT
decoder that is tested for conformance by operating the hypothetical stream scheduler to deliver a conforming bitstream to the decoder and to the hypothetical reference decoder and comparing the values and timing of the output of the two decoders
3.1.43
decoding order
order in which syntax elements are processed by the decoding process
3.1.44
decoding process
process that reads a bitstream and derives decoded pictures from it
3.1.45
direct prediction
inter prediction for a block for which no motion vector is decoded
Note 1 to entry: Two direct prediction modes are specified that are referred to as spatial direct prediction and temporal prediction mode.
3.1.46
display process
process having, as its input, the cropped decoded pictures that are the output of the decoding process
Note 1 to entry: The display process is not specified in this document.
3.1.47
elevation circle
circle on a sphere connecting all points with the same elevation value
Note 1 to entry: An elevation circle is similar to a lattitude line on the earth. Except when the elevation value is zero, an elevation circle is not a great circle like a longitude circle on the earth.
20 3.1.48
emulation prevention byte
byte equal to 0x03 that may be present within a NAL unit
Note 1 to entry: The presence of emulation prevention bytes ensures that no sequence of consecutive byte-aligned bytes in the NAL unit contains a start code prefix.
3.1.49
encoder
embodiment of an encoding process
3.1.50
encoding process
process that produces a bitstream
Note 1 to entry: A bitstream conforming to this document.
3.1.51
field
assembly of alternate rows of a frame
Note 1 to entry: A frame is composed of two fields, a top field and a bottom field.
3.1.52
field macroblock
macroblock containing samples from a single field
Note 1 to entry: All macroblocks of a coded field are field macroblocks. When macroblock-adaptive frame/field decoding is in use, some macroblocks of a coded frame can be field macroblocks.
3.1.53
field macroblock pair
macroblock pair decoded as two field macroblocks
3.1.54
field scan
specific sequential ordering of transform coefficients that differs from the zig-zag scan by scanning columns more rapidly than rows
Note 1 to entry: Field scan is used for transform coefficients in field macroblocks.
3.1.55
flag
variable that can take one of the two possible values 0 and 1
3.1.56
frame
frame contains an array of luma samples in monochrome format or an array of luma samples and two corresponding arrays of chroma samples in 4:2:0, 4:2:2, and 4:4:4 colour format
Note 1 to entry: A frame consists of two fields, a top field and a bottom field.
3.1.57
frame macroblock
macroblock representing samples from the two fields of a coded frame
Note 1 to entry: When macroblock-adaptive frame/field decoding is not in use, all macroblocks of a coded frame are frame macroblocks. When macroblock-adaptive frame/field decoding is in use, some macroblocks of a coded frame may be frame macroblocks.
3.1.58
frame macroblock pair
macroblock pair decoded as two frame macroblocks
3.1.59
frequency index
one-dimensional or two-dimensional index associated with a transform coefficient prior to an inverse transform part of the decoding process
21 3.1.60
global coordinate axes
coordinate axes associated with omnidirectional video that are associated with an externally referenceable position and orientation
Note 1 to entry: The global coordinate axes can correspond to the position and orientation of a device or rig used for omnidirectional audio/video acquisition as well as the position of an observer’s head in the three-dimensional space of the omnidire…
3.1.61
great circle
intersection of a sphere and a plane that passes through the centre point of the sphere
Note 1 to entry: A great circle is also known as an orthodrome or Riemannian circle.
3.1.62
hypothetical reference decoder
HRD
hypothetical decoder model that specifies constraints on the variability of conforming NAL unit streams or conforming byte streams that an encoding process may produce
3.1.63
hypothetical stream scheduler
HSS
hypothetical delivery mechanism for the timing and data flow of the input of a bitstream into the hypothetical reference decoder
Note 1 to entry: The HSS is used for checking the conformance of a bitstream or a decoder.
3.1.64
I slice
intra slice
slice that is not an SI slice that is decoded using intra prediction only
3.1.65
instantaneous decoding refresh access unit
IDR access unit
access unit in which the primary coded picture is an IDR picture
3.1.66
instantaneous decoding refresh picture
IDR picture
coded picture for which the variable IdrPicFlag is equal to 1
Note 1 to entry: An IDR picture causes the decoding process to mark all reference pictures as “unused for reference” immediately after the decoding of the IDR picture. All coded pictures that follow an IDR picture in decoding order can be decoded with…
3.1.67
inter coding
coding of a block, macroblock, slice, or picture that uses inter prediction
3.1.68
inter prediction
prediction derived from decoded samples of reference pictures other than the current decoded picture
3.1.69
interpretation sample value
possibly-altered value corresponding to a decoded sample value of an auxiliary coded picture that may be generated for use in the display process
Note 1 to entry: Interpretation sample values are not used in the decoding process and have no normative effect on the decoding process.
3.1.70
intra coding
coding of a block, macroblock, slice, or picture that uses intra prediction
22 3.1.71
intra prediction
prediction derived from the decoded samples of the same decoded slice
3.1.72
inverse transform
part of the decoding process by which a set of transform coefficients are converted into spatial-domain values, or by which a set of transform coefficients are converted into DC transform coefficients
3.1.73
layer
one of a set of syntactical structures in a non-branching hierarchical relationship
Note 1 to entry: Higher layers contain lower layers. The coding layers are the coded video sequence, picture, slice, and macroblock layers.
3.1.74
level
defined set of constraints on the values that may be taken by the syntax elements and variables
Note 1 to entry: The same set of levels is defined for all profiles, with most aspects of the definition of each level being in common across different profiles. Individual implementations can, within specified constraints, support a different level f…
3.1.75
list
one-dimensional array of syntax elements or variables
3.1.76
list 0 (list 1) motion vector
motion vector associated with a reference index pointing into reference picture list 0 (list 1)
3.1.77
list 0 (list 1) prediction
inter prediction of the content of a slice using a reference index pointing into reference picture list 0 (list 1)
3.1.78
local coordinate axes
coordinate axes having a specified rotation relationship relative to the global coordinate axes
3.1.79
luma
adjective specifying that a sample array or single sample is representing the monochrome signal related to the primary colours.
Note 1 to entry: The symbol or subscript used for luma is Y or L.
Note 2 to entry: The term luma is used rather than the term luminance in order to avoid the implication of the use of linear light transfer characteristics that is often associated with the term luminance. The symbol L is sometimes used instead of the…
3.1.80
macroblock
16×16 block of luma samples and two corresponding blocks of chroma samples of a picture that has three sample arrays, or a 16×16 block of samples of a monochrome picture or a picture that is coded using three separate colour planes
Note 1 to entry: The division of a slice or a macroblock pair into macroblocks is a partitioning.
3.1.81
macroblock-adaptive frame
macroblock-adaptive field decoding
decoding process for coded frames in which some macroblocks may be decoded as frame macroblocks and others may be decoded as field macroblocks
23 3.1.82
macroblock address
index of a macroblock in a macroblock raster scan of the picture starting with zero for the top-left macroblock in a picture
Note 1 to entry: The macroblock address of the top macroblock of each macroblock pair is an even number and the macroblock address of the bottom macroblock of each macroblock pair is an odd number.
3.1.83
macroblock address
top macroblock of a macroblock pair is two times the index of the macroblock pair in a macroblock pair raster scan of the picture, and the bottom macroblock of a macroblock pair is the macroblock address of the corre…
Note 1 to entry: The macroblock address of the top macroblock of each macroblock pair is an even number and the macroblock address of the bottom macroblock of each macroblock pair is an odd number.
3.1.84
macroblock location
two-dimensional coordinates of a macroblock in a picture denoted by ( x, y )
Note 1 to entry: For the top left macroblock of the picture ( x, y ) is equal to ( 0, 0 ). x is incremented by 1 for each macroblock column from left to right. When macroblock-adaptive frame/field decoding is not in use, y is incremented by 1 for each…
3.1.85
macroblock pair
pair of vertically contiguous macroblocks in a frame that is coupled for use in macroblock-adaptive frame/field decoding
Note 1 to entry: The division of a slice into macroblock pairs is a partitioning.
3.1.86
macroblock partition
block of luma samples and two corresponding blocks of chroma samples resulting from a partitioning of a macroblock for inter prediction for a picture that has three sample arrays or a block of luma samples resulting from a partitioning of a macroblock…
3.1.87
macroblock to slice group map
means of mapping macroblocks of a picture into slice groups
Note 1 to entry: The macroblock to slice group map consists of a list of numbers, one for each coded macroblock, specifying the slice group to which each coded macroblock belongs.
3.1.88
map unit to slice group map
means of mapping slice group map units of a picture into slice groups
Note 1 to entry: The map unit to slice group map consists of a list of numbers, one for each slice group map unit, specifying the slice group to which each coded slice group map unit belongs.
3.1.89
matrix
two-dimensional array of syntax elements or variables
3.1.90
memory management control operation
seven operations that control reference picture marking
3.1.91
motion vector
two-dimensional vector used for inter prediction that provides an offset from the coordinates in the decoded picture to the coordinates in a reference picture
3.1.92
NAL unit
24 syntax structure containing an indication of the type of data to follow and bytes containing that data in the form of an RBSP interspersed as necessary with emulation prevention bytes
3.1.93
NAL unit stream
sequence of NAL units
3.1.94
non-paired field
collective term for a non-paired reference field or a non-paired non-reference field
3.1.95
non-paired non-reference field
decoded non-reference field that is not part of a complementary non-reference field pair
3.1.96
non-paired reference field
decoded reference field that is not part of a complementary reference field pair
3.1.97
non-reference field
field coded with nal_ref_idc equal to 0
3.1.98
non-reference frame
frame coded with nal_ref_idc equal to 0
3.1.99
non-reference picture
picture coded with nal_ref_idc equal to 0
Note 1 to entry: A non-reference picture is not used for inter prediction of any other pictures.
3.1.100
omnidirectional video
video content in a format that enables rendering according to the user’s viewing orientation
EXAMPLE If viewed using a head-mounted device, or according to a user’s desired viewport, reflecting a potentially rotated viewing position.
3.1.101
opposite parity
opposite parity of top is bottom, and vice versa
3.1.102
output order
order in which the decoded pictures are output from the decoded picture buffer
3.1.103
P slice
predictive slice
slice that is not an SP slice that may be decoded using intra prediction or inter prediction using at most one motion vector and reference index to predict the sample values of each block
3.1.104
packed region
region in a region-wise packed picture that is mapped to a projected region according to a region-wise packing
3.1.105
parameter
syntax element of a sequence parameter set or a picture parameter set
Note 1 to entry: Parameter is also used as part of the defined term quantization parameter.
3.1.106
parity
top or bottom
3.1.107
25 partitioning
division of a set into subsets such that each element of the set is in exactly one of the subsets
3.1.108
picture
collective term for a field or a frame
3.1.109
picture parameter set
syntax structure containing syntax elements that apply to zero or more entire coded pictures as determined by the pic_parameter_set_id syntax element found in each slice header
3.1.110
picture order count
variable that is associated with each coded field and each field of a coded frame and has a value that is non-decreasing with increasing field position in output order relative to the first output field of the previous IDR picture in decoding order or…
3.1.111
prediction
embodiment of the prediction process
3.1.112
prediction process
use of a predictor to provide an estimate of the sample value or data element currently being decoded
3.1.113
predictor
combination of specified values or previously decoded sample values or data elements used in the decoding process of subsequent sample values or data elements
3.1.114
primary coded picture
coded representation of a picture to be used by the decoding process for a bitstream
Note 1 to entry: The primary coded picture contains all macroblocks of the picture. The only pictures that have a normative effect on the decoding process are primary coded pictures. See also redundant coded picture.
3.1.115
profile
specified subset of syntax
Note 1 to entry: The syntax of this document.
3.1.116
projected picture
picture that uses a projection format for omnidirectional video
3.1.117
projected region
region in a projected picture that is mapped to a packed region according to a region-wise packing
3.1.118
projection
specified correspondence between the colour samples of a projected picture and azimuth and elevation positions on a sphere
3.1.119
quantization parameter
variable used by the decoding process for scaling of transform coefficient levels
3.1.120
random access
act of starting the decoding process for a bitstream at a point other than the beginning of the stream
26 3.1.121
raster scan
mapping of a rectangular two-dimensional pattern to a one-dimensional pattern such that the first entries in the one-dimensional pattern are from the first top row of the two-dimensional pattern scanned from left to right, followed similarly by the se…
3.1.122
raw byte sequence payload
RBSP
syntax structure containing an integer number of bytes that is encapsulated in a NAL unit
Note 1 to entry: An RBSP is either empty or has the form of a string of data bits containing syntax elements followed by an RBSP stop bit and followed by zero or more subsequent bits equal to 0.
3.1.123
raw byte sequence payload stop bit
RBSP stop bit
bit equal to 1 present within a raw byte sequence payload after a string of data bits
Note 1 to entry: The location of the end of the string of data bits within an RBSP can be identified by searching from the end of the RBSP for the RBSP stop bit, which is the last non-zero bit in the RBSP.
3.1.124
recovery point
point in the bitstream at which the recovery of an exact or an approximate representation of the decoded pictures represented by the bitstream is achieved after a random access or broken link
3.1.125
redundant coded picture
coded representation of a picture or a part of a picture
Note 1 to entry: The content of a redundant coded picture shall not be used by the decoding process for a bitstream conforming to this document. A redundant coded picture is not required to contain all macroblocks in the primary coded picture. Redunda…
3.1.126
reference field
field used for inter prediction when P, SP, and B slices of a coded field or field macroblocks of a coded frame are decoded
Note 1 to entry: See also reference picture.
3.1.127
reference frame
frame used for inter prediction when P, SP, and B slices of a coded frame are decoded
Note 1 to entry: See also reference picture.
3.1.128
reference index
index into a reference picture list
3.1.129
reference picture
picture with nal_ref_idc not equal to 0
Note 1 to entry: A reference picture contains samples that can be used for inter prediction in the decoding process of subsequent pictures in decoding order.
3.1.130
reference picture list
list of reference pictures that is used for inter prediction of a P, B, or SP slice
Note 1 to entry: For the decoding process of a P or SP slice, there is one reference picture list. For the decoding process of a B slice, there are two reference picture lists.
3.1.131
reference picture list 0
reference picture list used for inter prediction of a P, B, or SP slice
27 Note 1 to entry: All inter prediction used for P and SP slices uses reference picture list 0. Reference picture list 0 is one of two reference picture lists used for inter prediction for a B slice, with the other being reference picture list 1.
3.1.132
reference picture list 1
reference picture list used for inter prediction of a B slice
Note 1 to entry: Reference picture list 1 is one of two reference picture lists used for inter prediction for a B slice, with the other being reference picture list 0.
3.1.133
reference picture marking
Specifies, in the bitstream, how the decoded pictures are marked for inter prediction
3.1.134
region-wise packed picture
decoded picture that contains one or more packed regions
Note 1 to entry: A packed picture can contain a region-wise packing of a projected picture.
3.1.135
region-wise packing
transformation, resizing, and relocation of packed regions of a region-wise packed picture to remap the packed regions to projected regions of a projected picture
3.1.136
reserved
values for future use by ITU-T | ISO/IEC
Note 1 to entry: These values shall not be used in bitstreams conforming to this document, but can be used in future extensions of this document by ITU-T | ISO/IEC.
3.1.137
residual
decoded difference between a prediction of a sample or data element and its decoded value
3.1.138
run
number of consecutive data elements represented in the decoding process
Note 1 to entry: In one context, the number of zero-valued transform coefficient levels preceding a non-zero transform coefficient level in the list of transform coefficient levels generated by a zig-zag scan or a field scan. In other contexts, run re…
3.1.139
sample aspect ratio
Specifies, for assisting the display process, which is not specified in this document, the ratio between the intended horizontal distance between the columns and the intended vertical distance between the rows of the luma sample array in a frame
Note 1 to entry: Sample aspect ratio is expressed as h:v, where h is horizontal width and v is vertical height (in arbitrary units of spatial distance).
3.1.140
scaling
process of multiplying transform coefficient levels by a factor, resulting in transform coefficients
3.1.141
sequence parameter set
syntax structure containing syntax elements that apply to zero or more entire coded video sequences as determined by the content of a seq_parameter_set_id syntax element found in the picture parameter set referred to by the pic_parameter_set_id syntax…
3.1.142
SI slice
switching I slice
slice that is coded using intra prediction only and using quantization of the prediction samples
Note 1 to entry: An SI slice can be coded such that its decoded samples can be constructed identically to an SP slice.
28 3.1.143
skipped macroblock
macroblock for which no data is coded other than an indication that the macroblock is to be decoded as “skipped”
Note 1 to entry: This indication can be common to several macroblocks.
3.1.144
slice
integer number of macroblocks or macroblock pairs ordered consecutively in the raster scan within a particular slice group
Note 1 to entry: For the primary coded picture, the division of each slice group into slices is a partitioning. Although a slice contains macroblocks or macroblock pairs that are consecutive in the raster scan within a slice group, these macroblocks o…
3.1.145
slice data partition
non-empty subset of the syntax elements of the slice data syntax structure for a slice
Note 1 to entry: The syntax elements of a slice data partition are associated with the same category.
3.1.146
slice data partitioning
method of partitioning selected syntax elements into syntax structures based on a category associated with each syntax element
3.1.147
slice group
subset of the macroblocks or macroblock pairs of a picture
Note 1 to entry: The division of the picture into slice groups is a partitioning of the picture. The partitioning is specified by the macroblock to slice group map.
3.1.148
slice group map units
units of the map unit to slice group map
3.1.149
slice header
part of a coded slice containing the data elements pertaining to the first or all macroblocks represented in the slice
3.1.150
source
video material or some of its attributes before encoding
3.1.151
SP slice
switching P slice
slice that may be coded using intra prediction or inter prediction with quantization of the prediction samples using at most one motion vector and reference index to predict the sample values of each block
Note 1 to entry: An SP slice can be coded such that its decoded samples can be constructed identically to another SP slice or an SI slice.
3.1.152
sphere coordinates
azimuth and elevation angles identifying a location of a point on a sphere
3.1.153
sphere region
region on a sphere, specified either by four great circles or by two azimuth circles and two elevation circles, or such a region on a rotated sphere after applying yaw, pitch, and roll rotations
3.1.154
start code prefix
unique sequence of three bytes equal to 0x000001 embedded in the byte stream as a prefix to each NAL unit
29 Note 1 to entry: The location of a start code prefix can be used by a decoder to identify the beginning of a new NAL unit and the end of a previous NAL unit. Emulation of start code prefixes is prevented within NAL units by the inclusion of emulation …
3.1.155
string of data bits
SODB
sequence of some number of bits representing syntax elements present within a raw byte sequence payload prior to the raw byte sequence payload stop bit
Note 1 to entry: Within an SODB, the left-most bit is considered to be the first and most significant bit, and the right-most bit is considered to be the last and least significant bit.
3.1.156
sub-macroblock
one quarter of the samples of a macroblock, i.e., an 8×8 luma block and two corresponding chroma blocks of which one corner is located at a corner of the macroblock for a picture that has three sample arrays or an 8×8 luma block of which one corner is…
3.1.157
sub-macroblock partition
block of luma samples and two corresponding blocks of chroma samples resulting from a partitioning of a sub-macroblock for inter prediction for a picture that has three sample arrays or a block of luma samples resulting from a partitioning of a sub-ma…
3.1.158
syntax element
element of data represented in the bitstream
3.1.159
syntax structure
zero or more syntax elements present together in the bitstream in a specified order
3.1.160
tilt angle
angle indicating the amount of tilt of a sphere region, measured as the amount of rotation of a sphere region along the axis originating from the sphere origin passing through the centre point of the sphere region, where the angle value increases cloc…
3.1.161
top field
one of two fields that comprise a frame
Note 1 to entry: Each row of a top field is spatially located immediately above the corresponding row of the bottom field.
3.1.162
top macroblock
macroblock within a macroblock pair that contains the samples in the top row of samples for the macroblock pair
Note 1 to entry: For a field macroblock pair, the top macroblock represents the samples from the region of the top field of the frame that lie within the spatial region of the macroblock pair. For a frame macroblock pair, the top macroblock represents…
3.1.163
transform coefficient
scalar quantity, considered to be in a frequency domain, that is associated with a particular one-dimensional or two-dimensional frequency index in an inverse transform part of the decoding process
3.1.164
transform coefficient level
integer quantity representing the value associated with a particular two-dimensional frequency index in the decoding process prior to scaling for computation of a transform coefficient value
30 3.1.165
universal unique identifier
UUID
identifier that is unique with respect to the space of all universal unique identifiers
3.1.166
unspecified
value which has no specified meaning
Note 1 to entry: These values will not have a specified meaning in the future as an integral part of this document.
3.1.167
variable length coding
VLC
reversible procedure for entropy coding that assigns shorter bit strings to symbols expected to be more frequent and longer bit strings to symbols expected to be less frequent
3.1.168
VCL NAL unit
collective term for coded slice NAL units and coded slice data partition NAL units
3.1.169
viewport
region of omnidirectional video content suitable for display and viewing by the user
3.1.170
zig-zag scan
specific sequential ordering of transform coefficient levels from (approximately) the lowest spatial frequency to the highest
Note 1 to entry: Zig-zag scan is used for transform coefficient levels in frame macroblocks.
3.2 Terms related to scalable video coding (Annex F)
3.2.1
arbitrary slice order
ASO
decoding order of slices in which the macroblock address of the first macroblock of some slice of a slice group within a layer representation may be less than the macroblock address of the first macroblock of some other preceding slice of the same sli…
3.2.2
associated NAL unit
NAL unit that directly succeeds a prefix NAL unit in decoding order
3.2.3
B slice
slice that may be decoded using intra-layer intra prediction or inter prediction using at most two motion vectors and reference indices to predict the sample values of each block
3.2.4
base layer
bitstream subset that contains all NAL units with the nal_unit_type syntax element equal to 1 and 5 of the bitstream and does not contain any NAL unit with the nal_unit_type syntax element equal to 14, 15, or 20
Note 1 to entry: The bitstream subset also conforms to one or more of the profiles specified in Annex A.
3.2.5
base quality layer representation
layer representation of the target dependency representation of an access unit that is associated with the quality_id syntax element equal to 0
3.2.6
bitstream subset
bitstream that is derived as a subset from a bitstream by discarding zero or more NAL units
31 Note 1 to entry: A bitstream subset is also referred to as sub-bitstream.
3.2.7
bottom macroblock
macroblock within a macroblock pair that contains the samples in the bottom row of samples for the macroblock pair
Note 1 to entry: For a field macroblock pair, the bottom macroblock represents the samples from the region of the bottom field or layer bottom field of the frame or layer frame, respectively, that lie within the spatial region of the macroblock pair. …
3.2.8
coded slice in scalable extension NAL unit
coded slice NAL unit that contains an EI slice, EP slice, or an EB slice
3.2.9
complementary reference field pair
two reference fields that are in consecutive access units in decoding order as two coded fields, where the target dependency representations of the fields share the same value of the frame_num syntax element and where the second field in decoding orde…
3.2.10
complementary reference base field pair
Two reference base fields that are associated with two coded fields that are in consecutive access units in decoding order, where the target dependency representations of the coded fields share the same value of the frame_num syntax element and where …
Note 1 to entry: A complementary reference base field pair is a complementary reference field pair.
3.2.11
dependency representation
subset of VCL NAL units within an access unit that are associated with the same value of the dependency_id syntax element, which is provided as part of the NAL unit header or by an associated prefix NAL unit, and the same value of the redundant_pic_cn…
3.2.12
EB slice
slice that may be decoded using intra prediction or inter prediction or inter-layer prediction from syntax elements and derived variables of the reference layer representation
Note 1 to entry: For inter-prediction of EB slices at most two motion vectors and reference indices are used to predict the sample values of each block.
3.2.13
EI slice
slice that is not an I slice or SI slice that is decoded using intra prediction only
3.2.14
EP slice
slice that may be decoded using intra prediction or inter prediction or inter-layer prediction from syntax elements and derived variables of the reference layer representation
Note 1 to entry: For inter-prediction of EP slices at most one motion vector and reference index is used to predict the sample values of each block.
3.2.15
field macroblock
macroblock containing samples from a single field or layer field
3.2.16
frame macroblock
macroblock containing samples from the two fields or layer fields of a frame or layer frame, respectively
3.2.17
32 I slice
slice that is decoded using intra-layer intra prediction only
3.2.18
instantaneous decoding refresh picture
IDR picture
coded picture for which the variable IdrPicFlag is equal to 1 for the target dependency representation
Note 1 to entry: An IDR picture causes the decoding process to mark all reference pictures as “unused for reference” immediately after the decoding of the IDR picture. All coded pictures that follow an IDR picture in decoding order can be decoded with…
3.2.19
inter-layer intra prediction
inter-layer prediction derived from decoded samples of intra-coded macroblocks of the reference layer representation
3.2.20
inter-layer prediction
prediction derived from syntax elements, derived variables, or decoded samples of the reference layer representation
3.2.21
intra-layer intra prediction
spatial intra prediction
prediction derived from decoded samples of the same decoded slice
3.2.22
intra prediction
collective term for intra-layer intra prediction or inter-layer intra prediction or a combination of intra-layer intra prediction together with inter-layer prediction from syntax elements and derived variables of the reference layer representation
3.2.23
intra slice
collective term for I slice or EI slice
3.2.24
layer bottom field
one of two layer fields that comprise a layer frame
Note 1 to entry: Each row of a layer bottom field is spatially located immediately below a corresponding row of a layer top field.
3.2.25
layer field
assembly of alternate rows of a layer frame
Note 1 to entry: A layer frame is composed of two layer fields, a layer top field and a layer bottom field.
3.2.26
layer frame
layer frame contains an array of luma samples that represents an intermediate decoding result for a field or a frame in monochrome format or an array of luma samples and two corresponding arrays of chroma samples that represent an intermediate decodin…
3.2.27
layer picture
collective term for a layer field or a layer frame
3.2.28
layer top field
one of two layer fields that comprise a layer frame
Note 1 to entry: Each row of a layer top field is spatially located immediately above a corresponding row of a layer bottom field.
3.2.29
layer representation
33 subset of VCL NAL units within an access unit that are associated with the same values of the dependency_id and quality_id syntax elements, which are provided as part of the VCL NAL unit header or by an associated prefix NAL unit, and the same value o…
3.2.30
layer representation identifier
integer value by which a particular layer representation inside a coded picture is uniquely identified
3.2.31
macroblock
16×16 block of luma samples and two corresponding blocks of chroma samples of a picture or layer picture that has three sample arrays, or a 16×16 block of samples of a monochrome picture or layer picture
Note 1 to entry: The division of a slice or a macroblock pair into macroblocks is a partitioning.
3.2.32
macroblock-adaptive frame/field decoding
decoding process for coded frames or layer representations in which some macroblocks may be decoded as frame macroblocks and others may be decoded as field macroblocks
3.2.33
macroblock address
macroblock address is the index of a macroblock in a macroblock raster scan of the picture or layer picture starting with zero for the top-left macroblock in a picture or layer picture.
Note 1 to entry: The macroblock address of the top macroblock of each macroblock pair is an even number and the macroblock address of the bottom macroblock of each macroblock pair is an odd number.
3.2.34
macroblock address
macroblock address of the top macroblock of a macroblock pair is two times the index of the macroblock pair in a macroblock pair raster scan of the picture or layer picture, and the macroblock address of the bottom m…
Note 1 to entry: The macroblock address of the top macroblock of each macroblock pair is an even number and the macroblock address of the bottom macroblock of each macroblock pair is an odd number.
3.2.35
macroblock location
two-dimensional coordinates of a macroblock in a picture or layer picture denoted by ( x, y )
Note 1 to entry: For the top left macroblock of the picture or layer picture ( x, y ) is equal to ( 0, 0 ). x is incremented by 1 for each macroblock column from left to right. When macroblock-adaptive frame/field decoding is not in use, y is incremen…
3.2.36
macroblock pair
pair of vertically contiguous macroblocks in a frame or layer frame that is coupled for use in macroblock-adaptive frame/field decoding
Note 1 to entry: The division of a slice into macroblock pairs is a partitioning.
3.2.37
macroblock to slice group map
means of mapping macroblocks of a picture or layer picture into slice groups
Note 1 to entry: The macroblock to slice group map consists of a list of numbers, one for each coded macroblock, specifying the slice group to which each coded macroblock belongs.
3.2.38
map unit to slice group map
means of mapping slice group map units of a picture or layer picture into slice groups
Note 1 to entry: The map unit to slice group map consists of a list of numbers, one for each slice group map unit, specifying the slice group to which each coded slice group map unit belongs to.
34 3.2.39
non-paired reference base field
reference base field that is not part of a complementary reference base field pair
Note 1 to entry: A non-paired reference base field is a non-paired reference field.
3.2.40
P slice
slice that may be decoded using intra-layer intra prediction or inter prediction using at most one motion vector and reference index to predict the sample values of each block
3.2.41
parameter
syntax element of an SVC sequence parameter set or a picture parameter set
Note 1 to entry: Parameter is also used as part of the defined term quantization parameter.
3.2.42
picture parameter set
syntax structure containing syntax elements that apply to zero or more layer representations as determined by the pic_parameter_set_id syntax element found in each slice header
3.2.43
prefix NAL unit
NAL unit with nal_unit_type equal to 14 that immediately precedes in decoding order a NAL unit with nal_unit_type equal to 1 or 5
Note 1 to entry: The NAL unit that immediately succeeds the prefix NAL unit in decoding order is referred to as the associated NAL unit. The prefix NAL unit contains data associated with the associated NAL unit, which are considered to be part of the …
3.2.44
reference base field
reference field that is obtained by decoding a base quality layer representation with the nal_ref_idc syntax element not equal to 0, the store_ref_base_pic_flag syntax element equal to 1, and the field_pic_flag syntax element equal to 1 of a coded pic…
Note 1 to entry: A reference base field is not a decoded picture and it is not an output of the decoding process, but can be used for inter prediction when P, B, EP, and EB slices of a coded field or a field macroblock of a coded frame are decoded. Se…
3.2.45
reference base frame
reference frame that is obtained by decoding a base quality layer representation with the nal_ref_idc syntax element not equal to 0, the store_ref_base_pic_flag syntax element equal to 1, and the field_pic_flag syntax element equal to 0 of a coded pic…
Note 1 to entry: A reference base frame is not a decoded picture and it is not an output of the decoding process, but can be used for inter prediction when P, B, EP, and EB slices of a coded frame are decoded. See also reference base picture.
3.2.46
reference base picture
collective term for a reference base field or a reference base frame
3.2.47
reference field
reference field may be used for inter prediction when P, B, EP, or EB slices of a coded field or field macroblocks of a coded frame are decoded
Note 1 to entry: See also reference picture.
3.2.48
reference frame
reference frame may be used for inter prediction when P, B, EP, or EB slices of a coded frame are decoded
Note 1 to entry: See also reference picture.
35 3.2.49
reference layer macroblock
macroblock of a reference layer representation
3.2.50
reference layer representation
reference layer representation for a particular layer representation of a coded picture is the layer representation that is used for inter-layer prediction of the particular layer representation
Note 1 to entry: The reference layer representation belongs to the same access unit as the layer representation that uses the reference layer representation for inter-layer prediction.
3.2.51
reference picture
collective term for a decoded picture that is obtained by decoding a coded picture for which the nal_ref_idc syntax element that is associated with the target dependency representation is not equal to 0 or a reference base picture
Note 1 to entry: A reference picture contains samples that can be used for inter prediction in the decoding process of subsequent pictures in decoding order.
3.2.52
reference picture list
list of reference pictures that is used for inter prediction of a P, B, EP, or EB slice
Note 1 to entry: For the decoding process of a P or EP slice, there is one reference picture list. For the decoding process of a B or EB slice, there are two reference picture lists.
3.2.53
reference picture list 0
reference picture list used for inter prediction of a P, B, EP, or EB slice
Note 1 to entry: All inter prediction used for P and EP slices uses reference picture list 0. Reference picture list 0 is one of two reference picture lists used for inter prediction for a B or EB slice, with the other being reference picture list 1.
3.2.54
reference picture list 1
reference picture list used for inter prediction of a B or EB slice
Note 1 to entry: Reference picture list 1 is one of two reference picture lists used for inter prediction for a B or EB slice, with the other being reference picture list 0.
3.2.55
scalable bitstream
bitstream with the property that one or more bitstream subsets that are not identical to the scalable bitstream form another bitstream that conforms to this specification
3.2.56
sequence parameter set
syntax structure containing syntax elements that apply to zero or more layer representations with the dependency_id syntax element equal to 0 and the quality_id syntax element equal to 0 as determined by the content of a seq_parameter_set_id syntax el…
3.2.57
slice
integer number of macroblocks or macroblock pairs ordered consecutively in the raster scan within a particular slice group
Note 1 to entry: Each macroblock or macroblock pair of a picture or layer picture shall not be contained in more than one slice of a particular layer representation. Although a slice contains macroblocks or macroblock pairs that are consecutive in the…
3.2.58
slice group
subset of the macroblocks or macroblock pairs of a picture or layer picture
36 Note 1 to entry: The division of the picture or layer picture into slice groups is a partitioning of the picture or layer picture. The partitioning is specified by the macroblock to slice group map.
3.2.59
sub-bitstream
subset of a bitstream
Note 1 to entry: A sub-bitstream is also referred to as bitstream subset.
3.2.60
subset
set containing only elements that are also contained in the set from which the subset is derived
Note 1 to entry: The subset can be identical to the set from which it is derived.
3.2.61
subset sequence parameter set
syntax structure containing syntax elements that apply to zero or more layer representations with the dependency_id syntax element not equal to 0 or the quality_id syntax element not equal to 0 as determined by the content of a seq_parameter_set_id sy…
3.2.62
SVC sequence parameter set
collective term for sequence parameter set or subset sequence parameter set
3.2.63
SVC sequence parameter set RBSP
collective term for sequence parameter set RBSP or subset sequence parameter set RBSP
3.2.64
target dependency representation
dependency representation of a coded picture that is associated with the largest value of the dependency_id syntax element for all dependency representations of the coded picture
3.2.65
target layer representation
layer representation of the target dependency representation of a coded picture that is associated with the largest value of the quality_id syntax element for all layer representations of the target dependency representation of the coded picture
3.2.66
top macroblock
macroblock within a macroblock pair that contains the samples in the top row of samples for the macroblock pair
Note 1 to entry: For a field macroblock pair, the top macroblock represents the samples from the region of the top field or layer top field of the frame or layer frame that lie within the spatial region of the macroblock pair. For a frame macroblock p…
3.2.67
VCL NAL unit
collective term for coded slice NAL units and prefix NAL units
3.3 Terms related to multiview video coding (Annex G)
3.3.1
access unit
set of NAL units that are consecutive in decoding order and contain exactly one primary coded picture consisting of one or more view components
Note 1 to entry: In addition to the primary coded picture, an access unit can also contain one or more redundant coded pictures, one auxiliary coded picture, or other NAL units not containing slices or slice data partitions of a coded picture. The dec…
3.3.2
anchor access unit
access unit in which the primary coded picture is an anchor picture
37 3.3.3
anchor picture
coded picture in which all slices may reference only slices within the same access unit, i.e., inter-view prediction may be used, but no inter prediction is used, and all following coded pictures in output order do not use inter prediction from any pi…
Note 1 to entry: The value of anchor_pic_flag is equal to 1 for all the prefix NAL units (when present) and all the slice extension NAL units that are contained in an anchor picture.
3.3.4
anchor view component
view component in an anchor picture
Note 1 to entry: All view components in an anchor picture are anchor view components.
3.3.5
associated NAL unit
NAL unit that immediately follows a prefix NAL unit in decoding order
3.3.6
base view
view that has the minimum value of view order index in a coded video sequence
Note 1 to entry: The base view can be decoded independently of other views, does not use inter-view prediction, and contains VCL NAL units only with nal_unit_type equal to 1, 5, or 14. The bitstream subset corresponding to the base view conforms to on…
3.3.7
bitstream subset
bitstream that is derived as a subset from a bitstream by discarding zero or more NAL units
Note 1 to entry: A bitstream subset is also referred to as a sub-bitstream.
3.3.8
coded slice MVC extension NAL unit
coded slice NAL unit that has nal_unit_type equal to 20
3.3.9
decoded view component
decoded view component is derived by decoding a view component
Note 1 to entry: A decoded view component is either a decoded frame view component, or a decoded field view component.
3.3.10
direct prediction
inter prediction or inter-view prediction for a block for which no motion vector is decoded
Note 1 to entry: Two direct prediction modes are specified that are referred to as spatial direct prediction mode and temporal direct prediction mode.
3.3.11
field view component
view component of a field
3.3.12
frame view component
view component of a frame
3.3.13
instantaneous decoding refresh view component
IDR view component
view component in an IDR picture
Note 1 to entry: All view components in an IDR picture are IDR view components. IDR view components are also anchor view components, and inter-view prediction can be used for IDR view components that are part of a non-base view.
3.3.14
inter-view coding
coding of a block, macroblock, slice, or picture that uses inter-view prediction
38 3.3.15
inter-view only reference component
view component coded with nal_ref_idc equal to 0 and inter_view_flag equal to 1
Note 1 to entry: An inter-view only reference component contains samples that can be used for inter-view prediction in the decoding process of subsequent view components in decoding order, but are not used for inter prediction by any view components. …
3.3.16
inter-view prediction
prediction derived from decoded samples of inter-view reference components or inter-view only reference components for decoding another view component in the same access unit
3.3.17
inter-view prediction reference
collective term for inter-view reference components or inter-view only reference components
3.3.18
inter-view reference component
view component coded with nal_ref_idc greater than 0 and inter_view_flag equal to 1
Note 1 to entry: An inter-view reference component contains samples that can be used for inter prediction of subsequent pictures in decoding order and inter-view prediction of subsequent view components in decoding order. Inter-view reference componen…
3.3.19
left view
left part of a picture coded in a frame-packed manner with the side-by-side frame packing arrangement type or the top part of a picture coded in a frame-packed manner with the top-bottom frame packing arrangement type
3.3.20
list 0 (list 1) prediction
inter prediction or inter-view prediction of the content of a slice using a reference index pointing into reference picture list 0 (list 1)
3.3.21
macroblock partition
block of luma samples and two corresponding blocks of chroma samples resulting from a partitioning of a macroblock for inter prediction or inter-view prediction
3.3.22
motion vector
two-dimensional vector used for inter prediction or inter-view prediction that provides an offset from the coordinates in the decoded view component to the coordinates in a reference picture or inter-view only reference component
3.3.23
MVC sequence parameter set
collective term for sequence parameter set or subset sequence parameter set
3.3.24
MVC sequence parameter set RBSP
collective term for sequence parameter set RBSP or subset sequence parameter set RBSP
3.3.25
non-anchor access unit
access unit that is not an anchor access unit
3.3.26
non-anchor picture
coded picture that is not an anchor picture
3.3.27
non-anchor view component
view component that is not an anchor view component
3.3.28
non-base view
view that is not the base view
39 Note 1 to entry: VCL NAL units of a non-base view have nal_unit_type equal to 20. Decoding of view components in a non-base view can require the use of inter-view prediction.
3.3.29
non-reference picture
view component coded with nal_ref_idc equal to 0
Note 1 to entry: A non-reference picture is not used for inter prediction in the decoding process of any other view components.
3.3.30
operation point
operation point is identified by a temporal_id value representing the target temporal level and a set of view_id values representing the target output views
Note 1 to entry: One operation point is associated with a bitstream subset, which consists of the target output views and all other views the target output views depend on, that is derived using the sub-bitstream extraction process as specified in sub…
3.3.31
picture order count
variable that is associated with each field view component and each field of a frame view component and has a value that is non-decreasing with increasing field position in output order in the same view relative to the first output field of the previo…
3.3.32
prefix NAL unit
NAL unit with nal_unit_type equal to 14 that immediately precedes in decoding order a NAL unit with nal_unit_type equal to 1 or 5
Note 1 to entry: The NAL unit that immediately follows in decoding order the prefix NAL unit is referred to as the associated NAL unit. The prefix NAL unit contains data associated with the associated NAL unit, which are considered to be part of the a…
3.3.33
reference picture
view component coded with nal_ref_idc greater than 0
Note 1 to entry: A reference picture contains samples that can be used for inter prediction in the decoding process of subsequent view components in decoding order. A reference picture can be an inter-view reference component, in which case the sample…
3.3.34
reference picture list
list of reference pictures and inter-view only reference components that are used for inter prediction or inter-view prediction of a P or B slice
Note 1 to entry: For the decoding process of a P slice, there is one reference picture list. For the decoding process of a B slice, there are two reference picture lists.
3.3.35
reference picture list 0
reference picture list used for inter prediction or inter-view prediction of a P or B slice
Note 1 to entry: All inter prediction or inter-view prediction used for P slices uses reference picture list 0. Reference picture list 0 is one of two reference picture lists used for inter prediction or inter-view prediction for a B slice, with the o…
3.3.36
reference picture list 1
reference picture list used for inter prediction or inter-view prediction of a B slice
Note 1 to entry: Reference picture list 1 is one of two reference picture lists used for inter prediction or inter-view prediction for a B slice, with the other being reference picture list 0.
40 3.3.37
reference picture marking
specifies, in the bitstream, how the decoded view components are marked for inter prediction or inter-view prediction
3.3.38
reference processing unit
functional unit that processes an inter-view prediction reference before the inter-view prediction reference is used for inter-view prediction in the decoding process of subsequent view components in decoding order
3.3.39
reference view index
index into a list of anchor view components or a list of non-anchor view components that are specified in the sequence parameter set MVC extension syntax structure and can be used for inter-view prediction as list 0 prediction or list 1 prediction
3.3.40
right view
right part of a picture coded in a frame-packed manner with the side-by-side frame packing arrangement type or the bottom part of a picture coded in a frame-packed manner with the top-bottom frame packing arrangement type
3.3.41
sub-bitstream
subset of a bitstream
Note 1 to entry: A sub-bitstream is also referred to as a bitstream subset.
3.3.42
subset
subset contains only elements that are also contained in the set from which the subset is derived
Note 1 to entry: The subset can be identical to the set from which it is derived.
3.3.43
subset sequence parameter set
syntax structure containing syntax elements that apply to zero or more non-base views as determined by the content of a seq_parameter_set_id syntax element found in the picture parameter set referred to by the pic_parameter_set_id syntax element found…
3.3.44
target output view
view that is to be output
Note 1 to entry: The target output views are either indicated by external means or, when not indicated by external means, the target output view is the base view.
Note 2 to entry: The output views can be requested by a receiver and can be negotiated between the receiver and the sender.
3.3.45
target temporal level
target temporal level of an operation point is the greatest value of temporal_id of all VCL NAL units in the bitstream subset associated with the operation point
3.3.46
view
sequence of view components associated with an identical value of view_id
3.3.47
view component
coded representation of a view in a single access unit
Note 1 to entry: When profile_idc is equal to 134, a view contains samples of two distinct spatially packed constituent frames that are packed into one frame using one of the frame packing arrangement schemes as specified in subclause D.2.26.
3.3.48
view order index
index that indicates the decoding order of view components in an access unit
41 3.4 Terms related to multiview and depth video coding (Annex H)
3.4.1
depth field view
depth view component of a field
3.4.2
depth frame view
depth view component of a frame
3.4.3
depth view
sequence of depth view components associated with an identical value of view_id
3.4.4
depth view component
coded representation of the depth of a view in a single access unit
3.4.5
inter-view only reference component
view component, texture view component, or depth view component coded with nal_ref_idc equal to 0 and inter_view_flag equal to 1
Note 1 to entry: An inter-view only reference component contains samples that can be used for inter-view prediction in the decoding process of subsequent view components in decoding order, but are not used for inter prediction by any view components. …
3.4.6
inter-view reference component
view component, texture view component, or depth view component coded with nal_ref_idc greater than 0 and inter_view_flag equal to 1
Note 1 to entry: An inter-view reference component contains samples that can be used for inter prediction of subsequent pictures in decoding order and inter-view prediction of subsequent view components in decoding order. Inter-view reference componen…
3.4.7
MVCD operation point
operation point for which each target output view includes a texture view or a depth view or both a texture view and a depth view
3.4.8
MVCD sequence parameter set
collective term for sequence parameter set or subset sequence parameter set
3.4.9
MVCD sequence parameter set RBSP
collective term for sequence parameter set RBSP or subset sequence parameter set RBSP
3.4.10
reference picture
view component, texture view component, or depth view component coded with nal_ref_idc greater than 0
Note 1 to entry: A reference picture contains samples that can be used for inter prediction in the decoding process of subsequent view components in decoding order. A reference picture can be an inter-view reference component, in which case the sample…
3.4.11
stereoscopic texture bitstream
bitstream containing two texture views
Note 1 to entry: The bitstream is also conforming to one of the profiles specified in Annex G.
3.4.12
texture field view component
texture view component of a field
42 3.4.13
texture frame view component
texture view component of a frame
3.4.14
texture view
sequence of texture view components associated with an identical value of view_id
3.4.15
texture view component
coded representation of the texture of a view in a single access unit
3.4.16
view
texture view and a depth view with the same value of view_id, unless explicitly limited to either texture view or depth view
3.4.17
view component
coded representation of a view in a single access unit
Note 1 to entry: A view component can consist of a texture view component and a depth view component.
3.4.18
view component pair
texture view component and a depth view component of the same view within the same access unit
3.5 Terms related to multiview and depth video with enhanced non-base view coding (Annex I)
3.5.1
MVC texture view component
texture view component composed of coded slice NAL units of nal_unit_type not equal to 21
3.5.2
texture view component
coded representation of the texture of a view in a single access unit
Note 1 to entry: A texture view component can be a 3D-AVC texture view component or an MVC texture view component.
3.5.3
view component pair
texture view component and a depth view component of the same view within the same access unit
3.5.4
view synthesis prediction
prediction derived from samples of inter-view reference components using motion vectors derived from a depth view component for decoding a texture view component
3.5.5
3D-AVC sequence parameter set
collective term for sequence parameter set or subset sequence parameter set
3.5.6
3D-AVC texture view component
texture view component composed of coded slice NAL units of nal_unit_type equal to 21
3.5.7
3DV acquisition parameters
closest and farthest depth values
4 Abbreviated terms
43 5 Conventions
5.1 Arithmetic operators
44 5.2 Logical operators
5.3 Relational operators
5.4 Bit-wise operators
45 5.5 Assignment operators
5.6 Range notation
5.7 Mathematical functions
46 5.8 Order of operation precedence
47 Table 5-1 – Operation precedence from highest (at top of table) to lowest (at bottom of table)
5.9 Variables, syntax elements, and tables
48 5.10 Text description of logical operations
49 5.11 Processes
6 Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships
6.1 Bitstream formats
6.2 Source, decoded, and output picture formats
50 Table 6-1 – SubWidthC, and SubHeightC values derived from chroma_format_idc and separate_colour_plane_flag
51 Figure 6-1 – Nominal vertical and horizontal locations of 4:2:0 luma and chroma samples in a frame
52 Figure 6-2 – Nominal vertical and horizontal sampling locations of 4:2:0 samples in top and bottom fields
Figure 6-3 – Nominal vertical and horizontal locations of 4:2:2 luma and chroma samples in a frame
53 Figure 6-4 – Nominal vertical and horizontal sampling locations of 4:2:2 samples top and bottom fields
Figure 6-5 – Nominal vertical and horizontal locations of 4:4:4 luma and chroma samples in a frame
54 Figure 6-6 – Nominal vertical and horizontal sampling locations of 4:4:4 samples top and bottom fields
6.3 Spatial subdivision of pictures and slices
55 Figure 6-7 – A picture with 11 by 9 macroblocks that is partitioned into two slices
Figure 6-8 – Partitioning of the decoded frame into macroblock pairs
6.4 Inverse scanning processes and derivation processes for neighbours
6.4.1 Inverse macroblock scanning process
56 6.4.2 Inverse macroblock partition and sub-macroblock partition scanning process
Figure 6-9 – Macroblock partitions, sub-macroblock partitions, macroblock partition scans, and sub-macroblock partition scans
57 6.4.2.1 Inverse macroblock partition scanning process
6.4.2.2 Inverse sub-macroblock partition scanning process
6.4.3 Inverse 4×4 luma block scanning process
Figure 6-10 – Scan for 4×4 luma blocks
58 6.4.4 Inverse 4×4 Cb or Cr block scanning process for ChromaArrayType equal to 3
6.4.5 Inverse 8×8 luma block scanning process
Figure 6-11 – Scan for 8×8 luma blocks
6.4.6 Inverse 8×8 Cb or Cr block scanning process for ChromaArrayType equal to 3
6.4.7 Inverse 4×4 chroma block scanning process
59 6.4.8 Derivation process of the availability for macroblock addresses
6.4.9 Derivation process for neighbouring macroblock addresses and their availability
6.4.10 Derivation process for neighbouring macroblock addresses and their availability in MBAFF frames
60 6.4.11 Derivation processes for neighbouring macroblocks, blocks, and partitions
61 Table 6-2 – Specification of input and output assignments for subclauses 6.4.11.1 to 6.4.11.7
Figure 6-14 – Determination of the neighbouring macroblock, blocks, and partitions
6.4.11.1 Derivation process for neighbouring macroblocks
6.4.11.2 Derivation process for neighbouring 8×8 luma block
62 6.4.11.3 Derivation process for neighbouring 8×8 chroma blocks for ChromaArrayType equal to 3
6.4.11.4 Derivation process for neighbouring 4×4 luma blocks
63 6.4.11.5 Derivation process for neighbouring 4×4 chroma blocks
6.4.11.6 Derivation process for neighbouring 4×4 chroma blocks for ChromaArrayType equal to 3
6.4.11.7 Derivation process for neighbouring partitions
65 6.4.12 Derivation process for neighbouring locations
6.4.12.1 Specification for neighbouring locations in fields and non-MBAFF frames
66 Table 6-3 – Specification of mbAddrN
6.4.12.2 Specification for neighbouring locations in MBAFF frames
67 Table 6-4 – Specification of mbAddrN and yM
68 6.4.13 Derivation processes for block and partition indices
6.4.13.1 Derivation process for 4×4 luma block indices
6.4.13.2 Derivation process for 4×4 chroma block indices
6.4.13.3 Derivation process for 8×8 luma block indices
6.4.13.4 Derivation process for macroblock and sub-macroblock partition indices
69 7 Syntax and semantics
7.1 Method of specifying syntax in tabular form
70 7.2 Specification of syntax functions, categories, and descriptors
73 7.3 Syntax in tabular form
7.3.1 NAL unit syntax
74 7.3.2 Raw byte sequence payloads and RBSP trailing bits syntax
7.3.2.1 Sequence parameter set RBSP syntax
7.3.2.1.1 Sequence parameter set data syntax
75 7.3.2.1.1.1 Scaling list syntax
76 7.3.2.1.2 Sequence parameter set extension RBSP syntax
7.3.2.1.3 Subset sequence parameter set RBSP syntax
77 7.3.2.2 Picture parameter set RBSP syntax
78 7.3.2.3 Supplemental enhancement information RBSP syntax
7.3.2.3.1 Supplemental enhancement information message syntax
7.3.2.4 Access unit delimiter RBSP syntax
79 7.3.2.5 End of sequence RBSP syntax
7.3.2.6 End of stream RBSP syntax
7.3.2.7 Filler data RBSP syntax
7.3.2.8 Slice layer without partitioning RBSP syntax
7.3.2.9 Slice data partition RBSP syntax
7.3.2.9.1 Slice data partition A RBSP syntax
7.3.2.9.2 Slice data partition B RBSP syntax
80 7.3.2.9.3 Slice data partition C RBSP syntax
7.3.2.10 RBSP slice trailing bits syntax
7.3.2.11 RBSP trailing bits syntax
7.3.2.12 Prefix NAL unit RBSP syntax
81 7.3.2.13 Slice layer extension RBSP syntax
82 7.3.3 Slice header syntax
84 7.3.3.1 Reference picture list modification syntax
85 7.3.3.2 Prediction weight table syntax
86 7.3.3.3 Decoded reference picture marking syntax
87 7.3.4 Slice data syntax
88 7.3.5 Macroblock layer syntax
89 7.3.5.1 Macroblock prediction syntax
90 7.3.5.2 Sub-macroblock prediction syntax
91 7.3.5.3 Residual data syntax
92 7.3.5.3.1 Residual luma syntax
93 7.3.5.3.2 Residual block CAVLC syntax
95 7.3.5.3.3 Residual block CABAC syntax
7.4 Semantics
7.4.1 NAL unit semantics
96 Table 7-1 – NAL unit type codes, syntax element categories, and NAL unit type classes
99 7.4.1.1 Encapsulation of an SODB within an RBSP
100 7.4.1.2 Order of NAL units and association to coded pictures, access units, and video sequences
7.4.1.2.1 Order of sequence and picture parameter set RBSPs and their activation
102 7.4.1.2.2 Order of access units and association to coded video sequences
7.4.1.2.3 Order of NAL units and coded pictures and association to access units
104 Figure 7-1 – Structure of an access unit not containing any NAL units with nal_unit_type equal to 0, 7, 8, or in the range of 12 to 18, inclusive, or in the range of 20 to 31, inclusive
7.4.1.2.4 Detection of the first VCL NAL unit of a primary coded picture
105 7.4.1.2.5 Order of VCL NAL units and association to coded pictures
106 7.4.2 Raw byte sequence payloads and RBSP trailing bits semantics
7.4.2.1 Sequence parameter set RBSP semantics
7.4.2.1.1 Sequence parameter set data semantics
109 Table 7-2 – Assignment of mnemonic names to scaling list indices and specification of fall-back rule
Table 7-3 – Specification of default scaling lists Default_4x4_Intra and Default_4x4_Inter
Table 7-4 – Specification of default scaling lists Default_8x8_Intra and Default_8x8_Inter
112 7.4.2.1.1.1 Scaling list semantics
113 7.4.2.1.2 Sequence parameter set extension RBSP semantics
114 7.4.2.1.3 Subset sequence parameter set RBSP semantics
115 7.4.2.2 Picture parameter set RBSP semantics
117 7.4.2.3 Supplemental enhancement information RBSP semantics
7.4.2.3.1 Supplemental enhancement information message semantics
7.4.2.4 Access unit delimiter RBSP semantics
118 Table 7-5 – Meaning of primary_pic_type
7.4.2.5 End of sequence RBSP semantics
7.4.2.6 End of stream RBSP semantics
7.4.2.7 Filler data RBSP semantics
7.4.2.8 Slice layer without partitioning RBSP semantics
7.4.2.9 Slice data partition RBSP semantics
7.4.2.9.1 Slice data partition A RBSP semantics
119 7.4.2.9.2 Slice data partition B RBSP semantics
7.4.2.9.3 Slice data partition C RBSP semantics
120 7.4.2.10 RBSP slice trailing bits semantics
7.4.2.11 RBSP trailing bits semantics
7.4.2.12 Prefix NAL unit RBSP semantics
7.4.2.13 Slice layer extension RBSP semantics
7.4.3 Slice header semantics
121 Table 7-6 – Name association to slice_type
126 7.4.3.1 Reference picture list modification semantics
127 Table 7-7 – modification_of_pic_nums_idc operations for modification of reference picture lists
7.4.3.2 Prediction weight table semantics
128 7.4.3.3 Decoded reference picture marking semantics
129 Table 7-8 – Interpretation of adaptive_ref_pic_marking_mode_flag
130 Table 7-9 – Memory management control operation (memory_management_control_operation) values
131 7.4.4 Slice data semantics
132 7.4.5 Macroblock layer semantics
133 Table 7-10 – Allowed collective macroblock types for slice_type
134 Table 7-11 – Macroblock types for I slices
135 Table 7-12 – Macroblock type with value 0 for SI slices
136 Table 7-13 – Macroblock type values 0 to 4 for P and SP slices
137 Table 7-14 – Macroblock type values 0 to 22 for B slices
139 Table 7-15 – Specification of CodedBlockPatternChroma values
140 7.4.5.1 Macroblock prediction semantics
Table 7-16 – Relationship between intra_chroma_pred_mode and spatial prediction modes
141 7.4.5.2 Sub-macroblock prediction semantics
Table 7-17 – Sub-macroblock types in P macroblocks
142 Table 7-18 – Sub-macroblock types in B macroblocks
143 7.4.5.3 Residual data semantics
7.4.5.3.1 Residual luma data semantics
144 7.4.5.3.2 Residual block CAVLC semantics
7.4.5.3.3 Residual block CABAC semantics
145 8 Decoding process
146 8.1 NAL unit decoding process
147 8.2 Slice decoding process
8.2.1 Decoding process for picture order count
148 8.2.1.1 Decoding process for picture order count type 0
149 8.2.1.2 Decoding process for picture order count type 1
150 8.2.1.3 Decoding process for picture order count type 2
151 8.2.2 Decoding process for macroblock to slice group map
Table 8-1 – Refined slice group map type
152 8.2.2.1 Specification for interleaved slice group map type
8.2.2.2 Specification for dispersed slice group map type
153 8.2.2.3 Specification for foreground with left-over slice group map type
8.2.2.4 Specification for box-out slice group map types
154 8.2.2.5 Specification for raster scan slice group map types
8.2.2.6 Specification for wipe slice group map types
8.2.2.7 Specification for explicit slice group map type
8.2.2.8 Specification for conversion of map unit to slice group map to macroblock to slice group map
8.2.3 Decoding process for slice data partitions
155 8.2.4 Decoding process for reference picture lists construction
156 8.2.4.1 Decoding process for picture numbers
157 8.2.4.2 Initialization process for reference picture lists
8.2.4.2.1 Initialization process for the reference picture list for P and SP slices in frames
8.2.4.2.2 Initialization process for the reference picture list for P and SP slices in fields
158 8.2.4.2.3 Initialization process for reference picture lists for B slices in frames
8.2.4.2.4 Initialization process for reference picture lists for B slices in fields
159 8.2.4.2.5 Initialization process for reference picture lists in fields
160 8.2.4.3 Modification process for reference picture lists
8.2.4.3.1 Modification process of reference picture lists for short-term reference pictures
161 8.2.4.3.2 Modification process of reference picture lists for long-term reference pictures
162 8.2.5 Decoded reference picture marking process
8.2.5.1 Sequence of operations for decoded reference picture marking process
163 8.2.5.2 Decoding process for gaps in frame_num
164 8.2.5.3 Sliding window decoded reference picture marking process
8.2.5.4 Adaptive memory control decoded reference picture marking process
8.2.5.4.1 Marking process of a short-term reference picture as “unused for reference”
8.2.5.4.2 Marking process of a long-term reference picture as “unused for reference”
165 8.2.5.4.3 Assignment process of a LongTermFrameIdx to a short-term reference picture
8.2.5.4.4 Decoding process for MaxLongTermFrameIdx
8.2.5.4.5 Marking process of all reference pictures as “unused for reference” and setting MaxLongTermFrameIdx to “no long-term frame indices”
8.2.5.4.6 Process for assigning a long-term frame index to the current picture
166 8.3 Intra prediction process
167 8.3.1 Intra_4x4 prediction process for luma samples
8.3.1.1 Derivation process for Intra4x4PredMode
Table 8-2 – Specification of Intra4x4PredMode[ luma4x4BlkIdx ] and associated names
168 Figure 8-1 – Intra_4x4 prediction mode directions
169 8.3.1.2 Intra_4x4 sample prediction
170 8.3.1.2.1 Specification of Intra_4x4_Vertical prediction mode
8.3.1.2.2 Specification of Intra_4x4_Horizontal prediction mode
8.3.1.2.3 Specification of Intra_4x4_DC prediction mode
8.3.1.2.4 Specification of Intra_4x4_Diagonal_Down_Left prediction mode
171 8.3.1.2.5 Specification of Intra_4x4_Diagonal_Down_Right prediction mode
8.3.1.2.6 Specification of Intra_4x4_Vertical_Right prediction mode
172 8.3.1.2.7 Specification of Intra_4x4_Horizontal_Down prediction mode
8.3.1.2.8 Specification of Intra_4x4_Vertical_Left prediction mode
8.3.1.2.9 Specification of Intra_4x4_Horizontal_Up prediction mode
173 8.3.2 Intra_8x8 prediction process for luma samples
8.3.2.1 Derivation process for Intra8x8PredMode
174 Table 8-3 – Specification of Intra8x8PredMode[ luma8x8BlkIdx ] and associated names
175 8.3.2.2 Intra_8x8 sample prediction
176 8.3.2.2.1 Reference sample filtering process for Intra_8x8 sample prediction
177 8.3.2.2.2 Specification of Intra_8x8_Vertical prediction mode
8.3.2.2.3 Specification of Intra_8x8_Horizontal prediction mode
8.3.2.2.4 Specification of Intra_8x8_DC prediction mode
178 8.3.2.2.5 Specification of Intra_8x8_Diagonal_Down_Left prediction mode
8.3.2.2.6 Specification of Intra_8x8_Diagonal_Down_Right prediction mode
179 8.3.2.2.7 Specification of Intra_8x8_Vertical_Right prediction mode
8.3.2.2.8 Specification of Intra_8x8_Horizontal_Down prediction mode
180 8.3.2.2.9 Specification of Intra_8x8_Vertical_Left prediction mode
8.3.2.2.10 Specification of Intra_8x8_Horizontal_Up prediction mode
8.3.3 Intra_16x16 prediction process for luma samples
181 Table 8-4 – Specification of Intra16x16PredMode and associated names
8.3.3.1 Specification of Intra_16x16_Vertical prediction mode
8.3.3.2 Specification of Intra_16x16_Horizontal prediction mode
182 8.3.3.3 Specification of Intra_16x16_DC prediction mode
8.3.3.4 Specification of Intra_16x16_Plane prediction mode
183 8.3.4 Intra prediction process for chroma samples
184 Table 8-5 – Specification of Intra chroma prediction modes and associated names
8.3.4.1 Specification of Intra_Chroma_DC prediction mode
185 8.3.4.2 Specification of Intra_Chroma_Horizontal prediction mode
186 8.3.4.3 Specification of Intra_Chroma_Vertical prediction mode
8.3.4.4 Specification of Intra_Chroma_Plane prediction mode
8.3.4.5 Intra prediction for chroma samples with ChromaArrayType equal to 3
187 8.3.5 Sample construction process for I_PCM macroblocks
188 8.4 Inter prediction process
190 8.4.1 Derivation process for motion vector components and reference indices
191 8.4.1.1 Derivation process for luma motion vectors for skipped macroblocks in P and SP slices
192 8.4.1.2 Derivation process for luma motion vectors for B_Skip, B_Direct_16x16, and B_Direct_8x8
8.4.1.2.1 Derivation process for the co-located 4×4 sub-macroblock partitions
193 Table 8-6 – Specification of the variable colPic
Table 8-7 – Specification of PicCodingStruct( X )
194 Table 8-8 – Specification of mbAddrCol, yM, and vertMvScale
195 8.4.1.2.2 Derivation process for spatial direct luma motion vector and reference index prediction mode
196 Table 8-9 – Assignment of prediction utilization flags
197 8.4.1.2.3 Derivation process for temporal direct luma motion vector and reference index prediction mode
199 Figure 8-2 – Example for temporal direct-mode motion vector inference
8.4.1.3 Derivation process for luma motion vector prediction
200 Figure 8-3 – Directional segmentation prediction
8.4.1.3.1 Derivation process for median luma motion vector prediction
201 8.4.1.3.2 Derivation process for motion data of neighbouring partitions
202 8.4.1.4 Derivation process for chroma motion vectors
Table 8-10 – Derivation of the vertical component of the chroma vector in field coding mode
203 8.4.2 Decoding process for Inter prediction samples
8.4.2.1 Reference picture selection process
204 8.4.2.2 Fractional sample interpolation process
206 8.4.2.2.1 Luma sample interpolation process
207 Figure 8-4 – Integer samples (shaded blocks with upper-case letters) and fractional sample positions (un-shaded blocks with lower-case letters) for quarter sample luma interpolation
208 Table 8-11 – Differential full-sample luma locations
209 Table 8-12 – Assignment of the luma prediction sample predPartLXL[ xL, yL ]
8.4.2.2.2 Chroma sample interpolation process
Figure 8-5 – Fractional sample position dependent variables in chroma interpolation and surrounding integer position samples A, B, C, and D
210 8.4.2.3 Weighted sample prediction process
211 8.4.2.3.1 Default weighted sample prediction process
8.4.2.3.2 Weighted sample prediction process
212 8.4.3 Derivation process for prediction weights
214 8.5 Transform coefficient decoding process and picture construction process prior to deblocking filter process
8.5.1 Specification of transform decoding process for 4×4 luma residual blocks
215 8.5.2 Specification of transform decoding process for luma samples of Intra_16x16 macroblock prediction mode
Figure 8-6 – Assignment of the indices of dcY to luma4x4BlkIdx
216 8.5.3 Specification of transform decoding process for 8×8 luma residual blocks
8.5.4 Specification of transform decoding process for chroma samples
218 Figure 8-7 – Assignment of the indices of dcC to chroma4x4BlkIdx: (a) ChromaArrayType equal to 1, (b) ChromaArrayType equal to 2
8.5.5 Specification of transform decoding process for chroma samples with ChromaArrayType equal to 3
219 8.5.6 Inverse scanning process for 4×4 transform coefficients and scaling lists
Figure 8-8 – 4×4 block scans. (a) Zig-zag scan. (b) Field scan
220 Table 8-13 – Specification of mapping of idx to cij for zig-zag and field scan
8.5.7 Inverse scanning process for 8×8 transform coefficients and scaling lists
221 Table 8-14 – Specification of mapping of idx to cij for 8×8 zig-zag and 8×8 field scan
8.5.8 Derivation process for chroma quantization parameters
222 Table 8-15 – Specification of QPC as a function of qPI
8.5.9 Derivation process for scaling functions
223 8.5.10 Scaling and transformation process for DC transform coefficients for Intra_16x16 macroblock type
224 8.5.11 Scaling and transformation process for chroma DC transform coefficients
8.5.11.1 Transformation process for chroma DC transform coefficients
225 8.5.11.2 Scaling process for chroma DC transform coefficients
226 8.5.12 Scaling and transformation process for residual 4×4 blocks
8.5.12.1 Scaling process for residual 4×4 blocks
227 8.5.12.2 Transformation process for residual 4×4 blocks
228 8.5.13 Scaling and transformation process for residual 8×8 blocks
229 8.5.13.1 Scaling process for residual 8×8 blocks
8.5.13.2 Transformation process for residual 8×8 blocks
232 8.5.14 Picture construction process prior to deblocking filter process
234 8.5.15 Intra residual transform-bypass decoding process
8.6 Decoding process for P macroblocks in SP slices or SI macroblocks
235 8.6.1 SP decoding process for non-switching pictures
8.6.1.1 Luma transform coefficient decoding process
236 8.6.1.2 Chroma transform coefficient decoding process
237 8.6.2 SP and SI slice decoding process for switching pictures
8.6.2.1 Luma transform coefficient decoding process
238 8.6.2.2 Chroma transform coefficient decoding process
239 8.7 Deblocking filter process
240 Figure 8-10 – Boundaries in a macroblock to be filtered
243 8.7.1 Filtering process for block edges
244 Figure 8-11 – Convention for describing samples across a 4×4 block horizontal or vertical boundary
245 8.7.2 Filtering process for a set of samples across a horizontal or vertical block edge
246 8.7.2.1 Derivation process for the luma content dependent boundary filtering strength
247 8.7.2.2 Derivation process for the thresholds for each block edge
248 Table 8-16 – Derivation of offset dependent threshold variables (′ and (′ from indexA and indexB
8.7.2.3 Filtering process for edges with bS less than 4
249 Table 8-17 – Value of variable t′C0 as a function of indexA and bS
250 8.7.2.4 Filtering process for edges for bS equal to 4
251 9 Parsing process
9.1 Parsing process for Exp-Golomb codes
252 Table 9-1 – Bit strings with “prefix” and “suffix” bits and assignment to codeNum ranges
Table 9-2 – Exp-Golomb bit strings and codeNum in explicit form and used as ue(v)
253 9.1.1 Mapping process for signed Exp-Golomb codes
Table 9-3 – Assignment of syntax element to codeNum for signed Exp-Golomb coded syntax elements se(v)
9.1.2 Mapping process for coded block pattern
254 Table 9-4 – Assignment of codeNum to values of coded_block_pattern for macroblock prediction modes
256 9.2 CAVLC parsing process for transform coefficient levels
257 9.2.1 Parsing process for total number of non-zero transform coefficient levels and number of trailing ones
260 9.2.2 Parsing process for level information
261 9.2.2.1 Parsing process for level_prefix
262 Table 9-6 – Codeword table for level_prefix
9.2.3 Parsing process for run information
263 Table 9-7 – total_zeros tables for 4×4 blocks with tzVlcIndex 1 to 7
264 Table 9-8 – total_zeros tables for 4×4 blocks with tzVlcIndex 8 to 15
Table 9-9 – total_zeros tables for chroma DC 2×2 and 2×4 blocks
265 Table 9-10 – Tables for run_before
9.2.4 Combining level and run information
9.3 CABAC parsing process for slice data
266 Figure 9-1 – Illustration of CABAC parsing process for a syntax element SE
9.3.1 Initialization process
267 9.3.1.1 Initialization process for context variables
269 Table 9-12 – Values of variables m and n for ctxIdx from 0 to 10
Table 9-13 – Values of variables m and n for ctxIdx from 11 to 23
270 Table 9-14 – Values of variables m and n for ctxIdx from 24 to 39
Table 9-15 – Values of variables m and n for ctxIdx from 40 to 53
Table 9-16 – Values of variables m and n for ctxIdx from 54 to 59, and 399 to 401
271 Table 9-17 – Values of variables m and n for ctxIdx from 60 to 69
Table 9-18 – Values of variables m and n for ctxIdx from 70 to 104
272 Table 9-19 – Values of variables m and n for ctxIdx from 105 to 165
273 Table 9-20 – Values of variables m and n for ctxIdx from 166 to 226
274 Table 9-21 – Values of variables m and n for ctxIdx from 227 to 275
275 Table 9-22 – Values of variables m and n for ctxIdx from 277 to 337
276 Table 9-23 – Values of variables m and n for ctxIdx from 338 to 398
277 Table 9-24 – Values of variables m and n for ctxIdx from 402 to 459
278 Table 9-25 – Values of variables m and n for ctxIdx from 460 to 483
279 Table 9-26 – Values of variables m and n for ctxIdx from 484 to 571
281 Table 9-27 – Values of variables m and n for ctxIdx from 572 to 659
283 Table 9-28 – Values of variables m and n for ctxIdx from 660 to 717
284 Table 9-29 – Values of variables m and n for ctxIdx from 718 to 775
285 Table 9-30 – Values of variables m and n for ctxIdx from 776 to 863
287 Table 9-31 – Values of variables m and n for ctxIdx from 864 to 951
289 Table 9-32 – Values of variables m and n for ctxIdx from 952 to 1011
290 Table 9-33 – Values of variables m and n for ctxIdx from 1012 to 1023
9.3.1.2 Initialization process for the arithmetic decoding engine
9.3.2 Binarization process
292 Table 9-34 – Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset
294 9.3.2.1 Unary (U) binarization process
Table 9-35 – Bin string of the unary binarization
295 9.3.2.2 Truncated unary (TU) binarization process
9.3.2.3 Concatenated unary/ k-th order Exp-Golomb (UEGk) binarization process
296 9.3.2.4 Fixed-length (FL) binarization process
9.3.2.5 Binarization process for macroblock type and sub-macroblock type
297 Table 9-36 – Binarization for macroblock types in I slices
298 Table 9-37 – Binarization for macroblock types in P, SP, and B slices
299 Table 9-38 – Binarization for sub-macroblock types in P, SP, and B slices
9.3.2.6 Binarization process for coded block pattern
9.3.2.7 Binarization process for mb_qp_delta
9.3.3 Decoding process flow
300 9.3.3.1 Derivation process for ctxIdx
301 Table 9-39 – Assignment of ctxIdxInc to binIdx for all ctxIdxOffset values except those related to the syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1
302 Table 9-40 – Assignment of ctxIdxBlockCatOffset to ctxBlockCat for syntax elements coded_block_flag, significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1
9.3.3.1.1 Assignment process of ctxIdxInc using neighbouring syntax elements
9.3.3.1.1.1 Derivation process of ctxIdxInc for the syntax element mb_skip_flag
303 9.3.3.1.1.2 Derivation process of ctxIdxInc for the syntax element mb_field_decoding_flag
9.3.3.1.1.3 Derivation process of ctxIdxInc for the syntax element mb_type
9.3.3.1.1.4 Derivation process of ctxIdxInc for the syntax element coded_block_pattern
304 9.3.3.1.1.5 Derivation process of ctxIdxInc for the syntax element mb_qp_delta
9.3.3.1.1.6 Derivation process of ctxIdxInc for the syntax elements ref_idx_l0 and ref_idx_l1
306 9.3.3.1.1.7 Derivation process of ctxIdxInc for the syntax elements mvd_l0 and mvd_l1
307 9.3.3.1.1.8 Derivation process of ctxIdxInc for the syntax element intra_chroma_pred_mode
9.3.3.1.1.9 Derivation process of ctxIdxInc for the syntax element coded_block_flag
310 9.3.3.1.1.10 Derivation process of ctxIdxInc for the syntax element transform_size_8x8_flag
9.3.3.1.2 Assignment process of ctxIdxInc using prior decoded bin values
311 Table 9-41 – Specification of ctxIdxInc for specific values of ctxIdxOffset and binIdx
9.3.3.1.3 Assignment process of ctxIdxInc for syntax elements significant_coeff_flag, last_significant_coeff_flag, and coeff_abs_level_minus1
Table 9-42 – Specification of ctxBlockCat for the different blocks
312 Table 9-43 – Mapping of scanning position to ctxIdxInc for ctxBlockCat = = 5, 9, or 13
314 9.3.3.2 Arithmetic decoding process
Figure 9-2 – Overview of the arithmetic decoding process for a single bin
315 9.3.3.2.1 Arithmetic decoding process for a binary decision
9.3.3.2.1.1 State transition process
316 Figure 9-3 – Flowchart for decoding a decision
317 Table 9-44 – Specification of rangeTabLPS depending on pStateIdx and qCodIRangeIdx
318 Table 9-45 – State transition table
9.3.3.2.2 Renormalization process in the arithmetic decoding engine
Figure 9-4 – Flowchart of renormalization
319 9.3.3.2.3 Bypass decoding process for binary decisions
Figure 9-5 – Flowchart of bypass decoding process
9.3.3.2.4 Decoding process for binary decisions before termination
320 Figure 9-6 – Flowchart of decoding a decision before termination
9.3.4 Arithmetic encoding process
9.3.4.1 Initialization process for the arithmetic encoding engine
321 9.3.4.2 Encoding process for a binary decision
Figure 9-7 – Flowchart for encoding a decision
9.3.4.3 Renormalization process in the arithmetic encoding engine
322 Figure 9-8 – Flowchart of renormalization in the encoder
323 Figure 9-9 – Flowchart of PutBit(B)
9.3.4.4 Bypass encoding process for binary decisions
324 Figure 9-10 – Flowchart of encoding bypass
9.3.4.5 Encoding process for a binary decision before termination
325 Figure 9-11 – Flowchart of encoding a decision before termination
Figure 9-12 – Flowchart of flushing at termination
9.3.4.6 Byte stuffing process
327 A Annex A (normative) Profiles and levels
A.1 Requirements on video decoder capability
A.2 Profiles
A.2.1 Baseline profile
328 A.2.1.1 Constrained Baseline profile
A.2.2 Main profile
A.2.3 Extended profile
329 A.2.4 High profile
A.2.4.1 Progressive High profile
330 A.2.4.2 Constrained High profile
A.2.5 High 10 profile
331 A.2.5.1 Progressive High 10 profile
A.2.6 High 4:2:2 profile
A.2.7 High 4:4:4 Predictive profile
332 A.2.8 High 10 Intra profile
A.2.9 High 4:2:2 Intra profile
333 A.2.10 High 4:4:4 Intra profile
A.2.11 CAVLC 4:4:4 Intra profile
334 A.3 Levels
A.3.1 Level limits common to the Baseline, Constrained Baseline, Main, and Extended profiles
337 Table A-1 – Level limits
A.3.2 Level limits common to the High, Progressive High, Constrained High, High 10, Progressive High 10, High 4:2:2, High 4:4:4 Predictive, High 10 Intra, High 4:2:2 Intra, High 4:4:4 Intra, and CAVLC 4:4:4 Intra profiles
339 A.3.3 Profile-specific level limits
341 Table A-2 – Specification of cpbBrVclFactor and cpbBrNalFactor
A.3.3.1 Level limits of the Baseline and Constrained Baseline profile
Table A-3 – Baseline and Constrained Baseline profile level limits
342 A.3.3.2 Level limits of the Main, High, Progressive High, Constrained High, High 10, Progressive High 10, High 4:2:2, High 4:4:4 Predictive, High 10 Intra, High 4:2:2 Intra, High 4:4:4 Intra, and CAVLC 4:4:4 Intra profile
Table A-4 – Main, High, Progressive High, Constrained High, High 10, Progressive High 10, High 4:2:2, High 4:4:4 Predictive, High 10 Intra, High 4:2:2 Intra, High 4:4:4 Intra, and CAVLC 4:4:4 Intra profile level limits
343 A.3.3.3 Level limits of the Extended profile
Table A-5 – Extended profile level limits
344 A.3.4 Effect of level limits on frame rate
Table A-6 – Maximum frame rates (frames per second) for some example frame sizes
347 A.3.5 Effect of level limits on maximum DPB size in units of frames
Table A-7 – Maximum DPB size (frames) for some example frame sizes
350 B Annex B (normative) Byte stream format
B.1 Byte stream NAL unit syntax and semantics
B.1.1 Byte stream NAL unit syntax
B.1.2 Byte stream NAL unit semantics
351 B.2 Byte stream NAL unit decoding process
B.3 Decoder byte-alignment recovery
353 C Annex C (normative) Hypothetical reference decoder
Figure C-1 – Structure of byte streams and NAL unit streams for HRD conformance checks
355 Figure C-2 – HRD buffer model
358 C.1 Operation of coded picture buffer (CPB)
C.1.1 Timing of bitstream arrival
359 C.1.2 Timing of coded picture removal
360 C.2 Operation of the decoded picture buffer (DPB)
C.2.1 Decoding of gaps in frame_num and storage of “non-existing” frames
361 C.2.2 Picture decoding and output
362 C.2.3 Removal of pictures from the DPB before possible insertion of the current picture
364 C.2.4 Current decoded picture marking and storage
C.2.4.1 Marking and storage of a reference picture into the DPB
C.2.4.2 Storage of a non-reference picture into the DPB
365 C.3 Bitstream conformance
366 C.4 Decoder conformance
367 C.4.1 Operation of the output order DPB
368 C.4.2 Decoding of gaps in frame_num and storage of “non-existing” pictures
C.4.3 Picture decoding
369 C.4.4 Removal of pictures from the DPB before possible insertion of the current picture
370 C.4.5 Current decoded picture marking and storage
371 C.4.5.1 Storage and marking of a reference decoded picture into the DPB
C.4.5.2 Storage and marking of a non-reference decoded picture into the DPB
372 C.4.5.3 “Bumping” process
374 D Annex D (normative) Supplemental enhancement information
375 D.1 SEI payload syntax
D.1.1 General SEI message syntax
378 D.1.2 Buffering period SEI message syntax
379 D.1.3 Picture timing SEI message syntax
380 D.1.4 Pan-scan rectangle SEI message syntax
D.1.5 Filler payload SEI message syntax
D.1.6 User data registered by ITU-T Rec. T.35 SEI message syntax
D.1.7 User data unregistered SEI message syntax
381 D.1.8 Recovery point SEI message syntax
D.1.9 Decoded reference picture marking repetition SEI message syntax
D.1.10 Spare picture SEI message syntax
382 D.1.11 Scene information SEI message syntax
D.1.12 Sub-sequence information SEI message syntax
D.1.13 Sub-sequence layer characteristics SEI message syntax
D.1.14 Sub-sequence characteristics SEI message syntax
383 D.1.15 Full-frame freeze SEI message syntax
D.1.16 Full-frame freeze release SEI message syntax
D.1.17 Full-frame snapshot SEI message syntax
D.1.18 Progressive refinement segment start SEI message syntax
D.1.19 Progressive refinement segment end SEI message syntax
384 D.1.20 Motion-constrained slice group set SEI message syntax
D.1.21 Film grain characteristics SEI message syntax
385 D.1.22 Deblocking filter display preference SEI message syntax
D.1.23 Stereo video information SEI message syntax
D.1.24 Post-filter hint SEI message syntax
386 D.1.25 Tone mapping information SEI message syntax
387 D.1.26 Frame packing arrangement SEI message syntax
D.1.27 Display orientation SEI message syntax
D.1.28 Green metadata SEI message syntax
388 D.1.29 Mastering display colour volume SEI message syntax
D.1.30 Colour remapping information SEI message syntax
389 D.1.31 Content light level information SEI message syntax
D.1.32 Alternative transfer characteristics SEI message syntax
D.1.33 Content colour volume SEI message syntax
390 D.1.34 Ambient viewing environment SEI message syntax
D.1.35 Syntax of omnidirectional video specific SEI messages
D.1.35.1 Equirectangular projection SEI message syntax
D.1.35.2 Cubemap projection SEI message syntax
D.1.35.3 Sphere rotation SEI message syntax
391 D.1.35.4 Region-wise packing SEI message syntax
392 D.1.35.5 Omnidirectional viewport SEI message syntax
D.1.36 SEI manifest SEI message syntax
D.1.37 SEI prefix indication SEI message syntax
D.1.38 Shutter interval information SEI message syntax
393 D.1.39 Reserved SEI message syntax
D.2 SEI payload semantics
D.2.1 General SEI payload semantics
394 D.2.2 Buffering period SEI message semantics
D.2.3 Picture timing SEI message semantics
396 Table D-1 – Interpretation of pic_struct
397 Table D-2 – Mapping of ct_type to source picture scan
398 Table D-3 – Definition of counting_type values
399 D.2.4 Pan-scan rectangle SEI message semantics
400 D.2.5 Filler payload SEI message semantics
D.2.6 User data registered by ITU-T Rec. T.35 SEI message semantics
401 D.2.7 User data unregistered SEI message semantics
D.2.8 Recovery point SEI message semantics
403 D.2.9 Decoded reference picture marking repetition SEI message semantics
D.2.10 Spare picture SEI message semantics
405 D.2.11 Scene information SEI message semantics
406 Table D-4 – scene_transition_type values
407 D.2.12 Sub-sequence information SEI message semantics
408 D.2.13 Sub-sequence layer characteristics SEI message semantics
409 D.2.14 Sub-sequence characteristics SEI message semantics
411 D.2.15 Full-frame freeze SEI message semantics
D.2.16 Full-frame freeze release SEI message semantics
D.2.17 Full-frame snapshot SEI message semantics
D.2.18 Progressive refinement segment start SEI message semantics
412 D.2.19 Progressive refinement segment end SEI message semantics
D.2.20 Motion-constrained slice group set SEI message semantics
413 D.2.21 Film grain characteristics SEI message semantics
414 Table D-5 – film_grain_model_id values
415 Table D-6 – blending_mode_id values
420 D.2.22 Deblocking filter display preference SEI message semantics
422 D.2.23 Stereo video information SEI message semantics
D.2.24 Post-filter hint SEI message semantics
423 Table D-7 – filter_hint_type values
D.2.25 Tone mapping information SEI message semantics
426 Table D-8 – Interpretation of camera_iso_speed_idc and exposure_index_idc
428 D.2.26 Frame packing arrangement SEI message semantics
430 Table D-10 – Definition of content_interpretation_type
433 Figure D-1 – Rearrangement and upconversion of checkerboard interleaving (frame_packing_arrangement_type equal to 0)
Figure D-2 – Rearrangement and upconversion of column interleaving with frame_packing_arrangement_type equal to 1, quincunx_sampling_flag equal to 0, and (x, y) equal to (0, 0) or (4, 8) for both constituent frames
434 Figure D-3 – Rearrangement and upconversion of column interleaving with frame_packing_arrangement_type equal to 1, quincunx_sampling_flag equal to 0, (x, y) equal to (0, 0) or (4, 8) for constituent frame 0 and (x, y) equal to (12, 8) for constituent…
Figure D-4 – Rearrangement and upconversion of row interleaving with frame_packing_arrangement_type equal to 2, quincunx_sampling_flag equal to 0, and (x, y) equal to (0, 0) or (8, 4) for both constituent frames
435 Figure D-6 – Rearrangement and upconversion of side-by-side packing arrangement with frame_packing_arrangement_type equal to 3, quincunx_sampling_flag equal to 0, and (x, y) equal to (0, 0) or (4, 8) for both constituent frames
436 Figure D-8 – Rearrangement and upconversion of top-bottom packing arrangement with frame_packing_arrangement_type equal to 4, quincunx_sampling_flag equal to 0, and (x, y) equal to (0, 0) or (8, 4) for both constituent frames
437 Figure D-10 – Rearrangement and upconversion of side-by-side packing arrangement with quincunx sampling (frame_packing_arrangement_type equal to 3 with quincunx_sampling_flag equal to 1)
438 Figure D-11 – Rearrangement of a temporal interleaving frame arrangement (frame_packing_arrangement_type equal to 5)
D.2.27 Display orientation SEI message semantics
440 D.2.28 Green metadata SEI message semantics
D.2.29 Mastering display colour volume SEI message semantics
441 D.2.30 Colour remapping information SEI message semantics
444 D.2.31 Content light level information SEI message semantics
445 D.2.32 Alternative transfer characteristics SEI message semantics
D.2.33 Content colour volume SEI message semantics
447 D.2.34 Ambient viewing environment SEI message semantics
D.2.35 Semantics of omnidirectional video specific SEI messages
D.2.35.1 Equirectangular projection SEI message semantics
448 D.2.35.2 Cubemap projection SEI message semantics
449 D.2.35.3 Sphere rotation SEI message semantics
450 D.2.35.4 Region-wise packing SEI message semantics
455 D.2.35.5 Omnidirectional viewport SEI message semantics
456 D.2.35.6 Sample location remapping process
D.2.35.6.1 General
457 D.2.35.6.2 Projection for a sample location
458 D.2.35.6.3 Conversion from the local coordinate axes to the global coordinate axes
459 D.2.35.6.4 Conversion of sample locations for rectangular region-wise packing
460 D.2.35.6.5 Mapping of luma sample locations within a cropped decoded picture to sphere coordinates relative to the global coordinate axes
461 D.2.35.6.6 Conversion from a sample location in a projected picture to sphere coordinates relative to the global coordinate axes
D.2.36 SEI manifest SEI message semantics
463 D.2.37 SEI prefix indication SEI message semantics
464 D.2.38 Shutter interval information SEI message semantics
465 D.2.39 Reserved SEI message semantics
D.3 Use of SEI messages specified in other documents
D.3.1 General
466 D.3.2 Use of the annotated regions SEI message
D.3.3 Use of the neural network post-filter characteristics SEI message and the neural-network post-filter activation SEI message
468 D.3.4 Use of the phase indication SEI message
469 E Annex E (normative) Video usability information
E.1 VUI syntax
E.1.1 VUI parameters syntax
470 E.1.2 HRD parameters syntax
471 E.2 VUI semantics
E.2.1 VUI parameters semantics
Table E-1 – Meaning of sample aspect ratio indicator
472 Table E-2 – Meaning of video_format
473 Table E-3 – Colour primaries interpretation using colour_primaries syntax element
484 Figure E-1 – Location of chroma samples for top and bottom fields for chroma_format_idc equal to 1 (4:2:0 chroma format) as a function of chroma_sample_loc_type_top_field and chroma_sample_loc_type_bottom_field
485 Table E-6 – Divisor for computation of (tfi,dpb( n )
488 E.2.2 HRD parameters semantics
490 F Annex F (normative) Scalable video coding
F.1 General
F.2 Source, coded, decoded and output data formats, scanning processes, neighbouring and reference layer relationships
F.2.1 Derivation process for reference layer macroblocks
492 F.2.1.1 Field-to-frame reference layer macroblock conversion process
F.2.1.2 Frame-to-field reference layer macroblock conversion process
493 F.2.2 Derivation process for reference layer partitions
F.2.3 Derivation process for reference layer sample locations in resampling
495 F.2.4 SVC derivation process for macroblock and sub-macroblock partition indices
496 F.3 Syntax and semantics
F.3.1 Method of specifying syntax in tabular form
F.3.2 Specification of syntax functions, categories, and descriptors
F.3.3 Syntax in tabular form
F.3.3.1 NAL unit syntax
F.3.3.1.1 NAL unit header SVC extension syntax
F.3.3.2 Raw byte sequence payloads and RBSP trailing bits syntax
F.3.3.2.1 Sequence parameter set RBSP syntax
497 F.3.3.2.1.1 Sequence parameter set data syntax
F.3.3.2.1.1.1 Scaling list syntax
F.3.3.2.1.2 Sequence parameter set extension RBSP syntax
F.3.3.2.1.3 Subset sequence parameter set RBSP syntax
F.3.3.2.1.4 Sequence parameter set SVC extension syntax
F.3.3.2.2 Picture parameter set RBSP syntax
F.3.3.2.3 Supplemental enhancement information RBSP syntax
498 F.3.3.2.3.1 Supplemental enhancement information message syntax
F.3.3.2.4 Access unit delimiter RBSP syntax
F.3.3.2.5 End of sequence RBSP syntax
F.3.3.2.6 End of stream RBSP syntax
F.3.3.2.7 Filler data RBSP syntax
F.3.3.2.8 Slice layer without partitioning RBSP syntax
F.3.3.2.9 Slice data partition RBSP syntax
F.3.3.2.10 RBSP slice trailing bits syntax
F.3.3.2.11 RBSP trailing bits syntax
F.3.3.2.12 Prefix NAL unit RBSP syntax
499 F.3.3.2.12.1 Prefix NAL unit SVC syntax
F.3.3.2.13 Slice layer extension RBSP syntax
F.3.3.3 Slice header syntax
F.3.3.3.1 Reference picture list modification syntax
F.3.3.3.2 Prediction weight table syntax
F.3.3.3.3 Decoded reference picture marking syntax
500 F.3.3.3.4 Slice header in scalable extension syntax
502 F.3.3.3.5 Decoded reference base picture marking syntax
F.3.3.4 Slice data syntax
503 F.3.3.4.1 Slice data in scalable extension syntax
F.3.3.5 Macroblock layer syntax
504 F.3.3.5.1 Macroblock prediction syntax
F.3.3.5.2 Sub-macroblock prediction syntax
F.3.3.5.3 Residual data syntax
F.3.3.5.3.1 Residual luma syntax
F.3.3.5.3.2 Residual block CAVLC syntax
F.3.3.5.3.3 Residual block CABAC syntax
F.3.3.6 Macroblock layer in scalable extension syntax
506 F.3.3.6.1 Macroblock prediction in scalable extension syntax
507 F.3.3.6.2 Sub-macroblock prediction in scalable extension syntax
F.3.4 Semantics
508 F.3.4.1 NAL unit semantics
F.3.4.1.1 NAL unit header SVC extension semantics
509 F.3.4.1.2 Order of NAL units and association to coded pictures, access units, and video sequences
510 F.3.4.1.2.1 Order of SVC sequence parameter set RBSPs and picture parameter set RBSPs and their activation
515 F.3.4.1.2.2 Order of access units and association to coded video sequences
F.3.4.1.2.3 Order of NAL units and coded pictures and association to access units
516 F.3.4.1.2.4 Detection of the first VCL NAL unit of a primary coded picture
F.3.4.1.2.5 Order of VCL NAL units and association to coded pictures
517 F.3.4.2 Raw byte sequence payloads and RBSP trailing bits semantics
F.3.4.2.1 Sequence parameter set RBSP semantics
F.3.4.2.1.1 Sequence parameter set data semantics
519 F.3.4.2.1.1.1 Scaling list semantics
F.3.4.2.1.2 Sequence parameter set extension RBSP semantics
F.3.4.2.1.3 Subset sequence parameter set RBSP semantics
F.3.4.2.1.4 Sequence parameter set SVC extension semantics
521 F.3.4.2.2 Picture parameter set RBSP semantics
F.3.4.2.3 Supplemental enhancement information RBSP semantics
F.3.4.2.3.1 Supplemental enhancement information message semantics
F.3.4.2.4 Access unit delimiter RBSP semantics
F.3.4.2.5 End of sequence RBSP semantics
F.3.4.2.6 End of stream RBSP semantics
F.3.4.2.7 Filler data RBSP semantics
522 F.3.4.2.8 Slice layer without partitioning RBSP semantics
F.3.4.2.9 Slice data partition RBSP semantics
F.3.4.2.10 RBSP slice trailing bits semantics
F.3.4.2.11 RBSP trailing bits semantics
F.3.4.2.12 Prefix NAL unit RBSP semantics
F.3.4.2.12.1 Prefix NAL unit SVC semantics
523 F.3.4.2.13 Slice layer extension RBSP semantics
F.3.4.3 Slice header semantics
F.3.4.3.1 Reference picture list modification semantics
F.3.4.3.2 Prediction weight table semantics
F.3.4.3.3 Decoded reference picture marking semantics
524 F.3.4.3.4 Slice header in scalable extension semantics
526 Table F-1 – Name association to slice_type for NAL units with nal_unit_type equal to 20
535 F.3.4.3.5 Decoded reference base picture marking semantics
Table F-2 – Interpretation of adaptive_ref_base_pic_marking_mode_flag
536 Table F-3 – Memory management base control operation (memory_management_base_control_operation) values
537 F.3.4.4 Slice data semantics
F.3.4.4.1 Slice data in scalable extension semantics
F.3.4.5 Macroblock layer semantics
F.3.4.5.1 Macroblock prediction semantics
F.3.4.5.2 Sub-macroblock prediction semantics
538 F.3.4.5.3 Residual data semantics
F.3.4.5.3.1 Residual luma semantics
F.3.4.5.3.2 Residual block CAVLC semantics
F.3.4.5.3.3 Residual block CABAC semantics
F.3.4.6 Macroblock layer in scalable extension semantics
539 Table F-4 – Allowed collective macroblock types for slice_type.
540 Table F-5 – Inferred macroblock type I_BL for EI slices
541 F.3.4.6.1 Macroblock prediction in scalable extension semantics
F.3.4.6.2 Sub-macroblock prediction in scalable extension semantics
F.4 SVC decoding process
543 F.4.1 SVC initialization and decoding processes
F.4.1.1 Derivation process for the set of layer representations required for decoding
F.4.1.2 Array assignment, initialization, and restructuring processes
F.4.1.2.1 Array assignment and initialization process
545 F.4.1.2.2 Array restructuring process
546 F.4.1.3 Layer representation decoding processes
F.4.1.3.1 Base decoding process for layer representations without resolution change
547 F.4.1.3.2 Base decoding process for layer representations with resolution change
548 F.4.1.3.3 Target layer representation decoding process
549 F.4.1.4 Slice decoding processes
F.4.1.4.1 Base decoding process for slices without resolution change
550 F.4.1.4.2 Base decoding process for slices with resolution change
F.4.1.5 Macroblock initialization and decoding processes
F.4.1.5.1 Macroblock initialization process
552 F.4.1.5.1.1 Derivation process for macroblock type, sub-macroblock type, and inter-layer predictors for reference indices and motion vectors
553 F.4.1.5.1.2 Derivation process for quantization parameters and transform type
555 F.4.1.5.2 Base decoding process for macroblocks in slices without resolution change
557 F.4.1.5.3 Base decoding process for macroblocks in slices with resolution change
558 F.4.1.5.4 Macroblock decoding process prior to decoding a layer representation without resolution change and MaxTCoeffLevelPredFlag equal to 0
559 F.4.1.5.5 Macroblock decoding process prior to resolution change
560 F.4.1.5.6 Target macroblock decoding process
562 F.4.2 SVC reference picture lists construction and decoded reference picture marking process
564 F.4.2.1 SVC decoding process for picture order count
565 F.4.2.2 SVC decoding process for picture numbers
F.4.2.3 SVC decoding process for reference picture lists construction
567 F.4.2.4 SVC decoded reference picture marking process
F.4.2.4.1 SVC reference picture marking process for a dependency representation
569 F.4.2.4.2 SVC sliding window decoded reference picture marking process
570 F.4.2.4.3 SVC adaptive memory control reference base picture marking process
571 F.4.2.4.4 SVC adaptive memory control decoded reference picture marking process
573 F.4.2.5 SVC decoding process for gaps in frame_num
F.4.3 SVC intra decoding processes
F.4.3.1 SVC derivation process for intra prediction modes
574 F.4.3.1.1 SVC derivation process for Intra_4x4 prediction modes
576 F.4.3.1.2 SVC derivation process for Intra_8x8 prediction modes
577 F.4.3.2 SVC intra sample prediction and construction process
579 F.4.3.2.1 SVC intra prediction and construction process for luma samples or chroma samples with ChromaArrayType equal to 3
F.4.3.2.1.1 SVC construction process for luma samples and chroma samples with ChromaArrayType equal to 3 of I_PCM macroblocks
580 F.4.3.2.1.2 SVC Intra_4x4 sample prediction and construction process
F.4.3.2.1.3 SVC Intra_8x8 sample prediction and construction process
581 F.4.3.2.1.4 SVC Intra_16x16 sample prediction and construction process
582 F.4.3.2.2 SVC intra prediction and construction process for chroma samples
F.4.3.2.2.1 SVC construction process for chroma samples of I_PCM macroblocks
583 F.4.3.2.2.2 SVC intra prediction and construction process for chroma samples with ChromaArrayType equal to 1 or 2
F.4.4 SVC Inter prediction process
F.4.4.1 SVC derivation process for motion vector components and reference indices
585 F.4.4.1.1 SVC derivation process for luma motion vector components and reference indices of a macroblock or sub-macroblock partition
589 F.4.4.1.2 SVC derivation process for luma motion vectors and reference indices for B_Skip, B_Direct_16x16, and B_Direct_8x8 in NAL units with nal_unit_type equal to 20
590 F.4.4.2 SVC decoding process for Inter prediction samples
593 F.4.4.2.1 SVC derivation process for prediction weights
594 F.4.4.2.2 Intra-inter prediction combination process
596 F.4.5 SVC transform coefficient decoding and sample array construction processes
F.4.5.1 Transform coefficient scaling and refinement process
597 F.4.5.1.1 Refinement process for luma transform coefficients or chroma transform coefficients with ChromaArrayType equal to 3
F.4.5.1.1.1 Assignment process for luma transform coefficient values or chroma transform coefficient values with ChromaArrayType equal to 3 for I_PCM macroblocks
598 F.4.5.1.1.2 Refinement process for transform coefficients of residual 4×4 blocks
599 F.4.5.1.1.3 Refinement process for transform coefficients of residual 8×8 blocks
600 F.4.5.1.1.4 Refinement process for transform coefficients of Intra_16x16 macroblocks
601 F.4.5.1.2 Refinement process for chroma transform coefficients
602 F.4.5.1.2.1 Assignment process for chroma transform coefficient values for I_PCM macroblocks
F.4.5.1.2.2 Refinement process for chroma transform coefficients with ChromaArrayType equal to 1 or 2
604 F.4.5.2 Transform coefficient level scaling process prior to transform coefficient refinement
Table F-6 – Scale values cS for transform coefficient level scaling
605 F.4.5.3 Residual construction and accumulation process
606 F.4.5.3.1 Construction process for luma residuals or chroma residuals with ChromaArrayType equal to 3
607 F.4.5.3.1.1 Construction process for luma residuals or chroma residuals with ChromaArrayType equal to 3 of I_PCM macroblocks
F.4.5.3.1.2 Construction process for residual 4×4 blocks
F.4.5.3.1.3 Construction process for residual 8×8 blocks
608 F.4.5.3.1.4 Construction process for residuals of Intra_16x16 macroblocks
F.4.5.3.2 Construction process for chroma residuals
F.4.5.3.2.1 Construction process for chroma residuals of I_PCM macroblocks
609 F.4.5.3.2.2 Construction process for chroma residuals with ChromaArrayType equal to 1 or 2
610 F.4.5.4 Sample array accumulation process
611 F.4.5.4.1 Picture sample array construction process
F.4.5.4.2 Macroblock sample array extraction process
F.4.5.4.3 Picture sample array construction process for a colour component
612 F.4.5.4.4 Macroblock sample array extraction process for a colour component
F.4.5.5 Sample array re-initialization process
613 F.4.6 Resampling processes for prediction data, intra samples, and residual samples
F.4.6.1 Derivation process for inter-layer predictors for macroblock type, sub-macroblock type, reference indices, and motion vectors
614 F.4.6.1.1 Derivation process for reference layer partition identifications
616 F.4.6.1.2 Derivation process for inter-layer predictors for reference indices and motion vectors
620 F.4.6.1.3 Derivation process for inter-layer predictors for P and B macroblock and sub-macroblock types
621 Table F-7 – Macroblock type predictors mbTypeILPred
622 Table F-8 – Sub-macroblock type predictors subMbTypeILPred[ mbPartIdx ]
F.4.6.2 Resampling process for intra samples
623 F.4.6.2.1 Resampling process for intra samples of a macroblock colour component
626 F.4.6.2.2 Reference layer sample array construction process prior to intra resampling
628 F.4.6.2.2.1 Derivation process for reference layer slice and intra macroblock identifications
629 F.4.6.2.2.2 Construction process for not available sample values prior to intra resampling
630 F.4.6.2.2.2.1 Diagonal construction process for not available sample values
631 F.4.6.2.3 Interpolation process for Intra_Base prediction
632 Table F-9 – 16-phase luma interpolation filter for resampling in Intra_Base prediction
633 F.4.6.2.4 Vertical interpolation process for Intra_Base prediction
634 F.4.6.2.5 Derivation process for variables related to inter-layer intra prediction
636 F.4.6.3 Resampling process for residual samples
F.4.6.3.1 Resampling process for residual samples of a macroblock colour component
639 F.4.6.3.2 Reference layer sample array construction process prior to residual resampling
640 F.4.6.3.2.1 Derivation process for reference layer transform block identifications
641 F.4.6.3.3 Interpolation process for residual prediction
642 F.4.6.3.4 Vertical interpolation process for residual prediction
F.4.7 SVC deblocking filter processes
643 F.4.7.1 Deblocking filter process for Intra_Base prediction
F.4.7.2 Deblocking filter process for target representations
644 F.4.7.3 Derivation process for quantization parameters used in the deblocking filter process
645 F.4.7.4 Macroblock deblocking filter process
649 F.4.7.4.1 SVC filtering process for block edges
650 F.4.7.4.2 SVC filtering process for a set of samples across a horizontal or vertical block edge
651 F.4.7.4.3 SVC derivation process for the luma content dependent boundary filtering strength
655 F.4.8 Specification of bitstream subsets
F.4.8.1 Sub-bitstream extraction process
656 F.4.8.2 Specification of the base layer bitstream
F.5 Parsing process
657 F.5.1 Alternative parsing process for coded block pattern
658 F.5.2 Alternative CAVLC parsing process for transform coefficient levels
659 F.5.2.1 Additional parsing process for total number of non-zero transform coefficient levels and number of trailing ones
661 F.5.2.2 Alternative parsing process for run information
662 F.5.3 Alternative CABAC parsing process for slice data in scalable extension
F.5.3.1 Initialization process
663 Table F-11 – Association of ctxIdx and syntax elements for each slice type in the initialization process
Table F-12 – Values of variables m and n for ctxIdx from 1024 to 1026
Table F-13 – Values of variables m and n for ctxIdx from 1027 to 1030
F.5.3.2 Binarization process
664 Table F-14 – Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset
F.5.3.3 Decoding process flow
F.5.3.3.1 Derivation process for ctxIdx
Table F-15 – Assignment of ctxIdxInc to binIdx for the ctxIdxOffset values related to the syntax elements base_mode_flag and residual_prediction_flag
665 F.5.3.3.2 Assignment process of ctxIdxInc using neighbouring syntax elements
F.5.3.3.2.1 Derivation process of ctxIdxInc for the syntax element base_mode_flag
F.5.3.3.2.2 Derivation process of ctxIdxInc for the syntax element residual_prediction_flag
F.6 Profiles and levels
F.6.1 Profiles
F.6.1.1 Scalable Baseline profile
667 F.6.1.1.1 Scalable Constrained Baseline profile
668 F.6.1.2 Scalable High profile
669 F.6.1.2.1.1 Scalable Constrained High profile
670 F.6.1.3 Scalable High Intra profile
671 F.6.2 Levels
F.6.2.1 Level limits common to Scalable Baseline, Scalable Constrained Baseline, Scalable High, Scalable Constrained High, and Scalable High Intra profiles
673 F.6.2.2 Profile specific level limits
676 Table F-16 – Scalable Baseline and Scalable Constrained Baseline profile level limits
Table F-17 – Specification of cpbBrVclFactor and cpbBrNalFactor
F.7 Byte stream format
F.8 Hypothetical reference decoder
F.9 Supplemental enhancement information
677 F.9.1 SEI payload syntax
F.9.1.1 Scalability information SEI message syntax
679 F.9.1.2 Sub-picture scalable layer SEI message syntax
680 F.9.1.3 Non-required layer representation SEI message syntax
F.9.1.4 Priority layer information SEI message syntax
F.9.1.5 Layers not present SEI message syntax
681 F.9.1.6 Layer dependency change SEI message syntax
F.9.1.7 Scalable nesting SEI message syntax
682 F.9.1.8 Base layer temporal HRD SEI message syntax
F.9.1.9 Quality layer integrity check SEI message syntax
683 F.9.1.10 Redundant picture property SEI message syntax
F.9.1.11 Temporal level zero dependency representation index SEI message syntax
F.9.1.12 Temporal level switching point SEI message syntax
F.9.2 SEI payload semantics
685 F.9.2.1 Scalability information SEI message semantics
701 F.9.2.2 Sub-picture scalable layer SEI message semantics
702 F.9.2.3 Non-required layer representation SEI message semantics
F.9.2.4 Priority layer information SEI message semantics
703 F.9.2.5 Layers not present SEI message semantics
F.9.2.6 Layer dependency change SEI message semantics
705 F.9.2.7 Scalable nesting SEI message semantics
706 F.9.2.8 Base layer temporal HRD SEI message semantics
707 F.9.2.9 Quality layer integrity check SEI message semantics
708 F.9.2.10 Redundant picture property SEI message semantics
709 F.9.2.11 Temporal level zero dependency representation index SEI message semantics
710 F.9.2.12 Temporal level switching point SEI message semantics
711 F.10 Video usability information
712 F.10.1 SVC VUI parameters extension syntax
F.10.2 SVC VUI parameters extension semantics
715 G Annex G (normative) Multiview video coding
G.1 General
G.2 Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships
G.3 Syntax and semantics
G.3.1 Method of specifying syntax in tabular form
G.3.2 Specification of syntax functions, categories, and descriptors
G.3.3 Syntax in tabular form
G.3.3.1 NAL unit syntax
G.3.3.1.1 NAL unit header MVC extension syntax
G.3.3.2 Raw byte sequence payloads and RBSP trailing bits syntax
G.3.3.2.1 Sequence parameter set RBSP syntax
716 G.3.3.2.1.1 Sequence parameter set data syntax
G.3.3.2.1.1.1 Scaling list syntax
G.3.3.2.1.2 Sequence parameter set extension RBSP syntax
G.3.3.2.1.3 Subset sequence parameter set RBSP syntax
G.3.3.2.1.4 Sequence parameter set MVC extension syntax
717 G.3.3.2.2 Picture parameter set RBSP syntax
G.3.3.2.3 Supplemental enhancement information RBSP syntax
G.3.3.2.3.1 Supplemental enhancement information message syntax
G.3.3.2.4 Access unit delimiter RBSP syntax
G.3.3.2.5 End of sequence RBSP syntax
G.3.3.2.6 End of stream RBSP syntax
G.3.3.2.7 Filler data RBSP syntax
G.3.3.2.8 Slice layer without partitioning RBSP syntax
G.3.3.2.9 Slice data partition RBSP syntax
718 G.3.3.2.10 RBSP slice trailing bits syntax
G.3.3.2.11 RBSP trailing bits syntax
G.3.3.2.12 Prefix NAL unit RBSP syntax
G.3.3.2.13 Slice layer extension RBSP syntax
G.3.3.3 Slice header syntax
G.3.3.3.1 Reference picture list modification syntax
719 G.3.3.3.1.1 Reference picture list MVC modification syntax
G.3.3.3.2 Prediction weight table syntax
G.3.3.3.3 Decoded reference picture marking syntax
G.3.3.4 Slice data syntax
G.3.3.5 Macroblock layer syntax
720 G.3.3.5.1 Macroblock prediction syntax
G.3.3.5.2 Sub-macroblock prediction syntax
G.3.3.5.3 Residual data syntax
G.3.3.5.3.1 Residual luma syntax
G.3.3.5.3.2 Residual block CAVLC syntax
G.3.3.5.3.3 Residual block CABAC syntax
G.3.4 Semantics
G.3.4.1 NAL unit semantics
G.3.4.1.1 NAL unit header MVC extension semantics
721 G.3.4.1.2 Order of NAL units and association to coded pictures, access units, and video sequences
722 G.3.4.1.2.1 Order of MVC sequence parameter set RBSPs and picture parameter set RBSPs and their activation
726 G.3.4.1.2.2 Order of access units and association to coded video sequences
G.3.4.1.2.3 Order of NAL units and coded pictures and association to access units
727 G.3.4.1.2.4 Detection of the first VCL NAL unit of a primary coded picture
G.3.4.1.2.5 Order of VCL NAL units and association to coded pictures
728 G.3.4.2 Raw byte sequence payloads and RBSP trailing bits semantics
G.3.4.2.1 Sequence parameter set RBSP semantics
G.3.4.2.1.1 Sequence parameter set data semantics
G.3.4.2.1.1.1 Scaling list semantics
G.3.4.2.1.2 Sequence parameter set extension RBSP semantics
G.3.4.2.1.3 Subset sequence parameter set RBSP semantics
729 G.3.4.2.1.4 Sequence parameter set MVC extension semantics
730 Table G-1 – Association between frame packing arrangement type and syntax elements
732 G.3.4.2.2 Picture parameter set RBSP semantics
G.3.4.2.3 Supplemental enhancement information RBSP semantics
G.3.4.2.3.1 Supplemental enhancement information message semantics
G.3.4.2.4 Access unit delimiter RBSP semantics
G.3.4.2.5 End of sequence RBSP semantics
G.3.4.2.6 End of stream RBSP semantics
G.3.4.2.7 Filler data RBSP semantics
G.3.4.2.8 Slice layer without partitioning RBSP semantics
G.3.4.2.9 Slice data partition RBSP semantics
G.3.4.2.10 RBSP slice trailing bits semantics
733 G.3.4.2.11 RBSP trailing bits semantics
G.3.4.2.12 Prefix NAL unit RBSP semantics
G.3.4.2.13 Slice layer extension RBSP semantics
G.3.4.3 Slice header semantics
734 G.3.4.3.1 Reference picture list modification semantics
G.3.4.3.1.1 Reference picture list MVC modification semantics
735 Table G-2 – modification_of_pic_nums_idc operations for modification of reference picture lists
G.3.4.3.2 Prediction weight table semantics
G.3.4.3.3 Decoded reference picture marking semantics
G.3.4.4 Slice data semantics
G.3.4.5 Macroblock layer semantics
G.3.4.5.1 Macroblock prediction semantics
736 G.3.4.5.2 Sub-macroblock prediction semantics
G.3.4.5.3 Residual data semantics
G.3.4.5.3.1 Residual luma semantics
G.3.4.5.3.2 Residual block CAVLC semantics
G.3.4.5.3.3 Residual block CABAC semantics
G.4 MVC decoding process
737 G.4.1 MVC decoding process for picture order count
G.4.2 MVC decoding process for reference picture lists construction
738 G.4.2.1 Initialization process for reference picture list for inter-view prediction references
G.4.2.2 Modification process for reference picture lists
739 G.4.2.2.1 Modification process of reference picture lists for short-term reference pictures for inter prediction
740 G.4.2.2.2 Modification process of reference picture lists for long-term reference pictures for inter prediction
G.4.2.2.3 Modification process for reference picture lists for inter-view prediction references
741 G.4.3 MVC decoded reference picture marking process
742 G.4.4 MVC inter prediction and inter-view prediction process
G.4.4.1 Additional processing for an inter-view prediction reference
746 G.4.5 Specification of bitstream subsets
G.4.5.1 Derivation process for required anchor view components
747 G.4.5.2 Derivation process for required non-anchor view components
G.4.5.3 Sub-bitstream extraction process
748 G.4.5.4 Specification of the base view bitstream
749 G.4.5.5 Creation of a base view during sub-bitstream extraction
750 G.4.6 MFC enhanced resolution picture reconstruction
754 G.5 Parsing process
G.6 Profiles and levels
G.6.1 Profiles
G.6.1.1 Multiview High profile
755 G.6.1.2 Stereo High profile
756 G.6.1.3 MFC High profile
757 G.6.2 Levels
G.6.2.1 Level limits common to Multiview High, Stereo High and MFC High profiles
760 G.6.2.2 Profile specific level limits
G.7 Byte stream format
G.8 MVC hypothetical reference decoder
G.9 MVC SEI messages
G.9.1 SEI message syntax
G.9.1.1 Parallel decoding information SEI message syntax
762 G.9.1.2 MVC scalable nesting SEI message syntax
G.9.1.3 View scalability information SEI message syntax
763 G.9.1.4 Multiview scene information SEI message syntax
G.9.1.5 Multiview acquisition information SEI message syntax
765 G.9.1.6 Non-required view component SEI message syntax
G.9.1.7 View dependency change SEI message syntax
G.9.1.8 Operation point not present SEI message syntax
G.9.1.9 Base view temporal HRD SEI message syntax
766 G.9.1.10 Multiview view position SEI message syntax
G.9.2 SEI message semantics
767 G.9.2.1 Parallel decoding information SEI message semantics
768 G.9.2.2 MVC scalable nesting SEI message semantics
769 G.9.2.3 View scalability information SEI message semantics
772 G.9.2.4 Multiview scene information SEI message semantics
773 G.9.2.5 Multiview acquisition information SEI message semantics
776 Table G-3 – Association between camera parameter variables and syntax elements.
G.9.2.6 Non-required view component SEI message semantics
G.9.2.7 View dependency change SEI message semantics
777 G.9.2.8 Operation point not present SEI message semantics
778 G.9.2.9 Base view temporal HRD SEI message semantics
G.9.2.10 Multiview view position SEI message semantics
779 G.10 Video usability information
G.10.1 MVC VUI parameters extension syntax
G.10.2 MVC VUI parameters extension semantics
782 H Annex H (normative) Multiview and depth video coding
H.1 General
H.2 Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships
H.3 Syntax and semantics
H.3.1 Method of specifying syntax in tabular form
H.3.2 Specification of syntax functions, categories, and descriptors
H.3.3 Syntax in tabular form
H.3.3.1 NAL unit syntax
H.3.3.1.1 NAL unit header MVC extension syntax
H.3.3.2 Raw byte sequence payloads and RBSP trailing bits syntax
H.3.3.2.1 Sequence parameter set RBSP syntax
H.3.3.2.1.1 Sequence parameter set data syntax
H.3.3.2.1.1.1 Scaling list syntax
H.3.3.2.1.2 Sequence parameter set extension RBSP syntax
783 H.3.3.2.1.3 Subset sequence parameter set RBSP syntax
H.3.3.2.1.4 Sequence parameter set MVC extension syntax
H.3.3.2.1.5 Sequence parameter set MVCD extension syntax
784 H.3.3.2.2 Picture parameter set RBSP syntax
H.3.3.2.3 Supplemental enhancement information RBSP syntax
H.3.3.2.3.1 Supplemental enhancement information message syntax
H.3.3.2.4 Access unit delimiter RBSP syntax
H.3.3.2.5 End of sequence RBSP syntax
H.3.3.2.6 End of stream RBSP syntax
H.3.3.2.7 Filler data RBSP syntax
H.3.3.2.8 Slice layer without partitioning RBSP syntax
H.3.3.2.9 Slice data partition RBSP syntax
H.3.3.2.10 RBSP slice trailing bits syntax
H.3.3.2.11 RBSP trailing bits syntax
785 H.3.3.2.12 Prefix NAL unit RBSP syntax
H.3.3.2.13 Slice layer extension RBSP syntax
H.3.3.3 Slice header syntax
H.3.3.3.1 Reference picture list modification syntax
H.3.3.3.1.1 Reference picture list MVC modification syntax
H.3.3.3.2 Prediction weight table syntax
H.3.3.3.3 Decoded reference picture marking syntax
H.3.3.4 Slice data syntax
H.3.3.5 Macroblock layer syntax
H.3.3.5.1 Macroblock prediction syntax
H.3.3.5.2 Sub-macroblock prediction syntax
H.3.3.5.3 Residual data syntax
H.3.3.5.3.1 Residual luma syntax
H.3.3.5.3.2 Residual block CAVLC syntax
H.3.3.5.3.3 Residual block CABAC syntax
786 H.3.4 Semantics
H.3.4.1 NAL unit semantics
H.3.4.1.1 NAL unit header MVC extension semantics
H.3.4.1.2 Order of NAL units and association to coded pictures, access units, and video sequences
H.3.4.1.2.1 Order of MVCD sequence parameter set RBSPs and picture parameter set RBSPs and their activation
792 H.3.4.1.2.2 Order of access units and association to coded video sequences
H.3.4.1.2.3 Order of NAL units and coded pictures and association to access units
H.3.4.1.2.4 Detection of the first VCL NAL unit of a primary coded picture
H.3.4.1.2.5 Order of VCL NAL units and association to coded pictures
793 H.3.4.2 Raw byte sequence payloads and RBSP trailing bits semantics
H.3.4.2.1 Sequence parameter set RBSP semantics
H.3.4.2.1.1 Sequence parameter set data semantics
H.3.4.2.1.1.1 Scaling list semantics
H.3.4.2.1.2 Sequence parameter set extension RBSP semantics
794 H.3.4.2.1.3 Subset sequence parameter set RBSP semantics
H.3.4.2.1.4 Sequence parameter set MVCD extension semantics
795 H.3.4.2.2 Picture parameter set RBSP semantics
H.3.4.2.3 Supplemental enhancement information RBSP semantics
H.3.4.2.3.1 Supplemental enhancement information message semantics
H.3.4.2.4 Access unit delimiter RBSP semantics
H.3.4.2.5 End of sequence RBSP semantics
H.3.4.2.6 End of stream RBSP semantics
H.3.4.2.7 Filler data RBSP semantics
H.3.4.2.8 Slice layer without partitioning RBSP semantics
H.3.4.2.9 Slice data partition RBSP semantics
H.3.4.2.10 RBSP slice trailing bits semantics
H.3.4.2.11 RBSP trailing bits semantics
796 H.3.4.2.12 Prefix NAL unit RBSP semantics
H.3.4.2.13 Slice layer extension RBSP semantics
H.3.4.3 Slice header semantics
H.3.4.3.1 Reference picture list modification semantics
H.3.4.3.1.1 Reference picture list MVC modification semantics
H.3.4.3.2 Prediction weight table semantics
H.3.4.3.3 Decoded reference picture marking semantics
H.3.4.4 Slice data semantics
H.3.4.5 Macroblock layer semantics
H.3.4.5.1 Macroblock prediction semantics
H.3.4.5.2 Sub-macroblock prediction semantics
797 H.3.4.5.3 Residual data semantics
H.3.4.5.3.1 Residual luma semantics
H.3.4.5.3.2 Residual block CAVLC semantics
H.3.4.5.3.3 Residual block CABAC semantics
H.4 MVCD decoding process
798 H.4.1 MVCD decoding process for picture order count
H.4.2 MVC decoding process for reference picture lists construction
H.4.2.1 Initialization process for reference picture list for inter-view prediction references
H.4.2.2 Modification process for reference picture lists
H.4.2.2.1 Modification process of reference picture lists for short-term reference pictures for inter prediction
H.4.2.2.2 Modification process of reference picture lists for long-term reference pictures for inter prediction
H.4.2.2.3 Modification process for reference picture lists for inter-view prediction references
H.4.3 MVCD decoded reference picture marking process
H.4.4 MVCD inter prediction and inter-view prediction process
H.4.5 Specification of bitstream subsets
H.4.5.1 Derivation process for required anchor view components
799 H.4.5.2 Derivation process for required non-anchor view components
H.4.5.3 Sub-bitstream extraction process
801 H.4.5.4 Specification of the base view bitstream
H.4.5.5 Specification of the stereoscopic texture bitstream
H.5 Parsing process
H.6 Profiles and levels
H.6.1 Profiles
H.6.1.1 Multiview Depth High profile
802 H.6.1.2 MFC Depth High profile
803 H.6.2 Levels
804 H.6.2.1 Level limits common to Multiview Depth High profiles
807 H.6.2.2 Profile specific level limits
H.7 Byte stream format
H.8 MVCD hypothetical reference decoder
H.9 MVCD SEI messages
H.9.1 SEI message syntax
H.9.1.1 MVCD view scalability information SEI message syntax
808 H.9.1.1.1 MVCD operation point view information syntax
809 H.9.1.2 MVCD scalable nesting SEI message syntax
H.9.1.3 Depth representation information SEI message syntax
810 H.9.1.3.1 Depth representation SEI element syntax
811 H.9.1.4 3D reference displays information SEI message syntax
H.9.1.5 Depth timing SEI message syntax
H.9.1.5.1 Depth timing offset syntax
812 H.9.1.6 Alternative depth information SEI message syntax
813 H.9.1.7 Depth sampling information SEI message syntax
H.9.1.7.1 Depth grid position syntax
H.9.2 SEI message semantics
816 H.9.2.1 MVCD view scalability information SEI message semantics
H.9.2.1.1 MVCD operation point view information semantics
H.9.2.2 MVCD scalable nesting SEI message semantics
817 H.9.2.3 Depth representation information SEI message semantics
818 Table H-1 – Definition of depth_representation_type
819 Table H-2 – Association between depth parameter variables and syntax elements
820 H.9.2.3.1 Depth representation SEI element semantics
H.9.2.4 3D reference displays information SEI message semantics
822 Table H-3 – Association between camera parameter variables and syntax elements
823 H.9.2.5 Depth timing SEI message semantics
H.9.2.5.1 Depth timing offset semantics
H.9.2.6 Alternative depth information SEI message semantics
824 Table H-4 – Locations of the top-left luma samples of constituent pictures packed in a non-base texture view relative to the top-left luma sample of this picture
827 H.9.2.7 Depth sampling information SEI message semantics
828 H.9.2.7.1 Depth grid position semantics
H.10 Video usability information
H.10.1 MVCD VUI parameters extension syntax
829 H.10.2 MVCD VUI parameters extension semantics
831 I Annex I (normative) Multiview and depth video with enhanced non-base view coding
I.1 General
I.2 Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships
I.2.1 Inverse sub-macroblock partition scanning process
832 I.3 Syntax and semantics
I.3.1 Method of specifying syntax in tabular form
I.3.2 Specification of syntax functions, categories, and descriptors
I.3.3 Syntax in tabular form
I.3.3.1 NAL unit syntax
I.3.3.1.1 NAL unit header 3D-AVC extension syntax
I.3.3.2 Raw byte sequence payloads and RBSP trailing bits syntax
I.3.3.2.1 Sequence parameter set RBSP syntax
I.3.3.2.1.1 Sequence parameter set data syntax
I.3.3.2.1.1.1 Scaling list syntax
I.3.3.2.1.2 Sequence parameter set extension RBSP syntax
I.3.3.2.1.3 Subset sequence parameter set RBSP syntax
I.3.3.2.1.4 Sequence parameter set MVC extension syntax
833 I.3.3.2.1.5 Sequence parameter set MVCD extension syntax
834 I.3.3.2.2 Picture parameter set RBSP syntax
I.3.3.2.3 Supplemental enhancement information RBSP syntax
I.3.3.2.3.1 Supplemental enhancement information message syntax
I.3.3.2.4 Access unit delimiter RBSP syntax
I.3.3.2.5 End of sequence RBSP syntax
I.3.3.2.6 End of stream RBSP syntax
I.3.3.2.7 Filler data RBSP syntax
I.3.3.2.8 Slice layer without partitioning RBSP syntax
I.3.3.2.9 Slice data partition RBSP syntax
I.3.3.2.10 RBSP slice trailing bits syntax
I.3.3.2.11 RBSP trailing bits syntax
835 I.3.3.2.12 Prefix NAL unit RBSP syntax
I.3.3.2.13 Depth parameter set RBSP syntax
I.3.3.2.13.1 Depth ranges syntax
836 I.3.3.2.13.2 3DV acquisition element syntax
837 I.3.3.2.13.3 View synthesis prediction parameters syntax
I.3.3.2.14 Slice layer extension RBSP syntax
I.3.3.3 Slice header syntax
I.3.3.3.1 Reference picture list modification syntax
I.3.3.3.1.1 Reference picture list MVC modification syntax
I.3.3.3.2 Prediction weight table syntax
I.3.3.3.3 Decoded reference picture marking syntax
I.3.3.3.4 Slice header in 3D-AVC extension syntax
840 I.3.3.4 Slice data syntax
I.3.3.4.1 Slice data in 3D-AVC extension syntax
841 I.3.3.5 Macroblock layer syntax
842 I.3.3.5.1 Macroblock prediction syntax
I.3.3.5.2 Sub-macroblock prediction syntax
I.3.3.5.3 Residual data syntax
I.3.3.5.3.1 Residual luma syntax
I.3.3.5.3.2 Residual block CAVLC syntax
I.3.3.5.3.3 Residual block CABAC syntax
843 I.3.3.6 Macroblock layer in 3D-AVC extension syntax
844 I.3.3.6.1 Macroblock prediction in 3D-AVC extension syntax
845 I.3.3.6.2 Sub-macroblock prediction syntax
846 I.3.4 Semantics
I.3.4.1 NAL unit semantics
I.3.4.1.1 NAL unit header MVC extension semantics
I.3.4.1.2 Order of NAL units and association to coded pictures, access units, and video sequences
I.3.4.1.2.1 Order of 3D-AVC sequence parameter set RBSPs and picture parameter set RBSPs and their activation
847 I.3.4.1.2.2 Order of access units and association to coded video sequences
I.3.4.1.2.3 Order of NAL units and coded pictures and association to access units
I.3.4.1.2.4 Detection of the first VCL NAL unit of a primary coded picture
I.3.4.1.2.5 Order of VCL NAL units and association to coded pictures
848 I.3.4.2 Raw byte sequence payloads and RBSP trailing bits semantics
I.3.4.2.1 Sequence parameter set RBSP semantics
I.3.4.2.1.1 Sequence parameter set data semantics
I.3.4.2.1.1.1 Scaling list semantics
I.3.4.2.1.2 Sequence parameter set extension RBSP semantics
I.3.4.2.1.3 Subset sequence parameter set RBSP semantics
I.3.4.2.1.4 Sequence parameter set MVCD extension semantics
I.3.4.2.1.5 Sequence parameter set 3D-AVC extension semantics
850 I.3.4.2.2 Picture parameter set RBSP semantics
I.3.4.2.3 Supplemental enhancement information RBSP semantics
I.3.4.2.3.1 Supplemental enhancement information message semantics
I.3.4.2.4 Access unit delimiter RBSP semantics
I.3.4.2.5 End of sequence RBSP semantics
I.3.4.2.6 End of stream RBSP semantics
I.3.4.2.7 Filler data RBSP semantics
I.3.4.2.8 Slice layer without partitioning RBSP semantics
I.3.4.2.9 Slice data partition RBSP semantics
I.3.4.2.10 RBSP slice trailing bits semantics
851 I.3.4.2.11 RBSP trailing bits semantics
I.3.4.2.12 Prefix NAL unit RBSP semantics
I.3.4.2.13 Depth parameter set RBSP semantics
852 I.3.4.2.13.1 Depth ranges semantics
853 I.3.4.2.13.2 3DV acquisition element semantics
I.3.4.2.13.3 View synthesis prediction parameters semantics
854 I.3.4.2.14 Slice layer extension RBSP semantics
I.3.4.3 Slice header semantics
I.3.4.3.1 Reference picture list modification semantics
I.3.4.3.1.1 Reference picture list MVC modification semantics
I.3.4.3.2 Prediction weight table semantics
I.3.4.3.3 Decoded reference picture marking semantics
I.3.4.3.4 Slice header in 3D-AVC semantics
855 Table I-1 – Respective syntax elements for pre_slice_header_src, pre_ref_lists_src, pre_pred_weight_table_src and pre_dec_ref_pic_marking_src
Table I-2 – Semantics of the values of pre_slice_header_src, pre_ref_lists_src, pre_pred_weight_table_src and pre_dec_ref_pic_marking_src
856 I.3.4.4 Slice data semantics
I.3.4.4.1 Slice data in 3D-AVC extension semantics
I.3.4.5 Macroblock layer semantics
857 I.3.4.5.1 Macroblock prediction semantics
I.3.4.5.2 Sub-macroblock prediction semantics
I.3.4.5.3 Residual data semantics
I.3.4.5.3.1 Residual luma semantics
I.3.4.5.3.2 Residual block CAVLC semantics
I.3.4.5.3.3 Residual block CABAC semantics
I.3.4.6 Macroblock layer in 3D-AVC extension semantics
858 I.3.4.6.1 Macroblock prediction in 3D-AVC extension semantics
I.3.4.6.2 Sub-macroblock prediction in 3D-AVC semantics
I.4 3D-AVC decoding process
859 I.4.1 3D-AVC decoding process for reference picture lists construction
860 I.4.2 3D-AVC inter prediction, inter-view prediction, view synthesis prediction and adaptive luminance compensation
863 I.4.2.1 Derivation process for motion vector components and reference indices
865 I.4.2.1.1 Depth-based disparity value derivation process
866 I.4.2.1.2 Depth-based derivation process for luma motion vectors for skipped macroblocks in P and SP slices
I.4.2.1.3 Derivation process for luma motion vectors for VSP skipped macroblocks in P and SP slices
867 I.4.2.1.4 Derivation process for luma motion vectors for B_Skip, B_Direct_16x16, and B_Direct_8x8
I.4.2.1.5 Derivation process for the motion vector in inter-view reference
868 I.4.2.1.6 Derivation process for luma motion vectors for VSP skipped/direct macroblocks in B slices
869 I.4.2.1.7 Derivation process for luma motion vector prediction
870 I.4.2.1.7.1 Depth-based derivation process for median luma motion vector prediction
I.4.2.1.7.1.1 Modification process for inter view motion vector in median luma motion vector prediction
I.4.2.1.7.2 Depth-based derivation process for median luma temporal motion vector prediction
872 I.4.2.1.7.2.1 Derivation process for the disparity vector and the inter-view reference
I.4.2.1.8 Macroblock-level neighbouring block based disparity vector derivation process
873 I.4.2.2 Derivation of prediction weights in depth-range-based weighted prediction
874 I.4.2.2.1 Derivation of weight and offset parameteres
875 I.4.2.3 Derivation process for motion vectors and reference indices for adaptive luminance compensation
I.4.2.4 Derivation process for prediction weights in adaptive luminance compensation
876 I.4.2.4.1 Defining of coordinates and sizes of a luma block to be predicted
I.4.2.4.2 Deriving of left and up reference samples of the current block
877 I.4.2.4.3 Deriving of left and up reference samples of the reference block
I.4.2.4.4 Deriviation of NeighbourRefSum and NeighbourSum
I.4.2.4.5 Deriviation of prediction weights
878 I.4.3 Specification of bitstream subsets
I.4.4 Decoding process for depth range parameters
Table I-4 – Association between depth parameter variables and syntax elements
I.5 Parsing process
I.5.1 Alternative CABAC parsing process for slice data and macroblock layer in depth extension
879 I.5.1.1 Initialization process
Table I-5 – Association of ctxIdx and syntax elements in the initialization process
880 Table I-6 – Values of variables m and n for ctxIdx from 1031 to 1039
Table I-7 – Values of variables m and n for ctxIdx from 1040 to 1052
I.5.1.2 Binarization process
881 Table I-8 – Syntax elements and associated types of binarization, maxBinIdxCtx, and ctxIdxOffset
I.5.1.3 Decoding process flow
I.5.1.3.1 Derivation process for ctxIdx
882 Table I-9 – Assignment of ctxIdxInc to binIdx for the ctxIdxOffset values related to the syntax elements mb_vsskip_flag, mb_direct_type_flag, mb_alc_skip_flag, mb_alc_flag and mb_vsp_flag
I.5.1.3.2 Derivation process of ctxIdxInc for the syntax element mb_vsskip_flag
I.5.1.3.3 Derivation process of ctxIdxInc for the syntax element mb_direct_type_flag
883 I.5.1.3.4 Derivation process of ctxIdxInc for the syntax element mb_alc_skip_flag
I.5.1.3.5 Derivation process of ctxIdxInc for the syntax element mb_alc_flag
I.5.1.3.6 Derivation process of ctxIdxInc for the syntax element mb_vsp_flag
I.6 Profiles and levels
884 I.6.1 Profiles
I.6.1.1 Enhanced Multiview Depth High profile
I.6.1.2 Levels
885 I.6.1.3 Level limits for Enhanced Multiview Depth High profile
I.6.1.4 Profile specific level limits
I.7 Byte stream format
I.8 3D-AVC hypothetical reference decoder
I.9 3D-AVC SEI messages
I.9.1 SEI message syntax
I.9.1.1 Constrained depth parameter set identifier SEI message syntax
I.9.2 SEI message semantics
I.9.2.1 Constrained depth parameter set identifier SEI message semantics
886 I.10 Video usability information
887 Bibliography
BSI 24/30478692 DC 2024
$54.81