Tech-invite3GPPspaceIETFspace
21222324252627282931323334353637384‑5x

Content for  TR 26.955  Word version:  18.0.0

Top   Top   None   None   Next
0…   4…   5…   6…   7…   8…   A…

 

0  Introductionp. 15

Predictions on mobile video consumption are ever increasing. Different studies point to dominance of video traffic in 5G networks reaching from 65% total traffic in the short-term all the way to 90% by the end of the decade. Video is expected to be integral for services such as enhanced mobile media (such as mobile streaming services), home broadband and TV (for example in the context of 5G fixed wireless access services), immersive and interactive media in the context of eXtended Realities (XR) and cloud gaming as well as new media services from new verticals. This indicates that the user experience and efficiency of 5G networks will be heavily impacted by the quality of video compression technologies that are used with 5G services. Efficient video compression and decompression technologies required dedicated hardware for power and resource efficient real-time execution but are at the same time complex and costly in terms of implementation on integrated platforms. Hence, typically state-of-the-art video compression technologies last for several years and are used as generic service enablers for different applications and services, including traditional streaming and conversational services, but also new media services. This document analyzes the currently defined 3GPP-defined video compression technologies for their suitability for existing and emerging services in the context of 5G and identifies gaps and optimization potentials that would warrant the introduction of new video compression technologies.
Up

1  Scopep. 16

The present technical report documents relevant interoperability requirements, performance characteristics and implementation constraints of video codecs in 5G services, and characterizes video codecs, in particular 3GPP defined codecs H.264/AVC and H.265/HEVC in order to have a benchmark for the addition of potential future video codecs. For this purpose, the document:
  • Collects a summary of the video coding capabilities in 3GPP services.
  • Collects a subset of relevant scenarios for video codecs in 5G-based services and applications, including video formats (resolution, frame rates, colour space, etc.), encoding and decoding requirements, adaptive streaming requirements.
  • Collects relevant and exemplary test conditions and material for such scenarios, including test sequences.
  • Defines performance metrics for such scenarios with focus on objective performance metrics.
  • Collects relevant interoperability functionalities and enabling elements for video codecs in different 5G services such as MTSI and Telepresence (i.e. RTP based conversational communications), or 5G media streaming (e.g. based on DASH/CMAF) supporting the identified scenarios.
  • Collects relevant criteria and key performance indicators for the integration of video codecs in 5G processing platforms, taking into account factors such as encoding and decoding complexity in the context of the defined scenarios.
  • Provides anchors for the existing codecs H.264/AVC and H.265/HEVC in the context of the above scenarios and document the findings in a consistent manner and characterizes H.265/HEVC against H.264/AVC
  • Provides initial information on EVC video codec developed in ISO/IEC SC29 WG 4 and H.266/VVC video codec developed in JVET (ITU-T SG16 Q6 and ISO/IEC SC29 WG 5) in the context of the above scenarios, including test streams and characterization results.
  • Provides initial information AV1 video codec developed by the Alliance for Open Media in the context of the above scenarios, including test streams and characterization results.
Up

2  Referencesp. 16

The following documents contain provisions which, through reference in this text, constitute provisions of the present document.
  • References are either specific (identified by date of publication, edition number, version number, etc.) or non-specific.
  • For a specific reference, subsequent revisions do not apply.
  • For a non-specific reference, the latest version applies. In the case of a reference to a 3GPP document (including a GSM document), a non-specific reference implicitly refers to the latest version of that document in the same Release as the present document.
[1]
TR 21.905: "Vocabulary for 3GPP Specifications".
[2]
TS 26.114: "IP Multimedia Subsystem (IMS); Multimedia telephony; Media handling and interaction".
[3]
TS 26.116: "Television (TV) over 3GPP services; Video profiles".
[4]
TS 26.118: "3GPP Virtual reality profiles for streaming applications".
[5]
TR 26.925: "Typical traffic characteristics of media services on 3GPP networks".
[6]
TR 26.928: "Extended Reality over 5G".
[7]
Recommendation ITU-T H.264 (06/2017): "Advanced video coding for generic audiovisual services" | ISO/IEC 14496-10:2014/Amd.3 2016: "Information technology - Coding of audio-visual objects - Part 10: Advanced Video Coding".
[8]
Recommendation ITU-T H.265 (11/2019): "High efficiency video coding" | ISO/IEC 23008-2:2020: "High Efficiency Coding and Media Delivery in Heterogeneous Environments - Part 2: High Efficiency Video Coding".
[9]
2020 Mobile Internet Phenomena Report, accessible here: https://www.sandvine.com/download-report-mobile-internet-phenomena-report-2020-sandvine, February 2020.
[10]
2019 Ericsson Mobility Report, accessible here: https://www.ericsson.com/4acd7e/assets/local/mobility-report/documents/2019/emr-november-2019.pdf, November 2019.
[11]
T. Fautier, "New Codecs for 5G", DASH-IF Workshop on "Media Streaming meets 5G", December 2019, accessible here: https://dashif.org/docs/workshop-2019/04-thierry%20fautier%20-%20Harmonic%20Codec%20Comparison%205G%20Media%20Workshop_Final%20v3.pdf
[12]
Bitmovin Video Developer Report, accessible here: https://go.bitmovin.com/video-developer-report-2019, September 2019.
[13]
TS 26.511: "5G Media Streaming (5GMS); Profiles, codecs and formats".
[14]
Recommendation ITU-R BT.709-6 (06/2015): "Parameter values for the HDTV standards for production and international programme exchange".
[15]
Recommendation ITU-R BT.2020-2 (10/2015): "Parameter values for ultra-high definition television systems for production and international programme exchange".
[16]
Recommendation ITU-R BT.2100-1 (06/2017): "Image parameter values for high dynamic range television for use in production and international programme exchange".
[17]
"You can watch Netflix on any screen you want, but you're probably watching it on a TV", https://www.vox.com/2018/3/7/17094610/netflix-70-percent-tv-viewing-statistics
[18]
YouTube Revenue and Usage Statistics (2020), https://www.businessofapps.com/data/youtube-statistics/
[19]
Ultra HD Forum service tracker B2C, https://ultrahdforum.org/uhd-service-tracker/"
[20]
HIS Market "4K-TV and UHD: the whole picture", https://cdn.ihs.com/www/pdf/4ktv-uhd-ebook.pdf
[21]
A. Mercat, M. Viitanen, and J. Vanne, "UVG dataset: 50/120fps 4K sequences for video codec analysis and development," Accepted to ACM Multimedia Syst. Conf., Istanbul, Turkey, June 2020.
[21b]
R. Jullian, Y. Chen, F. Galpin, E. François, M. Kerdranvat (InterDigital), "Extra results to JVET-N605 "Comparative study of video coding solutions VVC, AV1 and EVC versus HEVC"", document JVET-O0898, 15th Meeting: Gothenburg, SE, 3-12 July 2019.
[22]
R. Jullian, Y. Chen, F. Galpin, E. François, M. Kerdranvat (InterDigital), "Comparative study of video coding solutions VVC, AV1 and EVC versus HEVC", document JVET-N0605, 14th Meeting: Geneva, CH, 19-27 March 2019.
[23]
S. Iwamura, S. Nemoto, A. Ichigaya, "[AHG13] Compression performance analysis for 4K and 8K HLG test sequences", document JVET-N0828, 14th Meeting: Geneva, CH, 19-27 March 2019.
[24]
A. Segall, E. François, W. Husak, S. Iwamura, D. Rusanovskyy, "JVET common test conditions and evaluation procedures for HDR/WCG video," document JVET-P2011, 16th JVET meeting: Geneva, CH, 1-11 Oct. 2019.
[25]
Nick Zarzycki, "The Complete Guide to Social Media Video Specs in 2018", July 23, 2018, https://blog.hootsuite.com/social-media-video-specs/
[26]
YouTube Help, "Recommended upload encoding settings", https://support.google.com/youtube/answer/1722171?hl=en
[27]
Facebook Help Center, "What are the video format guidelines for live streaming on Facebook?", https://www.facebook.com/help/1534561009906955
[28]
Deepak Kumar, "All about TikTok video size [ Full Guide]-2020", February 2020, https://tiktoktip.com/tiktok-size/
[29]
Snapchat business center, "Single Image or Video Specifications", https://businesshelp.snapchat.com/en-US/article/top-snap-specs
[30]
ISO/IEC 23000-19: "Information Technology Multimedia Application Format (MPEG-A) - Part 19: Common Media Application Format (CMAF) for segmented media".
[31]
GSMA White Paper, "Chinese operators make major RCS commitment: Whitepaper", April 9, 2020, https://www.gsma.com/futurenetworks/latest-news/china-operators-make-major-rcs-commitment-whitepaper/
[32]
TS 26.140: "Multimedia Messaging Service (MMS); Media formats and codecs".
[33]
GSMA RCC.71, "RCS Universal Profile Service Definition Document", version 2.4, October 2019.
[34]
GSMA NG.114, "IMS Profile for Voice, Video and Messaging over 5GS", February 2020.
[35]
TS 26.223: "Telepresence using the IP Multimedia Subsystem (IMS); Media handling and interaction"
[36]
[37]
Microsoft Online Documentation, "Real-time media calls and meetings with Microsoft Teams", https://docs.microsoft.com/en-us/microsoftteams/platform/bots/calls-and-meetings/real-time-media-concepts
[38]
Recommendation ITU-T H.266 (07/2020): "Versatile Video Coding" | ISO/IEC 23090-3:2020: "Information technology - Coded representation of immersive media - Part 3: Versatile video coding".
[39]
Recommendation ITU-T H.274 (07/2020): "Versatile supplemental enhancement information for coded video bitstreams" | ISO/IEC 23002-7:2020 "Information technology - MPEG video technologies - Part 7: Supplemental enhancement information messages for coded video bitstreams".
[40]
JCTVC-AA1006, "Verification test report for HEVC screen content coding extensions" V. Baroncini, H. Yu, R. Joshi, S. Liu, X. Xiu, J. Xu (editors)- 2017-09-08
[41]
[42]
N. Barman, S. Zadtootaghaj, S. Schmidt, M. G. Martini and S. Möller, "GamingVideoSET: A Dataset for Gaming Video Streaming Applications," 2018 16th Annual Workshop on Network and Systems Support for Games (NetGames), Amsterdam, Netherlands, 2018, pp. 1-6. DOI: 10.1109/NetGames.2018.8463362
[43]
N. Barman, S. Schmidt, S. Zadtootaghaj, M. G. Martini, and S. Möller. 2018. An Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming. In Proceedings of the 23rd Packet Video Workshop (PV '18). ACM, Amsterdam, Netherlands, 2018, pp. 7-12. DOI: https://doi.org/10.1145/3210424.3210434
[44]
Technical Paper ITU-T HSTP-VID-WPOM (07/2020): "Working practices using objective metrics for evaluation of video coding efficiency experiments".
[45]
TR 26.902: "Video codec performance".
[46]
TS 26.244: "Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP)"
[47]
ISO/IEC 23001-17, "Information technology - MPEG systems technologies - Part 17: Carriage of Uncompressed Video in ISOBMFF"
[48]
Recommendation ITU-T P.910 (04/2008): "Subjective video quality assessment methods for multimedia applications".
[49]
[50]
ISO/IEC 23094-1, "Information technology - General video coding - Part 1: Essential video coding"
[51]
ISO/IEC 23094-4, " Information technology - General video coding - Part 4: Conformance and Reference software for Essential Video Coding".
[52]
ISO/IEC JTC 1/SC 29/WG 04 output document N0047, "Report on Essential Video Coding compression performance verification testing for SDR Content", Online meeting, Jan. 2021. http://www.mpegstandards.org/wp-content/uploads/mpeg_meetings/133_OnLine/w20000.zip.
[53]
ISO/IEC JTC 1/SC 29/WG 04 output document N0030, "Report on Essential Video Coding compression performance verification testing for HDR/WCG content", Online meeting, Oct. 2020. https://www.mpegstandards.org/wp-content/uploads/mpeg_meetings/132_OnLine/w19832.zip.
[54]
Z. Wang, E. P. Simoncelli, A. C. Bovik, "Multiscale structural similarity for image quality assessment" in the Proceedings of the Thirty-Seventh Asilomar Conference on Signals, Systems and Computers, Vol. 2, pp. 1398-1402, 2004.
[55]
Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity", IEEE Transactions on Image Processing, Vol. 13, No. 4, pp. 600-612, April 2004
[56]
Netflix, "VMAF - Video Multi-Method Assessment Fusion," version 1.3.5, repository, Aug. 2020. https://github.com/Netflix/vmaf/tags
[57]
F. Bossen, J. Boyce, X. Li, V. Seregin, K. Sühring, "JVET common test conditions and software reference configurations for SDR video", Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 document JVET-M1010, 13th JVET meeting, Marrakech, Morocco, January 9-18 2019.
[58]
A. Segall, E. François, W. Husak, S. Iwamura, D. Rusanovskyy, "JVET common test conditions and evaluation procedures for HDR/WCG video," Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 document JVET-P2011, 16th JVET meeting, Geneva, Switzerland, Oct. 2019.
[59]
[60]
RFC 4180:  Common Format and MIME Type for CSV Files
[61]
JVET-T2020: "VVC Verification Test Report for Ultra High Definition (UHD) Standard Dynamic Range (SDR) Video Content", Mathias Wien, Vottorio Baroncini, Output document, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 20th Meeting, by teleconference, 7 - 16 Oct. 2020.
[62]
Fraunhofer HHI, "Fraunhofer Versatile Video Encoder (VVenC)," version 0.1.0 (initial release), https://github.com/fraunhoferhhi/vvenc/tags, online, accessed Oct. 2020.
[63]
JVET-T0103:" Information on and analysis of the VVC encoders in the SDR UHD verification test", Christian Helmrich, Benjamin Bross et al, Input document, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 20th Meeting, by teleconference, 7 - 16 Oct. 2020.
[64]
Recommendation ITU-T P.910 (2008), Subjective video quality assessment methods for multimedia applications.
[65]
JCTVC-Q1011: "Report on HEVC compression performance verification testing", T. K. Tan, et al, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Valencia, Spain, April 2014.
[66]
JCTVC-P1011: [1] "HEVC verification test plan", T. K. Tan, et al, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, San Jose, CA, January 2014.
[67]
[68]
AV1 Bitstream & Decoding Process Specification, Alliance for Open Media, Jan. 18, 2019, https://aomediacodec.github.io/av1-spec/av1-spec.pdf" https://aomediacodec.github.io/av1-spec/av1-spec.pdf
[69]
AV1 Codec Software Library, Alliance for Open Media, https://aomedia.googlesource.com/aom/
[70]
draft-ietf-netvc-testing-07:  Video Codec Testing and Quality Measurement, https://datatracker.ietf.org/doc/html/draft-ietf-netvc-testing-09, January 31, 2020
[71]
JVET-W2020: "VVC verification test report for high dynamic range video content", Mathias Wien, Vittorio Baroncini, Output document, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 23rd Meeting, by teleconference, 7-16 July 2021.
[72]
JVET-V2020: "VVC verification test report for HD SDR and 360° video content", Mathias Wien, Vittorio Baroncini, Output document, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, by teleconference, 20 - 28 Apr. 2021.
[73]
Alliance for Open Media Output document, "Tool Description for AV1 and libaom", October 4, 2021, accessible at https://aomedia.org/docs/AV1_ToolDescription_v11-clean.pdf
[74]
Alliance for Open Media Output document, "aomenc - Command Line Parameters", August 3, 2021, accessible at https://aomedia.org/docs/aomenc-command-line-parameters-draft.pdf
Up

3  Definitions of terms, symbols and abbreviationsp. 20

3.1  Termsp. 20

For the purposes of the present document, the terms given in TR 21.905 and the following apply. A term defined in the present document takes precedence over the definition of the same term, if any, in TR 21.905.
3GPP codec:
a video codec defined in a 3GPP specification.
Anchor:
combination of a reference sequence, a reference software of 3GPP codec and codec configuration to provide a baseline for codec testing and characterization.
Anchor Bitstream:
a bitstream resulting from the encoding of a reference sequence with a reference software and a codec configuration assigned to an anchor.
Anchor Tuple:
several anchors that differentiate only by one parameter in the codec configuration to change the bitrate/quality.
BD-Rate Gain:
a measure of the bitrate reduction in percentage offered by a codec or codec feature under test compared to an anchor coded, while maintaining the same quality as measured by objective metrics.
Characterization:
comparison of a codec under test with a 3GPP codec based on selected metrics.
Metric:
A single number to provide a measurable quality of an anchor.
Test:
combination of tools to test a codec for comparison with anchor, i.e. same reference sequence and comparable codec configuration.
Test Bitstream:
a bitstream resulting from the encoding of a reference sequence with a reference software and a codec configuration assigned to a test.
Test Tuple:
several tests that differentiate only by one parameter in the codec configuration to change the bitrate/quality.
Up

3.2  Symbolsp. 21

For the purposes of the present document, the following symbols apply:
MSE_Y
Mean Square Error of the luma component
PSNRy
Peak-Signal to Noise Ratio of the luma component
PSNRu
Peak-Signal to Noise Ratio of the chroma u component
PSNRv
Peak-Signal to Noise Ratio of the chroma v component
PSNRyuv
Average PSNR over all colour components
MS_SSIM
Multi-Scale Structural Similarity Index Metric

3.3  Abbreviationsp. 21

For the purposes of the present document, the abbreviations given in TR 21.905 and the following apply. An abbreviation defined in the present document takes precedence over the definition of the same abbreviation, if any, in TR 21.905.
AAC
Advanced Audio Coding
AAP
Alternative Approval Process
ABR
Adaptive BitRate
AOM
Alliance for Open Media
AOV
Arena Of Valor
ATSC
Advanced Television Systems Committee
AV1
AOMedia Video 1
AVC
Advanced Video Coding
AVCHD
AVC High Definition
AVI
Audio Video Interleave
BD
Bjöntegard-Delta
BDR
BD Rate
BMFF
Based Media File Format
CABAC
Context-Adaptive Binary Arithmetic Coding
CAE
Content Aware Encoding
CBP
Constrained Baseline Profile
CBR
Constant BitRate
CGI
Computed Generated Imaginary
CHP
Constrained High Profile
CMAF
Common Media Application Format
CRA
Clean Random Access
CSV
Comma-Separated Values
CTC
Common Test Conditions
CTU
Coding Tree Unit
DASH
Dynamic Adaptive Streaming over HTTP
DVB
Digital Video Broadcasting
EBU
European Broadcast Union
EFS
Effective File Size
EPZS
Enhanced Predictive Zonal Search
ERP
Equi-Rectangular Projection
EVC
Essential Video Coding
EXR
EXtended Range
FHD
Full HD (i.e. 1080p)
FPS
Frames Per Second
GOP
Group-Of-Pictures
HDMI
High-Definition Multimedia Interface
HDR
High Dynamic Range
HDTV
High Definition TeleVision
HEVC
High-Efficiency Video Coding
HFR
High Frame Rate
HLG
Hybrid Log-Gamma
HLS
HTTP Live Streaming
HMD
Head-Mounted Display
HRD
Hypothetical Reference Decoder
HTML
HyperText Markup Language
HTTP
HyperText Transfer Protocol
IDR
Instantaneous Decoder Refresh
JCT-VC
Joint Collaborative Team on Video Coding
JSON
JavaScript Object Notation
JVET
Joint Video Experts Team
MCTF
Motion-Compensated Temporal Filtering
MIME
Multipurpose Internet Mail Extensions
MKV
MatrosKa Video
MMO
Massive Multiplayer Online
MMORPG
MMO Role-Playing Game
MMS
Multimedia Messaging Service
MOBA
Multiplayer Online Battle Arena
MOS
Mean Opinion Score
MPD
Media Presentation Description
MPEG
Moving Pictures Expert Group
MS-SSIM
Multi-Scale Structural Similarity Index
MSE
Mean Square Error
MTSI
Multimedia Telephony Service over IMS
OBS
Open Broadcaster Software
PSNR
Peak Signal to Noise Ratio
RA
Random Access
RAP
Random Access Point
RCS
Rich Communication Services
RDPCM
Residual Differential Pulse Code Modulation
RGB
Red Green Blue
RPG
Role-Playing Game
RTMP
Real-Time Messaging Protocol
RTP
Realtime Transport Protocol
RTS
RealTime Strategy
SCC
Screen Content Coding
SCM
Screen Content coding Model
SDK
Software Development Kit
SDR
Standard Definition Range
SEI
Supplemental Enhancement Information
SI
Spatial perceptual Information
SSIM
Structural Similarity Index Measure
SVOD
Subscription Video On Demand
TI
Temporal perceptual Information
TIFF
Tagged Image File Format
UDP
User Datagram Protocol
UHD
Ultra High Definition
URI
Uniform Resource Identifier
URL
Uniform Resource Locator
UVG
Ultra Video Group
VBR
Variable BitRate
VBS
Visual Basic Script
VCL
Video Coding Layer
VMAF
Video Multimethod Assessment Fusion
VSEI
Versatile Supplemental Enhancement Information
VTM
VVC Test Model
VVC
Versatile Video Coding
WCG
Wide Colour Gamut
Up

Up   Top   ToC