Tech-invite 3GPPspace IETFspace

21 22 23 24 25 26 27 28 29 31 32 33 34 35 36 37 38 4‑5x

Content for TR 26.955 Word version: 18.0.0

0… 4… 5… 6… 7… 8… A…

A Scenario Template p. 207

A.1 Introduction p. 207

A.2 Template p. 207

B Data Formats and Metrics p. 210

B.1 Introduction p. 210

B.2 Raw Video Sequences p. 210

B.2.1 Overview p. 210

B.2.2 JSON Schema p. 211

B.2.3 Example p. 215

B.3 Encoded Video Sequences p. 215

B.3.1 Overview p. 215

B.3.2 JSON Schema p. 216

B.3.3 Example p. 216

B.4 Verification p. 217

B.4.1 Overview p. 217

B.4.2 JSON Schema p. 217

B.4.3 Example p. 217

B.4.4 Cross-check Report p. 218

C Reference Sequences p. 220

C.1 Introduction p. 220

C.2 Gaming Test Sequences p. 220

C.2.1 Overview p. 220

C.2.2 AOV p. 221

C.2.2.1 Introduction p. 221

C.2.2.2 Sequence properties p. 222

C.2.2.3 Copyright and license information p. 222

C.2.3 Baolei-Man p. 222

C.2.3.1 Introduction p. 222

C.2.3.2 Sequence properties p. 223

C.2.3.3 Copyright and license information p. 223

C.2.4 Baolei-Woman p. 223

C.2.4.1 Introduction p. 223

C.2.4.2 Sequence properties p. 224

C.2.4.3 Copyright and license information p. 224

C.2.5 Baolei-Balloon p. 224

C.2.5.1 Introduction p. 224

C.2.5.2 Sequence properties p. 225

C.2.5.3 Copyright and license information p. 225

C.2.6 Baolei-Yard p. 225

C.2.6.1 Introduction p. 225

C.2.6.2 Sequence properties p. 226

C.2.6.3 Copyright and license information p. 226

C.2.7 Jianling-Temple p. 226

C.2.7.1 Introduction p. 226

C.2.7.2 Sequence properties p. 227

C.2.7.3 Copyright and license information p. 227

C.2.8 Jianling-Beach p. 227

C.2.8.1 Introduction p. 227

C.2.8.2 Sequence properties p. 228

C.2.8.3 Copyright and license information p. 228

C.2.9 Heroes of the Storm p. 228

C.2.9.1 Introduction p. 228

C.2.9.2 Sequence properties p. 229

C.2.9.3 Copyright and license information p. 229

C.2.10 Project CARS p. 229

C.2.10.1 Introduction p. 229

C.2.10.2 Sequence properties p. 230

C.2.10.3 Copyright and license information p. 230

C.2.11 World of WarCraft: WoW p. 230

C.2.11.1 Introduction p. 230

C.2.11.2 Sequence properties p. 231

C.2.11.3 Copyright and license information p. 231

C.2.12 Minecraft p. 231

C.2.12.1 Introduction p. 231

C.2.12.2 Sequence properties p. 232

C.2.12.3 Copyright and license information p. 232

C.2.13 CS:GO p. 232

C.2.13.1 Introduction p. 232

C.2.13.2 Sequence properties p. 233

C.2.13.3 Copyright and license information p. 233

C.2.14 StarCraft p. 233

C.2.14.1 Introduction p. 233

C.2.14.2 Sequence properties p. 234

C.2.14.3 Copyright and license information p. 234

C.3 4K-TV Sequences p. 234

C.3.1 SDR Category p. 234

C.3.1.1 Candidate Test Sequences p. 234

C.3.1.1.1 Introduction p. 234

C.3.1.1.2 Ultra Video Group Sequences p. 235

C.3.1.1.3 JVET Sequences p. 235

C.3.1.1.4 Netflix Sequences p. 235

C.3.1.1.5 EBU Sequences p. 236

C.3.1.1.6 SVT Sequences p. 236

C.3.1.1.7 4ever Sequences p. 236

C.3.1.1.8 CableLabs Sequences p. 237

C.3.1.2 Test Sequence Selection Process p. 238

C.3.1.2.1 Introduction p. 238

C.3.1.2.2 x265 Encoding p. 238

C.3.1.2.3 SI-TI Metrics p. 240

C.3.1.2.4 SDR Sequence Selection p. 242

C.3.1.3 Selected Sequences p. 244

C.3.1.3.1 Brest-Sedof p. 244

C.3.1.3.2 Rain Fruits p. 246

C.3.1.3.3 Park Joy p. 247

C.3.1.3.4 Soccer p. 248

C.3.1.3.5 Tunnel Flag p. 249

C.3.1.3.6 Boat p. 250

C.3.1.3.7 Fountain p. 251

C.3.1.3.8 Riverbank p. 252

C.3.2 HDR Category p. 253

C.3.2.1 HDR Candidate Test Sequences p. 253

C.3.2.1.1 Introduction p. 253

C.3.2.1.2 AOM Sequences p. 253

C.3.2.1.3 CableLabs Sequences p. 254

C.3.2.2 Selected Test Sequences p. 255

C.3.2.2.1 Introduction p. 255

C.3.2.2.2 x265 Encoding p. 255

C.3.2.2.3 SI-TI Metrics p. 258

C.3.2.2.4 Codewords distribution p. 260

C.3.2.2.5 HDR Sequence Selection p. 263

C.3.2.3 Selected Sequences p. 265

C.3.2.3.1 Life Untouched p. 265

C.3.2.3.2 Meridian p. 266

C.3.2.3.3 Sol Levante p. 267

C.3.2.3.4 Cosmos p. 268

C.3.2.3.5 Elevator p. 269

C.3.2.3.6 Sparks p. 270

C.3.2.3.7 Nocturne p. 271

C.3.3 HFR Category p. 272

C.4 HD Test Sequences p. 272

C.4.1 Overview p. 272

C.5 Messaging Sequences p. 273

C.5.1 Overview p. 273

C.5.1.1 Candidate Sequences p. 273

C.5.1.2 x265 encodings p. 273

C.5.2 Powder p. 274

C.5.2.1 Introduction p. 274

C.5.2.2 Sequence properties p. 275

C.5.2.3 Copyright and license information p. 275

C.5.3 Vertical Bees p. 276

C.5.3.1 Introduction p. 276

C.5.3.2 Sequence properties p. 276

C.5.3.3 Copyright and license information p. 277

C.5.4 Vertical Walking p. 277

C.5.4.1 Introduction p. 277

C.5.4.2 Sequence properties p. 277

C.5.4.3 Copyright and license information p. 278

C.5.5 Neon 4K p. 278

C.5.5.1 Introduction p. 278

C.5.5.2 Sequence properties p. 278

C.5.5.3 Copyright and license information p. 279

C.5.6 Skater 4K p. 279

C.5.6.1 Introduction p. 279

C.5.6.2 Sequence properties p. 279

C.5.6.3 Copyright and license information p. 279

C.6 Screen Content Test Sequences p. 280

C.6.1 Overview p. 280

C.6.2 Moving Text 2 p. 280

C.6.2.1 Introduction p. 280

C.6.2.2 Source sequence properties p. 280

C.6.2.3 Copyright information p. 281

C.6.3 Text Mix Transitions p. 281

C.6.3.1 Introduction p. 281

C.6.3.2 Source sequence properties p. 281

C.6.3.3 Copyright information p. 282

C.6.4 Graphics Mix Simple p. 282

C.6.4.1 Introduction p. 282

C.6.4.2 Source sequence properties p. 282

C.6.4.3 Copyright information p. 283

C.6.5 Graphics Mix Transition p. 283

C.6.5.1 Introduction p. 283

C.6.5.2 Source sequence properties p. 283

C.6.5.3 Copyright information p. 284

C.6.6 Mission Control p. 284

C.6.6.1 Introduction p. 284

C.6.6.2 Source sequence properties p. 284

C.6.6.3 Copyright information p. 285

D Data Management and Hosting p. 286

D.1 Introduction p. 286

D.2 Reference Sequences p. 286

D.2.1 Hosting p. 286

D.2.2 Uploading p. 286

D.2.3 Downloading p. 286

D.3 Anchors and Tests p. 287

D.3.1 Hosting p. 287

D.3.2 Uploading p. 288

D.3.3 Downloading p. 288

D.4 Verification p. 288

E Software Package p. 289

E.1 Introduction p. 289

E.2 README: Video codec characterization scripts p. 290

E.2.1 Overview p. 290

E.2.3 installation p. 291

E.2.3.1 cloning p. 291

E.2.3.2 working directory p. 291

E.2.3.3 download content from server p. 291

E.2.4 vcc.py script usage p. 292

E.2.4.1 Overview p. 292

E.2.4.2 processing all QPs of an anchor p. 292

E.2.4.3 processing a single QP for an anchor p. 292

E.2.4.4 process all anchors for a given encoder config p. 292

E.2.4.4.1 general p. 292

E.2.4.4.2 common options p. 292

E.2.4.4.3 encode p. 292

E.2.4.4.4 decode p. 293

E.2.4.4.5 convert p. 293

E.2.4.4.6 metrics p. 293

E.2.4.4.6.1 storage p. 293

E.2.4.4.6.2 image quality metrics p. 293

E.2.4.4.6.3 bitrate / bitstream size p. 294

E.2.4.4.6.4 metrics csv export p. 294

E.2.5 characterization, rd curves plots, bd rate p. 294

E.2.6 using the scripts for metrics verification p. 295

E.2.6.1 General p. 295

E.2.6.2 working directory p. 295

E.2.6.3 download bitstreams for verification p. 295

E.2.6.4 reconstruction and metrics p. 296

E.2.6.4.1 generate reconstruction of bitstreams p. 296

E.2.6.4.2 format conversion before metrics computation p. 296

E.2.6.4.3 compute metrics p. 297

E.2.6.4.4 export metrics from .json to .csv p. 297

E.2.6.5 generate verification report p. 297

E.2.6.5.1 general p. 297

E.2.6.5.2 download the original metrics p. 297

E.2.6.5.3 metrics verification p. 298

E.2.7 docker usage p. 298

E.2.7.1 General p. 298

E.2.7.2 building the docker images p. 298

E.2.7.3 using the worker image p. 298

E.2.7.4 using docker-compose p. 299

F Attachments p. 299

G Non-verified results p. 300

$ Change history p. 301