Tech-
invite
3GPP
space
IETF
space
21
22
23
24
25
26
27
28
29
31
32
33
34
35
36
37
38
4‑5x
Content for
TR 26.843
Word version: 16.0.0
0…
5…
5
Methods Description
5.1
Description
5.2
Signal Based Methods
5.3
Perceptually Based methods
6
Results
6.1
Experiment A
6.2
Experiment B
6.3
Experiment C
6.4
Experiment D
6.5
Experiment E
6.6
Experiment F
7
Conformance Process
8
Interoperability
9
Coverage Assessment
10
Conclusions
A
POLQA Considerations for Conformance Test
$
Change history
5
Methods Description
p. 8
5.1
Description
p. 8
5.2
Signal Based Methods
p. 8
5.2.1
General considerations
p. 8
5.2.2
SNR
p. 9
5.2.2.1
Methodology
p. 9
5.2.2.2
Thresholds and Criteria
p. 9
5.2.3
RMS error threshold
p. 10
5.2.3.1
Methodology
p. 10
5.2.3.2
Thresholds and Criteria
p. 10
5.2.4
Spectral Distortion
p. 10
5.2.4.1
Methodology
p. 10
5.2.4.2
Thresholds and Criteria
p. 11
5.2.5
Analysis Flow and Reporting
p. 11
5.2.6
List of Thresholds
p. 12
5.3
Perceptually Based methods
p. 13
5.3.1
General Consideration
p. 13
5.3.2
MOS-LQO Validation
p. 13
5.3.2.1
General Methodology
p. 13
5.3.2.2
Test Cases
p. 14
5.3.2.3
Scores Reporting and Analysis
p. 14
5.3.2.4
Thresholds and Criteria
p. 15
5.3.3
Maximum Loudness Difference
p. 18
5.3.3.1
General Methodology
p. 18
5.3.3.2
Proposed Encoder Conformance Test
p. 18
6
Results
p. 19
6.1
Experiment A
p. 19
6.1.1
Compiler Options
p. 19
6.1.2
MOS-LQO Results
p. 19
6.2
Experiment B
p. 23
6.2.1
Compiler Options
p. 23
6.2.2
Results
p. 23
6.2.3
Restricted Results
p. 26
6.3
Experiment C
p. 27
6.3.1
Compiler Options
p. 27
6.3.1.1
Introduction
p. 27
6.3.1.2
Icc Compiler on Atom Platform
p. 28
6.3.1.3
Gcc compiler on Xeon platform
p. 28
6.3.1.4
Gcc compiler on ARM platform
p. 28
6.3.2
Decoder Test Results
p. 28
6.3.3
Robustness Decoder Test Results
p. 30
6.4
Experiment D
p. 30
6.4.1
Delta-MOS-LQO Behaviour for Mixed-Music Signals
p. 30
6.4.2
Clean Speech Input Example
p. 32
6.4.3
MOS LQO evaluation
p. 33
6.4.4
Decoder test results
p. 35
6.5
Experiment E
p. 36
6.5.1
Delta-POLQA Limitations with Noisy Speech and Frame Erasures
p. 36
6.5.2
MOS-LQO Verification test
p. 37
6.5.3
Decoder Test
p. 39
6.6
Experiment F
p. 40
7
Conformance Process
p. 42
7.1
Description
p. 42
8
Interoperability
p. 43
8.1
Description
p. 43
8.2
Interoperability Testing
p. 43
8.3
Conclusion
p. 45
9
Coverage Assessment
p. 46
10
Conclusions
p. 46
A
POLQA Considerations for Conformance Test
p. 47
A.1
Specific Recommendation from ITU-T P.863.1 [9]
p. 47
A.2
Averaging of MOS-LQO Scores Over Long Inputs
p. 47
A.3
Concerns over the Suitability of Perceptually Based Methods
p. 48
$
Change history
p. 49