Content for TR 26.952 Word version: 18.0.0
5 Terms of Reference
6 Selection Process
7 Introduction to the Testing of the EVS codec
8 Important Notes about the Interpretation of Test Results
9 EVS Performance in Narrowband
10 EVS Performance in Wideband
11 EVS Performance in Super-Wideband
12 Mixed Bandwidth and Fullband Tests in Characterization
13 Objective Evaluations
14 Characterization Results of the Alternative Fixed-Point Implementation of EVS
A ToR Tests in Selection Phase
B Overall Characterization of the EVS Codec
C EVS Permanent Documents in 3GPP FTP-site
D Attachments
$ Change history
5 Terms of Reference p. 11
6 Selection Process p. 12
7 Introduction to the Testing of the EVS codec p. 13
7.0 General methodology p. 13
7.1 EVS Selection Phase Testing p. 13
7.2 EVS Characterization Phase Testing p. 16
8 Important Notes about the Interpretation of Test Results p. 16
9 EVS Performance in Narrowband p. 17
9.1 NB Selection Tests p. 17
9.1.1 Experiment N1 p. 18
9.1.2 Experiment N2 p. 19
9.1.3 Experiment N3 p. 21
9.1.4 Experiment N4 p. 21
9.2 NB Characterization Tests p. 23
9.2.0 List of experiments in the narrowband telephone bandwidth p. 23
9.2.1 Experiment N1 p. 23
9.2.2 Experiment N2 p. 25
9.2.3 Experiment N3 p. 25
9.2.4 Experiment N4 p. 27
9.3 Conclusions on EVS Performance in Narrowband p. 28
10 EVS Performance in Wideband p. 28
10.1 WB Selection Tests p. 28
10.1.1 Experiment W1 p. 29
10.1.2 Experiment W2 p. 30
10.1.3 Experiment W3 p. 31
10.1.4 Experiment W4 p. 31
10.1.5 Experiment W5 p. 32
10.1.6 Experiment W6 p. 32
10.1.7 Experiment W7 p. 33
10.1.8 Experiment I1 p. 34
10.1.9 Experiment I2 p. 34
10.1.10 Experiment I3 p. 35
10.1.11 Experiment I4 p. 36
10.1.12 Experiment I5 p. 36
10.1.13 Experiment I6 p. 37
10.2 WB Characterization Tests p. 38
10.2.0 List of experiments in the wideband frequency bandwidth p. 38
10.2.1 Experiment W1 p. 38
10.2.2 Experiment W2 p. 39
10.2.3 Experiment W3 p. 41
10.2.4 Experiment W4 p. 43
10.2.5 Experiment W5 p. 44
10.3 Conclusions on EVS Performance in Wideband p. 46
11 EVS Performance in Super-Wideband p. 47
11.1 SWB Selection Tests p. 47
11.1.1 Experiment S1 p. 47
11.1.2 Experiment S2 p. 48
11.1.3 Experiment S3 p. 49
11.1.4 Experiment S4 p. 50
11.1.5 Experiment S5 p. 51
11.1.6 Experiment S6 p. 52
11.1.7 Experiment S7 p. 53
11.2 SWB Characterization Tests p. 54
11.2.0 List of experiments in the super-wideband frequency bandwidth p. 54
11.2.1 Experiment S1 p. 55
11.2.2 Experiment S2 p. 55
11.2.3 Experiment S3 p. 57
11.2.4 Experiment S1_Noisy p. 58
11.3 Conclusions on EVS Performance in Super-Wideband p. 59
12 Mixed Bandwidth and Fullband Tests in Characterization p. 59
12.1 Mixed Bandwidth Tests p. 59
12.2 Fullband Tests p. 64
13 Objective Evaluations p. 66
13.1 Selection Phase p. 66
13.1.1 Objective Measurements p. 66
13.1.2 Verification of Codec Performance with respect to Acoustic Test Cases based on the EVS Selection Phase Executable p. 67
13.1.2.1 Evaluation Setup p. 67
13.1.2.2 General p. 68
13.1.2.3 EVS-Mode: Narrowband (NB) -- Frequency Response with Real Speech p. 69
13.1.2.4 EVS-Mode: Wideband (WB) - Frequency Response with Real Speech p. 69
13.1.2.5 EVS-Mode: Super-Wideband (SWB) - Frequency Response with Real Speech p. 70
13.1.2.6 Conclusions p. 71
13.2 Complexity and Delay Analysis p. 71
13.3 EVS JBM Objective Performance Evaluation in Channel Aware Mode p. 73
13.4 Frequency Response p. 75
13.4.1 Evaluation of Codec Performance with respect to Acoustic Test Cases based on EVS v.12.1.0 [7] p. 75
13.4.1.1 Evaluation Setup p. 75
13.4.1.2 General p. 75
13.4.1.3 EVS-Mode: Narrowband (NB) - Frequency Response with Real Speech p. 76
13.4.1.4 EVS-Mode: Wideband (WB) - Frequency Response with Real Speech p. 77
13.4.1.5 EVS-Mode: Super-Wideband (SWB) - Frequency Response with Real Speech p. 79
13.4.1.6 EVS-Mode: Fullband (FB) - Frequency Response with Real Speech p. 80
13.4.1.7 Conclusions p. 81
13.5 Further Evaluations p. 81
13.6 Conclusions on Objective Evaluations p. 81
14 Characterization Results of the Alternative Fixed-Point Implementation of EVS p. 82
A ToR Tests in Selection Phase p. 84
A.1 ToR Tests for Requirements p. 84
A.2 ToR Tests for Objectives p. 87
A.3 ToR Tests by Sets p. 88
A.4 Comparison of Listening Labs p. 89
B Overall Characterization of the EVS Codec p. 91
C EVS Permanent Documents in 3GPP FTP-site p. 92
D Attachments p. 93
$ Change history p. 94
