Content for TR 26.865 Word version: 18.0.0
4.1.3.2 Scenario 2 - Local Decoding and Pre-Rendering on 5G UE, Post-Rendering on End Device (ISAR on 5G UE)
4.1.3.2.1 General
4.1.3.2.2 Variation A - Pose Estimation, Post-Rendering and audio playback on End Device
4.1.3.2.3 Variation B - Pose Estimation and Post-Rendering on End Device, audio playback on TWS Earbuds/Headphones
4.1.3.2.4 Variation C - Pose Estimation, Post-Rendering and audio playback on TWS Earbuds/Headphones
...
...
4.1.3.2 Scenario 2 - Local Decoding and Pre-Rendering on 5G UE, Post-Rendering on End Device (ISAR on 5G UE) p. 9
4.1.3.2.1 General p. 9
This scenario is as follows in Figure 4.1-6, referring to a type of "5G WireLess Tethered AR UE" in TR 26.998, with the main characteristic that the binaural rendering process is shared between the 5G UE and the End Device (e.g. type 1 or 2). The 5G UE connects to Cloud/Edge through an embedded 5G modem, the 5G UE and End Device connect through WiFi or 5G sidelink, maybe through Bluetooth for audio. End Device send(s) Pose Information to 5G UE if needed. The 5G UE and the End Device provide the capabilities of decoding and head-tracked rendering (including pose compensation) together. More specifically, the 5G UE performs immersive audio decoding, pre-rendering, and re-encoding for transmission to the End Device. The re-encoding may be using an intermediate ISAR format supporting head-tracked binaural post-rendering. The End Device features a decoder, post-renderer and a pose estimator.
Figure 4.1-6: 5G UE-dependent End Device with decoding and post-rendering capabilities (see note in clause 0)
(⇒ copy of original 3GPP image)
(⇒ copy of original 3GPP image)
4.1.3.2.2 Variation A - Pose Estimation, Post-Rendering and audio playback on End Device p. 10
In Variation A, as depicted in Figure 4.1-7, the End Device features an ISAR decoder and post-renderer, built-in loudspeakers for binaural audio playback, and a pose estimator.
Figure 4.1-7: 5G UE-dependent End Device with decoding and post-rendering capabilities and built-in loudspeakers
(⇒ copy of original 3GPP image)
(⇒ copy of original 3GPP image)
4.1.3.2.3 Variation B - Pose Estimation and Post-Rendering on End Device, audio playback on TWS Earbuds/Headphones p. 10
In Variation B, as depicted in Figure 4.1-8, a pair of TWS Earbuds/Headphones is used to playback the binaural audio instead of the built-in speakers used in Variation A. The End Device still performs the pose estimation function but otherwise does not carry out any audio processing except for possibly passing it through to the earbuds/headphones. The pose information is sent both to the 5G UE where it may be used during pre-rendering and the earbuds/headphones where it may be used during the post-rendering processing. Variation B is expected to be more prevalent than Variation C described below due to possibly better pose estimation capability by the End Device.
Figure 4.1-8: 5G UE-dependent End Device with Pose Estimator and with connected TWS Earbuds/Headphones
(⇒ copy of original 3GPP image)
(⇒ copy of original 3GPP image)
4.1.3.2.4 Variation C - Pose Estimation, Post-Rendering and audio playback on TWS Earbuds/Headphones p. 10
In Variation C, as depicted in Figure 4.1-9, TWS Earbuds/Headphones perform ISAR decoding and head-tracked binaural post-rendering of audio and playback binaural audio. In addition, they perform pose estimation and provide pose information to the End Device or directly to the 5G UE. The End Device may be used to relay both pose information and codec audio between TWS Earbuds/Headphones and the 5G UE.
Figure 4.1-9: 5G UE-dependent End Device with connected TWS Earbuds/Headphones featuring Pose Estimator
(⇒ copy of original 3GPP image)
(⇒ copy of original 3GPP image)
