Tech-invite3GPPspaceIETFspace
21222324252627282931323334353637384‑5x

Content for  TR 26.865  Word version:  18.0.0

Top   Top   Up   Prev   Next
0…   4…   4.1.3.2…   4.1.3.3…   4.1.3.4…   4.1.3.5…   4.2…   5…   6…   7…   8…

 

4.1.3.3  Scenario 3 - Decoding and Pre-Rendering on Cloud/Edge, 5G UE as a pass-through device (ISAR in Edge/Cloud)p. 11

4.1.3.3.1  Generalp. 11
This scenario is as follows in Figure 4.1-10, referring to a type of "5G EDGe-Dependent AR (EDGAR) UE" in TR 26.998, with the main characteristic that the binaural rendering process is shared between the Cloud/Edge and the End Device (e.g. type 1 or 2). The 5G UE connects to Cloud/Edge through an embedded 5G modem, the 5G UE and End Device connect through WiFi or 5G sidelink, maybe through Bluetooth for audio. End Device sends Pose Information to Cloud/Edge if needed, and the Cloud/Edge and End Device provide the capabilities of decoding and rendering together. The 5G UE just acts as a relay device. More specifically, immersive audio decoding, pre-rendering, and re-encoding is performed in Cloud/Edge. The re-encoding may be using an intermediate ISAR format supporting head-tracked binaural post-rendering. The End Device features a decoder, post-renderer and a pose estimator. Motion to sound latency can at least be partially compensated, since the End Device can provide pose correction and head-tracked binaural rendering (ISAR Decoder&Post-Renderer).
Copy of original 3GPP image for 3GPP TS 26.865, Fig. 4.1-10: 5G Cloud/Edge dependent End Device with decoding and post-rendering capabilities (see note in clause 0)
Up
4.1.3.3.2  Variation A - Pose Estimation, Post-Rendering and audio playback on End Devicep. 11
In Variation A, as depicted in Figure 4.1-11, the End Device feature an ISAR decoder and post-renderer, built-in loudspeakers for binaural audio playback, and a pose estimator.
Copy of original 3GPP image for 3GPP TS 26.865, Fig. 4.1-11: 5G Cloud/Edge dependent End Device with decoding and post-rendering capabilities and built-in loudspeakers
Up
4.1.3.3.3  Variation B - Pose Estimation and Post-Rendering on End Device, audio playback on TWS Earbuds/Headphonesp. 12
In Variation B, as depicted in Figure 4.1-12, a pair of TWS Earbuds/Headphones is used to playback the binaural audio instead of the built-in speakers used in Variation A. The End Device performs pose estimation, ISAR decoding and head-tracked binaural post-rendering followed by stereo re-encoding the binaural audio signal. The pose information is sent to the 5G UE where it is relayed to the Cloud/Edge. The TWS Earbuds/Headphones decode the binaural audio signal and perform audio playback. Variation B is expected to be more prevalent than Variation C described below due to possibly better pose estimation capability by the End Device.
Copy of original 3GPP image for 3GPP TS 26.865, Fig. 4.1-12: 5G UE-dependent End Device with Pose Estimator, ISAR decoder & post-renderer and stereo re-encoder, with connected TWS Earbuds/Headphones
Up
4.1.3.3.4  Variation B.1 - Pose Estimation on End Device, audio decoding and head-tracked rendering (ISAR) and audio playback on TWS Earbuds/Headphonesp. 12
Variation B.1, as depicted in Figure 4.1-13, is like Variation B, except that the TWS Earbuds/Headphones are ISAR Decoder capable. The End Device relays the coded audio (ISAR format) from the 5G UE to the TWS Earbuds/Headphones and provide pose information to the TWS Earbuds/Headphones. Alternatively, the 5G UE can pass the coded audio directly to the TWS Earbuds/Headphones.
Copy of original 3GPP image for 3GPP TS 26.865, Fig. 4.1-13: 5G UE-dependent End Device with Pose Estimator, ISAR decoder & post-renderer and stereo re-encoder, with connected TWS Earbuds/Headphones
Up
4.1.3.3.5  Variation C - Pose Estimation, Post-Rendering and audio playback on TWS Earbuds/Headphonesp. 12
In Variation C, as depicted in Figure 4.1-14, TWS Earbuds/Headphones perform ISAR decoding and head-tracked binaural post-rendering of audio and playback binaural audio. In addition, they perform pose estimation and provide pose information to the End Device or directly to the 5G UE. The End Device and the 5G UE may be used to relay pose information and coded audio between TWS Earbuds/Headphones and the 5G Cloud/Edge.
Copy of original 3GPP image for 3GPP TS 26.865, Fig. 4.1-14: 5G UE-dependent End Device with connected TWS Earbuds/Headphones featuring Pose Estimator
Up

Up   Top   ToC