Emerging Metaverse XR and Video Multimedia Technologies

Improve the video multimedia services you work on or develop using tools from video service technologies such as Netflix, Disney+, YouTube, and Skype. This book introduces you to the core technologies that enable Metaverse XR (eXtended Reality) services and advanced video multimedia streaming services.

First, you’ll find out about the current and future trends in Metaverse and video streaming services. XR is a combination of technologies that include MR, AR, VR, voice recognition systems, haptic and 3D-motion UIs, as well as head mounted displays) like Microsoft Hololens 2 and Oculus Quest 2. You'll review metaverse services XR applications and learn more about the core XR feature extraction technologies.

With XR capabilities mastered, you can move into the main technologies for video streaming services like Netflix, Disney+, and YouTube. You’ll also about video formats, such as H.264, MPEG-4 AVC, H.265, MPEG-5, and MPEG-DASH. As well as online hosting services like content delivery network (CDN), mobile CDN, and Amazon Web Services (AWS). Additional details on content aging and updating operations along with CDN popularity predictions and contents update techniques, such as, Least Recently Used (LRU) and east Frequently Used (LFU) strategies are introduced.

All these technologies enable fast, efficient, reliable, and adaptable video streaming services. They also allow for video conferencing services like Zoom, Skype and WebEx. By the time you’ve finished reading, you’ll understand how these technologies converge into the Metaverse and and offer a wide variety of development opportunities for video streaming.

WHAT YOU'LL LEARN

* Incorporate core AI techniques and extraction XR algorithms


* Enable fast, efficient, and reliable video streaming in your product, service, or app


* Update content with CDN popularity predictions
* Explore the Netflix Open Connect CDN model and characteristics


* Understand the operations of modern video and multimedia systems
* Become a leader in metaverse and video multimedia services and products.



WHO THIS BOOK IS FOR

Developers, product managers, hobbyists, and students interested in learning how Metaverse XR and video streaming work and can be developed.

JONG-MOON CHUNG leads the development of South Korea’s largest Metaverse eXtended Reality (XR) flagship project, which is one of the World’s first XR deep digital twin (DT) based emergency training metaverse systems. Before this, he developed South Korea’s first mixed reality (MR) artificial intelligent (AI) disaster training system, which was awarded two of the highest government national awards in 2019 and 2021. He is an expert on real-time video streaming technologies. He is also an expert on cloud technology and edge computing optimization. In addition, he has developed many advanced Metaverse and XR supportive autonomous driving technologies for Hyundai automobiles and smartphone technologies for Samsung (Galaxy), LG (Optimus, V) and Google (Nexus). He is currently the Vice President of the IEEE Consumer Technology Society (CTSoc) and the IEEE Product Safety Engineering Society (PSES), Senior Editor of the IEEE Transactions on Consumer Electronics, Section Editor of the Wiley ETRI Journal, and former Editor (from 2011 to 2021) of the IEEE Transactions on Vehicular Technology.

CHAPTER 1. INTRODUCTION TO METAVERSE AND VIDEO STREAMING TECHNOLOGY AND SERVICES

Ÿ Metaverse XR (eXtended Reality) Technology Introduction

Ÿ Metaverse XR Products and Business

Ÿ Video Streaming Technology Introduction

Ÿ Video Streaming Services and Business

PART-1: METAVERSE XR TECHNOLOGIES

CHAPTER 2. METAVERSE XR COMPONENTS

Ÿ XR, MR (Mixed Reality), AR (Augmented Reality) & VR (Virtual Reality)

Ÿ XR System Components & Workflow

Ÿ STT (Speech to Text) voice recognition technology

Ÿ Haptic & 3D-Motion UIs (User Interfaces)

Ÿ HMDs (Head Mounted Displays)

Ÿ Unity and Lua Programming Languages

Ÿ XR cloud cooperative computation and offloading

CHAPTER 3. XR FEATURE EXTRACTION TECHNOLOGIES (SIFT, SURF, FAST, BRIEF, ORB, BRISK & AI)

Ÿ XR Feature Detection & Description Technology

Ÿ XR System Processing & Feature Extraction

Ÿ SIFT (Scale Invariant Feature Transform)

Ÿ SURF (Speed-Up Robust Feature)

Ÿ FAST (Features from Accelerated Segment Test)

Ÿ BRIEF (Binary Robust Independent Elementary Features)

Ÿ ORB (Oriented FAST and Rotated BRIEF)

Ÿ BRISK (Binary Robust Invariant Scalable Keypoints)

Ÿ AI (Artificial Intelligence) Technologies

PART-2: VIDEO STREAMING TECHNOLOGIES

CHAPTER 4. NETFLIX, DISNEY+, YOUTUBE, AND SKYPE VIDEO TECHNOLOGIES

Ÿ Netflix

Ÿ Disney+

Ÿ YouTube

Ÿ Skype

Ÿ H.264/MPEG-4 AVC

Ÿ H.265/MPEG-5

Ÿ H.266 Future Standards

Ÿ Futuristic Holography Technologies and Products (WayRay, SeeReal, RealView Imaging)

CHAPTER 5. VIDEO STREAMING AND MPEG-DASH

Ÿ Streaming Video Network Technology

Ÿ Push vs. Pull Media Streaming

Ÿ Video Frames (I, P, B Frames) & GOP (Group of Pictures)

Ÿ HTTP (Hypertext Transfer Protocol)

Ÿ MDP (Multimedia Presentation Description)

Ÿ MPEG-DASH (Moving Picture Experts Group - Dynamic Adaptive Streaming over HTTP)

CHAPTER 6. CDN VIDEO STREAMING TECHNOLOGY

Ÿ CDN (Content Delivery Network) Introduction

Ÿ CDN Market

Ÿ CDN Technologies & Hierarchical Content Delivery & Mobile CDN

Ÿ Disney+ CDN Structure

Ÿ Netflix Open Connect CDN

Ÿ CDN AWS (Amazon Web Services) Cloud Support

CHAPTER 7. EMERGING TECHNOLOGIES

Ÿ What’s Next

Ÿ How to Future Proof Your Efforts

Audience: Intermediate