This is made possible using:
Raw sports tracking data provided by Sony sport partner company
Cloud architectures for handling large volumes of tracking data in real time
Custom engine that merges these multiple data streams into a unified, production‑ready format that can power 3D simulationsÂ
Unity Enine to interpret the data and build the 3D simulation around that
Oculus XR Plugin, XR Plugin Management and Mock HMD Unity Engine packages for the virtual commentators implementation
Beyond Sports transforms raw sports tracking data into fully immersive, animated worlds broadcast in real time, bringing every game to life in thrilling new ways.
They work with leagues, broadcasters, clubs, and media platforms to turn live player and ball movement into interactive 3D simulations, leveraging Disney and Warner Bros IP to create themed animated broadcasts, adding characters and worlds that make each game visually spectacular.
The most innovative feature is the virtual commentator avatars, which take immersive sports broadcasting to the next level. Using full-body and upper-body tracking, real announcers appear inside the animated game world, moving naturally, gesturing, and reacting in real time.
This allows commentators to walk alongside players, analyze plays as they happen, and interact with virtual elements, creating a broadcast experience where viewers feel like the commentators are right there in the action with the athletes.