Deutsche Telekom, Orange, Telefónica and Vodafone and deep tech Matsuko are developing an easy-to-use platform for immersive 3D experiences that combine virtuality and reality.
The metaverse brings a new dimension to the future of connectivity, with exciting new experiences to interact with friends and family, or businesses connecting with their stakeholders. The proof of concept below drastically moves holographic communications from science fiction to real smartphones. Through this unique multi-operator collaboration, operators want to prepare their infrastructure to provide open, interoperable, and easy-to-use holographic communications.
Calling as if the person I’m talking to is standing in front of me now feels closer to reality.
Startup Matsuko, together with 3 mobile operators Deutsche Telekom, Orange, Telefónica and Vodafone, ran a pilot project to make holographic calling as easy and simple as calling by connecting their implementations so that their customers could participate in a session of common holographic calling. communication. This is made possible by advances in 5G connectivity and advanced computing technology offered by telecom operators, enabling smooth and natural movement of holograms, opening up a range of possible usage scenarios. Holograms are created using a smartphone’s selfie camera to capture and transmit a real-time three-dimensional holographic image of a person.
They had launched a hologram during the Tour de France that allowed Christian Prudhomme to address the fans in augmented reality, allowing them to appear in 3D on the fans’ augmented reality glasses with a 3D map of the race and information buttons for each step. Matsuko’s solution is not an animated avatar, but a fully expressive hologram. Using mixed and augmented reality and artificial intelligence, the startup creates 3D holograms for distance communication between people. This eliminates the problems often encountered with video calls: lack of nonverbal cues, lack of engagement, and lack of sentiment. Founded in 2017, the startup is building a full-featured software solution with a conversation-starting app that can model people in three dimensions and transfer them to real-world space and in real-time. What makes it unique is the use of a unique camera that can be found in smartphones or computers.
Holographic communication, a fully immersive three-dimensional experience with spatial awareness is available, but there are barriers to greater adoption. It is extremely data intensive, so new processing techniques, especially in the network, are needed to enable more mainstream solutions.
Mobile operators are also developing a platform that combines the real and virtual worlds over a cellular connection, using a smartphone camera to generate 2D video which is then converted into 3D holograms in the cloud to be streamed to viewers in an AR screen. surroundings. MR with clarity and sharpness never before possible. Parties are also currently exploring the potential of a broadcast, making it possible to virtually hold entire events or presentations with stunning realism, including conversations with two people!
Matsuko’s platform ensures that the end result offers better color and texture resolutions, increasing realism when viewed on a smartphone or other mobile device and without the need for a video headset, enhancing the immersive experience. Artificial intelligence enhancements and new or improved capabilities will enable networks to adapt based on user behavior and routines, while anticipating what will be required of the network to improve overall network quality and reliability .
Ericsson also deals with holographic conversations, with a one-millisecond latency, the time between a 5G action response, the ability to distinguish hard objects from soft objects (haptic skills) and to imitate your movements and your resistance through remote robots (kinesthetic abilities) are improving at an incredible rate. By 2030, this will be expanded further so that every human sense is digitally transformed to enable fully immersive experiences. The ability to virtually teleport yourself to a distant location will blur what you can experience in the virtual and physical world on the way…