Tetavi brings volumetric recording to music artists

Do you want to know what’s next for the game industry? Join gaming executives to discuss emerging parts of the industry at GamesBeat Summit Next in October. Learn more.


Tetavi brings volumetric video recording technology to Web3 music artists to enable them to create new kinds of virtual music content.

The Los Angeles-based company sees itself at the intersection of technology, entertainment and content creation. And today, it partners with new music artists, developing and creating a virtual stage where artists can produce enhanced music video content, immersive concert experiences, and artist-specific non-fungible tokens (NFTs).

To advertise

Tetavi begins a collaboration with two emerging artists, Riell and Besomorph. It provides them with volumetric recording services meaning it captures their shape and movements and renders them in a way that they are available for artists to wow their audiences with cool visual performances.

Tetavi will create a virtual stage capable of producing immersive music video content and artist-specific non-fungible tokens (NFTs) through Tetavi’s volumetric video platform. Tetavi provides these artists with a one-stop shop for all music video production – from preview and production to content editing and finalization. The artists’ ‘virtual twin’ can be placed digitally in any environment.

Today, fans can access hit singles from RIEL and The Besomorphs, volumetric music videos, and exclusive volumetric NFT drops. In early July, you’ll also be able to see RIELL, Besomorph, and other soon-to-be announced artists in a free virtual experimental volumetric performance of Tetavi on mobile and desktop.

https://www.youtube.com/watch?v=aEeq0AuxD3M

Tetavi’s volumetric video technology is powered by a proprietary algorithm, AI, and machine learning. It enables music creatives to transport themselves into any digital environment, immersing them in the production and experience of today’s music videos, while providing the gateway for the next generation of artists to enter the metaverse and Web3, said Gilad Talmon, CEO from Tetavi, in an interview with GamesBeat.

“We’re really focused on balancing quality, system portability, and usability of templates,” Talmon said. “If you combine these three elements, it will lead the market.”

The musicians are the first to appear in this collaboration.

“Tetavi’s volumetric technology has opened my eyes to what’s possible for the future of musical artists in the Metaverse and Web3,” Bésomorphe said in a report.

Riel added: “This project has been outstanding and I am excited to provide more engaging ways for my fans to connect with me and my music. My fans are everything to me.

Tetavi said his level of volumetric video recording quality would be nearly impossible if it were done through the traditional manufacturing process. From cost, movie time, to localization logistics, Tetavi’s software is more efficient across the board, taking about six weeks in total from creative development to final music video delivery, Talmon said.

Because everything is virtual, Tetavi can experiment and drop volumetric video recordings in any location and on any background, allowing for multiple settings that would be nearly impossible in real physical environments, costing a fraction of what traditional production would cost. experience.

“This partnership with emerging artists such as Riell and Besomorph is just the beginning as we strive to continue developing larger partnerships and projects in the music industry,” said Talmon. “Our technology platform breaks down barriers for those looking to create effective and profitable immersive content, and we’re excited to create new avenues for artists to connect and engage with their fans.”

Today, fans can access hit singles from Riell and Besomorph, volumetric music videos, and exclusive NFT releases featuring a riveting concert to be announced at a later date.

Talmon said the company is teaming up with another as-yet-unknown musical celebrity to create a gamified world. It’s a big project, but it takes a sort of phased approach. He reflects on how AI can help change the development cycle.

“You give value to the audience, you don’t bet too much and you don’t start out spending $200 million developing a game,” Talmon said. “I really liked the approach and I think this is the future of triple-A game development as the development costs are getting huge.”

“With AI, some benefits could be that the time is shortened or the development is just less labor intensive,” Talmon said. “With volumetric video, we’re using a lot of AI to make the process easier, more cost-effective and more photo-realistic.”

By automating volumetric video, Tetavi saves time, such as saving time with the motion capture process, where video cameras capture the movements of actors, then performers take a basic view and stitch them all together into an animation.

“It’s a relatively long process if you want to get realistic movements and you never really get realistic,” he said. “We think video solves that problem to a large extent.”

Talmon wants the technology to reach a point where the transition between volumetric video and high-quality digital human animation, as possible with Unreal Engine’s MetaHuman authoring tool, is seamless. Tetavi captured footage of the LA Kings hockey team and optimized it for mobile phones. The movements look very natural and the renders are good enough for many uses. With hockey players, it took a few hours to set up and capture.

But the demands for video quality are increasing. Games and music are currently the main demand for Tetavi’s services.

Artist Riell, captured using Tetavi technology.

“Music artists are looking for additional monetization channels and ways to interact with the public,” he said. “Social games are also huge because people spend a lot of time with friends playing online games.”

Tetavi focuses on democratizing the creation of volumetric videos, which can be manipulated to show new types of performances for game characters or music artists. If a dancer jumps in the air and that is captured in the volumetric video, that character can be used to generate more movement and image.

“When you think about our mission, it’s like you and I are putting ourselves in a game,” Talmon said. “It’s definitely something we’re focusing on. Much of the rigging and skinning we can do automatically.

The future of AI and capture

I was wondering what Talmon thought about whether AI could really be used to design some of the worlds in the metaverse.

“It depends on how realistic you want it to be or how accurate you want it to be,” he said. “In our experience, at least with a few caveats, machine learning is very good at creating things that look good. In the current state of AI, this is something achievable.

“If you develop the neural networks and tell them how to design cities with 3D modeling, they can do it,” he said. “Would it be lifelike? Probably not. Is that possible in 5 or 10 years? I don’t know. I think we’re just starting to scratch.

The company employs about 78 people and they are spread all over the world. Tetavi has raised $20 million to date, with the latest round being led by Insight Partners. The technology is still in beta stage.

About the Metaverse, Talmon said, “I’m a big supporter of the Metaverse. I think my definition of the metaverse aligns more with what Niantic thinks than Meta thinks. It’s not virtual reality. It is a combination of spatial computing and artificial intelligence in the real world, with augmented reality and mixed reality. †

The GamesBeat Creed in dealing with the video game industry is “where passion and business come together”. What does it mean? We want to tell you how much the news means to you, not only as a decision maker in a game studio, but also as a game fan. Whether you’re reading our articles, listening to our podcasts, or watching our videos, GamesBeat helps you learn about and get involved in the industry. Learn more about membership.

Leave a Comment