Nvidia's Fugatto AI Transforms Voices and Sounds, Ushering in a New Audio Era

Nvidia on Monday introduced Fugatto, a groundbreaking AI model that transforms voices and generates new sounds from text descriptions. Aimed at revolutionizing audio creation in music, film, and gaming, Fugatto showcases unprecedented capabilities, though its public release remains undecided.

Nvidia Introduces Fugatto: A Groundbreaking AI for Audio Creation

On Monday, Nvidia unveiled a new AI model for audio and music creation that can alter voices and create unique sounds; this technology is intended at those who make music, movies, and video games.

Reuters reports that the world's leading provider of AI-related hardware and software, Nvidia, has stated that it does not currently intend to make the technology, which it refers to as Fugatto (an abbreviation for Foundational Generative Audio Transformer Opus 1), available to the public.

Competing Technologies and Nvidia's Unique Features

This technology can be used in conjunction with others that have been demonstrated by startups like Runway and larger companies like Meta Platforms to create audio or video in response to text instructions.

Located in Santa Clara, California! Based on a text description, Nvidia's version can create music and sound effects, including unique noises like a trumpet barking like a dog.

Its capacity to alter preexisting audio is what sets it apart from competing AI systems. This might include, for instance, transcribing a piano line into a human vocal line or altering the accent and emotional tone of a spoken word clip.

Generative AI's Promise and Potential Impact

"If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers," stated Bryan Catanzaro, VP of applied deep learning research at Nvidia. "I think that generative AI is going to bring new capabilities to music, to video games and to ordinary folks that want to create things."

The relationship between tech and Hollywood has grown strained, especially when Scarlett Johansson accused OpenAI of mimicking her voice. This comes at a time when businesses like OpenAI are in negotiations with Hollywood studios about the potential use of AI in the entertainment industry.

Concerns Over Misuse and the Future of AI Models

Per MSN, the new model from Nvidia was trained using data that is already available to the public, but the business is currently considering whether or not to make it publicly available.

"Any generative technology always carries some risks, because people might use that to generate things that we would prefer they don't," said Catanzaro. "We need to be careful about that, which is why we don't have immediate plans to release this."

The developers of generative AI models still haven't figured out a way to stop people from abusing the technology and making things that aren't true, like making characters who aren't copyrighted or false information.

Just like DeepMind and Meta, OpenAI has been mum about when exactly they want to make their video and audio generation models publicly available.