Nvidia is rapidly moving from being the world’s biggest AI semiconductor chips maker to the original producer of top AI models.
Nvidia showed a new Artificial Intelligence model on Monday that can generate novel sounds and modify existing audio. The demonstrated technology aims to empower music producers, filmmakers, and video game developers, according to the company.
Nivida has named the newly introduced product Fugatto, short for Foundational Generative Audio Transformer Opus 1. The company is not planning to launch the product anytime soon and wants to rigorously test the efficiency, compensation methods, and other partnership possibilities before making it commercially available.
Fugatto has shown impressive examples of generating new audio from text descriptions, including making a trumpet bark like a dog. However, what sets the technology apart is its ability to modify existing audio to an extent that humans cannot manually do.
One example shown by the Santa Clara, California-based tech giant was taking a line played on a Piano and converting it into a line sung by a human voice. Another exemplary example was of taking a spoken word recording and changing it into a completely new accent along with a drastically different mood.
"If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers. I think that generative AI is going to bring new capabilities to music, to video games, and to ordinary folks that want to create things," said Bryan Catanzaro, VP of applied deep learning research at Nvidia.
"Any generative technology always carries some risks, because people might use that to generate things that we would prefer they don't. We need to be careful about that, which is why we don't have immediate plans to release this,” continued Catanzaro.
Fugatto has been trained on open-source data and requires further testing regarding biased, delusional, and opinionated AI generations. The company is contemplating how to release the product publicly with all security measures in place to prevent misuse. The successful launch of Fugatto will place Nvidia at the forefront of top Artificial Intelligence development companies.
