Adobe unveiled new cutting-edge generative AI tools designed for crafting and editing custom audio.
The Project Music GenAI Control, an early-stage generative AI music generation and editing tool, enables creators to produce music from text prompts and then refine that audio according to their specific requirements.
Project Music GenAI Control: Text-Prompted Music Generation
These innovative tools initiate music creation by utilizing a text prompt that is inputted into a generative AI model, a technique already employed in Adobe’s Firefly.
Users can input prompts like “powerful rock,” “happy dance,” or “sad jazz” to generate music. Following the generation process, users can seamlessly edit the music to meet their specific requirements.
Empowering Creativity
The experimental work from Adobe Research signifies a transformative shift in how custom audio and music are created and edited.
Project Music GenAI Control empowers creators to craft music tailored for their projects, whether they are broadcasters, podcasters, or individuals requiring audio with precise mood, tone, and duration.
User-Friendly Interface for Enhanced Control
With a user-friendly interface, users can effortlessly transform their generated audio. They can adjust elements such as tempo, structure, intensity, clip length, remix sections, and generate repeatable loops.
This streamlined process eliminates workflow challenges associated with manual audio editing, providing end-to-end solutions for users.
Collaborative Development Efforts
Project Music GenAI Control is a result of collaboration with colleagues from the University of California, San Diego, including Zachary Novack, Julian McAuley, and Taylor Berg-Kirkpatrick, as well as colleagues from the School of Computer Science at Carnegie Mellon University, such as Shih-Lun Wu, Chris Donahue, and Shinji Watanabe.
Commenting on the new AI tool, Nicholas Bryan, Senior Research Scientist at Adobe Research, said:
With Project Music GenAI Control, generative AI becomes your collaborative partner. It aids individuals in crafting music for their projects, catering to the needs of broadcasters, podcasters, and anyone else requiring audio with the perfect mood, tone, and duration.