Researchers from Singapore University of Technology and Design and Queen Mary University of London have developed Mustango, a text-to-music system that allows for control over musical aspects. By incorporating music-specific features into the diffusion denoising process, Mustango enables the creation of music clips with specific conditions such as chord progression, tempo, and key selection. The researchers also introduced the MusicBench dataset, which enriches existing text descriptions with music features. Mustango demonstrates superior performance in capturing desired chords, beats, keys, and tempo and achieves state-of-the-art music quality.
Introducing Mustango: A Text-to-Music System for Enhanced Control and Quality
A team of researchers from Singapore University of Technology and Design and the Queen Mary University of London has developed Mustango, a groundbreaking text-to-music synthesis system. While the quality of generated content has been improving, the ability to control musical aspects has remained unexplored. Mustango aims to address this challenge by allowing musicians, producers, and sound designers to create music clips with specific conditions such as chord progression, tempo, and key selection.
Key Features and Benefits:
- Mustango extends the Tango text-to-audio model, providing enhanced control over generated music.
- It enables the creation of music clips with specific conditions, such as chord progression, tempo, and key selection.
- Mustango incorporates a Music-Domain-Knowledge-Informed UNet sub-module called MuNet, which integrates music-specific features into the diffusion denoising process.
- The researchers introduce a novel data augmentation method to overcome limited availability of open datasets, resulting in the MusicBench dataset.
- Extensive experiments demonstrate that Mustango achieves state-of-the-art music quality and superior performance in capturing desired chords, beats, keys, and tempo.
- Mustango outperforms other systems, including Tango, in scenarios where control sentences are absent from the prompt.
- Mustango trained from scratch surpasses other variants in terms of audio quality, rhythm presence, and harmony.
Practical Applications:
Mustango offers practical solutions for musicians, producers, and sound designers who want to have more control over the music they create. It allows them to generate music clips with specific conditions, such as desired chord progressions, tempo, and key selection. With Mustango, users can enhance their creative process and produce high-quality music that meets their exact specifications.
Get Started with Mustango:
To learn more about Mustango and access the research paper and code, visit the Github repository. For further updates and insights on AI research, join our ML SubReddit, Facebook Community, Discord Channel, and subscribe to our Email Newsletter.
Unlock the Power of AI for Your Company:
If you’re looking to leverage AI to stay competitive and transform your company, consider exploring the possibilities offered by Mustango. AI can redefine your way of work and help you identify automation opportunities, define measurable KPIs, select the right AI solution, and implement it gradually for maximum impact. Connect with us at hello@itinai.com for AI KPI management advice and stay tuned on our Telegram channel and Twitter for continuous insights into leveraging AI.
Spotlight on a Practical AI Solution: AI Sales Bot
Discover how AI can revolutionize your sales processes and customer engagement with the AI Sales Bot from itinai.com/aisalesbot. This solution is designed to automate customer engagement 24/7 and manage interactions across all stages of the customer journey. Explore the possibilities of AI for your sales team and discover how it can redefine your customer interactions.
