AudioCraft

What is AudioCraft?

AudioCraft is an AI research project by Meta that focuses on generative audio models for music, sound effects, and audio compression. It simplifies text-to-audio generation. MusicGen generates music samples based on text prompts, enabling text-to-music applications. AudioGen creates sound effects and ambient sounds from text prompts, useful for videos and games. EnCodec learns compressed audio representations using discrete tokens, allowing more efficient audio generation. This unified framework efficiently models music, sounds, and compression with a single architecture. The open-source code on GitHub includes pre-trained models, model cards, and samples for exploration. AudioCraft aims to advance generative modeling technology to create new creative tools and applications using AI-generated music, sounds, and voices.