5 Things to Know About Meta’s Audiocraft

Meta's Audiocraft lets you easily generate high-quality audio and music from text

Meta Platforms on Wednesday introduced its open-source AI tool, AudioCraft, which will help users create music and audio based on text prompts. The AI tool is bundled with three models, AudioGen, EnCodec, and MusicGen, and works for music, sound, compression, and generation, Meta said.

"The AudioCraft family of models is capable of producing high-quality audio with long-term consistency, and they're easy to use. With AudioCraft, we simplify the overall design of generative models for audio compared to prior work in the field — giving people the full recipe to play with the existing models that Meta has been developing over the past several years while also empowering them to push the limits and develop their models," says Meta in its official release.

1. MusicGen: This AudioCraft model can generate music from text prompts by using licensed music data.

2. AudioGen: The model can generate audio effects from text prompts, such as environmental and sound effects, using publicly available sound effects data.

3. EnCodec: A decoder enhances music generation by reducing artifacts, leading to higher-quality results.

4. With AudioCraft, the company simplifies the overall design of generative models for audio compared to prior work in the field — giving people the full recipe to play with the existing models that Meta has been developing over the past several years while also empowering them to push the limits and develop their models.

5. AudioCraft works for music, sound, compression, and generation — all in the same place. Because it's easy to build on and reuse, people who want to build better sound generators, compression algorithms, or music generators can do it all in the same code base and build on top of what others have done.