whereismyai
YuE
YuE is an open source AI music generation model that writes symbolic composition plans to create complete songs with vocals.
YuE2 is an open source AI model that unifies symbolic and audio music generation. It takes lyrics and a style prompt, writes a melody and chord plan, and then renders it into a complete song with vocals and accompaniment. Users can inspect, play, and edit the composition score before generating the final audio. It also supports zero-shot covers by transcribing source recordings into melody scores for new interpretations. The system runs via a staged Python API, integrates with agent workflows, and operates locally on Linux with supported GPUs.
YuE at a glance
Key features
- Write melody and chord plans from lyrics and style prompts
- Generate 48 kHz stereo audio with vocals and accompaniment
- Transcribe source recordings for zero-shot covers
- Edit compositions via ABC notation score files
- Run staged Python API for planning and synthesis
- Integrate with AI agent skills for automated workflows
Use it for
- Compose complete songs from lyrics and style prompts
- Create zero-shot music covers from reference recordings
- Edit song harmony, melody, and tempo using score files
- Generate instrumental music from text descriptions
Alternatives to YuE
- Udio — Generate customized songs across multiple genres from simple text prompts.
- DiffSinger — It uses a shallow diffusion mechanism for singing voice synthesis and text-to-speech.
- Suno — Full songs with vocals from one prompt, plus a multitrack studio
- Applio — Runs locally with open-source code and no telemetry.
- Loudly — Integrated workflow from initial generation to final distribution.
- Beatoven — Generates unique soundtracks and sound effects instantly using text prompts.
- Magenta — Builds and plays AI musical instruments with open models and real-time neural synthesis.
- MuseGen — It generates complete radio-ready songs with vocals and editable stems in seconds.
- Eleven Music — Generates multi-genre full songs with vocals, inpainting, and commercial rights.
- VoxCPM — Provides tokenizer-free multilingual speech with controllable voice creativity.
- Remusic — Generate full-length AI songs, customize covers with 10,000+ voices, and remove vocals.
- SongUp AI — Connects song generators and audio tools to AI agents with one URL and no sign-in.
All YuE alternatives