Orpheus Music Transformer

SOTA 8k multi-instrumental music transformer trained on 2.31M+ high-quality MIDIs

🔥[2026]🔥 Now featuring large optimized model!

Key Features

• Efficient Architecture with RoPE: Large optimized 748M full attention autoregressive transformer with RoPE.
• Extended Sequence Length: 8k tokens that comfortably fit most music compositions and facilitate long-term music structure generation.
• Premium Training Data: Trained solely on the highest-quality MIDIs from the Godzilla MIDI dataset.
• Optimized MIDI Encoding: Extremely efficient MIDI representation using only 3 tokens per note and 7 tokens per tri-chord.
• Distinct Encoding Order: Features a unique duration/velocity last MIDI encoding order for refined musical expression.
• Full-Range Instrumental Learning: True full-range MIDI instruments encoding enabling the model to learn each instrument separately.
• Natural Composition Endings: Outro tokens that help generate smooth and natural musical conclusions.

Best Practices Tips

• Good prime seed MIDI is everything!!!
• Trim the seed MIDI to exact (or at least - approximate) musical phrase.
• 30sec-1min (1024-1536 tokens) run time is ideal.
• Remove excessive instruments. 4-5 most pronounced instruments work best.
• Do not be discouraged by generated contunuations! Sometimes you need several tries to get it right!
• Do not strive for perfection! Instead, try to have fun and enjoy the music!

Upload seed MIDI or select prime instruments or simply click 'Generate' button for random output

PLEASE NOTE:

• Orpheus Music Transformer is a primarily music continuation/co-composition model!"
• The model works best if given some music context to work with
• Random generation from SOS token/embeddings may not always produce good results

Generation options

Batch Previews

Add/Remove Batch