this post was submitted on 05 Oct 2023
7 points (100.0% liked)

LocalLLaMA

2207 readers
27 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

Would adding musical notations to LLMs training data allow it to create music since notations are a lot like normal languages? Or does it do so already?

you are viewing a single comment's thread
view the rest of the comments
[โ€“] howrar@lemmy.ca 4 points 11 months ago (1 children)

ChatGPT appears to be able to generate music in lilypond notation. It gets the notation, but not the music. You could probably fine tune a model on some lilypond files to get better results.

I tried getting it to write out a simple melody using MIDI note numbers once. I didn't think of asking it for LilyPond format, I couldn't think of a text-based format for music notation at the time.

It was able to produce a mostly accurate output for a few popular children's songs. It was also able to "improvise" a short blues riff (mostly keeping to the correct scale, and showing some awareness of/reference to common blues themes), and write an "answer" phrase (which was suitable and made musical sense) to a prompt phrase that I provided.