Score Processing, Part II
No-one exists here. We are still within the midst (or midsts? Which is it? Well, given that it is from the 15th century I guess I can get away with either. That’s how they used to roll.) of thanksgiving. No-one is here. Except me. I think my supervisor would have murdered me if I left this weekend, given that I was skipping around NYC for most of last week.
I did have some time to play around a bit more with the score processing. Here’s my standard guinea-pig type piece, Beethoven Op. 111:
Do you love the glorious widescreen? Oh wait… the embedded player doesn’t work with widescreen yet. Well, if you (like me) are hot for 16:9 you can watch the full thing here. HOWEVER. It still won’t have any audio. Why not? It turns out that synchronizing the audio is actually the real crux of this score analysis malarkey.
You see, the notes in the video are a literal transcription of the score (extracted from MusicXML versions of MIDI files), but no-one ever plays a literal transcription of the score. The tempos vary all the time. So making the audio match the notes is a much more difficult problem than getting the notes themselves. I have about five different ideas for getting this to work, but all of them are several day long programming sessions.
Still, the video looks kind of pretty, right?
December 10th, 2008 at 11:56 am
Hi Ben, I’ve just been reading your score following & visualization posts. Very interesting read. I’m looking forward to part 4. Just wanted to let you know that you can find musicXML files at http://wikifonia.org in case you’re looking for some data to work with. And in case it is your ambition as well to align the actual sheet music + audio, perhaps the free and open source MuseScore software might be useful.
December 10th, 2008 at 7:34 pm
Hi Thomas,
Thanks for the links! I’m looking forward to part 4 also
It’s a lot more work than any of the others…
Ben