Sunday, December 9, 2007

"Creating Visual Music in Jitter"

I found this great article on visual representation and synthesis of music and sound. The article is titled: "Creating Visual Music in Jitter- Approaches and Techniques".

This was the initial inspiration for my final project. It was written by Randy Jones and Ben Nevile. If anyone is interested in this article, please comment or email me and I'll send it your way.

Thursday, December 6, 2007

Tuesday, December 4, 2007

Technical overview Pt.1


I started out with a PD patch that I tailored to derive various data streams from an audio input.

The heart of this patch is the fiddle~ object with derives frequency, pitch (in MIDI note values), amplitude (in dB), and harmonic content (also known as individual sinosoidal components; I only printed 3 harmonics). Fiddle is also set up to derive attack values, but I haven't implemented that feature in the main patch yet.

If I precede the fiddle~ object with an adc~ (input from microphone), then I get lots of audio data streams. O Yea!

If I set up outlet points after each number box with the individual data streams, I can just plug this patch into a larger visually driven patch.

Please note: When writing a patch like this in Max/MSP, which I had to do after I realized that my project was best suited for Jitter, you need to download the fiddle object and place it in the Max/MSP externals folder. Otherwise this patch will not work.

Also note: As you will see, the audio input patch is like a master control for audio and MIDI. While I don't necessarily plan on using MIDI for the final presentation, this can be an added feature later on.

Final Projecting

So here's the rundown. I started my project using Pure Data. I was hoping to make an audio controlled "painting" program using Gem and Open GL objects. In other words, the project could be split up into 2 parts: The analog audio input from a microphone (which includes the information derived from its signal) and the visual output (created by Open GL).

After much frustration and many many hours of playing with examples from the PD Extended browser, I realized that using Jitter as a visual programing environment would be much easier and it would look pretty good too. With the generous help of my friend Borna Sammak, we set out to conquer Jitter with a similar concept as my original plan, but angled more towards the manipulation of images as they are displayed on a screen. The following posts will give a general procedural and technical overview of the final project as it exists in its current form. Since Today is Tuesday and the project isn't due until Thursday (I know this sounds absolutely ridiculous), I might decide to modify it if I find something inspiring.