Taku, STEIM’s artistic director and curator for most of the Jamboree events, welcomes the audience and guests, mentions the rough year STEIM has gone through, and the fact that STEIM will continue. He presents Dick Rijken as the new director, who talks a bit about Michel’s passing and his new role.
Then it’s Frank’s turn. He starts with an introduction on the hardware development at STEIM, from the Sensorlab to the junXionboard. Dan Overholt helped developing this sensorinterface. The idea arised that the software to support the HID USB interface should be more powerful than the small little utility we had then. Also, the Sensorlab code was very much a programming language, while most musicians don’t want to become a programmer, and Frank ended up writing all the setups, making the musician dependent on STEIM for their setup updates. So junXion should be userfriendly, no scripting language. But powerful.
Frank starts with a demo of the program. Support for HID devices, MIDI events, timers (sequential stuff), OSC. OSC is ‘high resolution MIDI’, with the drawback that it’s a bit too open, so everyone makes his own protocol. Also support for the Wiimote and audio events. Frank gives an example of the latter, tracking pitch and envelope: making drumsounds with his voice in the microhone triggers drumsounds from junXion! All these different input sensor possibilities can be combined.
Frank talks a bit about the Arduino sensorboard that is also supported. For the Arduino to work you need to write and upload a ’sketch’ to the board. Sketches are written in C, but sketches are also provided by software developers like STEIM. Frank shows how to upload a template sketch and make the Arduino based controller from the neighbour Xander work with junXion.
Now it’s time for video support. For serious video tracking stuff you need preferably a firewire camera and one that is manually adjustable. Auto adjusting will not work, as it is constantly changing the color of the object. Frank demos the workings of the video tracking, using a simple iPhone app showing a green screen using this as an object to track. Thank God the next example is without the Quicktime Synth, instead using LiSa.
Last but not least Frank will play a bit, using an iPhone app that sends out OSC data. Of course something has to go wrong, so the connection is a bit unwilling. But it works in the end, using the iPhone’s 3D accelerometer as a controller, processing the data with junXion, sending it to Garageband, a softwaresynth.
Typical Frank music