One of my main interests consists in creating an interaction between poetry and digital sound art. I am presently working at a performance whose task is to present my book of poems “lo spostamento degli oggetti”, that will be published in italian in september 2007. During the reading of the poems, I will treate and superpose my reading voice using real-time and played back recordings either, routing the sound in a quadraphonic surround environment.
The STEIM Orientation Workshop I attended at (27 february – 5 march 2007) gave me the possibility of discovering a lot of new features, from an artistic as well as from a technical point of view. As a software, LiSa allows the performer to load, play and modify several samples at the same time, which is perfect for my purpose: through LiSa I could read and perform my poems simultaneously. I also succesfully tried to make LiSa interact with Digital Performer and with IRCAM softwares that I often use, like AudioSculpt and Diphone Studio. Another important aspect to me has been STEIM’s attention for hardware and external controls, so that interfaces are no more considered as controllers, but as extensions of live performing activity. I believe that this issue is a path in order to give the performance a complete and rich artistic expression. And finally, the exchange with STEIM personnel brought my perspective to the aesthetical possibilities of voice spectrum analysis, which I am trying to explore now on the material that I recorded in Studio II, whose dry acoustic allowed me to get some high quality voice samples.

In August 2006 I presented an installation at the theatre festival Noorderzon in Groningen, together with artist Miriam Reeders. We totally rebuild a caravan into a multi-sensory experience. One person at the time can visit the caravan and nose around through the objects diplayed inside. Miriam wrote a lot of things, some amazing stories and thoughts, she laid out old photo albums, created various small installations and objects, like a “smell box” which contained various nostalgic smells.

The caravan is filled with sensors, walking around, opening cabinets or touching objects result in sound and light changes. The idea was originated by Miriam, who makes really cool installations like “The dream Operator” in which dreams are being transformed into animations. The idea for Memory Scan was to allow the visitors to stroll around in the mind of a person with Alzheimer’s Disease, in which old memories are still vividly projected, mixed with confused and puzzling information about the day-to day present.

The first stage of our research was done at the Grand Theatre in Groningen, which produced this project. We continued our work during a residency at STEIM. You can see Benjamin Scheers with the so called JunXion Bo which he build for us there. The JunXion Box is developed by STEIM, you can plug analogue switches and triggers in the box, which can be translated into MIDI or OSC with the JunXion software. This allowed us to place pressure sensors underneath the floor and switches behind the cabinets and drawers inside the caravan. When someone opens a drawer or just walks around in the caravan MIDI commands are generated by the JunXion Box, sending MIDI data to the light system or to LiSa. As you can see in one of the pictures it resulted in a crazy amount of cables going in and out the caravan, into the JunXion Box, then into the computer and into various mixers and amplifiers, sending sound back to various speakers in and underneath the caravan. The way that the system was set up the visitor inside the caravan was triggering all the light and sound changes, as an independent system without me touching any buttons or faders. I am generally interested in creating semi-autonomous systems for generating sound events, in this case the challenge was to create an interesting sound and light environment. Also we were determined not to allow the technique to dominate the atmosphere but, it was all hidden, to draw the visitor into the beautiful setting which Miriam created with her collection of found objects, old photos, drawings, animations and stories.

The experience was different every time, depending on which cabinet was opened first, with a certain ratio of predictability build in in the beginning. Some triggers were setup to change the function of all the other triggers, so the result was not always the same. To give you an idea: when a person would open a cabinet the phone would start ringing. The phone was usually picked up and the person was asked to read on of the thoughts written on the yellow papers stuck to the ceiling. The voice was recorded and played back later, but which sounds were played or lights were changed after that depended on the level of activity of the visitor and also the order of doing things.

Comments about the JunXion Box: It worked quite well, visuals were not always updated in JunXion. I felt an easier way of making tables (drawing) would have been useful. I linked two computers up with two different soundcards to get more sound outputs, I send the midi coming out of LiSa from Computer 1 to the midi in of LiSa on computer 2. I worked with different states, the audience would change the system to another state to get a different controller mapping / reaction of the system. I felt I could use more states.

pictures: Pierre Borasci
See also http://www.miriamreeders.nl/ (in Dutch)

THANK YOU STEIM!!!