The Telecolonization Performance

One of the joys in performing telematically is the ability to not only hear your collaborator, but also to see them. Therefore, a challenge in presenting artistic video imagery for a telematic performance is to do so without obscuring the image of the distant performer. One way to do this is to create a custom software application that can manipulate the (virtual) space within which the performer exists. This was achieved for the concept of the Telecolonization performance at ICAD 2007 by presenting a series of still images representing the spaces to be "colonized" -- hence referred to as "static images." The performers would then be revealed within these spaces through their movement as they performed with their instruments. The more motion created by the performer, the more their image would be revealed. Gradually over the course of the performance the static image of the space would become increasingly opaque, and the end would reveal the performers in the actual space of the studio.

In order to achieve this effect a video frame taken of the performance space was captured into a buffer at an adjustable interval of every 500ms to 2,000ms. This frame was then subtracted from each successive frame of live video. Any differences between the pixels of the stored frame and the pixels from the live video signal constituted movement. The different pixels were then blended with the alpha channel of the static image, revealing the movements of the performer. The imagery for the Telecolonization performance consisted (in order of appearance) of a landscape image of a sunset, the texture of a cave wall, and a partly cloudy sky. The images were changed based upon the progression of the performance.

The video system for this performance consisted of two cameras, an analog video mixer, and a computer running the Max/MSP/Jitter application. A second computer, running a special video streaming software, was used to stream the effected video to the remote location. This same system was used for the later performance at Siggraph 2007. The Siggraph performance, however, used a series of videos in place of static imagery. This gave the visuals for that performance a more fluid feeling.