with Sofy Yuditskaya

Breakneck Prototyping With Microsoft Kinect and Pure Data

Experiment with a variety of methodologies to create robust and complex interactive environments (games, installations, time/motion based etudes, etc.). There will be a lecture portion to the class giving an overview of precedent in computer vision, game art, mapping and re-mediation. No prior experience with programming necessary. The workshop portion of the class will be project based. Students will walk away with the tools, and a software toolkit needed to rapidly prototype multimedia works using the Kinect.

Day One:


Overview of previous work made with the Kinect,
Discussion of gesture mapping, and re-mediation in the context of media studies

Hands On:

Installation of Kinect software
Download and install Pd
Run Pd example patches


Intro to pd
Pd mapping library
Kinect objects and patches

Hands On:

Kinect as media controller
Kinect as part of an interactive system
Is there a difference?


Come up with a dream project, write a 1-2 paragraph description including the How, What, Where, Who and Why of it. Prepare any materials such as images, videos, audio, light bulbs, fans, etc. you might need.

Day Two:


Talk on 3d sensing, different kinds of cameras, visual and spacial sensing.
Incorporating how various spacial and visual sensors are used today, as well as historically, and which tool is the right one for the job.

Hands On:

Visual mapping of Kinect input
Aural mapping of Kinect input
Physical mapping of Kinect input to Arduino output

Hands On:

setup pre-made patches for integration with your projects
make alterations and new patches for completion of projects

Show & Tell

All course materials will be provided, but you must bring your own Kinect!


Sofy Yuditskaya

On a cold and stormy night in late November, Sofy is born, in Experimental Birth Clinic Number 26, City of Moscow, Union of Soviet Socialist Republics. In 1989 she gives up all nationality and identity documents and becomes a true global citizen. She adopts a nomadic life in the proper tradition of her Siberian ancestry, passing through most of Europe as well as the North American Continent. In 2004, she decides to consummate the perfect union of renaissance and industrial age ideals by officially enlisting to work for the advancement of science and art and begins her studies at The Cooper Union in NYC. Since receiving her degree in 2008, she has pursued continued experimentation in the decentralization of human subjectivity through technology and propaganda. Sometimes working as a cultural mercenary for houses such as Hearst and ARS Electronica, sometimes as a free agent. She is currently studying for her masters of Professional Studies at the Interactive Telecommunications Program at ITP in New York.