Breaking the walls between two spaces, either culturally and/or physically, to explore nonverbal communication through gestures, signals and actions.
We are exploring communication between two people who are sharing a simulated table, but occupying two different spaces. How do they unintentionally influence the other’s experience when they can’t speak and may not be able to see and hear the results themselves? We’ll project each person into the space of the other, creating the illusion of a complete round table while in actuality keeping them separate and creating a speech barrier. Through the use of the kinect (and possibly specific object triggers) we will be tracking their gestures and actions to use as triggers for sound and light changes in the other room. We will not tell them ahead of time the effects of their gestures, and they will be able to explore the space and attempt to interact with the other person sharing their table.
Group: Lindsey Daniels, Chris Hall, Akmyrat Tuyliyev
Location: Meeting Room (room reservation requested) + Micro Studio (waiting on ability of booking)
We started working this weekend to see if we can portray an individual sitting at the same table as you through the illusion of projection. We are thinking of making the table a circular one that we will build out of wood.
We just tapped out the what the table would look to to test the projection.
Using Isadora, we captured me at the one table and projected the capture at the second table location.
This week, we will start working with the Kinect 2 to track the non-verbal gestures of the individuals.
Interactions to track:
- Arms in same plane- nothing happening
- arm and hand at 90 degrees
- Hand with fist - unfriendly sound
- Hand waving - friendly sound
- Hand touching face
- Hands touching wall- dimming light
- Side to side body movement / lean- changes color
- Hand on chin- crickets
- Object movement- songs played
- Two hands up- applause
- Hands coming together/clap-
- Other simple facial gestures
Kinect Tutorial for reference:
Equipment/Props needed for installation:
2 sets of Speakers
2 Kinect 2s
2 big projectors
6 speed rails /table legs
2 hue bulbs & bridge
2 MSIs (can be the thin ones)
Lamps for both room
2 table cloths