Computational sense and movements, 2017

Interaction Design

This is a  performance project that exhibits in real-time, a process of a man counterbalancing with the computer motions through drawing.

The Project experiments with 5 different computational senses and motions analysing how different computational senses can impose different physical movements to human body.

The project uses gyrOsc attached to custom designed iphone harness. By wearing this harness, user’s interaction is no longer limited to the hands, but he entire body has to be utilised to interact with the program.


The project includes 5 different sensors ‘Gyroscope’ , ‘Accelerator’ , ‘Optical flow’ , and ‘Gravity’. For each individual computed motions the user is expected to utilise their own body to counterbalance with computer motions. The user can observe the process on the screen as they act.

The aim of each ‘Act’ is to sustain the system until its reaches the ending point at which point the program will store the final result of the ‘Act’ as a drawing, and a 3d mesh.

Therefore, a man himself become a drawing machine and the character of the sensors become an choreographic instruction and the final drawing produced can be analysed and seen as an choreographic score captured in time.


Computed Motions

pqt 10

User’s Motions

For Act #1 and Act #2 the user has to try to keep the ‘moving agents’ and their trail as close to the central as possible.

For Act #3 the user has to accelerate himself to stop the ‘agents’ dropping outside the screen. Once the balls drop outside the window, the system clashes and saves the drawing. Therefore the dancer drawings are, longer the user has survived.

For Act #4 the ‘agents’ are trying to escape the screen and the user has to move in opposing direction to keep them inside the screen.

For Act #5 the user has to counterbalance himself as the movements of the agent are caused by the user’s own posture. Once the balls reach outside the box, system clashes and saves the trail of the movement as 3d mesh.

All the attempts exported as drawings



iPhone harness