Reconstructing the Memory of Grandfather’s, 2016

architecture, Interaction Design

This project explores a method of constructing an architectural space through gestural description.

Relying on me and my cousin’s shared memory of my grandfather’s house, this project through Human Computer Interaction aim to convert our choreograph of describing the house into digital environment that is 3d printable as an architectural model.

Video of the performance and construction


The project utilises physical computing software such as Grasshopper and Firefly to connect a webcam and Rhino 3D together to utilise the our body as an interactive modelling tool. The key investigation of this design experiment was that the memory and the body can be directly utilised in architectural design in a more quantitative manner than qualitative. And although the system is guiding the final outcome to be a certain type of building, orientation and details of the space can vary between each individuals executing the exercise.

Dressed dark you can be disguised from the camera and dressed in white you were exposed to the camera and drawn on the screen. Using this system me and my cousin was able to translate our memory of grandfather’s into a choreography which our body and gestural description of the space were translated into 3d vector drawings.



Translation of time-based vector tracing into 3d geometry.

In choreographic modelling of the space, depth = time. 3m long wall would require the actor to stand for 30 minutes to get equivalent extrusion in digital environment.


Isometric drawing of how to act P1

Isometric notational drawing of ‘the choreography’ for the construction of grandfather’s house


Plan drawing of how to act

Plan drawing of ‘the choreography’ for the construction of grandfather’s house


tubmail12.jpgCollection of our choreography and the features of the grand father’s house




video reference

Tree on grass








Plan of grand father’s house



Elevation of grand father’s house