The aim of the project was to test the limits of the connections between physical and digital world. To depict this we were required to use Arduino and Processing programmes create a prototype that explains the relationship between manual control and digital mapping.

We created a device – MO:MAP which is a gesture detector that stimulates bubble graphics as per hand gestures and movements.

Components used:-

  • 3 – Axis / triaxial accelerometer
  • Bluetooth HC-06
  • Arduino Uno
  • 9V Battery

We followed a bottom-up approach and started by experimenting with simpler modules. Initially, we decoded the single bubble gesture detection, first with mouse and then with the accelerometer. Then we increased the number of bubbles and its various properties like color, fade, strokes etc.  We also introduced gravity effects and no. of bubbles per frame to give the graphics an effect of agitation. Since our vision for this project was to create a device that facilitates interactive performance through gestures, the next step was to make the device wireless. For this, we used the Bluetooth HC-06 device attached to the Arduino and connected with the programmes codes on the system. We then tested the device by projecting the processing screen behind a person with the device attached to his hands. And as the person moved his hands the bubble trails followed the gestures.


The future prospects of this device could find a way in world of augmented reality where objects can be controlled through various gestures to create a virtual space or design. These can be implemented in audio-visual performances, real-time presentations, and cinematography.

MO:MAP is a project of IaaC, Institute for Advanced Architecture of Catalonia developed at MAA01 in 2017 by:

Students: Deepak Sivadasan, Adriana Cano Limarino, Kavya Jose, Maya Mohan                                                                    Faculty: Angelos Chronis, Angel Munoz