Hello World

A monitor installation supported by a camera which detects the user’s facial and hand movements, accompanied by a sculpture which encapsulates a speaker for audio

Development: Derivative TouchDesigner, Python, MediaPipe Motion Tracking

Art: Autodesk Maya

Timeline: 8 Weeks

As we've trained modern technology to act a certain way and develop more user-friendly personas, we slowly begin to create characters for our machines. They are programmed to provide positive feedback, provide us with our needs, and sit still for their next command. However, we must ask, how does technology behave when we aren't looking? Are their obedient personalities the extent of their existence, or do they have more inside of them that they may not let the average user notice? The juxtaposition between a camouflaged AI assistant robot both with and without a relationship with the user is explored in Hello World. This program offers simple directions for the actions of the character, but we may only discover how it truly reacts by experimenting with how we interact with it and pushing its limits.

About the Process


This piece was displayed in the Bloomington Cook Center Gallery November 2025 - March 2026 for the Mimicry and Mirage Exhibition, which:


"Explores the interplay between visibility and concealment, adaptation and deception, through the lens of extended reality. Drawing inspiration from camouflage in the natural world, the exhibition showcases digital artworks that challenge perceptions and invite viewers to question what is seen, hidden, or imagined. These works investigate the concept of camouflage not only as a biological phenomenon but as a metaphor for navigating identity, space, and algorithmic landscapes in an increasingly mediated world."

Using MediaPipe's motion tracking technology, I identified points of interactions from the users' facial recognition and hand positions relative to the camera attatched to a monitor.

I developed embedded algorithms in Python to identify when the robot character should respond and react to gestures given by the user. When there is no face recognized by the camera, the robot stays dormant. When there is a face recognized, the eyeline of the robot follows that of the two main points between the viewer's eyes. If the user is to dissapear from the camera or obscure their face, the robot will become upset for up to ten seconds before lying dormant again. If the user decides to raise their hand, the robot responds in a friendly manner.

Each of the different states of the robot, based on how the user interacts with it, was accompanied by ambient music and sounds componsed by a peer.


Featured Images



Back to top