12:40:31

Gesture

October 2024

Gesture was a university project which looked into hand gestures and how they could communicate language.


For my project, I decided to use p5.js and the ml5.js hand tracking library to build a gesture recognition system for the phrase "stop, wait. I have an idea!"


The demo above was recorded in a dark background to isolate the hand, but the full code also doubles as a halftone filter for your environment, which all changes colour in accordance with the active gesture.

Try it here (Desktop Recommended)

Try it here

(Desktop Recommended)

STOP = two hands up


WAIT = one hand up


I HAVE AN IDEA = one hand + index finger up