Back to projects

Makeup Artist

Hsin-Yu Hsu, Aiymkan Raiapova
The Makeup Artist is an interactive web application enabling users to apply various makeup products onto a digital character using hand gestures. As the primary input modality, different intuitive hand gestures correspond to applying specific makeup products. Additionally, users have control over the density of the product colors in the following way. Continuous hand gesture interactions gradually intensify color brightness and density, whereas brief interactions lead to a lighter application of makeup colors. In this project, we employed hand landmarks and gesture recognition mechanisms to activate specific layers of makeup on the character. These gestures were designed to replicate either the procedural motions involved in the real-life application of a makeup product or the physical representation of the product itself. Our application contributes insights to the exploration of innovative human-computer interaction approaches in the field of digital aesthetics.
camera, mediapipe