Skip to content
Shadepick

How the try-on works

What happens when you try on makeup at Shadepick: on-device face detection, true-to-product colour and shade comparison.

Our try-on replaces the trip to the store: it lets you see how a specific product, in its exact shade, looks on your own face. Here's how it works under the hood.

1. Your photo stays on your phone

When you upload a photo or open the camera, the image is processed inside your browser. We use an open-source AI model (Google's MediaPipe) that downloads to your device and locates 478 points on your face: lip outline, eyelids, brows, cheeks and irises. Neither the photo nor those points are ever sent to a server.

2. Each product is painted in layers

Each category has its own area:

  • Lips: the outer outline minus the inner one, so teeth are never painted.
  • Blush: a soft ellipse high on each cheek, scaled to your face and clipped to its outline.
  • Eyeshadow: three styles (soft wash, defined and smoky) that follow the shape of your lid.
  • Eyeliner: thin, a wing that follows the axis of your eye, or smudged.
  • Brows: a soft fill with natural or defined intensity.

Edges are feathered in proportion to the size of your face, and colour is blended while keeping your skin's shadows and texture — never a flat block of colour.

3. True-to-product colour

Each shade is applied using the product's colour code. We also estimate the colour and brightness of the light in your photo, using the white of your eye as a reference, so the lipstick looks the way it would in that same light. Finishes are simulated too: matte flattens reflections, gloss adds shine and shimmer adds fine sparkle.

4. Compare and decide

  • Before / after: slide to compare your face with and without makeup.
  • Compare shades: up to four shades side by side on your face.
  • Looks: see the product in a natural, office, night, event or glow look.
  • Colour analysis: find your season and the shades that suit you.

5. Create content for social

With "Create for social" you can make vertical images and videos ready for Instagram and TikTok — also on your device. Each one comes with a "try it yourself" link that only contains the product and look, never data about your face.

Limitations

Results depend on the lighting and quality of the photo, and on your screen's calibration. Colours are indicative: what you see is very close to the real product, but it can vary slightly by batch and lighting.