Overview

In this session, you’ll be learning about artificial intelligence using the Hand Detection extension in the Pictoblox Python Interface by making an activity that tracks our finger from the camera using Artificial Intelligence. We will utilize the tracking to manipulate a sprite on the PictoBlox stage. Watch the video (below) for a step-by-step guide to making the “Finger Tracking with AI Python” activity within PictoBlox.

Introduction to Hand Detection

This works in a similar fashion as the Pose Detection algorithm, with much more accurate tracking of the points on the hand. Pictoblox uses the MediaPipe model to detect Hands and Gestures. It predicts 21 3D hand key points per detected hand.