Category Archives: OpenCV

Parsing Mediapipe Data for Face Mesh, Pose, and Hand Landmarks

YouTube video player

We all love the incredibly powerful features of the Mediapipe AI library. But, lets face it, the data is very hard to interpret, and the returned data structures are complex, and poorly documented. The purpose of this lesson is to show you how to parse the complex data structures coming from Mediapipe, and to create simple, intuitive arrays for the landmark data. We create classes in python which do the parsing, and the classes are easy to work with. With these classes, you can use mediapipe simply, and get simple to understand data structures back. The video explains what we are doing and how we are doing it. For your convenience the resulting code is posted below.

 

Parsing Mediapipe Data for Pose Landmarks, Hand Landmarks and Face Bounding Box


 

In this lesson we show how to create python classes to parse the data coming from Mediapipe for hand Landmarks, Pose Landmarks and the bounding boxes for found faces. Creating these classes allows the difficult parsing to be done in the class, and then have a simple way to parse and use all the data.

 

AI For Everyone: Parsing Pose and Hand Data Landmarks from Mediapipe

 In this video lesson we show you how to create simple Python classes to parse the data from mediapipe hand Landmarks and pose estimation. With these two classes, it is very easy to parse the most important data generated by mediapipe.

 

Distinguish Between Right and Left Hands in MediaPipe

 

In this video lesson we explore how to parse the data set returned from mediapipe to understand whether a given hand is a right hand or a left hand. Mediapipe has a method which determines the handedness of a found hand. We will show how to alter our data parsing class from earlier lessons to include the handedness of the found  hands. Enjoy!

 

AI for Everyone: Developing a Gesture Based Arcade Game Based on Mediapipe and Python

In this video lesson we introduce the concept of using OpenCV and Mediapipe to create gesture based arcade games in Python. In this lesson we suggest creating a gesture based version of the classic Pong arcade game. We show enough to get started, and your homework is to complete the game.