CODEWITHSUNDEEP
react-nativemachine-learningcomputer-visionface-detectiongoogle-mlkit
riccardolardi
riccardolardi

Reputation: 1750

Get detected face Pitch angle from Google ML Kit Mobile Vision API

I'm working on an app that needs to detect the face orientation, that is roll, yaw and pitch.

Roll, Yaw, Pitch

Since I'm using Expo (React Native) I hope I can stick with its FaceDetector implementation which used Google ML Kit's Mobile Vision API. I'm fully aware this might not be the most efficient API for the task of solely retrieving face orientation information.

Sadly, the Google API only passes Yaw and Roll but not Pitch:

The Euler X, Euler Y, and Euler Z angles characterize a face’s orientation as shown in Fig. 1. The Face API provides measurement of Euler Y and Euler Z (but not Euler X) for detected faces.

Mobile Vision API Euler Angles

Is there any way to calculate Pitch from the given Euler angles or at least approximate?

Additionally: What is the reason for that limitation?

Upvotes: 1

Views: 1968

Answers (1)

Chrisito
Chrisito

Reputation: 534

The Face Detection API in ML Kit (the successor to Google Mobile Vision) does report the EulerX for detected faces and maybe this should help clarify the conversion between Euler angles and Yaw/Roll/Pitch.

Upvotes: 0

Related Questions