Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Head and eye gaze estimation

See original GitHub issue

Hi, your project is very great !

I’m now working on head and eye estimation such as up-down, left-right directions problem. I’ve read your tracker.py file and I think you already have figured out this problem. Could you please guide which features or attributes I should use to solve this problem ?

Issue Analytics

State:
Created 2 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

1reaction

emilianavtcommented, Mar 27, 2021

When I wrote that code, I didn’t know about cv2.circle, so it’s still setting the pixels manually, like here:

https://github.com/emilianavt/OpenSeeFace/blob/master/facetracker.py#L311-L346

I’ve been meaning to refactor it but haven’t gotten around to it yet.

1reaction

emilianavtcommented, Mar 24, 2021

Hi! For the head, the quaternion or euler and translation fields of the face object specify the rotation and position. You can calculate an estimate of the eye ball rotations by taking the rotation between the eyeball center point and the iris point as given here:

https://github.com/emilianavt/OpenSeeFace/blob/master/Unity/OpenSee.cs#L179-L180

The swapX calls are just for converting the coordinate system to Unity’s and can be ignored.