question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Procedural face rendering

See original GitHub issue

Cozmo .bin FlatBuffers animation files describe Cozmo face images procedurally. Each face image is described with a structure in the following format: https://github.com/zayfod/pycozmo/blob/1fbf2775c2147356b39a031be7d92d74bb223a16/pycozmo/CozmoAnim/cozmo_anim.fbs#L11

The left and the right eye are described with 19 coefficients each.

Code that can interpret procedural face descriptions is needed. It should take pycozmo.CozmoAnim.ProceduralFace object as input and should generate a 128x32 PIL image as output.

The following presentation from Anki provides some background information: https://www.gdcvault.com/play/1024488/Cozmo-Animation-Pipeline-for-a

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:7 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
zayfodcommented, Oct 27, 2019

The latest commit on dev (5a62b146d2230741cda51153e4fc8c660ade65bd) finalizes the support for all 5+19+19=43 procedural face parameters.

There are now two examples:

The next step is to integrate procedural face rendering with animation playback.

1reaction
zayfodcommented, Oct 13, 2019

With the coefficient interpretation from @ppedro74 , Pillow.ImageDraw, and the new Client.display_image() method, everything is in place to start working on procedural face rendering.

I am planning to add a new pycozmo.procedural_face module to dev shortly.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Modeling and Rendering for Realistic Facial Animation
Modeling and rendering realistic faces and facial expressions is a difficult task on two levels. ... using a physical or procedural model of...
Read more >
Blender Procedural Face Render on Vimeo
This is "Blender Procedural Face Render" by Johannes Lex on Vimeo, the home for high quality videos and the people who love them....
Read more >
Chapter 14. Advanced Techniques for Realistic Real-Time ...
2006 work well for tuning both models for rendering faces. In Section 14.4 we review existing scattering theory, with a focus on diffusion...
Read more >
Procedural Faces : r/Houdini - Reddit
Scatter N (~30 for this render) points on the surface of some human face mesh. Initalize a random 3D vector dir for each...
Read more >
Face culling - LearnOpenGL
OpenGL checks all the faces that are front facing towards the viewer and renders those while discarding all the faces that are back...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found