Procedural face rendering
See original GitHub issueCozmo .bin FlatBuffers animation files describe Cozmo face images procedurally. Each face image is described with a structure in the following format: https://github.com/zayfod/pycozmo/blob/1fbf2775c2147356b39a031be7d92d74bb223a16/pycozmo/CozmoAnim/cozmo_anim.fbs#L11
The left and the right eye are described with 19 coefficients each.
Code that can interpret procedural face descriptions is needed. It should take pycozmo.CozmoAnim.ProceduralFace
object as input and should generate a 128x32 PIL image as output.
The following presentation from Anki provides some background information: https://www.gdcvault.com/play/1024488/Cozmo-Animation-Pipeline-for-a
Issue Analytics
- State:
- Created 4 years ago
- Comments:7 (3 by maintainers)
Top Results From Across the Web
Modeling and Rendering for Realistic Facial Animation
Modeling and rendering realistic faces and facial expressions is a difficult task on two levels. ... using a physical or procedural model of...
Read more >Blender Procedural Face Render on Vimeo
This is "Blender Procedural Face Render" by Johannes Lex on Vimeo, the home for high quality videos and the people who love them....
Read more >Chapter 14. Advanced Techniques for Realistic Real-Time ...
2006 work well for tuning both models for rendering faces. In Section 14.4 we review existing scattering theory, with a focus on diffusion...
Read more >Procedural Faces : r/Houdini - Reddit
Scatter N (~30 for this render) points on the surface of some human face mesh. Initalize a random 3D vector dir for each...
Read more >Face culling - LearnOpenGL
OpenGL checks all the faces that are front facing towards the viewer and renders those while discarding all the faces that are back...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
The latest commit on dev (5a62b146d2230741cda51153e4fc8c660ade65bd) finalizes the support for all 5+19+19=43 procedural face parameters.
There are now two examples:
The next step is to integrate procedural face rendering with animation playback.
With the coefficient interpretation from @ppedro74 , Pillow.ImageDraw, and the new
Client.display_image()
method, everything is in place to start working on procedural face rendering.I am planning to add a new
pycozmo.procedural_face
module todev
shortly.