[FR] VMC support

How about to add VMC Assistant support to OpenSeeFace?

I have read the docu of the protocol.

Currently iam writing an python pip package for vmc. But i have some questions about bone transform:

/VMC/Ext/Bone/Pos <boneName> <p.x> <p.y> <p.z> <q.x> <q.y> <q.z> <q.w>

After running an OSC sniffer with VSeeFace in “transmitter mode” and covered webcam i get for each bone the T-Pose values of my model. That’s clear. Now the question: How do you apply the tracking data to these T-Pose to get the correct position and quaternion?

In short: So if i want to add VMC support to OpenSeeFace, then how to apply the tracking data from the webcam to the initial T-Pose of the model bones?

[emilianavt]

According to the https://protocol.vmc.info/english#glossary it seems we don’t need IK for VMC protocol support at all in OpenSeeFace, if we only implement it as an ‘VMC Assistent’.

You can send the head target as a /VMC/Ext/Tra, in that case you don’t need IK, but not all applications will be able to handle the received data/perform IK on VMC protocol tracker data. For example, I believe VSeeFace ignores received /VMC/Ext/Tra data. If you want to apply it to the bones and send /VMC/Ext/Bone, you do need IK.

Which minimum and maximum ranges are typical?

They are quaternions, so there isn’t really a minimum or maximum range, especially if un-normalized.

[emilianavt]

Do mean the official VMC software?

The protocol is called “VMC protocol”, so I assumed the box labelled just “VMC” was referring to the software.