VR - Oculus Quest 2 hand-bone orientation changes

While working on the Oculus Quest 2, we have just found that the bone positions given by XRJoint are no longer correctly mapping to the mesh.

To Reproduce

1. Use Oculus Quest 2
2. Go to https://threejs.org/examples/?q=vr#webxr_vr_handinput_profiles
3. View hands with hand tracking

Video https://user-images.githubusercontent.com/33930602/115038901-41d81b00-9ed0-11eb-8486-5de53a566b0c.mp4

Screenshot

Expected behavior Hand models shouldn’t be warped.

Quick Fix XRHandOculusMeshModel.js

https://github.com/mrdoob/three.js/blob/f2086ff617a42a40c57977c06ab81544e9d4b648/examples/jsm/webxr/XRHandOculusMeshModel.js#L125

bone.position.copy( position.clone().multiplyScalar( 100 ) );
bone.quaternion.copy( XRJoint.quaternion );
// bone.scale.setScalar( XRJoint.jointRadius || defaultRadius );

if(this.handedness === 'left') {
	bone.rotateY(Math.PI/2);
	bone.rotateX(Math.PI);

} else {
	bone.rotateY(-Math.PI/2);
}

Platform:

• OculusBrowser/15.1.0.2.46.283931095 SamsungBrowser/4.0 Chrome/89.0.4389.105
• Device: [Oculus Quest 2]
• Three.js version: [r125.2, r127]

[cabanier]

Does this code hardcode the meshes? If not, it would be better to wait for updated models.

[felixtrz]

The hand ray in oculus quest sometimes doesn’t point down is a known issue, it is currently emulated in a way that assumes the UI is always in front of the user (not above or below). We can definitely propose change to this, but it would not be ideal to just disable the ray while not in controller mode, as a couple of examples are actually using this ray.