Objectron predicts low confidence and tracking jitter

Plugin Version or Commit ID

v0.10.0

Unity Version

2021.3f1

Your Host OS

MacOS M1

Target Platform

iOS

Description

Hi, I’m try to create a shoes try-on app, but there are some problems:

1. Low confidence
2. tracking jitter
3. Need to set FOCAL_LENGTH and PRINCIPAL_POINT

What do I need to do to get rid of these two problems？

As shown in the video effect.

https://user-images.githubusercontent.com/82647748/171526093-6fc1f1dc-6824-4889-8527-732d5b841d21.mp4

Thanks in advance.

Code to Reproduce the issue

var tmp_Rotation = CameraCoordinate.GetApproximateQuaternion(target);
sneaker.rotation = tmp_Rotation;
var tmp_Position = screen.rect.GetPoint(target.Keypoints[0].Point3D,
Application.isEditor ? Vector2.one : new Vector2(2.0975f, 1.5731f), Vector2.zero, 1, rotationAngle, isMirrored); 
sneaker.localPosition = tmp_Position;
sneaker.localScale = (target.Scale[0] + target.Scale[1] + target.Scale[2]) / 3 * Vector3.one * 90000 ;

Additional Context

No response

[Phantomxm2021]

var tmp_Position = screen.rect.GetPoint(target.Keypoints[0].Point3D, Application.isEditor ? Vector2.one : new Vector2(2.0975f, 1.5731f), Vector2.zero, 1, rotationAngle, isMirrored); sneaker.localPosition = tmp_Position;

@Phantomxm2021 nice work to get it running I would like to know how did you get the screen.rect from please explain or share some code on how you got it and also please tell me how did you do your occlusion did you use a shader or something else.

Any kind of help will be highly appreciated thanks.

About Screen rect

The screen.rect is a gameobject of Annotatable Screen. And it’s a RectTransform component, we can using GameObject.Find("Annotatable Screen").GetComponent<RectTransform>(); to got it.

About Occlusion

We wrote a shader for it.

Shader "Custom/ObjectOcclusionShader"
{
    SubShader
    {
        Tags { "RenderType"="Opaque" }
        Tags { "Queue" = "Geometry-1" }
        ZWrite On
        ZTest LEqual
        ColorMask 0

        Pass
        {
            CGPROGRAM
            #pragma vertex vert
            #pragma fragment frag
            
            #include "UnityCG.cginc"

            struct appdata
            {
                float4 vertex : POSITION;
            };

            struct v2f
            {
                float4 vertex : SV_POSITION;
            };

            v2f vert (appdata v)
            {
                v2f o;
                o.vertex = UnityObjectToClipPos(v.vertex);
                return o;
            }
            
            fixed4 frag (v2f i) : SV_Target
            {
                return fixed4(0.0, 0.0, 0.0, 0.0);
            }
            ENDCG
        }
    }
}

[burungiu]

I have a problem, the capsule and sphere are black on the iPhone. Do you know how to solve it? I used the shader which you wrote in a early comment.