Huge difference between the output from tflite model and kmodel

Hi,

I am trying to convert a tflite model to kmodel but during testing the output from both models, I found a huge difference after conversion.

Here is my tflite model and converted kmodel. Archive.zip I used command ncc compile model.tflite model.kmodel -i tflite -o kmodel -t k210 --inference-type uint8 --dataset images --input-mean 0.5 --input-std 0.5 for the conversion.

And my input range originally being [-1, 1]

Also I tried float inference and the result is the same. The output from kmodel is of range 10^2 while the output from tflite model is 10^-2

[zye1996]

Figured out with option --weights-quantize-threshold

[zye1996]

CI from master https://dev.azure.com/sunnycase/nncase/_build/results?buildId=156&view=artifacts&type=publishedArtifacts

I tested with the CI verision and the compiled model works fine. However when I did the compilation, it throws out warning:

WARN: Conv2D_3 Fallback to float conv2d due to weights divergence.
WARN: Conv2D_5 Fallback to float conv2d due to weights divergence.
WARN: Conv2D_13 Fallback to float conv2d due to weights divergence.
WARN: Conv2D_21 Fallback to float conv2d due to weights divergence.

I would assume it will degrade the performance of using kpu, is there any solution to this?