Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Generic naming for ONNX model objects

See original GitHub issue

/kind feature

Describe the solution you’d like Currently in order to turn an ONNX runtime model into a servable, the file must have the name model.onnx, here. This poses restrictions when multiple models are stored in the same directory, or with the potential extension of a storageUri that exists as a path over the internet. For example, the models in the ONNX model zoo are not directly servable under the current structure.

It would be good to extend the specification & downloading of ONNX models to have an arbitrary name. Whether this can be specified with another field in the CRD (like Pytorch does with modelClassName, or via some other mechanism is an open question.

Anything else you would like to add: [Miscellaneous information that will assist in solving the issue.]

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:8 (6 by maintainers)

Top GitHub Comments

1reaction

tduffy000commented, Sep 3, 2020

Right that was my thinking, just split the filename off the end and validate it. I’ll raise a PR and see what folks think.

0reactions

rakelkarcommented, Sep 3, 2020

aka here: https://github.com/kubeflow/kfserving/blob/2037e9c6c0e09385852af15236e939bd5f25cf71/pkg/apis/serving/v1alpha2/framework_onnx.go#L40

how about if did path.Base(s.StorageUri) and used that if it ends in .onnx?

Top Results From Across the Web

Generic naming for ONNX model objects · Issue #1004 - GitHub

Currently in order to turn an ONNX runtime model into a servable, the file must have the name model.onnx , here. This poses...

Models - Hugging Face

Base class for implementing models using ONNX Runtime. The ORTModel implements generic methods for interacting with the Hugging Face Hub as well as ......

Generic import and run of ML onnx model using ML.Net

I am trying to figure out how to create code to import an ONNX model with one input, being a flat array of...

Tutorial: Detect objects using ONNX in ML.NET - Microsoft Learn

This tutorial illustrates how to use a pre-trained ONNX deep learning model in ML.NET to detect objects in images.

Write your own converter for your own model - ONNX

The first section is about the implementation. The code is quite generic but basically follows this process to fit the model with X...