Python backend initialize 'model_repository' arg breaking change
See original GitHub issueDescription
I am upgrading triton from 21.05 to 22.06 and it seems that the python backend now receives the current models model.py
path instead of the current models folder as it previously did. This is a breaking change for all currently deployed models that use the python backend and relied on this. Are there any tips for handling this?
I also don’t see this mentioned in the release notes or any other issues, not sure if I missed it somewhere. Is there any reason a new arg wasn’t just added to args
instead of changing the expected value of an existing arg?
Issue Analytics
- State:
- Created a year ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
GitHub - triton-inference-server/python_backend
The goal of Python backend is to let you serve models written in Python by ... In the initialize function, you are given...
Read more >How we improved our Python backend start-up time - Medium
We moved the initialization code from init files into helpers and only called them when launching the web server. Break down big files...
Read more >Morepath Documentation
Morepath is a Python WSGI microframework. It uses routing, but the routing is to models. Morepath is model-driven.
Read more >Morepath Documentation - Read the Docs
Morepath is an Python WSGI microframework. It uses routing, but the routing is to models. Morepath is model-driven.
Read more >Plugin — OpenVINO™ documentation — Version(latest)
oneDNN backend for Intel CPU devices. NVIDIA cuDNN for NVIDIA GPUs. The responsibility of Inference Engine Plugin: Initializes a backend and throw exception ......
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
i think this PR can solve this issue: https://github.com/triton-inference-server/python_backend/pull/180
Closing this issue as the PR https://github.com/triton-inference-server/python_backend/pull/180 has been merged in.