question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

unable to load custom python environment with python backend

See original GitHub issue

I’m trying to use a custom environment for a pytorch model served with the python backend this is the config file

name: "model1"
backend: "python"

input [
  {
    name: "INPUT0"
    data_type: TYPE_FP32
    dims: [ 3 ]
  }
]
output [
  {
    name: "OUTPUT0"
    data_type: TYPE_FP32
    dims: [ 2 ]
  }


instance_group [{ kind: KIND_CPU }]

parameters: {
  key: "EXECUTION_ENV_PATH",
  value: {string_value: "$$TRITON_MODEL_DIRECTORY/model1/python-3-8.tar.gz"}
}

The file structure is like this

|-- model1
|   |-- 1
|   |    -- model_ckpt.pb
|   |   `-- model.py
|   |-- config.pbtxt
|   |-- python-3-8.tar.gz
|   `-- triton_python_backend_stub

I’m getting the error UNAVAILABLE: Internal: Failed to get the canonical path for $$TRITON_MODEL_DIRECTORY/model1/python-3-8.tar.gz.

Please help !

Issue Analytics

  • State:open
  • Created 2 years ago
  • Comments:23 (11 by maintainers)

github_iconTop GitHub Comments

1reaction
tanmayv25commented, Dec 7, 2021

@Tabrizian Can you attach appropriate labels to this issue and link it to the ticket you have created?

0reactions
Tabriziancommented, Oct 28, 2021

Strange… As I mentioned earlier, we have not tested Execution Environments with GCS in Python backend. I have filed a ticket to add testing for it.

cc @msalehiNV

Read more comments on GitHub >

github_iconTop Results From Across the Web

Can't import my own modules in Python - Stack Overflow
In your particular case it looks like you're trying to import SomeObject from the myapp.py and TestCase.py scripts. From myapp.py, do import SomeObject....
Read more >
unable to load model with custom objects on a Fresh Python ...
Hi all, i have an issue in loading a model with custom loss function in a fresh-separate IPython Environment. Following is a sample...
Read more >
How to Set Up a Virtual Environment in Python – And Why It's ...
You can create a new virtual environment for multiple Python versions; You are able to download packages into your project without admin ......
Read more >
Resolve "Unable to import module" errors from Python ... - AWS
I receive an "Unable to import module" error when I try to run my AWS Lambda code in Python. How do I resolve...
Read more >
Manage Python environments and interpreters - Visual Studio ...
For example, you might have installed Visual Studio 2017 or later but cleared all the interpreter options in the installer options for the ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found