question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Proxy server for artifacts just doesn't work

See original GitHub issue

Based on documentation https://www.mlflow.org/docs/latest/tracking.html#scenario-5-mlflow-tracking-server-enabled-with-proxied-artifact-storage-access there is a scenario when tracking server should act as proxy artifact: image

I am running the server using this command:

mlflow server --backend-store-uri postgresql+psycopg2://myuser:mypassword@db:5432/mlflow_db --artifacts-destination s3://mybucker/mlflow/prod --serve-artifacts --host 0.0.0.0

But unfortunately, I can clearly see that this code on the client side

mlflow.set_tracking_uri("http://my_server_on_amazon")
mlflow.set_experiment("test")
...
log_artifacts("outputs")

tries to access S3 directly (instead of sending all requests to the http://my_server_on_amazon, as I expect it to do).

May I have a question: is documentation is bad and this feature of artifact proxying is still not implemented? Or I am doing something wrong with “mlflow server … (parameters)” command?

MLflow version: 1.24.0. Thanks in advance.

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

3reactions
njanopouloscommented, Jun 30, 2022

I am having similar issue to what was posted here at the beginning of the conversation. Unfortunately, the solution provided hasn’t worked for me.

When running the same script on the Remote host, the artifacts get stored in S3 properly. When I run from localhost, I get:

botocore.exceptions.NoCredentialsError: Unable to locate credentials

Anybody have more suggestions of things to try or look for?

1reaction
ibobakcommented, Apr 12, 2022

Feel free to close the issue, if needed. Or change status to “problem in documentation”, whatever.

Thanks again!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Download Pipeline Artifact fails behind proxy
Workaround is to use Build Artifacts instead of Pipeline Artifacts - but this doesn't work well with YAML multi-stage pipelines. I can also...
Read more >
Maven proxy settings not working - Stack Overflow
I'm not able to do this with MVN 3.0.4 but I do with 3.0.3. It seems to be a bug in the 3.0.4...
Read more >
How to Use Pip with a Proxy Server - ActiveState
Click to install and use PIP with a Proxy server for security and privacy. ... Just run the following command to install Python...
Read more >
Dependency Proxy - GitLab Docs
The Dependency Proxy does not pull a new image each time the manifest changes; it checks only when the manifest becomes stale. Docker...
Read more >
Use a proxy server with Elastic Agent and Fleet
Set the proxy for communicating with Elasticsearchedit · In Kibana, open the main menu, then click Management > Fleet > Settings. · Under...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found