Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[CLI]: `WANDB_DIR` env. var. does not affect the location of the `artifacts/` directory

See original GitHub issue

I specifically set WANDB_DIR so that I can avoid downloading large files on expensive file storage, and instead place them onto cheaper local storage. Why then does the wandb client still download gigabytes of files into the ~/my/project/artifacts directory? What environment variable do I set to affect where wandb stores these heavyweight files?

AFAIU I don’t see any relevant variable in the official docs.

Issue Analytics

State:
Created a year ago
Comments:6 (2 by maintainers)

Top GitHub Comments

1reaction

vanpeltcommented, Jun 30, 2022

@samuela by default when you call .download on an artifacts it’s writes that data to the current directory. You can override what directory download writes to with the root argument of that method.

All artifact data is written through the cache. You can change the location of the cache with the WANDB_CACHE_DIR environment variable.

1reaction

armanharcommented, Jun 21, 2022

Hey Samuel, I believe this is a current limitation. I’ll double-check whether there is a workaround for this and let you know.

Top Results From Across the Web

[CLI]: `WANDB_DIR` env. var. does not affect the location of ...

You can override what directory download writes to with the root argument of that method. All artifact data is written through the cache....

Environment Variables - Documentation - Weights & Biases

When you're running a script in an automated environment, you can control wandb with environment variables set before the script runs or within...

Environment variables to configure the AWS CLI

Environment variables provide another way to specify configuration options and credentials, and can be useful for scripting or temporarily setting a named ...

Using Environment Variables | Cloud Functions Documentation

These variables are scoped to the function and are not visible to other ... runtime environment variable using the Google Cloud CLI, use...

Introduction to environment variables - CircleCI

If your secrets appear elsewhere, such as test results or artifacts, they will not be masked. Additionally, values are still accessible to users...