Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Existence of sdk.google.storage.credentials_json (GOOGLE_APPLICATION_CREDENTIALS) without storage credentials inside throws an exception
See original GitHub issueI have a google application credentials for a non-storage google service only. While the agent correctly identified the json based google credentials (during configuration), it failed when running the task (see stacktrace below). ClearML should gracefully keep going if the google credentials are present but missing storage credentials.
Environment setup completed successfully
Starting Task Execution:
Traceback (most recent call last):
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\code\pytorch_mnist.py", line 14, in <module>
from clearml import Task, Logger
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\__init__.py", line 4, in <module>
from .task import Task
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\task.py", line 30, in <module>
from .backend_interface.metrics import Metrics
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_interface\__init__.py", line 2, in <module>
from .task import Task
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_interface\task\__init__.py", line 1, in <module>
from .task import Task
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_interface\task\task.py", line 31, in <module>
from ...binding.artifacts import Artifacts
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\binding\artifacts.py", line 23, in <module>
from ..backend_interface.metrics.events import UploadEvent
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_interface\metrics\__init__.py", line 2, in <module>
from .interface import Metrics
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_interface\metrics\interface.py", line 14, in <module>
from ...storage.helper import StorageHelper
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\storage\__init__.py", line 2, in <module>
from .manager import StorageManager
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\storage\manager.py", line 13, in <module>
from .cache import CacheManager
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\storage\cache.py", line 7, in <module>
from .helper import StorageHelper
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\storage\helper.py", line 103, in <module>
class StorageHelper(object):
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\storage\helper.py", line 194, in StorageHelper
_gs_configurations = GSBucketConfigurations.from_config(config.get('google.storage', {}))
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\backend_config\bucket_config.py", line 245, in from_config
default_project = gs_configuration.get("project") or {}
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\utilities\pyhocon\config_tree.py", line 215, in get
return self._get(ConfigTree.parse_key(key), 0, default)
File "C:\Users\JohnLambert\.clearml\venvs-builds\3.8\lib\site-packages\clearml\utilities\pyhocon\config_tree.py", line 151, in _get
raise ConfigMissingException(u"No configuration setting found for key {key}".format(
clearml.utilities.pyhocon.exceptions.ConfigMissingException: 'No configuration setting found for key project'
Issue Analytics
- State:
- Created 2 years ago
- Comments:9 (5 by maintainers)
Top Results From Across the Web
Authenticate to Cloud services using client libraries
This page describes how you can use client libraries and Application Default Credentials to access Google APIs. Client libraries make it easier to...
Read more >java - GOOGLE_APPLICATION_CREDENTIALS can't be found
io.IOException: The Application Default Credentials are not available. They are available if running in Google Compute Engine. Otherwise, the ...
Read more >explicit credentials not detected for storage client? · Issue #2314
Describe the issue. I am trying to avoid using the GOOGLE_APPLICATION_CREDENTIALS to interact with the GCS client because in my application I ...
Read more >Spring Cloud GCP
OAuth2 credentials for authenticating with the Google Cloud Storage API, if different from the ones in the Spring Cloud GCP Core Module. No....
Read more >Use Google Cloud user credentials when testing containers ...
It's a great tutorial which explains how to load credentials in the container runtime environment for local tests. But the suggested JSON file ......
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Yes, I’m not sure either… anyhow they look pretty much the same on the console output 😃 Fix will be committed soon, I’ll update here once we have an RC with the fix
Hi @johnml1135 A fix was pushed, you can test with the latest from the main branch (RC coming soon)