Question with local module

I would say the automation together with the agent is amazing and I love this feature so much.

However, i got stuck at this point. The step I did:

1. run task init in my train.py which import a few local modules like config.py
2. after running, I got a complete task on server
3. I cloned the task and put it into the queue
4. the agent pulled the task and start installing the required pkgs everything here is fine until it starts running, the error shows like this:

Traceback (most recent call last):
  File "/user/.clearml/venvs-builds/3.9/code/train.py", line 8, in <module>
    from config import checkpoint
ModuleNotFoundError: No module named 'config'

Then I checked the code directory and got this:

ls .clearml/venvs-builds/3.9/code
>>> train.py

Seems the agent only copied the entry file, not the others. Can you please elaborate more about which files will be captured when running task init manually and how the agent decides which files will be copied to the venvs/code directory?

[jkhenning]

Hi @jing-bi ,

How did you run your initial task? Was it from a Git repository containing your code? If you only executed a file not in a Git repository, ClearML will only store that specific file in the task’s metadata and thus will only copy that file when running the task using the agent.

[jing-bi]

I know what’s wrong, I use pycharm to run the code remotely, it’s indeed a git repo on my local but on the remote it’s not