[CLI] Cannot pass init_args to override config file

🐛 Bug

Suppose I have a CLI configuration file, but I have no way to modify the Datamodule or Model init_args in it via command line arguments.

To Reproduce

I thought the traceback is clear enough, so I don’t reproduce with a BoringModel. If you really need it, please let me know.

Here is the reproduce steps:

1. git clone https://github.com/tshu-w/lightning-template.git
2. conda create -n env python=3.9 && conda activate env && pip install -r requirements.txt
3. make sure run fit --config configs/mrpc.yaml --print_config=skip_null works fine.
4. run fit --config configs/mrpc.yaml --data.batch_size=64 --print_config=skip_null raise error.

Traceback

Traceback (most recent call last):
  File "/home1/wangtianshu/lightning-template/run", line 33, in <module>
    main()
  File "/home1/wangtianshu/lightning-template/run", line 20, in main
    cli = LitCLI(
  File "/home1/wangtianshu/.local/share/conda/envs/template/lib/python3.9/site-packages/pytorch_lightning/utilities/cli.py", line 516, in __init__
    self.parse_arguments(self.parser)
  File "/home1/wangtianshu/.local/share/conda/envs/template/lib/python3.9/site-packages/pytorch_lightning/utilities/cli.py", line 655, in parse_arguments
    self.config = parser.parse_args()
  File "/home1/wangtianshu/.local/share/conda/envs/template/lib/python3.9/site-packages/pytorch_lightning/utilities/cli.py", line 230, in parse_args
    argv = self._convert_argv_issue_84(classes, k, argv)
  File "/home1/wangtianshu/.local/share/conda/envs/template/lib/python3.9/site-packages/pytorch_lightning/utilities/cli.py", line 290, in _convert_argv_issue_84
    class_path = passed_args[f"{argv_key}.class_path"]
KeyError: '--data.class_path'

Expected behavior

run fit --config configs/mrpc.yaml --data.batch_size=64 --print_config=skip_null works correctly.

Environment

• Packages:
  • numpy: 1.22.2
  • pyTorch_debug: False
  • pyTorch_version: 1.11.0+cu113
  • pytorch-lightning: 1.5.10
  • tqdm: 4.63.0
• System:
  • OS: Linux
  • architecture:
    • 64bit
    • ELF
  • processor: x86_64
  • python: 3.9.7
  • version: #219-Ubuntu SMP Tue Aug 11 12:26:50 UTC 2020

cc @borda @carmocca @mauvilsa

[carmocca]

Opened that report in a separate issue @quancs

[quancs]

Opened that report in a separate issue @quancs

I thought my problem is relavant to this one (both related with init_args, and may have the same solution), so I posted it in this issue. Anyway, thank you for moving it. ^^