Change default `meltano config` behavior to `--no-environment`
See original GitHub issueMigrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3503
Originally created by @aaronsteers on 2022-05-18 03:06:00
I keep running into this and I think it’s worth reconsidering the defaults here.
In CI - my CLI commands looked fine and only after 'cat’ing my meltano.yml
file was I able to diagnose the issue here.
$ meltano config tap-gitlab set _pip_url git+https://github.com/MeltanoLabs/tap-gitlab.git@main
2022-05-18T00:23:28.361467Z [info ] Environment 'dev' is active
Extractor 'tap-gitlab' setting '_pip_url' was set in `meltano_environment`: 'git+https://github.com/MeltanoLabs/tap-gitlab.git@main'
$ cat meltano.yml
version: 1
default_environment: dev
send_anonymous_usage_stats: false
plugins:
extractors:
- name: tap-gitlab
variant: meltanolabs
pip_url: git+https://github.com/MeltanoLabs/tap-gitlab.git
environments:
- name: dev
config:
plugins:
extractors:
- name: tap-gitlab
pip_url: git+https://github.com/MeltanoLabs/tap-gitlab.git@main
This one is particularly sticky because ‘pip_url’ at the environment level seems to be a noop.
Issue Analytics
- State:
- Created a year ago
- Reactions:1
- Comments:12 (5 by maintainers)
Top Results From Across the Web
Manage Configuration
You can use meltano config <plugin> list to list all available settings for a plugin with their names, environment variables, and current values....
Read more >Change default behavior in `meltano config ... set` when `kind` is ...
We should considering altering how Meltano behaves when kind is missing from specific settings. The default behavior when kind is not know would...
Read more >meltano - PyPI
Meltano is an open source convention-over-configuration product for the whole data lifecycle, all the way from loading data to analyzing it. It ...
Read more >Working with Project Settings in the AWS Cloud9 Integrated ...
Describes how to work with project settings in the AWS Cloud9 IDE.
Read more >Jacob Matson, Author at DataDuel.co
This target can take data from any Meltano tap and load it into DuckDB. ... The default settings inside HyperV is for an...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@aaronsteers The top-level specific issue is https://github.com/meltano/meltano/issues/6101.
@aaronsteers Note that setting
pip_url
usingmeltano config <plugin> set _pip_url <url>
is not actually expected to work at all, as it’s not a plugin extra or setting, but a key plugin definition property. If we document that anywhere, we shouldn’t. It’s not working underenvironments
because it wasn’t meant to.