question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Change default `meltano config` behavior to `--no-environment`

See original GitHub issue

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3503

Originally created by @aaronsteers on 2022-05-18 03:06:00


I keep running into this and I think it’s worth reconsidering the defaults here.

In CI - my CLI commands looked fine and only after 'cat’ing my meltano.yml file was I able to diagnose the issue here.

$ meltano config tap-gitlab set _pip_url git+https://github.com/MeltanoLabs/tap-gitlab.git@main
2022-05-18T00:23:28.361467Z [info     ] Environment 'dev' is active
Extractor 'tap-gitlab' setting '_pip_url' was set in `meltano_environment`: 'git+https://github.com/MeltanoLabs/tap-gitlab.git@main'
$ cat meltano.yml
version: 1
default_environment: dev
send_anonymous_usage_stats: false
plugins:
  extractors:
  - name: tap-gitlab
    variant: meltanolabs
    pip_url: git+https://github.com/MeltanoLabs/tap-gitlab.git
environments:
- name: dev
  config:
    plugins:
      extractors:
      - name: tap-gitlab
        pip_url: git+https://github.com/MeltanoLabs/tap-gitlab.git@main

This one is particularly sticky because ‘pip_url’ at the environment level seems to be a noop.

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:12 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
DouweMcommented, Jun 8, 2022
1reaction
DouweMcommented, Jun 8, 2022

@aaronsteers Note that setting pip_url using meltano config <plugin> set _pip_url <url> is not actually expected to work at all, as it’s not a plugin extra or setting, but a key plugin definition property. If we document that anywhere, we shouldn’t. It’s not working under environments because it wasn’t meant to.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Manage Configuration
You can use meltano config <plugin> list to list all available settings for a plugin with their names, environment variables, and current values....
Read more >
Change default behavior in `meltano config ... set` when `kind` is ...
We should considering altering how Meltano behaves when kind is missing from specific settings. The default behavior when kind is not know would...
Read more >
meltano - PyPI
Meltano is an open source convention-over-configuration product for the whole data lifecycle, all the way from loading data to analyzing it. It ...
Read more >
Working with Project Settings in the AWS Cloud9 Integrated ...
Describes how to work with project settings in the AWS Cloud9 IDE.
Read more >
Jacob Matson, Author at DataDuel.co
This target can take data from any Meltano tap and load it into DuckDB. ... The default settings inside HyperV is for an...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found