question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

feature: Include environment_name prefix in state_id for schedules

See original GitHub issue

Feature scope

API

Description

When you use the CLI to run a meltano run <tap> ... <target> command, the state id for that job will be automatically prefixed with the current environment. However, schedules do not behave this way, and they just use the schedule name as the state_id/job_name. I think this could result in a dev environment unintentionally overwriting prod state, if the two environments share a meltano system database.

I’d like it if schedules used an environment prefix as well. This would protect users from inadvertently altering state across environments.

The environment prefix behavior of meltano run is documented here, and I confirmed through a check in my own environment that v2.4.0 does not use environment prefixes for schedules, whether orchestrated or called via CLI (meltano schedule run).

Related:

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:7 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
tayloramurphycommented, Oct 23, 2022

@aaronsteers I don’t have an immediate concern with that 👍

1reaction
tayloramurphycommented, Oct 4, 2022

I confirmed through a check in my own environment that v2.4.0 does not use environment prefixes for schedules, whether orchestrated or called via CLI (meltano schedule run).

@qbatten this highlights the need for better versioned docs! cc @afolson @sbalnojan

Agreed that this would be a good feature to have. I wasn’t aware that schedule didn’t defer to meltano run for the state id. @pandemicsyn @aaronsteers is that your understanding of the behavior?

Read more comments on GitHub >

github_iconTop Results From Across the Web

Problem to renew certificate in GitLab (#218484) · Issues
Hi all! I'm with a problem when I tried to renew the certificate and too to clone repository. I upgraded recently the version...
Read more >
Command Line - Meltano Documentation
meltano add lets you add plugins to your Meltano project. ... run a pipeline with a custom state ID suffix # the autogenerated...
Read more >
salt/minion.rst at master · saltstack/salt · GitHub
Software to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository ...
Read more >
Server - CloudBees Documentation
Run procedure that creates application from deployment package. Arguments. Argument Name, Type, Description. artifactFileName.
Read more >
How to set hosting environment name for .NET Core console ...
Note how prefixes are used for the environment variable provider. – Gary Chan. Jan 20, 2021 at 6:31. Add a comment ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found