question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

bug: `stream_maps` configs inside environments arent used

See original GitHub issue

Meltano Version

2.8.0

Python Version

3.9

Bug scope

Configuration (settings parsing, validation, etc.)

Operating System

Mac

Description

When I configure stream_maps at the top level for my loader (target-apprise) it works as expected and when I run meltano config target-apprise I get:

{
  "uris": [
    "${SLACK_WEBHOOK_URI}"
  ],
  "stream_maps": {
    "my_stream": {
      "title": "TITLE",
      "body": "BODY"
    }
  }
}

but when I put the config inside an environment I run the same meltano config target-apprise and I only get:

{
  "uris": [
    "${SLACK_WEBHOOK_URI}"
  ]
}

which doesnt include my stream_map config that I need to set at the environment level.

Code

No response

Issue Analytics

  • State:open
  • Created a year ago
  • Reactions:1
  • Comments:7 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
aaronsteerscommented, Oct 29, 2022

@edgarrmondragon and @pnadolny13 - The issue description of #3171 specificall refers to arrays, whereas this issue relates to nesting values in subobjects but not arrays. It also introduces the distinction of object keys versus values, since the attempt here is to define a key of the sub-object using a dynamic interpolated string. This could be additional to the issue of value interpolation, or could be the same thing.

Do we think the issue is with one, some, or possibly all of these?:

  1. values in arrays
  2. subnodes of objects
  3. subobject keys (vs values)

Do we need this issue open in addition to #3171, or should we close this one and prioritize the other (optionally with slightly refined scope)?

0reactions
pnadolny13commented, Oct 31, 2022

@aaronsteers yeah youre right, its slightly different than described in https://github.com/meltano/meltano/issues/3171. My understanding is that we just havent implemented the logic to open up arrays and objects to expand their templated variables. Is that right?

Both are useful! This issue actually had both of those, an object key and also array values that were templated.

If thats true I’ll leave it to you all to decide if object support is in addition to https://github.com/meltano/meltano/issues/3171 or if its big enough to be a separate issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Inline Stream Maps - Meltano SDK
Enabling Stream Maps in SDK-Based Plugins . To support inline mapping functions, the developer only needs to declare two plugin settings, called...
Read more >
What is Value Stream Mapping (VSM), Benefits, Process and ...
“Value stream mapping is a lean manufacturing or lean enterprise technique used to document, analyze and improve the flow of information or ...
Read more >
Streaming record muxer error · Issue #743 - GitHub
Hello OME team, Describe the bug While streaming and recording with a drone, Application provided invalid, non monotonically increasing dts to muxer in...
Read more >
Common Salesforce Flow Errors and How to Troubleshoot Them
When working with flows, you may come across different errors, and although every time a flow interview fails Salesforce sends you an error...
Read more >
Lean & Environment Toolkit: Appendix A | US EPA
Common Icons Used in Value Stream Maps. Here is a key to Lean symbols used in the value stream maps in this toolkit....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found