question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

docs: Update "Replicate Data" docs to recommend `meltano run` instead of `meltano elt`

See original GitHub issue

https://docs.meltano.com/guide/integration still references elt a lot in the intro and first couple of sections. It looks like https://docs.meltano.com/guide/integration#incremental-replication-state was updated to primarily reference run but not the entire page.

Brought up in slack https://meltano.slack.com/archives/C01TCRBBJD7/p1660159636797759 by @visch because the outdated language made it seem like the MELTANO_EXTRACT__LOAD_SCHEMA variable was only available when using elt.

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
tayloramurphycommented, Nov 1, 2022

@sbalnojan @afolson I’ve put this on the DevRel board. Since the tutorial recommends run, we should be consistent across the documentation and only recommend elt as part of an advanced usage.

1reaction
pandemicsyncommented, Aug 16, 2022

@pandemicsyn - To confirm, within the EL pair, the extractor can see the loader vars and vice versa, yes?

@aaronsteers yep both the extractor and loader can see all vars.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Replicate Data
You can run EL(T) pipelines using meltano elt . If you encounter some trouble running a pipeline, read our troubleshooting tips for some...
Read more >
Meltano 2.0 Migration Guide
The following list includes all recommended migration tasks as well as breaking changes in ... installation as per the dbt available adapters documentation....
Read more >
Complete Tutorial - Meltano Documentation
The extractor extracts all available records in the table on every run. To learn more about replication methods, refer to the Data Integration...
Read more >
Command Line - Meltano Documentation
This allows you to run your ELT pipeline to Extract, Load, and Transform data using an extractor and loader of your choosing, and...
Read more >
Troubleshooting - Meltano Documentation
Common Issues #. Problem: “Why do incremental runs produce duplicate data?” Singer takes an “at least once” approach to replication, so if you ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found