question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Enable Meltano to use an SSH Tunnel

See original GitHub issue

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3501

Originally created by @vischous on 2022-05-17 17:06:17


Saw this thread on DBT slack https://getdbt.slack.com/archives/C0100SUQ0CW/p1652224126297119

SSH Tunneling via SSH itself is fairly straight forward as shown here https://www.ssh.com/academy/ssh/tunneling/example

If we wanted something more general, we could write a utility https://docs.meltano.com/concepts/plugins#utilities maybe using something like https://pypi.org/project/sshtunnel/.

The end result could be meltano run ssh-tunnel tap-postgres target-postgres

Possible outcomes of this issue:

  • Create a writeup for how to use SSH Tunnels with Taps/Targets
  • Create a SSH Tunnel Utility
  • Make an example / show it off of using the SSH Tunnel utility

Issue Analytics

  • State:open
  • Created a year ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

2reactions
DouweMcommented, Sep 9, 2022

@aaronsteers This is not about the system DB for a data stack component, but rather any transactional database backing an internal application at a company that they’d use tap-postgres, tap-mysql, tap-mssql etc for. If their Meltano project runs with us (so not hybrid: https://github.com/meltano/dragon/discussions/39), it’ll need to be able to securely connect with that internal database. Many users will not want to allow arbitrary logins from the public internet, so SSH tunnels have been a popular approach.

1reaction
DouweMcommented, Jul 22, 2022

@tayloramurphy This becomes a priority when we invest in the CDC use case.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Meltano Documentation
Welcome to the Meltano Documentation! Here you'll learn how to use Meltano, how Meltano is built, and where to get started.
Read more >
[FEATURE] SSH Tunnel for Database connections (MySQL)
So providing an SSH tunnel will enable those users to use the platform with confidence and not compromising on security. Front logo Front...
Read more >
SSH tunneling - Retool Docs
Open up a new connection for your database type. At the bottom of the form, there is a section that allows you to...
Read more >
freckles · ssh-tunnel-over-nginx
A Nginx web server (with valid Letsencrypt https certificate) proxies content from your local machine, after you established an ssh-tunnel. You can use...
Read more >
Job not finished with Kubernetes executor when a sub shell is ...
We recently switched over our runner, from a VM using the Docker ... keep open a port forwarding tunnel, so we're running into...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found