Enable Meltano to use an SSH Tunnel
See original GitHub issueMigrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3501
Originally created by @vischous on 2022-05-17 17:06:17
Saw this thread on DBT slack https://getdbt.slack.com/archives/C0100SUQ0CW/p1652224126297119
SSH Tunneling via SSH itself is fairly straight forward as shown here https://www.ssh.com/academy/ssh/tunneling/example
If we wanted something more general, we could write a utility https://docs.meltano.com/concepts/plugins#utilities maybe using something like https://pypi.org/project/sshtunnel/.
The end result could be
meltano run ssh-tunnel tap-postgres target-postgres
Possible outcomes of this issue:
- Create a writeup for how to use SSH Tunnels with Taps/Targets
- Create a SSH Tunnel Utility
- Make an example / show it off of using the SSH Tunnel utility
Issue Analytics
- State:
- Created a year ago
- Comments:5 (3 by maintainers)
Top Results From Across the Web
Meltano Documentation
Welcome to the Meltano Documentation! Here you'll learn how to use Meltano, how Meltano is built, and where to get started.
Read more >[FEATURE] SSH Tunnel for Database connections (MySQL)
So providing an SSH tunnel will enable those users to use the platform with confidence and not compromising on security. Front logo Front...
Read more >SSH tunneling - Retool Docs
Open up a new connection for your database type. At the bottom of the form, there is a section that allows you to...
Read more >freckles · ssh-tunnel-over-nginx
A Nginx web server (with valid Letsencrypt https certificate) proxies content from your local machine, after you established an ssh-tunnel. You can use...
Read more >Job not finished with Kubernetes executor when a sub shell is ...
We recently switched over our runner, from a VM using the Docker ... keep open a port forwarding tunnel, so we're running into...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@aaronsteers This is not about the system DB for a data stack component, but rather any transactional database backing an internal application at a company that they’d use tap-postgres, tap-mysql, tap-mssql etc for. If their Meltano project runs with us (so not hybrid: https://github.com/meltano/dragon/discussions/39), it’ll need to be able to securely connect with that internal database. Many users will not want to allow arbitrary logins from the public internet, so SSH tunnels have been a popular approach.
@tayloramurphy This becomes a priority when we invest in the CDC use case.