confluent-hub install through proxy
See original GitHub issueI’m trying to run docker-compose up -d --build according to documentation but the process gets stuck on building step:
Step 5/5 : RUN confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:latest
---> Running in c4b8de698b86
Running in a "--no-prompt" mode
java.net.ConnectException: Connection timed out (Connection timed out)
Server that I’m running docker on doesn’t have direct Internet access and configured to use proxy server so I tried to add environment variables to Dockerfile:
ENV HTTP_PROXY="my_proxy"
ENV HTTPS_PROXY="my_proxy"
But it doesn’t help.
I’ve pulled confluentinc/cp-kafka-connect:5.2.1 docker image, run it interactively and tried to install kafka-connect-datagen:latest manually
docker pull confluentinc/cp-kafka-connect:5.2.1
docker run -it --rm confluentinc/cp-kafka-connect:5.2.1 /bin/bash
export http_proxy=MY_PROXY_ADDRESS
export https_proxy=MY_PROXY_ADDRESS
confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:latest
But the image still cannot be downloaded.
curl -I https://api.hub.confluent.io/api/plugins says that connection was successful so obviously there is no proxy support for confluent-hub client. Is there any workaround for this issue?
Issue Analytics
- State:
- Created 4 years ago
- Reactions:1
- Comments:7 (1 by maintainers)
Top Results From Across the Web
confluent-hub install | Confluent Platform 4.1.0
The local directory into which components are installed. Defaults to $share/confluent-hub-components when running the client in an archive ...
Read more >Installing kafka-connect-spooldir doesn't work - Stack Overflow
I assume that you are attempting to run confluent-hub install behind a proxy. If this is the case, then the following should do...
Read more >Proxy and HTTPS setup for Confluence
HTTPS - Proxying Confluence via Apache or Nginx over HTTPS, Use this option when you want to use a reverse proxy and enable...
Read more >confluentinc/cp-kafka-rest - Docker Image
Confluent Docker Image for the REST Proxy. Docker image for deploying and running the REST Proxy. The source code is are currently available...
Read more >GitHub - grepplabs/kafka-proxy
kafka -proxy. Build Status Docker Hub Docker Pulls. The Kafka Proxy is based on idea of Cloud SQL Proxy. It allows a service...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
As usual, I managed to fix the problem by myself right after posting 😃 Proxy parameters are taken from zulu-8-amd64 package so I simply add few lines into Dockerfile which define default proxy settings for Java:
I use the image
confluentinc/ksqldb-server:0.17.0
and installation viaconfluent-hub install
in the docker-compose command option, as you can see in https://github.com/confluentinc/demo-scene/blob/master/ksqldb-tombstones/docker-compose.yml. In this version zulu11 is used and you have to edit/usr/lib/jvm/zulu11/conf/net.properties
. This cannot be edited by the docker-compose command option, because the user has not enough permissons. So I copied thenet.properties
withdocker cp ksqldb:/usr/lib/jvm/zulu11/conf/net.properties .
, edited and mounted thenet.properties
by:In the
net.properties
it is important to not use the schema, sohttp://
before the hosts, as so: