question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Unable to install kafka-connect-datagen:0.1.0

See original GitHub issue

After running docker-compose up -d in examples/cp-all-in-one i get the following error:

$ docker-compose up -d
Building connect
Downloading context: https://github.com/confluentinc/kafka-connect-datagen/raw/master/Dockerfile-confluenthub     778B
Step 1/3 : FROM confluentinc/cp-kafka-connect:5.0.0
 ---> 7df8759460f7
Step 2/3 : ENV CONNECT_PLUGIN_PATH="/usr/share/java,/usr/share/confluent-hub-components"
 ---> Using cache
 ---> 54861200b09e
Step 3/3 : RUN  confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:0.1.0
 ---> Running in e32e29b5eae7
Running in a "--no-prompt" mode 
java.net.UnknownHostException: api.hub.confluent.io 
 
Error: Unknown error 
ERROR: Service 'connect' failed to build: The command '/bin/sh -c confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:0.1.0' returned a non-zero code: 7

I was able to avoid this error after i set connect back to image: confluentinc/cp-kafka-connect:5.0.0 .

Issue Analytics

  • State:open
  • Created 5 years ago
  • Comments:36 (17 by maintainers)

github_iconTop GitHub Comments

3reactions
ybyzekcommented, Dec 20, 2018

If you’re willing, here is one more suggestion to try: instead of building the connector image locally, run the CP connect image and then manually install the connector.

  1. Remove these lines at: https://github.com/confluentinc/cp-docker-images/blob/5.1.0-post/examples/cp-all-in-one/docker-compose.yml#L51-L54
    image: confluentinc/kafka-connect-datagen:0.1.0
    build:
      context: https://github.com/confluentinc/kafka-connect-datagen/raw/master/Dockerfile-confluenthub
      dockerfile: Dockerfile-confluenthub

and replace it with the following line

    image: confluentinc/cp-kafka-connect:5.0.0
  1. Bring up the environment: docker-compose up -d

  2. Run the install command from within the connect container: docker-compose exec connect confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:0.1.0

2reactions
sadehartcommented, Apr 23, 2019

So a weird series of events just happened. As suggested, I manually downloaded the zip file into my downloads folder using https://www.confluent.io/connector/kafka-connect-datagen/#download. I then made a new folder in confluent-5.2.1/share called “confluent-hub-components”. Then, just for fun I tried rerunning confluent-hub install confluentinc/kafka-connect-datagen:0.1.2 and it worked fine. After that ran successfully, docker-compose up -d --build ran without error.

I dunno if it’s an issue with the folder not being there or if by manually downloading the thing I generated a valid certificate for the CLI to piggyback off of, but hopefully this provides some helpful info for resolvers (or at least a viable workaround).

Read more comments on GitHub >

github_iconTop Results From Across the Web

confluentinc/kafka-connect-datagen
Install the connector from Confluent Hub to a local Confluent Platform · Build connector from latest code · Run connector in local install....
Read more >
Unable to install kafka-connect-datagen:0.1.0
Unable to install kafka-connect-datagen :0.1.0. ... ERROR: Service 'connect' failed to build: The command '/bin/sh -c confluent-hub install ...
Read more >
Quick Start for Apache Kafka using Confluent Platform ...
Download, install, and set up Confluent Community components: open source ... Install the Kafka Connect Datagen source connector using the Confluent Hub ...
Read more >
Unable to run kafka connect datagen inside ...
I just added in the dockerfile and ran RUN confluent-hub install --no-prompt confluentinc/kafka-connect-datagen:0.4.0 inside the dockerfile.
Read more >
cnfldemos/kafka-connect-datagen:0.1.3-5.3.0
cnfldemos/kafka-connect-datagen:0.1.3-5.3.0 ... VOLUME [/var/lib/kafka/data /etc/kafka/secrets] ... /bin/sh -c confluent-hub install --no-prompt.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found