Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

kafka-connect-elastic: ES 5 support

See original GitHub issue

A sister issue reference: I might be missing something, but on the outside, I’d like to see the two projects merged and properly maintained.

That being said, I’m getting: java.lang.IllegalStateException: Received message from unsupported version: [2.0.0] minimal compatible version is: [5.0.0] on the elastic side, when trying to use fast-data-dev/kafka-connect-elastic with

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:13

github_iconTop GitHub Comments

stheppicommented, May 7, 2017

I will take care of the upgrade.This way it will be ‘properly’ maintained open source.

costacommented, Jul 4, 2017

@Antwnis Hey, I’ve pulled the latest image just now, and it seems to talk ES2 still. Also, I’m not sure how is it possible, but it both tries to talk ES2 protocol (according to the errors I see in the ES log) and shows the following error in its kafka-connect-ui page:

NoNodeAvailableException[None of the configured nodes are available: [{#transport#-1}{}{}]]
	at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(
	at org.elasticsearch.client.transport.TransportClientNodesService.execute(
	at org.elasticsearch.client.transport.TransportClient.doExecute(
	at com.sksamuel.elastic4s.CreateIndexDsl$CreateIndexDefinitionExecutable$$anonfun$apply$1.apply(CreateIndexDsl.scala:27)
	at com.sksamuel.elastic4s.CreateIndexDsl$CreateIndexDefinitionExecutable$$anonfun$apply$1.apply(CreateIndexDsl.scala:27)
	at com.sksamuel.elastic4s.Executable$class.injectFuture(Executable.scala:30)
	at com.sksamuel.elastic4s.CreateIndexDsl$CreateIndexDefinitionExecutable$.injectFuture(CreateIndexDsl.scala:24)
	at com.sksamuel.elastic4s.CreateIndexDsl$CreateIndexDefinitionExecutable$.apply(CreateIndexDsl.scala:27)
	at com.sksamuel.elastic4s.CreateIndexDsl$CreateIndexDefinitionExecutable$.apply(CreateIndexDsl.scala:24)
	at com.sksamuel.elastic4s.ElasticClient.execute(ElasticClient.scala:20)
	at com.datamountaineer.streamreactor.connect.elastic.ElasticJsonWriter$$anonfun$createIndexes$1.apply(ElasticJsonWriter.scala:47)
	at com.datamountaineer.streamreactor.connect.elastic.ElasticJsonWriter$$anonfun$createIndexes$1.apply(ElasticJsonWriter.scala:47)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at scala.collection.TraversableLike$
	at com.datamountaineer.streamreactor.connect.elastic.ElasticJsonWriter.createIndexes(ElasticJsonWriter.scala:47)
	at com.datamountaineer.streamreactor.connect.elastic.ElasticJsonWriter.<init>(ElasticJsonWriter.scala:36)
	at com.datamountaineer.streamreactor.connect.elastic.ElasticWriter$.apply(ElasticWriter.scala:43)
	at com.datamountaineer.streamreactor.connect.elastic.ElasticSinkTask.start(ElasticSinkTask.scala:59)
	at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(
	at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(
	at org.apache.kafka.connect.runtime.WorkerTask.doRun(
	at java.util.concurrent.Executors$
	at java.util.concurrent.ThreadPoolExecutor.runWorker(
	at java.util.concurrent.ThreadPoolExecutor$

while the specified ES node is actually available (checked the connectivity from inside the fast-data-dev container to that IP:port).

Read more comments on GitHub >

github_iconTop Results From Across the Web

Changelog | Confluent Documentation
PR-635 - CCMSG-1958: Elasticsearch 8 support through compatibility mode. Version 13.1.3¶. PR-661 - CCMSG-2220: Updated jackson dependency to resolve CVE-2022- ...
Read more >
Kafka Connect and Elasticsearch - rmoff's random ramblings
Kafka Connect's Elasticsearch sink connector has been improved in 5.3.1 to fully support Elasticsearch 7. To stream data from a Kafka topic ...
Read more >
Working with Kafka Elasticsearch Connector Simplified
It supports many data outputs from the Kafka topics such as Avro, JSON Schema, Protobuf, or JSON-schemaless. It publishes data to an ...
Read more >
Kafka Connect Elasticsearch: Consuming and Indexing with ...
1. Run $ git clone -b 2. Run $ cd kafka-connect-elasticsearch 3. The final thing that we need to do is...
Read more >
is transforms working in to elastic cloud
we're excited to announce that most of our Confluent Cloud connectors now support single message transforms, connector log events, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found