Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Error returned by Apicurio not compliant with Confluent Schema Registry Client in Databricks

See original GitHub issue

Hi all,

We are trying to use Apicurio as a schema registry. Apicurio should be fully compliant with Confluent’s API. However, we are trying to register a schema from Azure databricks. The confluent client in this case gets (for unknown reasons) an error returned. The error from apicurio contains the field “detail”, crashing the schema registry client from confluent without us knowing what the possible cause is. Apicurio logging doesn’t help either. How is this fixable/error showable?

Job aborted due to stage failure: Task 3 in stage 35.0 failed 1 times, most recent failure: Lost task 3.0 in stage 35.0 (TID 143, 10.139.64.4, executor driver): org.spark_project.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException: Unrecognized field "detail" (class org.spark_project.confluent.kafka.schemaregistry.client.rest.entities.ErrorMessage), not marked as ignorable (2 known properties: "error_code", "message"])
 at [Source: (sun.net.www.protocol.http.HttpURLConnection$HttpInputStream); line: 1, column: 222] (through reference chain: org.spark_project.confluent.kafka.schemaregistry.client.rest.entities.ErrorMessage["detail"]); error code: 50005

Issue Analytics

State:
Created 3 years ago
Comments:6 (5 by maintainers)

Top GitHub Comments

2reactions

jelmewcommented, Jan 15, 2021

Bug is not in recent version, Thanksalot.

1reaction

carlesarnalcommented, Jan 19, 2021

@EricWittmann this was fixed here and released in version 1.2.1.Final.

Top Results From Across the Web

Accessing confluent schema registry from databricks with ...

locally with scala - works (via the same prod schema registry); in the cluster with python - works; in the cluster with scala...

Using Apache Kafka with Schema Registry and Avro - Quarkus

This guide shows how your Quarkus application can use Apache Kafka, Avro serialized records, and connect to a schema registry (such as the...

Validating Kafka messages using serializers/deserializers in ...

The Kafka client serializer uses lookup strategies to determine the artifact ID and global ID under which the message schema is registered in...

The Art of Building Open Data Lakes with Apache Hudi, Kafka ...

Replace Apache Hive with AWS Glue Data Catalog, a fully-managed Hive-compatible metastore. Replace Apicurio Registry with Confluent Schema ...

Apicurio/apicurio-registry 2.0.0.RC1 on GitHub

... Error returned by Apicurio not compliant with Confluent Schema Registry Client in Databricks #1081; [Enhancement] Kafka+SQL - add tombstone Kafka ...