jackson-databind conflicts with Spark's

I am trying reading a CSV file using dataframes (Spark 2.2.0) like so:

Dataset<Row> df = spark.read()
			.format("csv")
			.option("sep", "\t")
			.option("header", "true")
			.option("inferSchema", "true")
			.load("/tmp/example.csv");

This fails with a Exception in thread "main" java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JavaType.isReferenceType()Z exception. This is the content of the pom.xml file:

<dependencies>
  	<dependency>
  		<groupId>org.apache.spark</groupId>
  		<artifactId>spark-core_2.11</artifactId>
  		<version>2.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>org.apache.spark</groupId>
  		<artifactId>spark-sql_2.11</artifactId>
  		<version>2.2.0</version>
  	</dependency>
  	<dependency>
  		<groupId>com.lucidworks.spark</groupId>
  		<artifactId>spark-solr</artifactId>
  		<version>3.2.0</version>
  	</dependency>
</dependencies>

The jackson-databind version (2.4.0) is omitted due to a conflict with Spark’s 2.6.5 version. Can it be updated?

[nvitucci]

Excluding any version of jackson-databind does not work. Adding it explicitly to the pom file (together with its related packages) apparently solves the problem:

<dependency>
  <groupId>com.fasterxml.jackson.core</groupId>
  <artifactId>jackson-databind</artifactId>
  <version>2.6.5</version>
</dependency>
<dependency>
  <groupId>com.fasterxml.jackson.core</groupId>
  <artifactId>jackson-annotations</artifactId>
  <version>2.6.5</version>
</dependency>
<dependency>
  <groupId>com.fasterxml.jackson.core</groupId>
  <artifactId>jackson-core</artifactId>
  <version>2.6.5</version>
</dependency>

[jackson-chris]

Just stumbled across this same problem. I believe the correct solution when targeting spark 2.2.0 and spark-solr 3.3.4 version is to just list the spark-solr dependency as follows:

<dependency>
  <groupId>com.lucidworks.spark</groupId>
  <artifactId>spark-solr</artifactId>
  <version>3.3.4</version>
    <exclusions>
      <exclusion>
         <!-- use the jackson libraries specified by solr dependencies -->
         <groupId>com.fasterxml.jackson.core</groupId>
         <artifactId>jackson-core</artifactId>
      </exclusion>
    </exclusions>
</dependency>

With this approach there is no need to include specific versions of the jackson-core, jackson-databind, and jackson-annotations as the correct versions will be transitively included via the spark dependencies.