Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Zeppelin NoClassDefFoundError when the JAR is used

See original GitHub issue

Hi, If I use --package in my Zeppelin everything is fine. But when I use the JAR in my Zeppelin I receive this error: (I use JAR because it’s on HDFS and it has a faster session creation for users)

java.lang.NoClassDefFoundError: com/typesafe/config/ConfigMergeable
  at com.johnsnowlabs.nlp.serialization.Feature.<init>(Feature.scala:15)
  at com.johnsnowlabs.nlp.serialization.MapFeature.<init>(Feature.scala:142)
  at com.johnsnowlabs.nlp.annotators.NormalizerModel.<init>(NormalizerModel.scala:21)
  at com.johnsnowlabs.nlp.annotators.NormalizerModel.<init>(NormalizerModel.scala:23)
  at com.johnsnowlabs.nlp.annotators.Normalizer.train(Normalizer.scala:60)
  at com.johnsnowlabs.nlp.annotators.Normalizer.train(Normalizer.scala:16)
  at com.johnsnowlabs.nlp.AnnotatorApproach.fit(AnnotatorApproach.scala:33)
  at org.apache.spark.ml.Pipeline$$anonfun$fit$2.apply(Pipeline.scala:153)
  at org.apache.spark.ml.Pipeline$$anonfun$fit$2.apply(Pipeline.scala:149)
  at scala.collection.Iterator$class.foreach(Iterator.scala:893)
  at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
  at scala.collection.IterableViewLike$Transformed$class.foreach(IterableViewLike.scala:44)
  at scala.collection.SeqViewLike$AbstractTransformed.foreach(SeqViewLike.scala:37)
  at org.apache.spark.ml.Pipeline.fit(Pipeline.scala:149)
  ... 58 elided
Caused by: java.lang.ClassNotFoundException: com.typesafe.config.ConfigMergeable
  at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
  at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
  at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
  ... 72 more

Many thanks, Maziyar

Issue Analytics

State:
Created 5 years ago
Comments:15 (13 by maintainers)

Top GitHub Comments

1reaction

maziyarpanahicommented, Oct 31, 2020

@aburkov please have a look at the release notes, each release has all the fat jars listed at the bottom and hosted on S3.

1reaction

saif-ellaficommented, May 30, 2018

Why aren’t you using --packages? this downloads all necessary dependencies automatically.

We have realized recently that to use --jars, we need to include the fat-jar (i.e. result of sbt assembly). We’ll be updating the website with the fat-jar to download. but for now you’ll have to clone and assembly yourself