Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Failing on Running Examples, java.lang.RuntimeException: [download failed: asm#asm;3.1!asm.jar
See original GitHub issueI’m trying to run the examples,
spark-submit --verbose --class org.apache.spark.sql.execution.datasources.hbase.examples.HBaseSource --packages com.hortonworks:shc-core:1.1.1-2.1-s_2.11 --repositories http://repo.hortonworks.com/content/groups/public/ examples/target/shc-examples-1.1.2-2.2-s_2.11-SNAPSHOT.jar
lab:shc danielmantovani$ spark-submit --version Using Scala version 2.11.8, Java HotSpot(TM) 64-Bit Server VM, 1.8.0_144 Branch Compiled by user felixcheung on 2017-11-24T23:19:45Z Revision Url Type --help for more information.
I’m having the following error:
Using properties file: null
Parsed arguments:
master local[*]
deployMode null
executorMemory null
executorCores null
totalExecutorCores null
propertiesFile null
driverMemory null
driverCores null
driverExtraClassPath null
driverExtraLibraryPath null
driverExtraJavaOptions null
supervise false
queue null
numExecutors null
files null
pyFiles null
archives null
mainClass org.apache.spark.sql.execution.datasources.hbase.examples.HBaseSource
primaryResource file:/Users/danielmantovani/projects/shc/examples/target/shc-examples-1.1.2-2.2-s_2.11-SNAPSHOT.jar
name org.apache.spark.sql.execution.datasources.hbase.examples.HBaseSource
childArgs []
jars null
packages com.hortonworks:shc-core:1.1.1-2.1-s_2.11
packagesExclusions null
repositories http://repo.hortonworks.com/content/groups/public/
verbose true
Spark properties used, including those specified through
--conf and those from the properties file null:
http://repo.hortonworks.com/content/groups/public/ added as a remote repository with the name: repo-1
Ivy Default Cache set to: /Users/danielmantovani/.ivy2/cache
The jars for the packages stored in: /Users/danielmantovani/.ivy2/jars
:: loading settings :: url = jar:file:/usr/local/Cellar/apache-spark/2.2.1/libexec/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
com.hortonworks#shc-core added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
confs: [default]
found com.hortonworks#shc-core;1.1.1-2.1-s_2.11 in repo-1
found org.apache.hbase#hbase-server;1.1.2 in local-m2-cache
found org.apache.hbase#hbase-protocol;1.1.2 in local-m2-cache
found org.apache.hbase#hbase-annotations;1.1.2 in local-m2-cache
found com.github.stephenc.findbugs#findbugs-annotations;1.3.9-1 in local-m2-cache
found log4j#log4j;1.2.17 in user-list
found junit#junit;4.11 in local-m2-cache
found org.hamcrest#hamcrest-core;1.3 in user-list
found com.google.protobuf#protobuf-java;2.5.0 in user-list
found org.apache.hbase#hbase-procedure;1.1.2 in local-m2-cache
found com.google.guava#guava;12.0.1 in local-m2-cache
found com.google.code.findbugs#jsr305;1.3.9 in user-list
found org.apache.hbase#hbase-client;1.1.2 in local-m2-cache
found commons-codec#commons-codec;1.9 in user-list
found commons-io#commons-io;2.4 in user-list
found commons-lang#commons-lang;2.6 in user-list
found io.netty#netty-all;4.0.23.Final in local-m2-cache
found org.apache.zookeeper#zookeeper;3.4.6 in user-list
found org.slf4j#slf4j-api;1.7.7 in user-list
found org.slf4j#slf4j-log4j12;1.6.1 in local-m2-cache
found org.apache.htrace#htrace-core;3.1.0-incubating in local-m2-cache
found org.codehaus.jackson#jackson-mapper-asl;1.9.13 in user-list
found org.codehaus.jackson#jackson-core-asl;1.9.13 in user-list
found org.jruby.jcodings#jcodings;1.0.8 in local-m2-cache
found org.jruby.joni#joni;2.1.2 in local-m2-cache
found commons-httpclient#commons-httpclient;3.1 in user-list
found commons-collections#commons-collections;3.2.1 in user-list
found com.yammer.metrics#metrics-core;2.2.0 in local-m2-cache
found com.sun.jersey#jersey-core;1.9 in local-m2-cache
found com.sun.jersey#jersey-server;1.9 in local-m2-cache
found commons-cli#commons-cli;1.2 in user-list
found org.apache.commons#commons-math;2.2 in local-m2-cache
found org.mortbay.jetty#jetty;6.1.26 in local-m2-cache
found org.mortbay.jetty#jetty-util;6.1.26 in user-list
found org.mortbay.jetty#jetty-sslengine;6.1.26 in local-m2-cache
found org.mortbay.jetty#jsp-2.1;6.1.14 in local-m2-cache
found org.mortbay.jetty#jsp-api-2.1;6.1.14 in local-m2-cache
found org.mortbay.jetty#servlet-api-2.5;6.1.14 in local-m2-cache
found org.codehaus.jackson#jackson-jaxrs;1.9.13 in user-list
found tomcat#jasper-compiler;5.5.23 in local-m2-cache
found org.jamon#jamon-runtime;2.3.1 in local-m2-cache
found com.lmax#disruptor;3.3.0 in local-m2-cache
found org.apache.hbase#hbase-prefix-tree;1.1.2 in local-m2-cache
found org.mortbay.jetty#servlet-api;2.5-20081211 in local-m2-cache
found tomcat#jasper-runtime;5.5.23 in local-m2-cache
found commons-el#commons-el;1.0 in local-m2-cache
found org.apache.hbase#hbase-common;1.1.2 in local-m2-cache
found org.apache.phoenix#phoenix-core;4.9.0-HBase-1.1 in local-m2-cache
found org.apache.tephra#tephra-api;0.9.0-incubating in local-m2-cache
found org.apache.tephra#tephra-hbase-compat-1.1;0.9.0-incubating in local-m2-cache
found org.apache.tephra#tephra-core;0.9.0-incubating in local-m2-cache
found com.google.code.gson#gson;2.2.4 in user-list
found com.google.guava#guava;13.0.1 in local-m2-cache
found com.google.inject#guice;3.0 in user-list
found javax.inject#javax.inject;1 in user-list
found aopalliance#aopalliance;1.0 in user-list
found org.sonatype.sisu.inject#cglib;2.2.1-v20090111 in user-list
found asm#asm;3.1 in local-m2-cache
found com.google.inject.extensions#guice-assistedinject;3.0 in local-m2-cache
found ch.qos.logback#logback-classic;1.0.9 in local-m2-cache
found ch.qos.logback#logback-core;1.0.9 in local-m2-cache
found org.apache.thrift#libthrift;0.9.0 in local-m2-cache
found org.apache.httpcomponents#httpcore;4.1.3 in local-m2-cache
found it.unimi.dsi#fastutil;6.5.6 in local-m2-cache
found org.apache.twill#twill-common;0.6.0-incubating in local-m2-cache
found com.google.code.findbugs#jsr305;2.0.1 in local-m2-cache
found org.apache.twill#twill-core;0.6.0-incubating in local-m2-cache
found org.apache.twill#twill-api;0.6.0-incubating in local-m2-cache
found org.apache.twill#twill-discovery-api;0.6.0-incubating in local-m2-cache
found org.apache.twill#twill-zookeeper;0.6.0-incubating in local-m2-cache
found org.apache.twill#twill-discovery-core;0.6.0-incubating in local-m2-cache
found org.ow2.asm#asm-all;5.0.2 in local-m2-cache
found io.dropwizard.metrics#metrics-core;3.1.0 in local-m2-cache
found org.antlr#antlr-runtime;3.5.2 in user-list
found jline#jline;2.11 in local-m2-cache
found sqlline#sqlline;1.2.0 in local-m2-cache
found joda-time#joda-time;1.6 in local-m2-cache
found com.github.stephenc.jcip#jcip-annotations;1.0-1 in local-m2-cache
found junit#junit;4.12 in user-list
found org.apache.httpcomponents#httpclient;4.0.1 in local-m2-cache
found commons-logging#commons-logging;1.2 in user-list
found org.iq80.snappy#snappy;0.3 in local-m2-cache
found commons-collections#commons-collections;3.2.2 in user-list
found org.apache.commons#commons-csv;1.0 in local-m2-cache
found org.apache.hbase#hbase-annotations;1.1.3 in local-m2-cache
found org.apache.hbase#hbase-protocol;1.1.3 in local-m2-cache
found org.apache.hadoop#hadoop-common;2.7.1 in local-m2-cache
found org.apache.hadoop#hadoop-annotations;2.7.1 in local-m2-cache
found org.apache.commons#commons-math3;3.1.1 in local-m2-cache
found xmlenc#xmlenc;0.52 in user-list
found commons-net#commons-net;3.1 in local-m2-cache
found javax.servlet#servlet-api;2.5 in local-m2-cache
found com.sun.jersey#jersey-json;1.9 in local-m2-cache
found org.codehaus.jettison#jettison;1.1 in user-list
found com.sun.xml.bind#jaxb-impl;2.2.3-1 in local-m2-cache
found javax.xml.bind#jaxb-api;2.2.2 in user-list
found javax.xml.stream#stax-api;1.0-2 in user-list
found javax.activation#activation;1.1 in user-list
found org.codehaus.jackson#jackson-xc;1.9.2 in central
found net.java.dev.jets3t#jets3t;0.9.0 in local-m2-cache
found org.apache.httpcomponents#httpcore;4.2.5 in central
found com.jamesmurty.utils#java-xmlbuilder;0.4 in local-m2-cache
found commons-configuration#commons-configuration;1.6 in user-list
found commons-digester#commons-digester;1.8 in user-list
found commons-beanutils#commons-beanutils;1.7.0 in user-list
found commons-beanutils#commons-beanutils-core;1.8.0 in user-list
found org.apache.hadoop#hadoop-auth;2.7.1 in local-m2-cache
found org.apache.directory.server#apacheds-kerberos-codec;2.0.0-M15 in user-list
found org.apache.directory.server#apacheds-i18n;2.0.0-M15 in user-list
found org.apache.directory.api#api-asn1-api;1.0.0-M20 in user-list
found org.apache.directory.api#api-util;1.0.0-M20 in user-list
found org.apache.curator#curator-framework;2.7.1 in local-m2-cache
found org.apache.curator#curator-client;2.7.1 in local-m2-cache
found com.jcraft#jsch;0.1.42 in local-m2-cache
found org.apache.curator#curator-recipes;2.7.1 in local-m2-cache
found org.apache.commons#commons-compress;1.4.1 in user-list
found org.tukaani#xz;1.0 in user-list
found org.apache.hadoop#hadoop-mapreduce-client-core;2.7.1 in local-m2-cache
found org.apache.hadoop#hadoop-yarn-common;2.7.1 in local-m2-cache
found org.apache.hadoop#hadoop-yarn-api;2.7.1 in local-m2-cache
found com.sun.jersey#jersey-client;1.9 in local-m2-cache
found com.google.inject.extensions#guice-servlet;3.0 in local-m2-cache
found com.sun.jersey.contribs#jersey-guice;1.9 in local-m2-cache
found org.slf4j#slf4j-log4j12;1.7.10 in local-m2-cache
found io.netty#netty;3.6.2.Final in local-m2-cache
found javax.servlet.jsp#jsp-api;2.1 in local-m2-cache
found org.apache.avro#avro;1.7.6 in user-list
found com.thoughtworks.paranamer#paranamer;2.3 in user-list
found org.xerial.snappy#snappy-java;1.0.5 in user-list
:: resolution report :: resolve 14273ms :: artifacts dl 43ms
:: modules in use:
aopalliance#aopalliance;1.0 from user-list in [default]
asm#asm;3.1 from local-m2-cache in [default]
ch.qos.logback#logback-classic;1.0.9 from local-m2-cache in [default]
ch.qos.logback#logback-core;1.0.9 from local-m2-cache in [default]
com.github.stephenc.findbugs#findbugs-annotations;1.3.9-1 from local-m2-cache in [default]
com.github.stephenc.jcip#jcip-annotations;1.0-1 from local-m2-cache in [default]
com.google.code.findbugs#jsr305;2.0.1 from local-m2-cache in [default]
com.google.code.gson#gson;2.2.4 from user-list in [default]
com.google.guava#guava;13.0.1 from local-m2-cache in [default]
com.google.inject#guice;3.0 from user-list in [default]
com.google.inject.extensions#guice-assistedinject;3.0 from local-m2-cache in [default]
com.google.inject.extensions#guice-servlet;3.0 from local-m2-cache in [default]
com.google.protobuf#protobuf-java;2.5.0 from user-list in [default]
com.hortonworks#shc-core;1.1.1-2.1-s_2.11 from repo-1 in [default]
com.jamesmurty.utils#java-xmlbuilder;0.4 from local-m2-cache in [default]
com.jcraft#jsch;0.1.42 from local-m2-cache in [default]
com.lmax#disruptor;3.3.0 from local-m2-cache in [default]
com.sun.jersey#jersey-client;1.9 from local-m2-cache in [default]
com.sun.jersey#jersey-core;1.9 from local-m2-cache in [default]
com.sun.jersey#jersey-json;1.9 from local-m2-cache in [default]
com.sun.jersey#jersey-server;1.9 from local-m2-cache in [default]
com.sun.jersey.contribs#jersey-guice;1.9 from local-m2-cache in [default]
com.sun.xml.bind#jaxb-impl;2.2.3-1 from local-m2-cache in [default]
com.thoughtworks.paranamer#paranamer;2.3 from user-list in [default]
com.yammer.metrics#metrics-core;2.2.0 from local-m2-cache in [default]
commons-beanutils#commons-beanutils;1.7.0 from user-list in [default]
commons-beanutils#commons-beanutils-core;1.8.0 from user-list in [default]
commons-cli#commons-cli;1.2 from user-list in [default]
commons-codec#commons-codec;1.9 from user-list in [default]
commons-collections#commons-collections;3.2.2 from user-list in [default]
commons-configuration#commons-configuration;1.6 from user-list in [default]
commons-digester#commons-digester;1.8 from user-list in [default]
commons-el#commons-el;1.0 from local-m2-cache in [default]
commons-httpclient#commons-httpclient;3.1 from user-list in [default]
commons-io#commons-io;2.4 from user-list in [default]
commons-lang#commons-lang;2.6 from user-list in [default]
commons-logging#commons-logging;1.2 from user-list in [default]
commons-net#commons-net;3.1 from local-m2-cache in [default]
io.dropwizard.metrics#metrics-core;3.1.0 from local-m2-cache in [default]
io.netty#netty;3.6.2.Final from local-m2-cache in [default]
io.netty#netty-all;4.0.23.Final from local-m2-cache in [default]
it.unimi.dsi#fastutil;6.5.6 from local-m2-cache in [default]
javax.activation#activation;1.1 from user-list in [default]
javax.inject#javax.inject;1 from user-list in [default]
javax.servlet#servlet-api;2.5 from local-m2-cache in [default]
javax.servlet.jsp#jsp-api;2.1 from local-m2-cache in [default]
javax.xml.bind#jaxb-api;2.2.2 from user-list in [default]
javax.xml.stream#stax-api;1.0-2 from user-list in [default]
jline#jline;2.11 from local-m2-cache in [default]
joda-time#joda-time;1.6 from local-m2-cache in [default]
junit#junit;4.12 from user-list in [default]
log4j#log4j;1.2.17 from user-list in [default]
net.java.dev.jets3t#jets3t;0.9.0 from local-m2-cache in [default]
org.antlr#antlr-runtime;3.5.2 from user-list in [default]
org.apache.avro#avro;1.7.6 from user-list in [default]
org.apache.commons#commons-compress;1.4.1 from user-list in [default]
org.apache.commons#commons-csv;1.0 from local-m2-cache in [default]
org.apache.commons#commons-math;2.2 from local-m2-cache in [default]
org.apache.commons#commons-math3;3.1.1 from local-m2-cache in [default]
org.apache.curator#curator-client;2.7.1 from local-m2-cache in [default]
org.apache.curator#curator-framework;2.7.1 from local-m2-cache in [default]
org.apache.curator#curator-recipes;2.7.1 from local-m2-cache in [default]
org.apache.directory.api#api-asn1-api;1.0.0-M20 from user-list in [default]
org.apache.directory.api#api-util;1.0.0-M20 from user-list in [default]
org.apache.directory.server#apacheds-i18n;2.0.0-M15 from user-list in [default]
org.apache.directory.server#apacheds-kerberos-codec;2.0.0-M15 from user-list in [default]
org.apache.hadoop#hadoop-annotations;2.7.1 from local-m2-cache in [default]
org.apache.hadoop#hadoop-auth;2.7.1 from local-m2-cache in [default]
org.apache.hadoop#hadoop-common;2.7.1 from local-m2-cache in [default]
org.apache.hadoop#hadoop-mapreduce-client-core;2.7.1 from local-m2-cache in [default]
org.apache.hadoop#hadoop-yarn-api;2.7.1 from local-m2-cache in [default]
org.apache.hadoop#hadoop-yarn-common;2.7.1 from local-m2-cache in [default]
org.apache.hbase#hbase-annotations;1.1.3 from local-m2-cache in [default]
org.apache.hbase#hbase-client;1.1.2 from local-m2-cache in [default]
org.apache.hbase#hbase-common;1.1.2 from local-m2-cache in [default]
org.apache.hbase#hbase-prefix-tree;1.1.2 from local-m2-cache in [default]
org.apache.hbase#hbase-procedure;1.1.2 from local-m2-cache in [default]
org.apache.hbase#hbase-protocol;1.1.3 from local-m2-cache in [default]
org.apache.hbase#hbase-server;1.1.2 from local-m2-cache in [default]
org.apache.htrace#htrace-core;3.1.0-incubating from local-m2-cache in [default]
org.apache.httpcomponents#httpclient;4.0.1 from local-m2-cache in [default]
org.apache.httpcomponents#httpcore;4.2.5 from central in [default]
org.apache.phoenix#phoenix-core;4.9.0-HBase-1.1 from local-m2-cache in [default]
org.apache.tephra#tephra-api;0.9.0-incubating from local-m2-cache in [default]
org.apache.tephra#tephra-core;0.9.0-incubating from local-m2-cache in [default]
org.apache.tephra#tephra-hbase-compat-1.1;0.9.0-incubating from local-m2-cache in [default]
org.apache.thrift#libthrift;0.9.0 from local-m2-cache in [default]
org.apache.twill#twill-api;0.6.0-incubating from local-m2-cache in [default]
org.apache.twill#twill-common;0.6.0-incubating from local-m2-cache in [default]
org.apache.twill#twill-core;0.6.0-incubating from local-m2-cache in [default]
org.apache.twill#twill-discovery-api;0.6.0-incubating from local-m2-cache in [default]
org.apache.twill#twill-discovery-core;0.6.0-incubating from local-m2-cache in [default]
org.apache.twill#twill-zookeeper;0.6.0-incubating from local-m2-cache in [default]
org.apache.zookeeper#zookeeper;3.4.6 from user-list in [default]
org.codehaus.jackson#jackson-core-asl;1.9.13 from user-list in [default]
org.codehaus.jackson#jackson-jaxrs;1.9.13 from user-list in [default]
org.codehaus.jackson#jackson-mapper-asl;1.9.13 from user-list in [default]
org.codehaus.jackson#jackson-xc;1.9.2 from central in [default]
org.codehaus.jettison#jettison;1.1 from user-list in [default]
org.hamcrest#hamcrest-core;1.3 from user-list in [default]
org.iq80.snappy#snappy;0.3 from local-m2-cache in [default]
org.jamon#jamon-runtime;2.3.1 from local-m2-cache in [default]
org.jruby.jcodings#jcodings;1.0.8 from local-m2-cache in [default]
org.jruby.joni#joni;2.1.2 from local-m2-cache in [default]
org.mortbay.jetty#jetty;6.1.26 from local-m2-cache in [default]
org.mortbay.jetty#jetty-sslengine;6.1.26 from local-m2-cache in [default]
org.mortbay.jetty#jetty-util;6.1.26 from user-list in [default]
org.mortbay.jetty#jsp-2.1;6.1.14 from local-m2-cache in [default]
org.mortbay.jetty#jsp-api-2.1;6.1.14 from local-m2-cache in [default]
org.mortbay.jetty#servlet-api;2.5-20081211 from local-m2-cache in [default]
org.mortbay.jetty#servlet-api-2.5;6.1.14 from local-m2-cache in [default]
org.ow2.asm#asm-all;5.0.2 from local-m2-cache in [default]
org.slf4j#slf4j-api;1.7.7 from user-list in [default]
org.slf4j#slf4j-log4j12;1.7.10 from local-m2-cache in [default]
org.sonatype.sisu.inject#cglib;2.2.1-v20090111 from user-list in [default]
org.tukaani#xz;1.0 from user-list in [default]
org.xerial.snappy#snappy-java;1.0.5 from user-list in [default]
sqlline#sqlline;1.2.0 from local-m2-cache in [default]
tomcat#jasper-compiler;5.5.23 from local-m2-cache in [default]
tomcat#jasper-runtime;5.5.23 from local-m2-cache in [default]
xmlenc#xmlenc;0.52 from user-list in [default]
:: evicted modules:
org.apache.hbase#hbase-protocol;1.1.2 by [org.apache.hbase#hbase-protocol;1.1.3] in [default]
org.apache.hbase#hbase-annotations;1.1.2 by [org.apache.hbase#hbase-annotations;1.1.3] in [default]
junit#junit;4.11 by [junit#junit;4.12] in [default]
com.google.guava#guava;12.0.1 by [com.google.guava#guava;13.0.1] in [default]
com.google.code.findbugs#jsr305;1.3.9 by [com.google.code.findbugs#jsr305;2.0.1] in [default]
org.slf4j#slf4j-log4j12;1.6.1 by [org.slf4j#slf4j-log4j12;1.7.10] in [default]
commons-collections#commons-collections;3.2.1 by [commons-collections#commons-collections;3.2.2] in [default]
org.slf4j#slf4j-api;1.6.4 by [org.slf4j#slf4j-api;1.7.7] in [default]
commons-lang#commons-lang;2.5 by [commons-lang#commons-lang;2.6] in [default]
org.apache.httpcomponents#httpclient;4.1.3 by [org.apache.httpcomponents#httpclient;4.0.1] in [default]
org.apache.httpcomponents#httpcore;4.1.3 by [org.apache.httpcomponents#httpcore;4.2.5] in [default]
org.apache.zookeeper#zookeeper;3.4.5 by [org.apache.zookeeper#zookeeper;3.4.6] in [default]
org.codehaus.jackson#jackson-core-asl;1.9.2 by [org.codehaus.jackson#jackson-core-asl;1.9.13] in [default]
org.codehaus.jackson#jackson-mapper-asl;1.9.2 by [org.codehaus.jackson#jackson-mapper-asl;1.9.13] in [default]
org.apache.httpcomponents#httpcore;4.0.1 by [org.apache.httpcomponents#httpcore;4.2.5] in [default]
commons-codec#commons-codec;1.7 by [commons-codec#commons-codec;1.9] in [default]
org.codehaus.jackson#jackson-jaxrs;1.9.2 by [org.codehaus.jackson#jackson-jaxrs;1.9.13] in [default]
org.apache.httpcomponents#httpclient;4.2.5 by [org.apache.httpcomponents#httpclient;4.0.1] in [default]
org.apache.avro#avro;1.7.4 by [org.apache.avro#avro;1.7.6] in [default]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 140 | 48 | 48 | 19 || 121 | 0 |
---------------------------------------------------------------------
:: problems summary ::
:::: WARNINGS
[NOT FOUND ] ch.qos.logback#logback-classic;1.0.9!logback-classic.jar (1ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/ch/qos/logback/logback-classic/1.0.9/logback-classic-1.0.9.jar
[NOT FOUND ] ch.qos.logback#logback-core;1.0.9!logback-core.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/ch/qos/logback/logback-core/1.0.9/logback-core-1.0.9.jar
[NOT FOUND ] asm#asm;3.1!asm.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/asm/asm/3.1/asm-3.1.jar
[NOT FOUND ] org.apache.hadoop#hadoop-auth;2.7.1!hadoop-auth.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.1/hadoop-auth-2.7.1.jar
[NOT FOUND ] org.apache.curator#curator-client;2.7.1!curator-client.jar(bundle) (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar
[NOT FOUND ] org.apache.curator#curator-recipes;2.7.1!curator-recipes.jar(bundle) (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar
[NOT FOUND ] com.jamesmurty.utils#java-xmlbuilder;0.4!java-xmlbuilder.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar
[NOT FOUND ] org.apache.curator#curator-framework;2.7.1!curator-framework.jar(bundle) (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar
[NOT FOUND ] org.apache.hadoop#hadoop-yarn-common;2.7.1!hadoop-yarn-common.jar (1ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.1/hadoop-yarn-common-2.7.1.jar
[NOT FOUND ] org.slf4j#slf4j-log4j12;1.7.10!slf4j-log4j12.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar
[NOT FOUND ] org.apache.hadoop#hadoop-yarn-api;2.7.1!hadoop-yarn-api.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.1/hadoop-yarn-api-2.7.1.jar
[NOT FOUND ] javax.servlet.jsp#jsp-api;2.1!jsp-api.jar (0ms)
==== local-m2-cache: tried
file:/Users/danielmantovani/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar
::::::::::::::::::::::::::::::::::::::::::::::
:: FAILED DOWNLOADS ::
:: ^ see resolution messages for details ^ ::
::::::::::::::::::::::::::::::::::::::::::::::
:: asm#asm;3.1!asm.jar
:: ch.qos.logback#logback-classic;1.0.9!logback-classic.jar
:: ch.qos.logback#logback-core;1.0.9!logback-core.jar
:: com.jamesmurty.utils#java-xmlbuilder;0.4!java-xmlbuilder.jar
:: org.apache.hadoop#hadoop-auth;2.7.1!hadoop-auth.jar
:: org.apache.curator#curator-framework;2.7.1!curator-framework.jar(bundle)
:: org.apache.curator#curator-client;2.7.1!curator-client.jar(bundle)
:: org.apache.curator#curator-recipes;2.7.1!curator-recipes.jar(bundle)
:: org.apache.hadoop#hadoop-yarn-common;2.7.1!hadoop-yarn-common.jar
:: org.apache.hadoop#hadoop-yarn-api;2.7.1!hadoop-yarn-api.jar
:: org.slf4j#slf4j-log4j12;1.7.10!slf4j-log4j12.jar
:: javax.servlet.jsp#jsp-api;2.1!jsp-api.jar
::::::::::::::::::::::::::::::::::::::::::::::
:::: ERRORS
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
unknown resolver null
:: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
Exception in thread "main" java.lang.RuntimeException: [download failed: asm#asm;3.1!asm.jar, download failed: ch.qos.logback#logback-classic;1.0.9!logback-classic.jar, download failed: ch.qos.logback#logback-core;1.0.9!logback-core.jar, download failed: com.jamesmurty.utils#java-xmlbuilder;0.4!java-xmlbuilder.jar, download failed: org.apache.hadoop#hadoop-auth;2.7.1!hadoop-auth.jar, download failed: org.apache.curator#curator-framework;2.7.1!curator-framework.jar(bundle), download failed: org.apache.curator#curator-client;2.7.1!curator-client.jar(bundle), download failed: org.apache.curator#curator-recipes;2.7.1!curator-recipes.jar(bundle), download failed: org.apache.hadoop#hadoop-yarn-common;2.7.1!hadoop-yarn-common.jar, download failed: org.apache.hadoop#hadoop-yarn-api;2.7.1!hadoop-yarn-api.jar, download failed: org.slf4j#slf4j-log4j12;1.7.10!slf4j-log4j12.jar, download failed: javax.servlet.jsp#jsp-api;2.1!jsp-api.jar]
at org.apache.spark.deploy.SparkSubmitUtils$.resolveMavenCoordinates(SparkSubmit.scala:1197)
at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:304)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:153)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Issue Analytics
- State:
- Created 6 years ago
- Comments:8 (4 by maintainers)
Top Results From Across the Web
Workflow sometimes crashing due to failure to download jars
Two of them complete successfully, but a third crashes; error is : Exception in thread "main" java.lang.RuntimeException: [unresolved ...
Read more >java - Fail to resolving dependencies of org.apache.hadoop ...
Finally I try to download the missing jar files from maven repository maven repository. And I put them into properly repository of ...
Read more >Dependency issues when using --packages option with spark
I think it's because maven tried to download the artifact from central before but failed to get the jar for some reason. A...
Read more >Execute failed: Job JAR library is unknown sate - KNIME Forum
The detailed error messages is: “java.lang.RuntimeException: ManagedLibrarylnstallFailed : java.util.concurrent.ExecutionException: java.io.
Read more >Issue on running spark application in Yarn-cluster mode
When I execute the following in yarn-client mode its working fine and giving the ... Shell.run(Shell.java:424) at org.apache.hadoop.util.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
@mantovani
I modified your command a little bit since the version number and group id have been changed (please refer to the pom file here)
spark-submit --verbose --class org.apache.spark.sql.execution.datasources.hbase.examples.HBaseSource --packages com.hortonworks.shc:shc-core:1.1.0.2.6.5.0-188 --repositories http://nexus-private.hortonworks.com/nexus/content/groups/public/ examples/target/shc-examples-1.1.2-2.2-s_2.11-SNAPSHOT.jarI can use fine from my HDP cluster, but I can’t in a separate Spark instance. Nothing so far helped.