question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[SUPPORT] NoClassDefFoundError: org/apache/hudi/org/apache/hadoop/hive/metastore/api/NoSuchObjectException

See original GitHub issue

Environment Description

  • Hudi version : 0.10.1
  • Spark version :
  • Hive version : 3.1.2
  • Hadoop version : 3.1.4
  • Storage (HDFS/S3/GCS…) : hdfs
  • Running on Docker? (yes/no) : no

Add the stacktrace of the error. 2022-03-03 10:48:07,375 ERROR org.apache.hudi.sink.StreamWriteOperatorCoordinator [] - Executor executes action [sync hive metadata for instant 20220303104806421] error java.lang.NoClassDefFoundError: org/apache/hudi/org/apache/hadoop/hive/metastore/api/NoSuchObjectException at org.apache.hudi.hive.HiveSyncTool.<init>(HiveSyncTool.java:78) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1] at org.apache.hudi.sink.utils.HiveSyncContext.hiveSyncTool(HiveSyncContext.java:51) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1] at org.apache.hudi.sink.StreamWriteOperatorCoordinator.syncHive(StreamWriteOperatorCoordinator.java:302) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1] at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_191] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_191] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_191] Caused by: java.lang.ClassNotFoundException: org.apache.hudi.org.apache.hadoop.hive.metastore.api.NoSuchObjectException at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_191] at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_191] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_191] at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_191] ... 7 more 2022-03-03 10:48:07,376 INFO org.apache.hudi.client.AbstractHoodieClient [] - Stopping

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:10 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
nlonedaycommented, Mar 18, 2022

hello, I did this , create one hive table named hudi ,not found any exception . but It’s create two tables auto, and actual named hudi_rt / hudi_ro , is or right ? and then I use beeline " set hive.input.format = org.apache.hudi.hadoop.hive.HoodieCombineHiveInputFormat " Use sql “select * from hudi_rt limit 1” , just return empty schema ,can’t get any data. I found the data already exist in hdfs. what can i do next ?

I use flink 1.3.6 ,hudi0.10.1,hive 3.1.2 ,hadoop 2.8.5

https://www.yuque.com/docs/share/01c98494-a980-414c-9c45-152023bf3c17, for your reference

0reactions
nsivabalancommented, May 12, 2022

going ahead and closing it out. feel free to re-open if you are still looking for help.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How can I solve "java.lang.NoClassDefFoundError"?
It appears that the rpm upgrade invalidated the service's file handle on the underlying JAR file. The service then saw a class that...
Read more >
3 ways to solve java.lang.NoClassDefFoundError in Java J2EE
NoClassDefFoundError has come before and how it's been resolved. This can help you to troubleshoot the root cause of NoClassDefFoundError in Java application....
Read more >
java.lang.NoClassDefFoundError: How to resolve – Part 1
Since at runtime your main activity class is looking for your service class, java.lang.NoClassDefFoundError will be thrown since the runtime ...
Read more >
java.lang.NoClassDefFoundError: org/eclipse/core/launcher ...
NoClassDefFoundError : org/eclipse/core/launcher/Main [java] Caused by: java.lang.ClassNotFoundException: org.eclipse.core.launcher.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found