[SUPPORT] Compile hudi master with hive version 2.1.1 error
See original GitHub issueTips before filing an issue
-
Have you gone through our FAQs?
-
Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.
-
If you have triaged this as a bug, then file an issue directly.
Describe the problem you faced
Compile hudi master with hive version 2.2.1 error
To Reproduce
Steps to reproduce the behavior:
- pull hudi master branch
- compile it command:
mvn clean package -DskipTests -Drat.skip=true -Pflink-bundle-shade-hive2,include-flink-sql-connector-hive -Dhadoop.version=3.0.0 -Dhive.version=2.1.1
Expected behavior
Compile hudi master with hive version 2.2.1 error
Environment Description
-
Hudi version : master
-
Spark version :
-
Hive version : 2.1.1
-
Hadoop version :3.0.0
-
Storage (HDFS/S3/GCS…) : hdfs
-
Running on Docker? (yes/no) : no
Additional context
use default hive version package, when sync hudi metadata to hive, will throw hive “Required field ‘client_protocol’ is unset!” exception, and sync fail
Stacktrace
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 25.462 s
[INFO] Finished at: 2021-08-03T19:15:30+08:00
[INFO] Final Memory: 119M/1420M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project hudi-hadoop-mr: Compilation failure
[ERROR] /home/wuxu/git/hudi/hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/hive/HoodieCombineHiveInputFormat.java:[32,37] cannot find symbol
[ERROR] symbol: class StringInternUtils
[ERROR] location: package org.apache.hadoop.hive.common
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hudi-hadoop-mr
Issue Analytics
- State:
- Created 2 years ago
- Comments:6 (5 by maintainers)
Top GitHub Comments
You only need to package the flink bundle jar with hive 2.1.1, there is no need to package the mr-bundle first.
Close due to inactive