該賞金到期in 4天。此問題的答案有資格獲得 150聲望獎勵。 bluethundr想引起更多人對這個問題的關注。
我有 Hadoop/HBase/Pig 在 Windows 10 下都成功運行。但是當我使用本指南安裝 Hive 3.1.2 時,我在 Cygwin 下初始化 Hive 時出錯:
$HIVE_HOME/bin/schematool -dbType derby -initSchema
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/D:/Hadoop/Hive/apache-hive-3.1.2-bin/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/D:/Hadoop/hadoop-3.2.1/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)
at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:536)
at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:554)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:448)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141)
at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5104)
at org.apache.hive.beeline.HiveSchemaTool.<init>(HiveSchemaTool.java:96)
at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1473)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
我找到了有關此問題的StackOverflow,但是解決方案是在 Windows 管理命令提示符下為 cygwin 創建一個適當路徑的符號鏈接,并且我已經使用以下命令完成了該操作:
mklink /J D:\cygdrive\d\ D:\
如何在 Windows 下解決此問題?
uj5u.com熱心網友回復:
為了擺脫我發現的第一個錯誤(并在 OP 中發布),我必須轉到該$HIVE_HOME/lib目錄并洗掉這個舊的番石榴庫檔案:guava-19.0.jar
我必須確保我從 Hadoop 庫中復制的番石榴庫在那里: guava-27.0-jre.jar
在下一次嘗試時,我得到了一個不同的錯誤:
schematool -dbType derby -initSchema
Error: FUNCTION 'NUCLEUS_ASCII' already exists. (state=X0Y68,code=30000)
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
Underlying cause: java.io.IOException : Schema script failed, errorcode 2
Use --verbose for detailed stacktrace.
*** schemaTool failed ***
我已經找到了解決這一問題在這里。
我必須做的是轉到$HIVE_HOME/scripts/metastore/upgrade/derby/目錄以找到hive-schema-3.1.0.derby.sql檔案,然后編輯并查找并注釋掉這些行:
--CREATE FUNCTION "APP"."NUCLEUS_ASCII" (C CHAR(1)) RETURNS INTEGER LANGUAGE JAVA PARAMETER STYLE JAVA READS SQL DATA CALLED ON NULL INPUT EXTERNAL NAME 'org.datanucleus.store.rdbms.adapter.DerbySQLFunction.ascii';
--CREATE FUNCTION "APP"."NUCLEUS_MATCHES" (TEXT VARCHAR(8000),PATTERN VARCHAR(8000)) RETURNS INTEGER LANGUAGE JAVA PARAMETER STYLE JAVA READS SQL DATA CALLED ON NULL INPUT EXTERNAL NAME 'org.datanucleus.store.rdbms.adapter.DerbySQLFunction.matches' ;
注釋掉這兩行后,我切換到$HIVE_HOME/bin/目錄并重新運行schematool -dbType derby -initSchema命令,這次成功了!
Initialization script completed
schemaTool completed
我希望其他人可能會發現這個答案有用。
轉載請註明出處,本文鏈接:https://www.uj5u.com/caozuo/399820.html
