Failing because I am unlikely to write too排查方案

tez本身不带logs，我在输入hive的时候碰到了下面的报错Logging initialized using configuration in file:/home/appleyuchi/bigdata/apache-hive-3.0.0-bin/conf/hive-log4j2.properties Async: trueException in thread "main" java.lan

微电子学与固体电子学-俞驰

4099人浏览 · 2020-05-31 23:21:50

微电子学与固体电子学-俞驰 · 2020-05-31 23:21:50 发布

tez本身不带logs，我在输入hive的时候碰到了下面的报错

Logging initialized using configuration in file:/home/appleyuchi/bigdata/apache-hive-3.0.0-bin/conf/hive-log4j2.properties Async: true
Exception in thread "main" java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://Desktop:9000/tmp/hive/appleyuchi/_tez_session_dir/b334822e-6e45-45c9-9788-7aac05961286-resources/*. Failing because I am unlikely to write too.
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:676)
	at org.apache.hadoop.hive.ql.session.SessionState.beginStart(SessionState.java:585)
	at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:747)
	at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
Caused by: java.io.IOException: Previous writer likely failed to write hdfs://Desktop:9000/tmp/hive/appleyuchi/_tez_session_dir/b334822e-6e45-45c9-9788-7aac05961286-resources/*. Failing because I am unlikely to write too.
	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeResource(DagUtils.java:1191)
	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.addTempResources(DagUtils.java:1042)
	at org.apache.hadoop.hive.ql.exec.tez.DagUtils.localizeTempFilesFromConf(DagUtils.java:931)
	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.ensureLocalResources(TezSessionState.java:587)
	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:279)
	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.beginOpen(TezSessionState.java:248)
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:673)
	... 9 more

$HIVE_HOME/logs/hive.log会汇报关于tez的详细错误:

报错	解决方案
ERROR [main] common.FileUtils: The jar file path file:///home/appleyuchi/bigdata/hadoop-3.1.2/share/hadoop/common/hadoop-lzo-0.4.13.jar/home/appleyuchi/bigdata/apache-tez-0.9.2-bin/* doesn't exist	export HIVE_AUX_JARS_PATH=$HADOOP_HOME/share/hadoop/common/hadoop-lzo-0.4.13.jar$TEZ_JARS 改成 export HIVE_AUX_JARS_PATH=$HADOOP_HOME/share/hadoop/common/hadoop-lzo-0.4.13.jar:$TEZ_JARS
ERROR [main] common.FileUtils: The jar file path file:///home/appleyuchi/bigdata/apache-tez-0.9.2-bin/*	export TEZ_HOME=/home/appleyuchi/bigdata/apache-tez-0.9.2-bin export TEZ_CONF_DIR=$TEZ_HOME/conf export TEZ_JARS=$TEZ_HOME/:$TEZ_HOME/lib export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$TEZ_CONF_DIR:$TEZ_JARS export HIVE_AUX_JARS_PATH=$HADOOP_HOME/share/hadoop/common/hadoop-lzo-0.4.13.jar:$TEZ_JARS
Unexpected character '/' (code 47) in prolog; expected '<' ”.	/** xxxxx / 改成:* <!-- /** XXXXXx */ --> 讲人话就是tez-site.xml的开头官方说明用<></>注释掉
Caused by: com.ctc.wstx.exc.WstxParsingException: Illegal processing instruction target ("xml"); xml (case insensitive) is reserved by the specs. at [row,col,system-id]: [18,5,"file:/home/appleyuchi/bigdata/apache-tez-0.9.2-bin/conf/tez-site.xml"]	<?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> WARNING: THIS IS A GENERATED TEMPLATE PURELY FOR DOCUMENTATION PURPOSES AND SHOULD NOT BE USED AS A CONFIGURATION FILE FOR TEZ 这些全部注释掉即可
ERROR [main] tez.DagUtils: Could not find the jar that was being uploaded	???????这个我目前也没解决，尴尬了