tail -f hadoop-hadoop-jobtracker-h1.log 日志內容
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = h1/192.168.253.128
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-cdh3u3
STARTUP_MSG: build = git://ubuntu-slave01/var/lib/jenkins/workspace/CDH3-Selective/build/cdh3/hadoop20/0.20.2-cdh3u3/source -r 318bc781117fa276ae81a3d111f5eeba0020634f; compiled by 'jenkins' on Tue Mar 20 13:26:06 PDT 2012
************************************************************/
===========================2015-03-06 01:39:34,639 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.RuntimeException: Not a host:port pair: local
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:140)
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:124)
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2434)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2057)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2050)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:296)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:288)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4792)
2015-03-06 01:39:34,643 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobTracker at h1/192.168.253.128
************************************************************/
hadoop-hadoop-tasktracker-h1.log 日志內容
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG: host = h1/192.168.253.128
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2-cdh3u3
STARTUP_MSG: build = git://ubuntu-slave01/var/lib/jenkins/workspace/CDH3-Selective/build/cdh3/hadoop20/0.20.2-cdh3u3/source -r 318bc781117fa276ae81a3d111f5eeba0020634f; compiled by 'jenkins' on Tue Mar 20 13:26:06 PDT 2012
************************************************************/
2015-03-06 01:39:38,094 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.lang.RuntimeException: Not a host:port pair: local
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:140)
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:124)
at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2434)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1576)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3879)
2015-03-06 01:39:38,097 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at h1/192.168.253.128
************************************************************/
以下是組態檔資訊
[hadoop@h1 conf]$ cat core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="https://bbs.csdn.net/topics/configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://h1:9000</value>
</property>
</configuration>
[hadoop@h1 conf]$ cat hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="https://bbs.csdn.net/topics/configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>dfs.data.dir</name>
<value>/home/hadoop/hadoop-data</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
[hadoop@h1 conf]$ cat mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="https://bbs.csdn.net/topics/configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapred.job.tracker></name>
<value>h1:9001</value>
</property>
</configuration>
我剛開始學習hadoop,發現偽分布模謝式下的jobtracker和tasktracker兩個行程在啟動大約30移鐘后消失,
看日志發現以上問題,但做測驗包括檔案考被,wordcount測驗時,均正常輸出job日志,
查過很多貼子都沒有找出問題所在,請專家或或者是遇到和我一樣的問題的前輩幫助指點一下,謝謝!
uj5u.com熱心網友回復：
我上網查了下“ java.lang.RuntimeException: Not a host:port pair: local”，說是mapred.job.tracker沒配置。但是你配置了。唯一不同的是我當時的偽分布式是<value>http://h1:9001</value>
寫了http,不知道是這個問題不？
uj5u.com熱心網友回復：
還有這個問題應該放在hadoop，你在spark里問，回答人少。轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/97201.html
標籤：Spark
上一篇：運行spark-sql命令報錯