运行wordcount时:INFO ipc.Client: Retrying connect to server

运行bin/hadoop jar /tmp/wordcount.jar WordCount /test/input /test/output时,一直尝试连接active namenode 服务器,最后不得以,ctrl+c强行中断。我的任务就是在active namenode的这台服务器上运行的。不知道是什么问题。
$ bin/hadoop jar /tmp/wordcount.jar org.apache.hadoop.examples.WordCount /home/weixiaoling/test/input /home/weixiaoling/test/output
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:12 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:13 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:14 INFO client.RMProxy: Connecting to ResourceManager at SY-0217/192.168.1.222:8032
15/12/05 17:21:14 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:14 WARN conf.Configuration: bad conf file: element not <property>
15/12/05 17:21:16 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:17 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:18 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:19 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:21 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:22 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
15/12/05 17:21:23 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
 
请教高人帮忙解答,谢谢。

wangxiaolei

赞同来自: fish lirongxing

15/12/05 22:47:39 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. 你的yarn服务连不上,没启动成功。  

fish - Hadooper

赞同来自: lirongxing

先把配置文件整理下吧,有配置格式不太对的property。

lirongxing

赞同来自:

经过检查core-site.xml里确实漏了一对property标签。加上后警告消除。但是原来的问题依旧。   $  bin/hadoop jar /tmp/wordcount.jar org.apache.hadoop.examples.WordCount /home/weixiaoling/test/input /home/weixiaoling/test/output 15/12/05 22:47:34 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/12/05 22:47:36 INFO client.RMProxy: Connecting to ResourceManager at SY-0217/192.168.1.222:8032 15/12/05 22:47:39 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:40 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:41 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:42 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:43 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:44 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:45 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS) 15/12/05 22:47:46 INFO ipc.Client: Retrying connect to server: SY-0217/192.168.1.222:8032. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)  

lirongxing

赞同来自:

改变了日志级别,看到下列错误,但就是不知道什么原因。 15/12/05 23:27:22 DEBUG ipc.Client: closing ipc connection to SY-0217/192.168.1.222:8032: 拒绝连接 java.net.ConnectException: 拒绝连接         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529)         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493)         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:604)         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:699)         at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:367)         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1461)         at org.apache.hadoop.ipc.Client.call(Client.java:1380)         at org.apache.hadoop.ipc.Client.call(Client.java:1362)         at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:206)         at $Proxy10.getNewApplication(Unknown Source)         at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getNewApplication(ApplicationClientProtocolPBClientImpl.java:172)         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:601)         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:186)         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)         at $Proxy11.getNewApplication(Unknown Source)         at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:134)         at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:142)         at org.apache.hadoop.mapred.ResourceMgrDelegate.getNewJobID(ResourceMgrDelegate.java:175)         at org.apache.hadoop.mapred.YARNRunner.getNewJobID(YARNRunner.java:230)         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:357)         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1295)         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1292)         at java.security.AccessController.doPrivileged(Native Method)         at javax.security.auth.Subject.doAs(Subject.java:415)         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1292)         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1313)         at org.apache.hadoop.examples.WordCount.main(WordCount.java:84)         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:601)         at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

fish - Hadooper

赞同来自:

看看Resourcemanager的log。

要回复问题请先登录注册