start-all.sh 啟動(dòng)

坑爹

找不出錯(cuò)

試了各種辦法，重新formaet 查看 集群ID是否相同。都無(wú)效

日志也沒(méi)看到錯(cuò)

按官網(wǎng)方法手動(dòng)一步步啟，問(wèn)題照舊

?

master節(jié)點(diǎn)，yarn namenode 啟動(dòng)（打印詳細(xì)日志）

node節(jié)點(diǎn) yarn datanode 啟動(dòng)

?

看到錯(cuò)了

15/07/02 03:32:51 INFO datanode.DataNode: Block pool BP-89742471-127.0.1.1-1435821846469 (Datanode Uuid null) service to /172.16.231.176:8020 beginning handshake with NN

15/07/02 03:32:52 ERROR datanode.DataNode: Initialization failed for Block pool BP-89742471-127.0.1.1-1435821846469 (Datanode Uuid null) service to /172.16.231.176:8020 Datanode denied communication with namenode because hostname cannot be resolved (ip=172.16.231.175, hostname=172.16.231.175): DatanodeRegistration(0.0.0.0:50010, datanodeUuid=c165abfd-1c06-4259-8588-c805abd72fca, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-56;cid=CID-c13bccb4-70ca-43f7-94f7-1b66bbaf64dd;nsid=1827594974;c=0)

at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.registerDatanode(DatanodeManager.java:863)

at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.registerDatanode(FSNamesystem.java:4485)

at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.registerDatanode(NameNodeRpcServer.java:1271)

at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.registerDatanode(DatanodeProtocolServerSideTranslatorPB.java:95)

at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:28539)

at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)

at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)

at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)

at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)

?

?

?

問(wèn)題在這里hostname cannot be resolved (ip=172.16.231.175, hostname=172.16.231.175)

改 slaves? 文件 中的ip 為hostname

如

datanode1

datanode2

配置/etc/hosts

172.16.231.173 datanode1

172.16.231.174 datanode2

?

再啟動(dòng)，解決

?

問(wèn)題是? slaves ?不能寫(xiě)ip 只能寫(xiě)hostname

?

hadoop datanode 啟動(dòng)正常，但master無(wú)法識(shí)別（50030不顯示datanode節(jié)點(diǎn)）