1. 程式人生 > >Hadoop--Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [localhost]

Hadoop--Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [localhost]

The ice ddr bsp uic cep icu pub pat

    Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [localhost]

  1 2018-06-03 01:45:32,343 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService failed in
state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 2 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0
.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 3 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139) 4 at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65
) 5 at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54) 6 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:356) 7 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:334) 8 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 9 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 10 at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:450) 11 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 12 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 13 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 14 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 15 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 16 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 17 Caused by: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 18 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 19 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) 20 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 21 at java.lang.reflect.Constructor.newInstance(Constructor.java:526) 22 at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791) 23 at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:720) 24 at org.apache.hadoop.ipc.Server.bind(Server.java:424) 25 at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:573) 26 at org.apache.hadoop.ipc.Server.<init>(Server.java:2205) 27 at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:931) 28 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:537) 29 at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:512) 30 at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:776) 31 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169) 32 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132) 33 ... 13 more 34 Caused by: java.net.BindException: Address already in use 35 at sun.nio.ch.Net.bind0(Native Method) 36 at sun.nio.ch.Net.bind(Net.java:444) 37 at sun.nio.ch.Net.bind(Net.java:436) 38 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) 39 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) 40 at org.apache.hadoop.ipc.Server.bind(Server.java:407) 41 ... 21 more 42 2018-06-03 01:45:32,346 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8040 43 2018-06-03 01:45:32,349 INFO org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server 44 2018-06-03 01:45:32,351 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 45 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 46 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139) 47 at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65) 48 at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54) 49 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:356) 50 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:334) 51 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 52 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 53 at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:450) 54 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 55 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 56 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 57 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 58 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 59 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 60 Caused by: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 61 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 62 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) 63 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 64 at java.lang.reflect.Constructor.newInstance(Constructor.java:526) 65 at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791) 66 at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:720) 67 at org.apache.hadoop.ipc.Server.bind(Server.java:424) 68 at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:573) 69 at org.apache.hadoop.ipc.Server.<init>(Server.java:2205) 70 at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:931) 71 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:537) 72 at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:512) 73 at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:776) 74 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169) 75 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132) 76 ... 13 more 77 Caused by: java.net.BindException: Address already in use 78 at sun.nio.ch.Net.bind0(Native Method) 79 at sun.nio.ch.Net.bind(Net.java:444) 80 at sun.nio.ch.Net.bind(Net.java:436) 81 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) 82 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) 83 at org.apache.hadoop.ipc.Server.bind(Server.java:407) 84 ... 21 more 85 2018-06-03 01:45:32,351 INFO org.apache.hadoop.ipc.Server: Stopping server on 35080 86 2018-06-03 01:45:32,353 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 35080 87 2018-06-03 01:45:32,355 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 88 2018-06-03 01:45:32,356 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 89 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 90 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139) 91 at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65) 92 at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54) 93 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:356) 94 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:334) 95 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 96 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 97 at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:450) 98 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 99 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 100 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 101 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 102 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 103 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 104 Caused by: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 105 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 106 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) 107 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 108 at java.lang.reflect.Constructor.newInstance(Constructor.java:526) 109 at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791) 110 at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:720) 111 at org.apache.hadoop.ipc.Server.bind(Server.java:424) 112 at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:573) 113 at org.apache.hadoop.ipc.Server.<init>(Server.java:2205) 114 at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:931) 115 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:537) 116 at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:512) 117 at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:776) 118 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169) 119 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132) 120 ... 13 more 121 Caused by: java.net.BindException: Address already in use 122 at sun.nio.ch.Net.bind0(Native Method) 123 at sun.nio.ch.Net.bind(Net.java:444) 124 at sun.nio.ch.Net.bind(Net.java:436) 125 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) 126 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) 127 at org.apache.hadoop.ipc.Server.bind(Server.java:407) 128 ... 21 more 129 2018-06-03 01:45:32,356 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting 130 2018-06-03 01:45:32,357 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... 131 2018-06-03 01:45:32,357 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. 132 2018-06-03 01:45:32,357 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. 133 2018-06-03 01:45:32,357 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager 134 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 135 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:139) 136 at org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC.getServer(HadoopYarnProtoRPC.java:65) 137 at org.apache.hadoop.yarn.ipc.YarnRPC.getServer(YarnRPC.java:54) 138 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.createServer(ResourceLocalizationService.java:356) 139 at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService.serviceStart(ResourceLocalizationService.java:334) 140 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 141 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 142 at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceStart(ContainerManagerImpl.java:450) 143 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 144 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 145 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 146 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 147 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 148 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 149 Caused by: java.net.BindException: Problem binding to [0.0.0.0:8040] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException 150 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 151 at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) 152 at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 153 at java.lang.reflect.Constructor.newInstance(Constructor.java:526) 154 at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791) 155 at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:720) 156 at org.apache.hadoop.ipc.Server.bind(Server.java:424) 157 at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:573) 158 at org.apache.hadoop.ipc.Server.<init>(Server.java:2205) 159 at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:931) 160 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:537) 161 at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:512) 162 at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:776) 163 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169) 164 at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132) 165 ... 13 more 166 Caused by: java.net.BindException: Address already in use 167 at sun.nio.ch.Net.bind0(Native Method) 168 at sun.nio.ch.Net.bind(Net.java:444) 169 at sun.nio.ch.Net.bind(Net.java:436) 170 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) 171 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) 172 at org.apache.hadoop.ipc.Server.bind(Server.java:407) 173 ... 21 more 174 2018-06-03 01:45:32,358 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8040: starting 175 2018-06-03 01:45:32,360 INFO org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG: 176 /************************************************************ 177 SHUTDOWN_MSG: Shutting down NodeManager at hu_hadoop1/192.168.11.11 178 ************************************************************/ 179 2018-06-03 01:45:32,361 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer started on port 8040 180 2018-06-03 01:45:32,376 INFO org.apache.hadoop.mapred.IndexCache: IndexCache created with max memory = 10485760 181 2018-06-03 01:45:32,388 INFO org.apache.hadoop.mapred.ShuffleHandler: httpshuffle listening on port 13562 182 2018-06-03 01:45:32,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager started at hu_hadoop1/192.168.11.11:57376 183 2018-06-03 01:45:32,390 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: ContainerManager bound to 0.0.0.0/0.0.0.0:0 184 2018-06-03 01:45:32,392 INFO org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer: Instantiating NMWebApp at 0.0.0.0:8042 185 2018-06-03 01:45:32,464 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 186 2018-06-03 01:45:32,467 INFO org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.nodemanager is not defined 187 2018-06-03 01:45:32,488 INFO org.apache.hadoop.http.HttpServer2: Added global filter safety (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) 188 2018-06-03 01:45:32,496 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node 189 2018-06-03 01:45:32,496 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 190 2018-06-03 01:45:32,496 INFO org.apache.hadoop.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 191 2018-06-03 01:45:32,499 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /node/* 192 2018-06-03 01:45:32,500 INFO org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* 193 2018-06-03 01:45:32,523 INFO org.apache.hadoop.http.HttpServer2: Jetty bound to port 8042 194 2018-06-03 01:45:32,523 INFO org.mortbay.log: jetty-6.1.26 195 2018-06-03 01:45:32,595 INFO org.mortbay.log: Extract jar:file:/home/bigdata/hadoop-2.6.0/share/hadoop/yarn/hadoop-yarn-common-2.6.0.jar!/webapps/node to /tmp/Jetty_0_0_0_0_8042_node____19tj0x/webapp 196 2018-06-03 01:45:32,973 INFO org.mortbay.log: Started [email protected]:8042 197 2018-06-03 01:45:32,973 INFO org.apache.hadoop.yarn.webapp.WebApps: Web app /node started at 8042 198 2018-06-03 01:45:33,541 INFO org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules 199 2018-06-03 01:45:33,547 ERROR org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Unexpected error starting NodeStatusUpdater 200 java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 201 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) 202 at org.apache.hadoop.yarn.conf.YarnConfiguration.getSocketAddr(YarnConfiguration.java:1499) 203 at org.apache.hadoop.yarn.server.api.ServerRMProxy.getRMAddress(ServerRMProxy.java:59) 204 at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:97) 205 at org.apache.hadoop.yarn.server.api.ServerRMProxy.createRMProxy(ServerRMProxy.java:51) 206 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:244) 207 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:190) 208 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 209 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 210 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 211 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 212 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 213 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 214 2018-06-03 01:45:33,548 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 215 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 216 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197) 217 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 218 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 219 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 220 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 221 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 222 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 223 Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 224 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) 225 at org.apache.hadoop.yarn.conf.YarnConfiguration.getSocketAddr(YarnConfiguration.java:1499) 226 at org.apache.hadoop.yarn.server.api.ServerRMProxy.getRMAddress(ServerRMProxy.java:59) 227 at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:97) 228 at org.apache.hadoop.yarn.server.api.ServerRMProxy.createRMProxy(ServerRMProxy.java:51) 229 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:244) 230 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:190) 231 ... 6 more 232 2018-06-03 01:45:33,550 INFO org.apache.hadoop.service.AbstractService: Service NodeManager failed in state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 233 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 234 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197) 235 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 236 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 237 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 238 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 239 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 240 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 241 Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 242 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) 243 at org.apache.hadoop.yarn.conf.YarnConfiguration.getSocketAddr(YarnConfiguration.java:1499) 244 at org.apache.hadoop.yarn.server.api.ServerRMProxy.getRMAddress(ServerRMProxy.java:59) 245 at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:97) 246 at org.apache.hadoop.yarn.server.api.ServerRMProxy.createRMProxy(ServerRMProxy.java:51) 247 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:244) 248 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:190) 249 ... 6 more 250 2018-06-03 01:45:33,557 INFO org.mortbay.log: Stopped [email protected]:8042 251 2018-06-03 01:45:33,558 INFO org.apache.hadoop.ipc.Server: Stopping server on 57376 252 2018-06-03 01:45:33,560 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 57376 253 2018-06-03 01:45:33,561 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 254 2018-06-03 01:45:33,562 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is interrupted. Exiting. 255 2018-06-03 01:45:33,567 INFO org.apache.hadoop.ipc.Server: Stopping server on 8040 256 2018-06-03 01:45:33,567 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 8040 257 2018-06-03 01:45:33,568 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server Responder 258 2018-06-03 01:45:33,568 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Public cache exiting 259 2018-06-03 01:45:33,568 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager metrics system... 260 2018-06-03 01:45:33,569 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system stopped. 261 2018-06-03 01:45:33,569 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics system shutdown complete. 262 2018-06-03 01:45:33,569 FATAL org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting NodeManager 263 org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 264 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:197) 265 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 266 at org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120) 267 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:264) 268 at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193) 269 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:463) 270 at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:509) 271 Caused by: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: hu_hadoop1:8031 (configuration property ‘yarn.resourcemanager.resource-tracker.address‘) 272 at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:212) 273 at org.apache.hadoop.yarn.conf.YarnConfiguration.getSocketAddr(YarnConfiguration.java:1499) 274 at org.apache.hadoop.yarn.server.api.ServerRMProxy.getRMAddress(ServerRMProxy.java:59) 275 at org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:97) 276 at org.apache.hadoop.yarn.server.api.ServerRMProxy.createRMProxy(ServerRMProxy.java:51) 277 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.getRMClient(NodeStatusUpdaterImpl.java:244) 278 at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:190) 279 ... 6 more

      hadoop初學者:哈哈哈哈哈,找了久。。。。

      原理時因為hostname不合法 不能代 ‘_‘ 。。。。。

Hadoop--Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Starting namenodes on [localhost]