Hadoop 2.8.3 standalone sample ubuntu 16.04.4

阿新 • • 發佈：2019-01-17

執行Hadoop standalone sample 報一下錯誤：

 bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.3.jar grep sample/input sample/output 'dfs[a-z.]+'
18/03/28 03:41:51 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
18/03/28 03:41:51 INFO jvm.JvmMetrics: Initializing JVM Metrics with 
 processName=JobTracker, sessionId=
18/03/28 03:41:51 INFO metrics.MetricsUtil: Unable to obtain hostName
java.net.UnknownHostException: Test131: Test131: Name or service not known
        at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
        at org.apache.hadoop.metrics.MetricsUtil.getHostName(MetricsUtil.java:97 
)
        at org.apache.hadoop.metrics.MetricsUtil.createRecord(MetricsUtil.java:86)
        at org.apache.hadoop.metrics.jvm.JvmMetrics.<init>(JvmMetrics.java:90)
        at org.apache.hadoop.metrics.jvm.JvmMetrics.init(JvmMetrics.java:81)
        at org.apache.hadoop.metrics.jvm.JvmMetrics.init(JvmMetrics.java:68 
)
        at org.apache.hadoop.mapred.LocalJobRunnerMetrics.<init>(LocalJobRunnerMetrics.java:40)
        at org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:741)
        at org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:734)
        at org.apache.hadoop.mapred.LocalClientProtocolProvider.create(LocalClientProtocolProvider.java:42)
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:121)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:108)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:101)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1311)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
        at org.apache.hadoop.mapreduce.Job.connect(Job.java:1306)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1335)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at org.apache.hadoop.examples.Grep.run(Grep.java:78)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.examples.Grep.main(Grep.java:103)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.net.UnknownHostException: Test131: Name or service not known
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
        ... 36 more
18/03/28 03:41:51 INFO metrics.MetricsUtil: Unable to obtain hostName
java.net.UnknownHostException: Test131: Test131: Name or service not known
        at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
        at org.apache.hadoop.metrics.MetricsUtil.getHostName(MetricsUtil.java:97)
        at org.apache.hadoop.metrics.MetricsUtil.createRecord(MetricsUtil.java:86)
        at org.apache.hadoop.mapred.LocalJobRunnerMetrics.<init>(LocalJobRunnerMetrics.java:44)
        at org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:741)
        at org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:734)
        at org.apache.hadoop.mapred.LocalClientProtocolProvider.create(LocalClientProtocolProvider.java:42)
        at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:121)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:108)
        at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:101)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1311)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
        at org.apache.hadoop.mapreduce.Job.connect(Job.java:1306)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1335)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at org.apache.hadoop.examples.Grep.run(Grep.java:78)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.examples.Grep.main(Grep.java:103)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.net.UnknownHostException: Test131: Name or service not known
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
        ... 33 more
java.net.UnknownHostException: Test131: Test131: Name or service not known
        at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:148)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1341)
        at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1338)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1338)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1359)
        at org.apache.hadoop.examples.Grep.run(Grep.java:78)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.examples.Grep.main(Grep.java:103)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.net.UnknownHostException: Test131: Name or service not known
        at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
        at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
        at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
        at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
        ... 24 more

這個錯誤是由於我裝完系統之後把hostname 從ubuntutest修改成了Test131。忘記修改hosts檔案裡面的hostname ip映射了。
解決方案就是將hostname 重新進行ip對映

sudo vi /etc/hosts
sudo /etc/init.d/networking restart

這裡寫圖片描述

Hadoop 2.8.3 standalone sample ubuntu 16.04.4

執行Hadoop standalone sample 報一下錯誤： bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.3.jar grep sample/input s

Python 2.7.12+Django 1.11.8+Ubuntu 16.04.4 LTS+Apache 2.4.33寶塔配置

鏈接是我 AD 測試環境可能 static ive window In 將在本地localhost的項目部署到寶塔上;首先創建兩個域名,因為是測試環境,所以只是修該了C:\Windows\System32\drivers\etc\host文件然後分別建立了前端(

hadoop 2.8.3 UnregisteredNodeException

起因：hadoop 已經叢集完畢，想測試動態新增節點，然後直接克隆已有的節點虛擬系統作為新節點。現象：使用jps 之後發現只有NodeManager 並沒有發現DataNode. 排查：重新啟動叢集，現象還是一樣，排除動態節點新增，然後開啟master日誌

第4步：在雲伺服器Ubuntu 16.04.4 LTS中安裝Hadoop2.9.2

在阿里雲中搭建大資料實驗環境第4步：在雲伺服器Ubuntu 16.04.4 LTS中安裝Hadoop2.9.2 https://www.cnblogs.com/87hbteo/p/7606012.html 一、更新apt 用liuxv使用者登入後，先更新apt，能使apt安裝以後要

第3步：在雲伺服器Ubuntu 16.04.4 LTS中配置jdk-8u191-linux-x64.tar.gz

在阿里雲中搭建大資料實驗環境第3步：在雲伺服器Ubuntu 16.04.4 LTS中配置jdk-8u191-linux-x64.tar.gz 前期準備1：在命令列輸入passwd +使用者名稱，修改密碼，若修改成功，則會返回password updated successfully&nbs

Ubuntu 16.04.4 安裝openjdk各種問題

keyword 意思 open less code sku pos ack clas 不知道為什麽會如此曲折，一個問題接一個，如果你也遇到問題，可以參考參考問題1：......has no installation andidate,解決如下（不理解）：參考https:

Upgrade gnugk from 4.7 to 4.9 on ubuntu 16.04.4

gnugk gnugk 升級 Upgrade gnugk from 4.7 to 4.9 on ubuntu 16.04.4（LTS）背景我之前使用了gnugk 來解決和h323 穿透NAT問題，可以參考這篇【歷史博客】今天看到gnugk 已經更新到了4.9了，fix 了不少BUG ,而我目

Ubuntu 16.04.4的網路配置

1、檢視網絡卡狀態 [email protected]:~# ifconfig -a [email protected]:~# ip addr [email protected]:~# ip route show 2、設定靜態IP [email protected

ubuntu-16.04.4-server-amd64 USB安裝過程記錄

一、安裝背景：用普通桌上型電腦安裝ubuntu server，用來做測試機。二、安裝問題：分別用ultraiso和universal-usb-installer燒錄U盤啟動，均遇到問題，具體問題如下： 1、用官網推薦的universal-usb-install

重大安全事件 | Ubuntu 16.04.4 暴本地提權漏洞

漏洞簡介Twitter 上 Nikolenko 發推表示 Ubuntu 最新版本存在一個本地提權

通過teamviewer 遠端連線 ubuntu 16.04.4 LTS

最近搞了個雲伺服器，之前都是通過XShell遠端命令列，用著也挺方便的，但是現在要在上面裝virtualbox安裝虛擬機器，結果發現還是有不少問題要解決： 1.在windows下遠端Ubuntu 之前用過VNC Viewer和VNC Server實現的方

Ubuntu 16.04.4安裝Anaconda

需要一個操作 dev chm nor cond xen 記得環境：剛裝上的系統： $ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Descriptio

並行作業2：Ubuntu(16.04)下安裝配置hadoop(2.7.3)

Ubuntu(16.04)下安裝配置hadoop(2.7.3) 系統採用vm下ubuntu16.04 一、Java環境搭建(參考我的其它部落格) 二、安裝ssh-server並實現免密碼登入 1、下載安裝ssh-server sudo apt-get install op

Ubuntu 16.04下為Android編譯OpenCV 3.2.0 Manager

由於 ica 如何 setting -i add 標記 roi stripe http://johnhany.net/2016/07/build-opencv-manager-for-android-on-ubuntu/ 最近想在Android上嘗試一下SIFT和SU

Hadoop 2.9.1 on Ubuntu 16.04

serve 用戶 datanode syn cat bashrc 格式 pat mixed Hadoop 2.9.1 on Ubuntu 16.04 環境配置 3臺機器虛擬機 ubuntu16.04 10.64.104.177 hadoop-master 10.64.10

[環境配置]Ubuntu 16.04 原始碼編譯安裝OpenCV-3.2.0+OpenCV_contrib-3.2.0及產生的問題

1.OpenCV-3.2.0+OpenCV_contrib-3.2.0編譯安裝過程 1）下載官方要求的依賴包 GCC 4.4.x or later CMake 2.6 or higher Git GTK+2.x or higher, including headers (libgtk2.

Ubuntu 16.04 安裝opencv 3.2

1.安裝依賴庫 sudo apt-get install build-essential sudo apt-get install cmake git libgtk2.0-dev pkg-config libavcodec-dev libavformat-dev libsw

Ubuntu 16.04.3 LTS部署MantisBT2.8.0

前言由於工作需要，準備搭建一個缺陷管理系統，最後相中了MantisBT，原因有以下幾點：系統開源且安裝部署快捷支援多種語言，使用起來很方便角色、許可權等設定靈活，功能強大廢話不多說，下面開始安裝部署MantisBT 安裝部署MantisBT

Ubuntu-16.04.3-server安裝配置JDK-8u191、Tomcat-8.5

Ubuntu-16.04.3-server安裝配置JDK、Tomcat 準備檔案： ubuntu-16.04.3-server-amd64.iso jdk-8u191-linux-x64.tar.gz apache-tomcat-8.5.34.tar.gz pscp

大資料基礎（五）從零開始安裝配置Hadoop 2.7.2+Spark 2.0.0到Ubuntu 16.04

raw to spark 0 install ubuntu 14.04.01 desktop x64 1 system基礎配置《以下都是root模式》 1.3 root password sudo passwd root 1.5 root登入選項 a.在terminal下

Hadoop 2.8.3 standalone sample ubuntu 16.04.4

相關推薦