centos下安裝單機版kafka-0.10.0.1
1.環境說明
主機資訊如下: 1[[email protected] soft]# hostname
2test1
3[[email protected] soft]# cat /etc/hosts
4127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
5::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
6192.168.56.91 test1
7192.168.56.92 test28
192.168.56.93 test3
9192.168.56.1 PC-201306171517
10作業系統版本如下:[[email protected] soft]# cat /etc/redhat-release
2
CentOS release 6.4 (Final)
3
[[email protected] soft]# uname -a
4
Linux test1 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
5
2.下載kafka
下載地址如下:3.安裝配置kafka
一.解壓縮kafka
1[[email protected] soft]# tar zxvf kafka_2.11-0.10.0.1.tgz -C /root/kafka
二.配置zookeeper
由於kafka需要使用到zookeeper來註冊資訊,因此需要首先配置zookeeper.在kafka的安裝包中已經提供了zookeeper,不需要額外安裝,直接配置一下即可.配置檔案在config下的zookeeper. properties[ [email protected] config]# cat zookeeper.properties
2
# Licensed to the Apache Software Foundation (ASF) under one or more
3
# contributor license agreements. See the NOTICE file distributed with
4
# this work for additional information regarding copyright ownership.
5
# The ASF licenses this file to You under the Apache License, Version 2.0
6
# (the "License"); you may not use this file except in compliance with
7
# the License. You may obtain a copy of the License at
8
#
9
# http://www.apache.org/licenses/LICENSE-2.0
10
#
11
# Unless required by applicable law or agreed to in writing, software
12
# distributed under the License is distributed on an "AS IS" BASIS,
13
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
14
# See the License for the specific language governing permissions and
15
# limitations under the License.
16
# the directory where the snapshot is stored.
17
dataDir=/root/kafka/kafka_2.11-0.10.0.1/zoodata ###########這裡修改zookeeper的快照目錄,需要事先在檔案系統上建立目錄,其它預設即可.
18
# the port at which the clients will connect
19
clientPort=2181 #預設埠號2181
20
# disable the per-ip limit on the number of connections since this is a non-production config
21
maxClientCnxns=0
22
三.配置kafka
kafka的配置檔案在config下的server.properties檔案.下面是一個配置例項: 1[[email protected] config]# pwd
2/root/kafka/kafka_2.11-0.10.0.1/config
3[[email protected] config]# cat server.properties
4# Licensed to the Apache Software Foundation (ASF) under one or more
5# contributor license agreements. See the NOTICE file distributed with
6# this work for additional information regarding copyright ownership.
7# The ASF licenses this file to You under the Apache License, Version 2.0
8# (the "License"); you may not use this file except in compliance with
9# the License. You may obtain a copy of the License at
10#
11# http://www.apache.org/licenses/LICENSE-2.0
12#
13# Unless required by applicable law or agreed to in writing, software
14# distributed under the License is distributed on an "AS IS" BASIS,
15# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
16# See the License for the specific language governing permissions and
17# limitations under the License.
18# see kafka.server.KafkaConfig for additional details and defaults
1920############################# Server Basics #############################
2122# The id of the broker. This must be set to a unique integer for each broker.
23broker.id=0 ############################這裡是主機的id,類似於zookeeper的id
24相關推薦
centos下安裝單機版kafka-0.10.0.1
1.環境說明 主機資訊如下: 1[[email protected] soft]# hostname2test13[[email protected] soft]# cat /etc/hosts4127.0.0.1 localh
Centos下Spark單機版(python)安裝配置
如果上面都成功了,那說明我們就基本安裝成功了,可以用scala或者python來開發相關程式了。但是如果我們希望能夠在一個很清新的IDE中開發程式怎麼辦?那麼這裡強烈推薦一款互動式的開發工具-jupyter notebook。接下來我們就來配置該工具,以保證能連線上sprak。
windows 10下安裝GPU版MXNet 0.7.0
前置條件 已經安裝: visual studio 2013(參照mxnet官網,安裝“ Visual C++ Compiler Nov 2013 CTP.”使其支援C++11,如果裝不上需要解除安裝一些東西,印象中是“Microsoft 2013 VC++
Windows下安裝單機Kafka
zookeeper -c 現在 消息 src 安裝包 trap ole 根目錄 Zookeeper 解壓後進入conf目錄,復制出一個zoo.cfg,然後進入bin目錄,直接運行zkServer.cmd Kafka 首先你得有一個安裝包: 解壓,目錄結構: confi
CentOS下安裝配置MySQL8.0的步驟詳解
下載yum源的安裝包 yum localinstall https://repo.mysql.com//mysql80-community-release-el7-1.noarch.rpm 安裝 yum install mysql-community-server 啟動
Windows環境下HBase單機版安裝全部過程
下載 HBase: http://hbase.apache.org/downloads.html Hadoop: https://hadoop.apache.org/releases.html 下載後會得到兩個壓縮檔案hadoop-common-[版本號]-bin-master.zi
centos6.5安裝單機版hadoop2.6.0
安裝hadoop之前,首先要安裝 jdk1.8.0_181(我使用的版本) 並配置jdk環境變數,接下來開始安裝hadoop 1. hadoop2.6.0下載 下載地址:http://archive.apache.org/dist/hadoop/core/hadoop-2.6.0/
centos下安裝mongodb4.0
下載mongodb,https://www.mongodb.com/download-center#community,我這裡下載的是最新版,mongodb-linux-x86_64-amazon2-4.0.2,下載後上傳至/usr/local/mongodb,並解壓 進入解壓後的資
linux(centos)下安裝mysql5.7(mysql8.0類似)
本人使用的是centos64位系統。mysql安裝步驟如下: 1、下載mysql安裝包---二進位制壓縮包: 下載免費社群版本: 2、檢視系統是否自帶mysql,若有則將其解除安裝: 3、解壓壓縮包: 將壓縮包放在你需要安裝的路徑下:a:新建路徑
CentOS下安裝nodejs v8.0環境
新建目錄www 下載nodejs wget https://npm.taobao.org/mirrors/node/v8.0.0/node-v8.0.0-linux-x64.tar.xz 解壓 tar -xvf node-v8.0.0-linux-x64.t
mac下單機版 kafka + spark + python搭建與例項
kafka+zookeeper 不提供spark安裝,這裡從kafka安裝開始 首先下載kafka和zookeeper brew install zookeeper 等它安裝完畢,先進入zookeeper資料夾,往往在/usr/local/Cella
最簡單的redis教程:centos6.5下redis單機版安裝《一》
安裝 命令如下: wget http://download.redis.io/releases/redis-3.0.0.tar.gz tar -zxvf redis-3.0.0.tar.gz cd
在CentOS下安裝配置MySQL-5.0.77過程
近日在CentOS下安裝配置成功了MySQL-5.0.27(事實上這種安裝方法適合任何Linux版本),特記下來備忘。^_^ 我在安裝CentOS是一直是選擇最小安裝(為了在linux下安裝某某,安裝linux已經無數遍了),只選擇了安裝包中的development too
centos下安裝kafka
環境:CentOS release 6.5 (Final) 1.kafka服務依賴jdk1.7,所以要先裝好jdk 下載jdk包到伺服器上,但官網上已經沒有這個版本的了,在百度雲盤存了一個。 下載地址:連結:https://pan.baidu.com/s/1zn4
centos 7 kafka 2.10-0.10.2.0 叢集
快速開始: 關於kafka說明可以參考: 0) kafka叢集的安裝, 準備三臺伺服器 server1:192.168.0.1 server2:192.168.0.2 server3:192.168.0.3
單機版kafka、zookeeper安裝
今天剛接觸kafka,網上很多kafka的安裝,這裡只講單機版的安裝以及安裝過程中遇到的問題。 軟體 JDK1.8(jdk-8u131-linux-x64.rpm) zookeeper (zookeeper-3.4.10.tar.gz) kafka (ka
kafka在linux安裝單機版(--zookeeper未識別的坑)
kafka安裝評測 下載地址:http://archive.apache.org/dist/kafka/2.0.0/ 可以直接通過wget下載 依賴jdk環境 可以安裝在/usr/local中 vim server.properties 修改對外的IP地址,否則kafka在
Linux(CentOS)下安裝Redis(redis-4.0.1)
1、下載Redis 下載最新Linux版本的Redis,我用的是redis-4.0.1.tar.gz。百度雲盤連結:https://pan.baidu.com/s/1bo5UOUV 密碼:iofs 2、編譯 redis是通過原始碼安裝的,所以我們需要先安裝gcc編譯器,同時
Mac 10.10安裝破解版Navicat Premium 11.0.16.dmg
1.下載Navicat Premium 11.0.16.dmg 已經放到百度網盤,裡面有安裝檔案和註冊機 2.安裝步驟: 2.1開啟下載的檔案,把檔案拖到應用程式 2.2開啟core keygen.app(破解版,千萬不要開啟app,先打core keygen.a
CentOS下 安裝配置hadoop環境--單實例版
per pla centos pre dfs- pat prop alt art CentOS下1、安裝linux2、安裝jdk[[email protected] ~]# javac //顯示信息[[email protected] ~]# rp