使用docker-compose 一鍵部署你的分散式呼叫鏈跟蹤框架skywalking
摘要：
一旦你的程式docker化之後，你會遇到各種問題，比如原來採用的本地記日誌的方式就不再方便了，雖然你可以掛載到宿主機，但你使用 --scale 的話，會導致
記錄日誌異常，所以最好的方式還是要做日誌中心化，另一個問題，原來一個請求在一個程序中的痙攣失敗，你可以在日誌中巡查出呼叫堆疊，但是d...
一旦你的程式docker化之後，你會遇到各種問題，比如原來採用的本地記日誌的方式就不再方便了，雖然你可以掛載到宿主機，但你使用 --scale 的話，會導致
記錄日誌異常，所以最好的方式還是要做日誌中心化，另一個問題，原來一個請求在一個程序中的痙攣失敗，你可以在日誌中巡查出呼叫堆疊，但是docker化之後，
原來一個程序的東西會拆成幾個微服務，這時候最好就要有一個分散式的呼叫鏈跟蹤，類似於wcf中的svctraceview工具。
一：搭建skywalking
gihub地址是： https://github.com/apache/incubator-skywalking 從文件中大概看的出來，大體分三個部分：儲存，收集器，探針，儲存這裡就選用推薦的
elasticsearch。收集器準備和es部署在一起，探針就有各自語言的實現了，總之這裡就有三個docker container： es，kibana，skywalking， 如果不用容器編排工具
的話就比較麻煩。
下面是本次搭建的一個目錄結構：
1. elasticsearch.yml
es的配置檔案，不過這裡有一個坑，就是一定要將 network.publish_host： 0.0.0.0 ，否則skywalking會連不上 9300埠。
network.publish_host: 0.0.0.0 transport.tcp.port: 9300 network.host: 0.0.0.0
2. elasticsearch.dockerfile
在up的時候，將這個es檔案copy到 容器的config資料夾下。
FROM elasticsearch:5.6.4 EXPOSE 9200 9300 COPY elasticsearch.yml /usr/share/elasticsearch/config/
3. application.yml
skywalking的配置檔案，這裡也有一個坑：連線es的地址中，配置的 clustername一定要修改成和es的clustername保持一致，否則會連不上，這裡容器之間用link
進行互聯，所以es的ip改成elasticsearch就可以了，其他的ip改成0.0.0.0 。
# Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements.See the NOTICE file # distributed with this work for additional information # regarding copyright ownership.The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License"); you may not use this file except in compliance # with the License.You may obtain a copy of the License at # #http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. #cluster: #zookeeper: #hostPort: localhost:2181 #sessionTimeout: 100000 naming: jetty: host: 0.0.0.0 port: 10800 contextPath: / cache: #guava: caffeine: remote: RPC/">gRPC: host: 0.0.0.0 port: 11800 agent_gRPC: gRPC: host: 0.0.0.0 port: 11800 #Set these two setting to open ssl #sslCertChainFile: $path #sslPrivateKeyFile: $path #Set your own token to active auth #authentication: xxxxxx agent_jetty: jetty: host: 0.0.0.0 port: 12800 contextPath: / analysis_register: default: analysis_jvm: default: analysis_segment_parser: default: bufferFilePath: ../buffer/ bufferOffsetMaxFileSize: 10M bufferSegmentMaxFileSize: 500M bufferFileCleanWhenRestart: true ui: jetty: host: 0.0.0.0 port: 12800 contextPath: / storage: elasticsearch: clusterName: elasticsearch clusterTransportSniffer: true clusterNodes: elasticsearch:9300 indexShardsNumber: 2 indexReplicasNumber: 0 highPerformanceMode: true ttl: 7 #storage: #h2: #url: jdbc:h2:~/memorydb #userName: sa configuration: default: #namespace: xxxxx # alarm threshold applicationApdexThreshold: 2000 serviceErrorRateThreshold: 10.00 serviceAverageResponseTimeThreshold: 2000 instanceErrorRateThreshold: 10.00 instanceAverageResponseTimeThreshold: 2000 applicationErrorRateThreshold: 10.00 applicationAverageResponseTimeThreshold: 2000 # thermodynamic thermodynamicResponseTimeStep: 50 thermodynamicCountOfResponseTimeSteps: 40
4. skywalking.dockerfile
接下來就是 skywalking的 下載安裝，使用dockerfile流程化。
FROM centos:7 LABEL username="[email protected]" WORKDIR /app RUN yum install -y wget && \ yum install -y java-1.8.0-openjdk ADD http://mirrors.hust.edu.cn/apache/incubator/skywalking/5.0.0-RC2/apache-skywalking-apm-incubating-5.0.0-RC2.tar.gz /app RUN tar -xf apache-skywalking-apm-incubating-5.0.0-RC2.tar.gz && \ mv apache-skywalking-apm-incubating skywalking RUN ls /app #copy檔案 COPY application.yml /app/skywalking/config/application.yml WORKDIR /app/skywalking/bin USER root RUNecho "tail -f /dev/null" >> /app/skywalking/bin/startup.sh CMD ["/bin/sh","-c","/app/skywalking/bin/startup.sh" ]
5. docker-compose.yml
最後就是將這三個容器進行編排，要注意的是，因為收集器會將資料放入到es中，所有一定要將es的data掛載到宿主機的大硬碟下，否則你的空間會不足的。
version: '3.1' services: #elastic 映象 elasticsearch: build: context: . dockerfile: elasticsearch.dockerfile # ports: #- "9200:9200" #- "9300:9300" volumes: - "/data/es2:/usr/share/elasticsearch/data" #kibana 視覺化查詢，暴露 5601 kibana: image: kibana links: - elasticsearch ports: - 5601:5601 depends_on: - "elasticsearch" #skywalking skywalking: build: context: . dockerfile: skywalking.dockerfile ports: - "10800:10800" - "11800:11800" - "12800:12800" - "8080:8080" links: - elasticsearch depends_on: - "elasticsearch"
二：一鍵部署
要部署在docker中，你還得需要安裝docker-ce 和 docker-compose，大家可以參照官方安裝一下。
1. Docker-ce 的安裝
sudo yum remove docker \ docker-client \ docker-client-latest \ docker-common \ docker-latest \ docker-latest-logrotate \ docker-logrotate \ docker-selinux \ docker-engine-selinux \ docker-engine sudo yum install -y yum-utils \ device-mapper-persistent-data \ lvm2 sudo yum-config-manager \ --add-repo \ https://download.docker.com/linux/centos/docker-ce.repo sudo yum install docker-ce
然後啟動一下docker 服務，可以看到版本是18.06.1
[root@localhost ~]# service docker start Redirecting to /bin/systemctl startdocker.service [root@localhost ~]# docker -v Docker version 18.06.1-ce, build e68fc7a
2. docker-compose的安裝
sudo curl -L "https://github.com/docker/compose/releases/download/1.22.0/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose sudo chmod +x /usr/local/bin/docker-compose
3. 最後在centos上執行 docker-compopse up --build 就可以了，如果不想terminal上執行，可以加 -d 使用後臺執行。
[root@localhost docker]# docker-compose up --build Building elasticsearch Step 1/3 : FROM elasticsearch:5.6.4 ---> 7a047c21aa48 Step 2/3 : EXPOSE 9200 9300 ---> Using cache ---> 8d66bb57b09d Step 3/3 : COPY elasticsearch.yml /usr/share/elasticsearch/config/ ---> Using cache ---> 02b516c03b95 Successfully built 02b516c03b95 Successfully tagged docker_elasticsearch:latest Building skywalking Step 1/12 : FROM centos:7 ---> 5182e96772bf Step 2/12 : LABEL username="[email protected]" ---> Using cache ---> b95b96a92042 Step 3/12 : WORKDIR /app ---> Using cache ---> afdf4efe3426 Step 4/12 : RUN yum install -y wget &&yum install -y java-1.8.0-openjdk ---> Using cache ---> 46be0ca0f7b5 Step 5/12 : ADD http://mirrors.hust.edu.cn/apache/incubator/skywalking/5.0.0-RC2/apache-skywalking-apm-incubating-5.0.0-RC2.tar.gz /app ---> Using cache ---> d5c30bcfd5ea Step 6/12 : RUN tar -xf apache-skywalking-apm-incubating-5.0.0-RC2.tar.gz &&mv apache-skywalking-apm-incubating skywalking ---> Using cache ---> 1438d08d18fa Step 7/12 : RUN ls /app ---> Using cache ---> b594124672ea Step 8/12 : COPY application.yml /app/skywalking/config/application.yml ---> Using cache ---> 10eaf0805a65 Step 9/12 : WORKDIR /app/skywalking/bin ---> Using cache ---> bc0f02291536 Step 10/12 : USER root ---> Using cache ---> 4498afca5fe6 Step 11/12 : RUNecho "tail -f /dev/null" >> /app/skywalking/bin/startup.sh ---> Using cache ---> 1c4be7c6b32a Step 12/12 : CMD ["/bin/sh","-c","/app/skywalking/bin/startup.sh" ] ---> Using cache ---> ecfc97e4c97d Successfully built ecfc97e4c97d Successfully tagged docker_skywalking:latest Recreating docker_elasticsearch_1 ... WARNING: Service "elasticsearch" is using volume "/usr/share/elasticsearch/data" from the previous container. Host mapping "/data/es2" has no effect. Remove the existing containers (with `docker-compose rm elasticsea Recreating docker_elasticsearch_1 ... done Recreating docker_skywalking_1... done Recreating docker_kibana_1... done Attaching to docker_elasticsearch_1, docker_kibana_1, docker_skywalking_1 elasticsearch_1| [2018-09-17T23:30:29,689][INFO ][o.e.n.Node] [] initializing ... skywalking_1| SkyWalking Collector started successfully! elasticsearch_1| [2018-09-17T23:30:29,830][INFO ][o.e.e.NodeEnvironment] [C3Z3xlS] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda3)]], net usable_space [5.1gb], net total_space [22.1gb], spins? [possibly], types [xfs] elasticsearch_1| [2018-09-17T23:30:29,831][INFO ][o.e.e.NodeEnvironment] [C3Z3xlS] heap size [1.9gb], compressed ordinary object pointers [true] elasticsearch_1| [2018-09-17T23:30:30,071][INFO ][o.e.n.Node] node name [C3Z3xlS] derived from node ID [C3Z3xlScTmq1MbtJsGKZ0Q]; set [node.name] to override elasticsearch_1| [2018-09-17T23:30:30,071][INFO ][o.e.n.Node] version[5.6.4], pid[1], build[8bbedf5/2017-10-31T18:55:38.105Z], OS[Linux/3.10.0-327.el7.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_151/25.151-b12] elasticsearch_1| [2018-09-17T23:30:30,071][INFO ][o.e.n.Node] JVM arguments [-Xms2g, -Xmx2g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -XX:+HeapDumpOnOutOfMemoryError, -Des.path.home=/usr/share/elasticsearch] skywalking_1| SkyWalking Web Application started successfully! elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [aggs-matrix-stats] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [ingest-common] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [lang-expression] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [lang-groovy] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [lang-mustache] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [lang-painless] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [parent-join] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [percolator] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [reindex] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [transport-netty3] elasticsearch_1| [2018-09-17T23:30:31,964][INFO ][o.e.p.PluginsService] [C3Z3xlS] loaded module [transport-netty4] elasticsearch_1| [2018-09-17T23:30:31,968][INFO ][o.e.p.PluginsService] [C3Z3xlS] no plugins loaded kibana_1| {"type":"log","@timestamp":"2018-09-17T23:30:34Z","tags":["status","plugin:[email protected]","info"],"pid":11,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}
從上圖中可以看到 es，kibana，skywalking都啟動成功了，你也可以通過docker-compose ps 看一下是否都起來了，netstat 看一下宿主機開放了哪些埠。
[root@localhost docker]# docker ps CONTAINER IDIMAGECOMMANDCREATEDSTATUSPORTSNAMES 9aa90401ca16kibana"/docker-entrypoint.…"2 minutes agoUp 2 minutes0.0.0.0:5601->5601/tcpdocker_kibana_1 c551248e32afdocker_skywalking"/bin/sh -c /app/sky…"2 minutes agoUp 2 minutes0.0.0.0:8080->8080/tcp, 0.0.0.0:10800->10800/tcp, 0.0.0.0:11800->11800/tcp, 0.0.0.0:12800->12800/tcpdocker_skywalking_1 765d38469ff1docker_elasticsearch"/docker-entrypoint.…"2 minutes agoUp 2 minutes9200/tcp, 9300/tcpdocker_elasticsearch_1 [root@localhost docker]# netstat -tlnp Active Internet connections (only servers) Proto Recv-Q Send-Q Local AddressForeign AddressStatePID/Program name tcp00 192.168.122.1:530.0.0.0:*LISTEN2013/dnsmasq tcp00 0.0.0.0:220.0.0.0:*LISTEN1141/sshd tcp00 127.0.0.1:6310.0.0.0:*LISTEN1139/cupsd tcp00 127.0.0.1:250.0.0.0:*LISTEN1622/master tcp600 :::8080:::*LISTEN38262/docker-proxy tcp600 :::10800:::*LISTEN38248/docker-proxy tcp600 :::22:::*LISTEN1141/sshd tcp600 ::1:631:::*LISTEN1139/cupsd tcp600 :::11800:::*LISTEN38234/docker-proxy tcp600 ::1:25:::*LISTEN1622/master tcp600 :::12800:::*LISTEN38222/docker-proxy tcp600 :::5601:::*LISTEN38274/docker-proxy [root@localhost docker]#
然後就可以看一些8080埠的視覺化UI，預設使用者名稱密碼admin，admin，一個比較耐看的UI就出來了。
三： net下的探針
從nuget上拉取一個SkyWalking.AspNetCore探針進行程式碼埋點，github地址： https://github.com/OpenSkywalking/skywalking-netcore
在startup類中進行注入，在頁面請求中進行一次cnblogs.com的請求操作，然後仔細觀察一下呼叫鏈跟蹤是一個什麼樣子？
using System; using System.Collections.Generic; using System.Linq; using System.Threading.Tasks; using Microsoft.AspNetCore.Builder; using Microsoft.AspNetCore.Hosting; using Microsoft.AspNetCore.Http; using Microsoft.Extensions.DependencyInjection; using SkyWalking.Extensions; using SkyWalking.AspNetCore; using System.Net; namespace WebApplication1 { public class Startup { // This method gets called by the runtime. Use this method to add services to the container. // For more information on how to configure your application, visit https://go.microsoft.com/fwlink/?LinkID=398940 public void ConfigureServices(IServiceCollection services) { services.AddSkyWalking(option => { // Application code is showed in sky-walking-ui option.ApplicationCode = "10001 測試站點"; //Collector agent_gRPC/grpc service addresses. option.DirectServers = "192.168.23.183:11800"; }); } // This method gets called by the runtime. Use this method to configure the HTTP request pipeline. public void Configure(IApplicationBuilder app, IHostingEnvironment env) { if (env.IsDevelopment()) { app.UseDeveloperExceptionPage(); } app.Run(async (context) => { WebClient client = new WebClient(); var str = client.DownloadString("http://cnblogs.com"); await context.Response.WriteAsync(str); }); } } } View Code
可以看到這張圖還是蠻漂亮的哈，也方便我們快速的跟蹤程式碼，發現問題，找出問題， 還有更多的功能期待你的挖掘啦。 好了，本篇就說到這裡，希望對你有幫助。