1. 程式人生 > >kubernetes log 流式資料處理

kubernetes log 流式資料處理

PS: 最近在重構公司的業務容器化平臺,記錄一塊。關於容器日誌的, kubernetes python API本身提供了日誌流式資料,在以前的版本是不會輸出新資料的,後續版本進行了改進。

直接上程式碼

Flask 前端路由塊


# Router
"""獲取專案pod的日誌"""
@api_cluster_pod.route('/<env>/<cluster_name>/pod/<pod_name>/log')
@env_rules
def api_cluster_pod_log(env, cluster_name, pod_name):
    """檢視pod的log"""

    tail_lines = request.values.get("tail_lines", 1000)
    namespace = request.values.get("namespace", "")

    # 生成Config Object
    try:
        cluster_config = ClusterConfig(
            env=env,
            cluster_name=cluster_name,
            namespace=namespace
        )
    except Exception as e:
        return jsonify(dict(
            code=5000,
            message='獲取叢集介面時未找到對應條目, 資訊:{0}'.format(str(e))
        ))

    try:
        poder = Pod( cluster_config)
        resp = Response(stream_with_context(poder.get_pod_log(pod_name, tail_lines)), mimetype="text/plain")
        return resp

    except Exception as e:
        return jsonify(dict(
            code=7000,
            message=str(e)
        ))

Flask 後端程式碼塊

# 後臺功能
class Pod:
    ...
       def get_pod_log(self, pod_name, tail_lines=100):
        """
        獲取pod的日誌
        :param tail_lines: # 顯示最後多少行
        :return:
        """
        try:
            # stream pod log
            streams = self.cluster.api.read_namespaced_pod_log(
                pod_name,
                self.cluster_config.namespace,
                follow=True,
                _preload_content=False,
                tail_lines=tail_lines).stream()
            return streams

        except ApiException as e:
            if e.status == 404:
                logger.exception("Get Log not fund Podname: {0}".format(pod_name))
                raise PodNotFund("獲取日誌時,未找到此pod: {0}".format(pod_name))
            if e.status == 400:
                raise PodNotFund("容器並未建立成功,請聯絡運維人員進行排查。")
            raise e
        except Exception as e:
            logger.exception("Get Log Fail: {0}".format(str(e)))
            raise e

HTML

<!DOCTYPE>
<html>
<head>
    <title>Flushed ajax test</title>
    <meta charset="UTF-8" />
    <script type="text/javascript" src="https://cdn.bootcss.com/jquery/3.0.0/jquery.min.js"></script>

    <style>
        #log-container {
            height: 800px;
            /*width: 800px;*/
            overflow-x: scroll;
            padding: 10px;
        }
        .logs {
            background-color: black;
            color: aliceblue;
            font-size: 18px;
        }
    </style>
</head>
<body>
<div id="log-container">
    <pre class="logs">
    </pre>
</div>

<script type="text/javascript">
    var last_response_len = false;
    var logs = $("#log-container");
    $.ajax('http://localhost/api/pre/ops-test/pod/ops-test-1211763235-jfbst/log?tail_lines=100', {
        xhrFields: {
            onprogress: function(e)
            {
                var this_response, response = e.currentTarget.response;
                if(last_response_len === false)
                {
                    this_response = response;
                    last_response_len = response.length;
                }
                else
                {
                    this_response = response.substring(last_response_len);
                    last_response_len = response.length;
                }
                // console.log(this_response);
                // 接收服務端的實時日誌並新增到HTML頁面中
                $("#log-container pre").append(this_response);
                // 滾動條滾動到最低部
                $("#log-container").scrollTop($("#log-container pre").height() - $("#log-container").height() + 10);
            }
        }
    })
        .done(function(data)
        {

            console.log('Complete response = ' + data);
        })
        .fail(function(data)
        {
            console.log('Error: ', data);
        });
    console.log('Request Sent');
</script>
</body>
</html>

其它

我們應用是前後端分離的,把html裡面的核心程式碼放置VUE裡面就可以了。

效果圖

日誌是流式的,如果Container有日誌,則視窗會運態更新。
kubernetes log 流式資料處理