Kubernetes技術(shù)分析之監(jiān)控
Docker的流行激活了一直不溫不火的PaaS,隨著而來的是各類Micro-PaaS的出現(xiàn),Kubernetes是其中***代表性的一員,它是Google多年大規(guī)模容器管理技術(shù)的開源版本。本系列文章將逐一分析Kubernetes,本文介紹 Kubernetes中2個主要的監(jiān)控模塊cAdvisor 和Heapster 。
Kubernetes監(jiān)控
監(jiān)控是運維的根基,是非常重要的一環(huán),對此Kubernete提供了平臺本身以及應(yīng)用的監(jiān)控,下圖是Kubernete中監(jiān)控的邏輯設(shè)計圖:
cAdvisor
監(jiān)控agent, 在每個Kubernetes Node上都會運行cAdvisor 。cadvisor 會收集本機(jī)以及容器的監(jiān)控數(shù)據(jù)(CPU, memory, filesystem, and network usage statistics)。
在較新的Kubernetes版本里,cadvior功能已經(jīng)被集成到了kubelet組件中。在Node節(jié)點上可以直接訪問cadvisor 的界面:
也可以調(diào)用cadvisor 的API接口,參考:
https://github.com/google/cadv ... pi.md
下面是cadvisor 一條記錄,可以看到統(tǒng)計的監(jiān)控數(shù)據(jù)范圍:
- {
- "timestamp": "2015-08-06T16:26:14.407749377+08:00",
- "cpu": {
- "usage": {
- "total": 9868208554,
- "per_cpu_usage": [9868208554],
- "user": 1850000000,
- "system": 280000000
- },
- "load_average": 0
- },
- "diskio": {
- "io_service_bytes": [{
- "major": 253,
- "minor": 7,
- "stats": {
- "Async": 13946880,
- "Read": 13946880,
- "Sync": 0,
- "Total": 13946880,
- "Write": 0
- }
- }],
- "io_serviced": [{
- "major": 253,
- "minor": 7,
- "stats": {
- "Async": 369,
- "Read": 369,
- "Sync": 0,
- "Total": 369,
- "Write": 0
- }
- }]
- },
- "memory": {
- "usage": 8548352,
- "working_set": 4067328,
- "container_data": {
- "pgfault": 6462,
- "pgmajfault": 132
- },
- "hierarchical_data": {
- "pgfault": 6462,
- "pgmajfault": 132
- }
- },
- "network": {
- "name": "",
- "rx_bytes": 0,
- "rx_packets": 0,
- "rx_errors": 0,
- "rx_dropped": 0,
- "tx_bytes": 0,
- "tx_packets": 0,
- "tx_errors": 0,
- "tx_dropped": 0
- },
- "task_stats": {
- "nr_sleeping": 0,
- "nr_running": 0,
- "nr_stopped": 0,
- "nr_uninterruptible": 0,
- "nr_io_wait": 0
- }
- },
Heapster
Heapster 收集所有Kubernetes Node,然后匯總數(shù)據(jù),然后可以導(dǎo)到第三方工具(如Influxdb)。
Heapster 可以以Pod的方式運行在Kubernetes平臺里,也可以單獨運行以standalone的方式。
使用Pod方式部署的話問題比較多,本文采用standalone方式部署。
- $ docker run -p 8082:8082 \
- --add-host=node1:192.168.3.147 --add-host=node2:192.168.3.148 --add-host=node3:192.168.3.149 \
- kubernetes/heapster:v0.15.0 \
- --source=kubernetes:http://192.168.3.146:8080?inClusterConfig=false&useServiceAccount=false \
- --sink=influxdb:http://10.254.209.104:8086
source用于配置監(jiān)控來源,它支持的參數(shù):
- inClusterConfig - Use kube config in service accounts associated with heapster's namesapce. (default: true)
- kubeletPort - kubelet port to use (default: 10255)
- kubeletHttps - whether to use https to connect to kubelets (default: false)
- apiVersion - API version to use to talk to Kubernetes. Defaults to the version in kubeConfig.
- insecure - whether to trust kubernetes certificates (default: false)
- auth - client auth file to use. Set auth if the service accounts are not usable.
- useServiceAccount - whether to use the service account token if one is mounted at/var/run/secrets/kubernetes.io/serviceaccount/token (default: false)
注意:--add-host主要是因為Heapster 會根據(jù)hostname去查詢node的IP,參考:
https://github.com/GoogleCloud ... 62998
Heapster 運行后,可以在influxdb查詢到數(shù)據(jù),說明監(jiān)控數(shù)據(jù)已經(jīng)上報: