自拍偷在线精品自拍偷,亚洲欧美中文日韩v在线观看不卡

「云原生」Elasticsearch + Kibana on k8s 講解與實(shí)戰(zhàn)操作

作者：大數(shù)據(jù)老司機(jī)
云計(jì)算 云原生
Elasticsearch是一個(gè)基于Lucene的搜索引擎。它提供了具有HTTP Web界面和無(wú)架構(gòu)JSON文檔的分布式，多租戶能力的全文搜索引擎。

一、概述

Elasticsearch是一個(gè)基于Lucene的搜索引擎。它提供了具有HTTP Web界面和無(wú)架構(gòu)JSON文檔的分布式，多租戶能力的全文搜索引擎。Elasticsearch是用Java開(kāi)發(fā)的，根據(jù)Apache許可條款作為開(kāi)源發(fā)布。

官方文檔：https://www.elastic.co/guide/en/elasticsearch/reference/master/getting-started.htmlGitHub: https://github.com/elastic/elasticsearch

二、Elasticsearch 編排部署

地址：https://artifacthub.io/packages/helm/elastic/elasticsearch

1）添加源并下載編排部署包

helm repo add elastic https://helm.elastic.co
helm pull elastic/elasticsearch --version 7.17.3
tar -xf elasticsearch-7.17.3.tgz

2）構(gòu)建鏡像

Elasticsearch 各版本下載地址：https://www.elastic.co/cn/downloads/past-releases#elasticsearch這里就不重新構(gòu)建鏡像了，這里是將遠(yuǎn)程的鏡像推送到我們本地harbor，加速拉取鏡像。

docker pull docker.elastic.co/elasticsearch/elasticsearch:7.17.3

docker tag docker.elastic.co/elasticsearch/elasticsearch:7.17.3  myharbor.com/bigdata/elasticsearch:7.17.3

# 上傳鏡像
docker push myharbor.com/bigdata/elasticsearch:7.17.3

# 刪除鏡像
docker rmi myharbor.com/bigdata/elasticsearch:7.17.3
crictl rmi myharbor.com/bigdata/elasticsearch:7.17.3

3）修改yaml編排

  • elasticsearch/values.yaml
image: "myharbor.com/bigdata/elasticsearch"

...

...
### 去掉這幾行
volumeClaimTemplate:
  accessModes: ["ReadWriteOnce"]
  resources:
    requests:
      storage: 30Gi
....

persistence:
  enabled: true
  labels:
    # Add default labels for the volumeClaimTemplate of the StatefulSet
    enabled: false
  annotations: {}
  accessModes:
    - ReadWriteOnce
  size: 1Gi
  storageClass: "elasticsearch-local-storage"
  local:
  - name: elasticsearch-0
    host: "local-168-182-110"
    path: "/opt/bigdata/servers/elasticsearch/data/data1"
  - name: elasticsearch-1
    host: "local-168-182-111"
    path: "/opt/bigdata/servers/elasticsearch/data/data1"
  - name: elasticsearch-2
    host: "local-168-182-112"
    path: "/opt/bigdata/servers/elasticsearch/data/data1"

...

protocol: http
httpPort: 9200
transportPort: 9300
service:
  enabled: true
  type: NodePort
  nodePort: 30920
  httpPortName:
  • elasticsearch/templates/storage-class.yaml
kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: {{ .Values.persistence.storageClass }}
provisioner: kubernetes.io/no-provisioner
  • elasticsearch/templates/pv.yaml

{{- range .Values.persistence.local }}
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: {{ .name }}
  labels:
    name: {{ .name }}
spec:
  storageClassName: {{ $.Values.persistence.storageClass }}
  capacity:
    storage: {{ $.Values.persistence.size }}
  accessModes:
  {{- range $.Values.persistence.accessModes }}
    - {{ . | quote }}
  {{- end }}
  local:
    path: {{ .path }}
  nodeAffinity:
    required:
      nodeSelectorTerms:
        - matchExpressions:
            - key: kubernetes.io/hostname
              operator: In
              values:
                - {{ .host }}
---
{{- end }}

  • elasticsearch/templates/statefulset.yaml

spec:
  volumeClaimTemplates:
    spec:
# 去掉這行
{{ toYaml .Values.volumeClaimTemplate | indent 6 }}

# 新增以下內(nèi)容：
      accessModes:
      {{- range .Values.persistence.accessModes }}
      - {{ . | quote }}
      {{- end }}
      resources:
        requests:
          storage: {{ .Values.persistence.size | quote }}
    {{- if .Values.persistence.storageClass }}
    {{- if (eq "-" .Values.persistence.storageClass) }}
      storageClassName: ""
    {{- else }}
      storageClassName: "{{ .Values.persistence.storageClass }}"
    {{- end }}
    {{- end }}

4）開(kāi)始部署

# 先創(chuàng)建本地存儲(chǔ)目錄
mkdir -p /opt/bigdata/servers/elasticsearch/data/data1
chmod -R 777 /opt/bigdata/servers/elasticsearch/data/data1

helm install my-elasticsearch ./elasticsearch -n elasticsearch --create-namespace
# 查看
helm get notes my-elasticsearch -n elasticsearch
kubectl get pods,svc -n elasticsearch -owide

NOTES

NAME: my-elasticsearch
LAST DEPLOYED: Wed Oct 12 23:47:17 2022
NAMESPACE: elasticsearch
STATUS: deployed
REVISION: 1
NOTES:
1. Watch all cluster members come up.
  $ kubectl get pods --namespace=elasticsearch -l app=elasticsearch-master -w2. Test cluster health using Helm test.
  $ helm --namespace=elasticsearch test my-elasticsearch

5）測(cè)試驗(yàn)證

://192.168.182.110:30920/
curl http://192.168.182.110:30920/_cat/nodes
curl http://192.168.182.110:30920/_cat/health?pretty

6）elasticsearch-head

elasticsearch-head GitHub下載地址：https://github.com/mobz/elasticsearch-headGoogle 瀏覽器 elasticsearch-head插件：

鏈接：https://pan.baidu.com/s/1kYcTjBDPmSWVzsku2hEW7w?pwd=67v4提取碼：67v4

7）卸載

helm uninstall my-elasticsearch -n elasticsearch
kubectl delete ns elasticsearch --force

rm -fr /opt/bigdata/servers/elasticsearch/data/data1/*
ssh local-168-182-111 "rm -fr /opt/bigdata/servers/elasticsearch/data/data1/*"
ssh local-168-182-112 "rm -fr /opt/bigdata/servers/elasticsearch/data/data1/*"

docker rmi myharbor.com/bigdata/elasticsearch:7.17.3
crictl rmi myharbor.com/bigdata/elasticsearch:7.17.3
ssh local-168-182-111 "crictl rmi myharbor.com/bigdata/elasticsearch:7.17.3"
ssh local-168-182-112 "crictl rmi myharbor.com/bigdata/elasticsearch:7.17.3"

三、Kibana 編排部署

地址：https://artifacthub.io/packages/helm/bitnami/kibana?modal=install

1）添加源并下載編排部署包

helm repo add bitnami https://charts.bitnami.com/bitnami
helm pull bitnami/kibana --version 10.2.6
tar -xf kibana-10.2.6.tgz

2）構(gòu)建鏡像

這里也不重新構(gòu)建鏡像了，只是將鏡像推送到本地harbor加速，【注意】版本號(hào)需要跟ES相對(duì)應(yīng)，版本不一樣，可能會(huì)存儲(chǔ)不兼容的情況。

docker pull docker.io/bitnami/kibana:7.17.3
docker tag docker.io/bitnami/kibana:7.17.3 myharbor.com/bigdata/kibana:7.17.3

# 上傳鏡像
docker push myharbor.com/bigdata/kibana:7.17.3

# 刪除鏡像
docker rmi myharbor.com/bigdata/kibana:7.17.3
crictl rmi myharbor.com/bigdata/kibana:7.17.3

3）修改yaml編排

  • kibana/values.yaml

image:
  registry: myharbor.com
  repository: bigdata/kibana
  tag: 8.4.3-debian-11-r1

...

replicaCount: 1

...

persistence:
  enabled: true
  accessModes:
    - ReadWriteOnce
  size: 1Gi
  storageClass: "kibana-local-storage"
  local:
  - name: kibana-0
    host: "local-168-182-111"
    path: "/opt/bigdata/servers/kibana/data/data1"

...

service:
  ports:
    http: 5601
  type: NodePort
  nodePorts:
    http: "30601"

...

elasticsearch:
  hosts:
    - elasticsearch-master.elasticsearch
  port: "9200"

  • kibana/templates/values.yaml

{{- range .Values.persistence.local }}
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: {{ .name }}
  labels:
    name: {{ .name }}
spec:
  storageClassName: {{ $.Values.persistence.storageClass }}
  capacity:
    storage: {{ $.Values.persistence.size }}
  accessModes:
  {{- range $.Values.persistence.accessModes }}
    - {{ . | quote }}
  {{- end }}
  local:
    path: {{ .path }}
  nodeAffinity:
    required:
      nodeSelectorTerms:
        - matchExpressions:
            - key: kubernetes.io/hostname
              operator: In
              values:
                - {{ .host }}
---
{{- end }}

  • kibana/templates/storage-class.yaml

kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
  name: {{ .Values.persistence.storageClass }}
provisioner: kubernetes.io/no-provisioner

  • kibana/templates/pv.yaml

{{- range .Values.persistence.local }}
---
apiVersion: v1
kind: PersistentVolume
metadata:
  name: {{ .name }}
  labels:
    name: {{ .name }}
spec:
  storageClassName: {{ $.Values.persistence.storageClass }}
  capacity:
    storage: {{ $.Values.persistence.size }}
  accessModes:
  {{- range $.Values.persistence.accessModes }}
    - {{ . | quote }}
  {{- end }}
  local:
    path: {{ .path }}
  nodeAffinity:
    required:
      nodeSelectorTerms:
        - matchExpressions:
            - key: kubernetes.io/hostname
              operator: In
              values:
                - {{ .host }}
---
{{- end }}

4）開(kāi)始部署

# 先創(chuàng)建本地存儲(chǔ)目錄
mkdir -p /opt/bigdata/servers/kibana/data/data1
chmod -R 777 /opt/bigdata/servers/kibana/data/data1

helm install my-kibana ./kibana -n kibana --create-namespace
# 查看
helm get notes my-kibana -n kibana 
kubectl get pods,svc -n kibana -owide

NOTES

NAME: my-kibana
LAST DEPLOYED: Thu Oct 13 22:43:30 2022
NAMESPACE: kibana
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
CHART NAME: kibana
CHART VERSION: 10.2.6
APP VERSION: 8.4.3

** Please be patient while the chart is being deployed **######################################################################################################
### ERROR: You did not provide the Elasticsearch external host or port in your 'helm install' call ###
######################################################################################################

Complete your Kibana deployment by running:

  helm upgrade --namespace kibana my-kibana my-repo/kibana \
    --set elasticsearch.hosts[0]=YOUR_ES_HOST,elasticsearch.port=YOUR_ES_PORT

Replacing "YOUR_ES_HOST" and "YOUR_ES_PORT" placeholders by the proper values of your Elasticsearch deployment.

5）測(cè)試驗(yàn)證

web：http://192.168.182.111:30601

6）卸載

helm uninstall my-kibana -n kibana
kubectl delete ns kibana --force

ssh local-168-182-111 rm -fr /opt/bigdata/servers/kibana/data/data1/*

docker rmi myharbor.com/bigdata/bigdata:8.4.3-debian-11-r1
crictl rmi myharbor.com/bigdata/bigdata:8.4.3-debian-11-r1

elasticsearch-on-k8s

下載地址：https://gitee.com/hadoop-bigdata/elasticsearch-on-k8skibana-on-k8s

下載地址：https://gitee.com/hadoop-bigdata/kibana-on-k8s

責(zé)任編輯：武曉燕 來(lái)源： 今日頭條
LuceneHTTPWeb
相關(guān)推薦

2023-09-11 00:09:18

2023-03-06 07:19:50

2023-03-03 07:54:21

2022-11-08 08:55:31

2023-03-07 07:56:37

Sqoopk8s底層

2022-11-06 21:31:11

云原生Sentinel集群模式

2023-03-01 07:42:12

HBase編排部署數(shù)據(jù)

2022-10-10 12:54:00

Flink運(yùn)維

2023-02-27 07:40:00

2022-12-13 09:01:50

云原生組件數(shù)據(jù)

2022-11-28 17:22:32

高可用master節(jié)點(diǎn)

2022-12-26 08:14:57

K8sCronhpa定時(shí)彈性

2021-04-25 10:26:58

云計(jì)算云原生

2023-11-06 01:17:25

主機(jī)容器選項(xiàng)

2024-09-26 09:50:07

2023-08-29 10:27:32

2022-04-07 10:17:18

云原生服務(wù)器優(yōu)化

2025-01-03 08:08:56

2023-09-06 08:12:04

k8s云原生

2024-06-12 13:21:06

點(diǎn)贊
收藏

51CTO技術(shù)棧公眾號(hào)