Tekton 實戰(zhàn)完整示例
在 Tekton 中我們就可以將這些階段直接轉(zhuǎn)換成 Task 任務(wù),Clone 代碼在 Tekton 中不需要我們主動定義一個任務(wù),只需要在執(zhí)行的任務(wù)上面指定一個輸入的代碼資源即可。下面我們就來將上面的工作流一步一步來轉(zhuǎn)換成 Tekton 流水線,代碼倉庫同樣還是 http://git.k8s.local/course/devops-demo.git。
Clone 代碼
雖然我們可以不用單獨定義一個 Clone 代碼的任務(wù),直接使用 git 類型的輸入資源即可,由于這里涉及到的任務(wù)較多,而且很多時候都需要先 Clone 代碼然后再進行操作,所以最好的方式是將代碼 Clone 下來過后通過 Workspace 共享給其他任務(wù),這里我們可以直接使用 Catalog git-clone 來實現(xiàn)這個任務(wù),我們可以根據(jù)自己的需求做一些定制,對應(yīng)的 Task 如下所示:
# task-clone.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: git-clone
labels:
app.kubernetes.io/version: "0.8"
annotations:
tekton.dev/pipelines.minVersion: "0.29.0"
tekton.dev/categories: Git
tekton.dev/tags: git
tekton.dev/displayName: "git clone"
tekton.dev/platforms: "linux/amd64,linux/s390x,linux/ppc64le,linux/arm64"
spec:
description: >-
These Tasks are Git tasks to work with repositories used by other tasks
in your Pipeline.
The git-clone Task will clone a repo from the provided url into the
output Workspace. By default the repo will be cloned into the root of
your Workspace. You can clone into a subdirectory by setting this Task's
subdirectory param. This Task also supports sparse checkouts. To perform
a sparse checkout, pass a list of comma separated directory patterns to
this Task's sparseCheckoutDirectories param.
workspaces:
- name: output
description: The git repo will be cloned onto the volume backing this Workspace.
- name: ssh-directory
optional: true
description: |
A .ssh directory with private key, known_hosts, config, etc. Copied to
the user's home before git commands are executed. Used to authenticate
with the git remote when performing the clone. Binding a Secret to this
Workspace is strongly recommended over other volume types. - name: basic-auth
optional: true
description: |
A Workspace containing a .gitconfig and .git-credentials file. These
will be copied to the user's home before any git commands are run. Any
other files in this Workspace are ignored. It is strongly recommended
to use ssh-directory over basic-auth whenever possible and to bind a
Secret to this Workspace over other volume types. - name: ssl-ca-directory
optional: true
description: |
A workspace containing CA certificates, this will be used by Git to
verify the peer with when fetching or pushing over HTTPS. params:
- name: url
description: Repository URL to clone from.
type: string
- name: revision
description: Revision to checkout. (branch, tag, sha, ref, etc...)
type: string
default: ""
- name: refspec
description: Refspec to fetch before checking out revision.
default: ""
- name: submodules
description: Initialize and fetch git submodules.
type: string
default: "true"
- name: depth
description: Perform a shallow clone, fetching only the most recent N commits.
type: string
default: "1"
- name: sslVerify
description: Set the `http.sslVerify` global git config. Setting this to `false` is not advised unless you are sure that you trust your git remote.
type: string
default: "true"
- name: crtFileName
description: file name of mounted crt using ssl-ca-directory workspace. default value is ca-bundle.crt.
type: string
default: "ca-bundle.crt"
- name: subdirectory
description: Subdirectory inside the `output` Workspace to clone the repo into.
type: string
default: ""
- name: sparseCheckoutDirectories
description: Define the directory patterns to match or exclude when performing a sparse checkout.
type: string
default: ""
- name: deleteExisting
description: Clean out the contents of the destination directory if it already exists before cloning.
type: string
default: "true"
- name: httpProxy
description: HTTP proxy server for non-SSL requests.
type: string
default: ""
- name: httpsProxy
description: HTTPS proxy server for SSL requests.
type: string
default: ""
- name: noProxy
description: Opt out of proxying HTTP/HTTPS requests.
type: string
default: ""
- name: verbose
description: Log the commands that are executed during `git-clone`'s operation.
type: string
default: "true"
- name: gitInitImage
description: The image providing the git-init binary that this Task runs.
type: string
default: "cnych/tekton-git-init:v0.29.0"
- name: userHome
description: |
Absolute path to the user's home directory. type: string
default: "/home/nonroot"
results:
- name: commit
description: The precise commit SHA that was fetched by this Task.
- name: url
description: The precise URL that was fetched by this Task.
steps:
- name: clone
image: "$(params.gitInitImage)"
env:
- name: HOME
value: "$(params.userHome)"
- name: PARAM_URL
value: $(params.url)
- name: PARAM_REVISION
value: $(params.revision)
- name: PARAM_REFSPEC
value: $(params.refspec)
- name: PARAM_SUBMODULES
value: $(params.submodules)
- name: PARAM_DEPTH
value: $(params.depth)
- name: PARAM_SSL_VERIFY
value: $(params.sslVerify)
- name: PARAM_CRT_FILENAME
value: $(params.crtFileName)
- name: PARAM_SUBDIRECTORY
value: $(params.subdirectory)
- name: PARAM_DELETE_EXISTING
value: $(params.deleteExisting)
- name: PARAM_HTTP_PROXY
value: $(params.httpProxy)
- name: PARAM_HTTPS_PROXY
value: $(params.httpsProxy)
- name: PARAM_NO_PROXY
value: $(params.noProxy)
- name: PARAM_VERBOSE
value: $(params.verbose)
- name: PARAM_SPARSE_CHECKOUT_DIRECTORIES
value: $(params.sparseCheckoutDirectories)
- name: PARAM_USER_HOME
value: $(params.userHome)
- name: WORKSPACE_OUTPUT_PATH
value: $(workspaces.output.path)
- name: WORKSPACE_SSH_DIRECTORY_BOUND
value: $(workspaces.ssh-directory.bound)
- name: WORKSPACE_SSH_DIRECTORY_PATH
value: $(workspaces.ssh-directory.path)
- name: WORKSPACE_BASIC_AUTH_DIRECTORY_BOUND
value: $(workspaces.basic-auth.bound)
- name: WORKSPACE_BASIC_AUTH_DIRECTORY_PATH
value: $(workspaces.basic-auth.path)
- name: WORKSPACE_SSL_CA_DIRECTORY_BOUND
value: $(workspaces.ssl-ca-directory.bound)
- name: WORKSPACE_SSL_CA_DIRECTORY_PATH
value: $(workspaces.ssl-ca-directory.path)
securityContext:
runAsNonRoot: true
runAsUser: 65532
script: |
#!/usr/bin/env sh
set -eu
if [ "${PARAM_VERBOSE}" = "true" ] ; then
set -x
fi
if [ "${WORKSPACE_BASIC_AUTH_DIRECTORY_BOUND}" = "true" ] ; then
cp "${WORKSPACE_BASIC_AUTH_DIRECTORY_PATH}/.git-credentials" "${PARAM_USER_HOME}/.git-credentials"
cp "${WORKSPACE_BASIC_AUTH_DIRECTORY_PATH}/.gitconfig" "${PARAM_USER_HOME}/.gitconfig"
chmod 400 "${PARAM_USER_HOME}/.git-credentials"
chmod 400 "${PARAM_USER_HOME}/.gitconfig"
fi
if [ "${WORKSPACE_SSH_DIRECTORY_BOUND}" = "true" ] ; then
cp -R "${WORKSPACE_SSH_DIRECTORY_PATH}" "${PARAM_USER_HOME}"/.ssh
chmod 700 "${PARAM_USER_HOME}"/.ssh
chmod -R 400 "${PARAM_USER_HOME}"/.ssh/*
fi
if [ "${WORKSPACE_SSL_CA_DIRECTORY_BOUND}" = "true" ] ; then
export GIT_SSL_CAPATH="${WORKSPACE_SSL_CA_DIRECTORY_PATH}"
if [ "${PARAM_CRT_FILENAME}" != "" ] ; then
export GIT_SSL_CAINFO="${WORKSPACE_SSL_CA_DIRECTORY_PATH}/${PARAM_CRT_FILENAME}"
fi
fi
CHECKOUT_DIR="${WORKSPACE_OUTPUT_PATH}/${PARAM_SUBDIRECTORY}"
cleandir() {
# Delete any existing contents of the repo directory if it exists.
#
# We don't just "rm -rf ${CHECKOUT_DIR}" because ${CHECKOUT_DIR} might be "/"
# or the root of a mounted volume.
if [ -d "${CHECKOUT_DIR}" ] ; then
# Delete non-hidden files and directories
rm -rf "${CHECKOUT_DIR:?}"/*
# Delete files and directories starting with . but excluding ..
rm -rf "${CHECKOUT_DIR}"/.[!.]*
# Delete files and directories starting with .. plus any other character
rm -rf "${CHECKOUT_DIR}"/..?*
fi
}
if [ "${PARAM_DELETE_EXISTING}" = "true" ] ; then
cleandir
fi
test -z "${PARAM_HTTP_PROXY}" || export HTTP_PROXY="${PARAM_HTTP_PROXY}"
test -z "${PARAM_HTTPS_PROXY}" || export HTTPS_PROXY="${PARAM_HTTPS_PROXY}"
test -z "${PARAM_NO_PROXY}" || export NO_PROXY="${PARAM_NO_PROXY}"
/ko-app/git-init \
-url="${PARAM_URL}" \
-revision="${PARAM_REVISION}" \
-refspec="${PARAM_REFSPEC}" \
-path="${CHECKOUT_DIR}" \
-sslVerify="${PARAM_SSL_VERIFY}" \
-submodules="${PARAM_SUBMODULES}" \
-depth="${PARAM_DEPTH}" \
-sparseCheckoutDirectories="${PARAM_SPARSE_CHECKOUT_DIRECTORIES}"
cd "${CHECKOUT_DIR}"
RESULT_SHA="$(git rev-parse HEAD)"
EXIT_CODE="$?"
if [ "${EXIT_CODE}" != 0 ] ; then
exit "${EXIT_CODE}"
fi
printf "%s" "${RESULT_SHA}" > "$(results.commit.path)"
printf "%s" "${PARAM_URL}" > "$(results.url.path)"
一般來說我們只需要提供 output 這個個用于持久化代碼的 workspace,然后還包括 url 和 revision 這兩個參數(shù),其他使用默認的即可。
單元測試
單元測試階段比較簡單,正常來說也是只是單純執(zhí)行一個測試命令即可,我們這里沒有真正執(zhí)行單元測試,所以簡單測試下即可,編寫一個如下所示的 Task:
# task-test.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: test
spec:
steps:
- name: test
image: golang:1.14.2-alpine3.11
command: ["echo"]
args: ["this is a test task"]
編譯打包
然后第二個階段是編譯打包階段,因為我們這個項目的 Dockerfile 不是使用的多階段構(gòu)建,所以需要先用一個任務(wù)去將應(yīng)用編譯打包成二進制文件,然后將這個編譯過后的文件傳遞到下一個任務(wù)進行鏡像構(gòu)建。
我們已經(jīng)明確了這個階段要做的事情,編寫任務(wù)也就簡單了,創(chuàng)建如下所示的 Task 任務(wù),首先需要通過定義一個 workspace 把 clone 任務(wù)里面的代碼關(guān)聯(lián)過來:
# task-build.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: build
spec:
workspaces:
- name: go-repo
mountPath: /workspace/repo
steps:
- name: build
image: golang:1.14.2-alpine3.11
workingDir: /workspace/repo
script: |
go build -v -o demo-app env:
- name: GOPROXY
value: https://goproxy.cn
- name: GOOS
value: linux
- name: GOARCH
value: amd64
這個構(gòu)建任務(wù)也很簡單,只是我們將需要用到的環(huán)境變量直接通過 env? 注入了,當然直接寫入到 script? 中也是可以的,或者直接使用 command? 來執(zhí)行任務(wù)都可以,然后構(gòu)建生成的 demo-app 這個二進制文件保留在代碼根目錄,這樣也就可以通過 workspace 進行共享了。
Docker 鏡像
接下來就是構(gòu)建并推送 Docker 鏡像了,前面我們介紹過使用 Kaniko、DooD、DinD 3 種模式的鏡像構(gòu)建方式,這里我們直接使用 DinD 這種模式,我們這里要構(gòu)建的鏡像 Dockerfile 非常簡單:
FROM alpine
WORKDIR /home
# 修改alpine源為阿里云
RUN sed -i 's/dl-cdn.alpinelinux.org/mirrors.ustc.edu.cn/g' /etc/apk/repositories && \
apk update && \
apk upgrade && \
apk add ca-certificates && update-ca-certificates && \
apk add --update tzdata && \
rm -rf /var/cache/apk/*
COPY demo-app /home/
ENV TZ=Asia/Shanghai
EXPOSE 8080
ENTRYPOINT ./demo-app
直接將編譯好的二進制文件拷貝到鏡像中即可,所以我們這里同樣需要通過 Workspace 去獲取上一個構(gòu)建任務(wù)的制品,這里我們使用 sidecar 的方式來實現(xiàn) DinD 模式構(gòu)建鏡像,創(chuàng)建一個如下所示的任務(wù):
# task-docker.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: docker
spec:
workspaces:
- name: go-repo
params:
- name: image
description: Reference of the image docker will produce.
- name: registry_mirror
description: Specific the docker registry mirror
default: ""
- name: registry_url
description: private docker images registry url
steps:
- name: docker-build # 構(gòu)建步驟
image: docker:stable
env:
- name: DOCKER_HOST # 用 TLS 形式通過 TCP 鏈接 sidecar
value: tcp://localhost:2376
- name: DOCKER_TLS_VERIFY # 校驗 TLS
value: "1"
- name: DOCKER_CERT_PATH # 使用 sidecar 守護進程生成的證書
value: /certs/client
- name: DOCKER_PASSWORD
valueFrom:
secretKeyRef:
name: harbor-auth
key: password
- name: DOCKER_USERNAME
valueFrom:
secretKeyRef:
name: harbor-auth
key: username
workingDir: $(workspaces.go-repo.path)
script: | # docker 構(gòu)建命令
docker login $(params.registry_url) -u $DOCKER_USERNAME -p $DOCKER_PASSWORD
docker build --no-cache -f ./Dockerfile -t $(params.image) .
docker push $(params.image)
volumeMounts: # 聲明掛載證書目錄
- mountPath: /certs/client
name: dind-certs
sidecars: # sidecar 模式,提供 docker daemon服務(wù),實現(xiàn)真正的 DinD 模式
- image: docker:dind
name: server
args:
- --storage-driver=vfs
- --userland-proxy=false
- --debug
- --insecure-registry=$(params.registry_url)
- --registry-mirror=$(params.registry_mirror)
securityContext:
privileged: true
env:
- name: DOCKER_TLS_CERTDIR # 將生成的證書寫入與客戶端共享的路徑
value: /certs
volumeMounts:
- mountPath: /certs/client
name: dind-certs
- mountPath: /var/lib/docker
name: docker-root
readinessProbe: # 等待 dind daemon 生成它與客戶端共享的證書
periodSeconds: 1
exec:
command: ["ls", "/certs/client/ca.pem"]
volumes: # 使用 emptyDir 的形式即可
- name: dind-certs
emptyDir: {}
- name: docker-root
persistentVolumeClaim:
claimName: docker-root-pvc
這個任務(wù)的重點還是要去聲明一個 Workspace,當執(zhí)行任務(wù)的時候要使用和前面構(gòu)建任務(wù)同一個 Workspace,這樣就可以獲得上面編譯成的 demo-app 這個二進制文件了。
部署
接下來的部署階段,我們同樣可以參考之前 Jenkins 流水線里面的實現(xiàn),由于項目中我們包含了 Helm Chart 包,所以直接使用 Helm 來部署即可,要實現(xiàn) Helm 部署,當然我們首先需要一個包含 helm? 命令的鏡像,當然完全可以自己去編寫一個這樣的任務(wù),此外我們還可以直接去 hub.tekton.dev 上面查找 Catalog,因為這上面就有很多比較通用的一些任務(wù)了,比如 helm-upgrade-from-source 這個 Task 任務(wù)就完全可以滿足我們的需求了:
這個 Catalog 下面也包含完整的使用文檔了,我們可以將該任務(wù)直接下載下來根據(jù)我們自己的需求做一些定制修改,如下所示:
# task-deploy.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: deploy
labels:
app.kubernetes.io/version: "0.3"
annotations:
tekton.dev/pipelines.minVersion: "0.12.1"
tekton.dev/categories: Deployment
tekton.dev/tags: helm
tekton.dev/platforms: "linux/amd64,linux/s390x,linux/ppc64le,linux/arm64"
spec:
description: >-
These tasks will install / upgrade a helm chart into your Kubernetes /
OpenShift Cluster using Helm
params:
- name: charts_dir
description: The directory in source that contains the helm chart
- name: release_version
description: The helm release version in semantic versioning format
default: "v1.0.0"
- name: release_name
description: The helm release name
default: "helm-release"
- name: release_namespace
description: The helm release namespace
default: ""
- name: overwrite_values
description: "Specify the values you want to overwrite, comma separated: autoscaling.enabled=true,replicas=1"
default: ""
- name: values_file
description: "The values file to be used"
default: "values.yaml"
- name: helm_image
description: "helm image to be used"
default: "docker.io/lachlanevenson/k8s-helm@sha256:5c792f29950b388de24e7448d378881f68b3df73a7b30769a6aa861061fd08ae" #tag: v3.6.0
- name: upgrade_extra_params
description: "Extra parameters passed for the helm upgrade command"
default: ""
workspaces:
- name: source
results:
- name: helm-status
description: Helm deploy status
steps:
- name: upgrade
image: $(params.helm_image)
workingDir: /workspace/source
script: |
echo current installed helm releases
helm list --namespace "$(params.release_namespace)"
echo installing helm chart...
helm upgrade --install --wait --values "$(params.charts_dir)/$(params.values_file)" --namespace "$(params.release_namespace)" --version "$(params.release_version)" "$(params.release_name)" "$(params.charts_dir)" --debug --set "$(params.overwrite_values)" $(params.upgrade_extra_params)
status=`helm status $(params.release_name) --namespace "$(params.release_namespace)" | awk '/STATUS/ {print $2}'`
echo ${status} | tr -d "\n" | tee $(results.helm-status.path)
因為我們的 Helm Chart 模板就在代碼倉庫中,所以不需要從 Chart Repo 倉庫中獲取,只需要指定 Chart 路徑即可,其他可配置的參數(shù)都通過 params 參數(shù)暴露出去了,非常靈活,最后我們還獲取了 Helm 部署的狀態(tài),寫入到了 Results 中,方便后續(xù)任務(wù)處理。
回滾
最后應(yīng)用部署完成后可能還需要回滾,因為可能部署的應(yīng)用有錯誤,當然這個回滾動作最好是我們自己去觸發(fā),但是在某些場景下,比如 helm 部署已經(jīng)明確失敗了,那么我們當然可以自動回滾了,所以就需要判斷當部署失敗的時候再執(zhí)行回滾,也就是這個任務(wù)并不是一定會發(fā)生的,只在某些場景下才會出現(xiàn),我們可以在流水線中通過使用 WhenExpressions? 來實現(xiàn)這個功能。要只在滿足某些條件時運行任務(wù),可以使用 when? 字段來保護任務(wù)執(zhí)行,when 字段允許你列出對 WhenExpressions 的一系列引用。
WhenExpressions? 由 Input、Operator? 和 Values 幾部分組成:
- Input? 是WhenExpressions 的輸入,它可以是一個靜態(tài)的輸入或變量(Params 或 Results),如果未提供輸入,則默認為空字符串
- Operator? 是一個運算符,表示 Input 和 Values 之間的關(guān)系,有效的運算符包括in、notin
- Values 是一個字符串數(shù)組,必須提供一個非空的 Values 數(shù)組,它同樣可以包含靜態(tài)值或者變量(Params、Results 或者 Workspaces 綁定)
當在一個 Task 任務(wù)中配置了 WhenExpressions?,在執(zhí)行 Task 之前會評估聲明的 WhenExpressions,如果結(jié)果為 True,則執(zhí)行任務(wù),如果為 False,則不會執(zhí)行該任務(wù)。
我們這里創(chuàng)建的回滾任務(wù)如下所示:
# task-rollback.yaml
apiVersion: tekton.dev/v1beta1
kind: Task
metadata:
name: rollback
spec:
params:
- name: release_name
description: The helm release name
- name: release_namespace
description: The helm release namespace
default: ""
- name: helm_image
description: "helm image to be used"
default: "docker.io/lachlanevenson/k8s-helm@sha256:5c792f29950b388de24e7448d378881f68b3df73a7b30769a6aa861061fd08ae" #tag: v3.6.0
steps:
- name: rollback
image: $(params.helm_image)
script: |
echo rollback current installed helm releases
helm rollback $(params.release_name) --namespace $(params.release_namespace)
流水線
現(xiàn)在我們的整個工作流任務(wù)都已經(jīng)創(chuàng)建完成了,接下來我們就可以將這些任務(wù)全部串聯(lián)起來組成一個 Pipeline 流水線了,將上面定義的幾個 Task 引用到 Pipeline 中來,當然還需要聲明 Task 中用到的 resources 或者 workspaces 這些數(shù)據(jù):
# pipeline.yaml
apiVersion: tekton.dev/v1beta1
kind: Pipeline
metadata:
name: pipeline
spec:
workspaces: # 聲明 workspaces
- name: go-repo-pvc
params:
# 定義代碼倉庫
- name: git_url
- name: revision
type: string
default: "main"
# 定義鏡像參數(shù)
- name: image
- name: registry_url
type: string
default: "harbor.k8s.local"
- name: registry_mirror
type: string
default: "https://mirror.baidubce.com"
# 定義 helm charts 參數(shù)
- name: charts_dir
- name: release_name
- name: release_namespace
default: "default"
- name: overwrite_values
default: ""
- name: values_file
default: "values.yaml"
tasks: # 添加task到流水線中
- name: clone
taskRef:
name: git-clone
workspaces:
- name: output
workspace: go-repo-pvc
params:
- name: url
value: $(params.git_url)
- name: revision
value: $(params.revision)
- name: test
taskRef:
name: test
runAfter:
- clone
- name: build # 編譯二進制程序
taskRef:
name: build
runAfter: # 測試任務(wù)執(zhí)行之后才執(zhí)行 build task
- test
- clone
workspaces: # 傳遞 workspaces
- name: go-repo
workspace: go-repo-pvc
- name: docker # 構(gòu)建并推送 Docker 鏡像
taskRef:
name: docker
runAfter:
- build
workspaces: # 傳遞 workspaces
- name: go-repo
workspace: go-repo-pvc
params: # 傳遞參數(shù)
- name: image
value: $(params.image)
- name: registry_url
value: $(params.registry_url)
- name: registry_mirror
value: $(params.registry_mirror)
- name: deploy # 部署應(yīng)用
taskRef:
name: deploy
runAfter:
- docker
workspaces:
- name: source
workspace: go-repo-pvc
params:
- name: charts_dir
value: $(params.charts_dir)
- name: release_name
value: $(params.release_name)
- name: release_namespace
value: $(params.release_namespace)
- name: overwrite_values
value: $(params.overwrite_values)
- name: values_file
value: $(params.values_file)
- name: rollback # 回滾
taskRef:
name: rollback
when:
- input: "$(tasks.deploy.results.helm-status)"
operator: in
values: ["failed"]
params:
- name: release_name
value: $(params.release_name)
- name: release_namespace
value: $(params.release_namespace)
整體流程比較簡單,就是在 Pipeline 需要先聲明使用到的 Workspace、Resource、Params 這些資源,然后將聲明的數(shù)據(jù)傳遞到 Task 任務(wù)中去,需要注意的是最后一個回滾任務(wù),我們需要根據(jù)前面的 deploy? 任務(wù)的結(jié)果來判斷是否需要執(zhí)行該任務(wù),所以這里我們使用了 when? 屬性,通過 $(tasks.deploy.results.helm-status) 獲取部署狀態(tài)。
執(zhí)行流水線
現(xiàn)在我們就可以來執(zhí)行下我們的流水線,看是否符合我們自身的要求,首先我們需要先創(chuàng)建關(guān)聯(lián)的其他資源對象,比如 Workspace 對應(yīng)的 PVC、還有 GitLab、Harbor 的認證信息:
# other.yaml
apiVersion: v1
kind: Secret
metadata:
name: gitlab-auth
annotations:
tekton.dev/git-0: http://git.k8s.local
type: kubernetes.io/basic-auth
stringData:
username: root
password: admin321
---
apiVersion: v1
kind: Secret
metadata:
name: harbor-auth
annotations:
tekton.dev/docker-0: http://harbor.k8s.local
type: kubernetes.io/basic-auth
stringData:
username: admin
password: Harbor12345
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: tekton-build-sa
secrets:
- name: harbor-auth
- name: gitlab-auth
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: tekton-clusterrole-binding
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: edit
subjects:
- kind: ServiceAccount
name: tekton-build-sa
namespace: default
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: go-repo-pvc
spec:
resources:
requests:
storage: 1Gi
volumeMode: Filesystem
storageClassName: nfs-client # 使用 StorageClass 自動生成 PV
accessModes:
- ReadWriteOnce
---
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: docker-root-pvc
spec:
resources:
requests:
storage: 2Gi
volumeMode: Filesystem
storageClassName: nfs-client # 使用 StorageClass 自動生成 PV
accessModes:
- ReadWriteOnce
這些關(guān)聯(lián)的資源對象創(chuàng)建完成后,還需要為上面的 ServiceAccount 綁定一個權(quán)限,因為在 Helm 容器中我們要去操作一些集群資源,必然需要先做權(quán)限聲明,這里我們可以將 tekton-build-sa? 綁定到 edit 這個 ClusterRole 上去。
我們接下來就可以創(chuàng)建一個 PipelineRun 資源對象來觸發(fā)我們的流水線構(gòu)建了:
# pipelinerun.yaml
apiVersion: tekton.dev/v1beta1
kind: PipelineRun
metadata:
name: pipelinerun
spec:
serviceAccountName: tekton-build-sa
pipelineRef:
name: pipeline
workspaces:
- name: go-repo-pvc
persistentVolumeClaim:
claimName: go-repo-pvc
params:
- name: git_url
value: http://git.k8s.local/course/devops-demo.git
- name: image
value: "harbor.k8s.local/course/devops-demo:v0.1.0"
- name: charts_dir
value: "./helm"
- name: release_name
value: devops-demo
- name: release_namespace
value: "kube-ops"
- name: overwrite_values
value: "image.repository=harbor.k8s.local/course/devops-demo,image.tag=v0.1.0"
- name: values_file
value: "my-values.yaml"
直接創(chuàng)建上面的資源對象就可以執(zhí)行我們的 Pipeline 流水線了:
$ kubectl apply -f pipelinerun.yaml
$ tkn pr describe pipelinerun
Name: pipelinerun
Namespace: default
Pipeline Ref: pipeline
Service Account: tekton-build-sa
Timeout: 1h0m0s
Labels:
tekton.dev/pipeline=pipeline
??? Status
STARTED DURATION STATUS
4 minutes ago 2m30s Succeeded(Completed)
? Params
NAME VALUE
? git_url http://git.k8s.local/course/devops-demo.git
? image harbor.k8s.local/course/devops-demo:v0.1.0
? charts_dir ./helm
? release_name devops-demo
? release_namespace kube-ops
? overwrite_values image.repository=harbor.k8s.local/course/devops-demo,image.tag=v0.1.0
? values_file my-values.yaml
?? Workspaces
NAME SUB PATH WORKSPACE BINDING
? go-repo-pvc --- PersistentVolumeClaim (claimName=go-repo-pvc)
?? Taskruns
NAME TASK NAME STARTED DURATION STATUS
? pipelinerun-deploy deploy 3 minutes ago 1m14s Succeeded
? pipelinerun-docker docker 4 minutes ago 55s Succeeded
? pipelinerun-build build 4 minutes ago 11s Succeeded
? pipelinerun-test test 4 minutes ago 4s Succeeded
? pipelinerun-clone clone 4 minutes ago 6s Succeeded
?? Skipped Tasks
NAME
? rollback
# 部署成功了
$ curl devops-demo.k8s.local
{"msg":"Hello DevOps On Kubernetes"}
在 Dashboard 上也可以看到流水線可以正常執(zhí)行,由于部署成功了,所以 rollback 回滾的任務(wù)也就被忽略了:
觸發(fā)器
整個流水線已經(jīng)成功執(zhí)行了,接下來最后一步就是將 Gitlab 和 Tekton 進行對接,也就是通過 Tekton Trigger 來自動觸發(fā)構(gòu)建。關(guān)于 Tekton Trigger 的使用前面我們已經(jīng)詳細講解過了,細節(jié)就不過多討論。
首先添加一個用于 Gitlab Webhook 訪問的 Secret Token,同樣要將這個 Secret 關(guān)聯(lián)到上面使用的 ServiceAccount 上面去,然后繼續(xù)添加對應(yīng)的 RBAC 權(quán)限:
# other.yaml
# ......
apiVersion: v1
kind: Secret
metadata:
name: gitlab-secret
type: Opaque
stringData:
secretToken: "1234567"
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: tekton-build-sa
secrets:
- name: harbor-auth
- name: gitlab-auth
- name: gitlab-secret
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
name: tekton-triggers-gitlab-minimal
rules:
# EventListeners need to be able to fetch all namespaced resources
- apiGroups: ["triggers.tekton.dev"]
resources:
["eventlisteners", "triggerbindings", "triggertemplates", "triggers"]
verbs: ["get", "list", "watch"]
- apiGroups: [""]
# configmaps is needed for updating logging config
resources: ["configmaps"]
verbs: ["get", "list", "watch"]
# Permissions to create resources in associated TriggerTemplates
- apiGroups: ["tekton.dev"]
resources: ["pipelineruns", "pipelineresources", "taskruns"]
verbs: ["create"]
- apiGroups: [""]
resources: ["serviceaccounts"]
verbs: ["impersonate"]
- apiGroups: ["policy"]
resources: ["podsecuritypolicies"]
resourceNames: ["tekton-triggers"]
verbs: ["use"]
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
name: tekton-triggers-gitlab-binding
subjects:
- kind: ServiceAccount
name: tekton-build-sa
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: Role
name: tekton-triggers-gitlab-minimal
---
kind: ClusterRole
apiVersion: rbac.authorization.k8s.io/v1
metadata:
name: tekton-triggers-gitlab-clusterrole
rules:
# EventListeners need to be able to fetch any clustertriggerbindings
- apiGroups: ["triggers.tekton.dev"]
resources: ["clustertriggerbindings", "clusterinterceptors"]
verbs: ["get", "list", "watch"]
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: tekton-triggers-gitlab-clusterbinding
subjects:
- kind: ServiceAccount
name: tekton-build-sa
namespace: default
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: tekton-triggers-gitlab-clusterrole
接著就可以來創(chuàng)建 EventListener 資源對象了,用來接收 Gitlab 的 Push Event 事件,如下所示:
# gitlab-listener.yaml
apiVersion: triggers.tekton.dev/v1beta1
kind: EventListener
metadata:
name: gitlab-listener # 該事件監(jiān)聽器會創(chuàng)建一個名為el-gitlab-listener的Service對象
spec:
serviceAccountName: tekton-build-sa
triggers:
- name: gitlab-push-events-trigger
interceptors:
- ref:
name: gitlab
params:
- name: secretRef # 引用 gitlab-secret 的 Secret 對象中的 secretToken 的值
value:
secretName: gitlab-secret
secretKey: secretToken
- name: eventTypes
value:
- Push Hook # 只接收 GitLab Push 事件
bindings: # 定義TriggerBinding,配置參數(shù)
- name: gitrevision
value: $(body.checkout_sha)
- name: gitrepositoryurl
value: $(body.repository.git_http_url)
template:
ref: gitlab-template
上面我們通過 TriggerBinding 定義了兩個參數(shù) gitrevision、gitrepositoryurl?,這兩個參數(shù)的值可以通過 Gitlab 發(fā)送過來的 POST 請求中獲取到數(shù)據(jù),然后我們就可以將這兩個參數(shù)傳遞到 TriggerTemplate? 對象中去,這里的模板其實也就是將上面我們定義的 PipelineRun 對象模板化而已,主要是替換 git_url 和鏡像 TAG 這兩個參數(shù),如下所示:
# gitlab-template.yaml
apiVersion: triggers.tekton.dev/v1beta1
kind: TriggerTemplate
metadata:
name: gitlab-template
spec:
params: # 定義參數(shù),和 TriggerBinding 中的保持一致
- name: gitrevision
- name: gitrepositoryurl
resourcetemplates: # 定義資源模板
- apiVersion: tekton.dev/v1beta1
kind: PipelineRun # 定義 pipeline 模板
metadata:
generateName: gitlab-run- # TaskRun 名稱前綴
spec:
serviceAccountName: tekton-build-sa
pipelineRef:
name: pipeline
workspaces:
- name: go-repo-pvc
persistentVolumeClaim:
claimName: go-repo-pvc
params:
- name: git_url
value: $(tt.params.gitrepositoryurl)
- name: image
value: "harbor.k8s.local/course/devops-demo:$(tt.params.gitrevision)"
- name: charts_dir
value: "./helm"
- name: release_name
value: devops-demo
- name: release_namespace
value: "kube-ops"
- name: overwrite_values
value: "image.repository=harbor.k8s.local/course/devops-demo,image.tag=$(tt.params.gitrevision)"
- name: values_file
value: "my-values.yaml"
直接創(chuàng)建上面新建的幾個資源對象即可,這會創(chuàng)建一個 eventlistern 服務(wù)用來接收 Webhook 請求:
$ kubectl get eventlistener gitlab-listener
NAME ADDRESS AVAILABLE REASON READY REASON
gitlab-listener http://el-gitlab-listener.default.svc.cluster.local:8080 True MinimumReplicasAvailable True
所以一定還要記得在 Gitlab 倉庫中配置上 Webhook:
這樣我們整個觸發(fā)器和監(jiān)聽器就配置好了,接下來我們?nèi)バ薷南挛覀兊捻椖看a,然后提交代碼,正常提交過后就會在集群中創(chuàng)建一個 PipelinRun 對象用來執(zhí)行我們的流水線了。
$ kubectl get pipelinerun
NAME SUCCEEDED REASON STARTTIME COMPLETIONTIME
gitlab-run-j77rx True Completed 4m46s 46s
$ curl devops-demo.k8s.local
{"msg":"Hello Tekton On Kubernetes"}
可以看到流水線執(zhí)行成功后,應(yīng)用已經(jīng)成功部署了我們新提交的代碼,到這里我們就完成了使用 Tekton 來重構(gòu)項目的流水線。