Skip to main content

Rancher Fleet

  • rancher/fleet
    • 多集群 GitOps
      • 使用 clusterSelector, clusterGroupSelector, clusterGroup 为 GitRepo 选择集群 - 直接应用到多个集群
    • 应用自动发现
      • 检测 fleet.yaml
    • 默认自动部署
    • 支持 helm+kustomize 同时
  • 文档
  • 安装 rancher 2.5+ 会默认安装 fleet
  • 注意
    • 目前要求压缩后的 Repo < 1MB
    • ssh 密钥会直接存储到对应空间下的 secret
    • namespace 必须要先不存在
      • fleet 相当于是强制受管理状态
      • argocd 会合并
  • 参考
# fleet 对 ssh 密钥有一定要求,格式必须为 EC PRIVATE KEY, RSA PRIVATE KEY, PRIVATE KEY 因此需要 -m pem
# 生成 SSH 密钥到 /tmp/fleet /tmp/fleet.pub
ssh-keygen -t rsa -b 4096 -m pem -C "fleet@example" -q -N "" -f /tmp/fleet

# fleet 用的 ssh secret
kubectl create secret generic --dry-run=client -o yaml \
fleet-ssh \
--type kubernetes.io/ssh-auth \
--from-file=ssh-privatekey=/tmp/fleet \
--from-file=ssh-publickey=/tmp/fleet.pub > fleet-ssh.secret.yaml

概念

  • Fleet Manager
    • 中控 - 多集群只需要启一个
  • Fleet controller
    • 只是概念层,实际使用 manager 与 controller 无区别
  • 单集群
    • Manager 与受控集群在一起
  • 多集群
    • Manager 位于其他集群,Controller 在受控集群
  • Fleet agent
    • 受控集群的代理,与 manager 交互
    • 一组组件

结构

  • /
    • Chart.yaml
    • kustomization.yaml
  • 任意目录/fleet.yaml
  • *.yaml - 没有 Chart 和 kustomization 则会部署所有 yaml
  • overlays/{name}

fleet.yaml

# 可在配置时修改
defaultNamespace: default

# 强制指定 - 资源已存在会部署失败
namespace: ""

# kustomize 部署
kustomize:
# 目录下包含 kustomization.yaml
dir: ./kustomize

# helm 部署
helm:
# chart 位置 - 支持 https://github.com/hashicorp/go-getter URL
chart: ./chart
# 指定 chart 仓库 - 指定后 chart 则变为仓库中的 chart 名而非 chart 位置
repo: https://charts.rancher.io
# release 名字 - 不指定会生成
releaseName: my-release
# chart 版本 - 支持 semver 版本 范围限定
version: 0.1.0
# inline 的 value 值
values:
any-custom: value
# 覆盖不可变资源 - 开启有一定危险
force: false

# 如果暂停,则需要手动同步
paused: false

rolloutStrategy:
# A number or percentage of clusters that can be unavailable during an update
# of a bundle. This follows the same basic approach as a deployment rollout
# strategy.
# default: 10%
maxUnavailable: 15%
# A number or percentage of cluster partitions that can be unavailable during
# an update of a bundle.
# default: 0
maxUnavailablePartitions: 20%
# A number of percentage of how to automatically partition clusters if not
# specific partitioning strategy is configured.
# default: 25%
autoPartitionSize: 10%
# A list of definitions of partitions. If any target clusters do not match
# the configuration they are added to partitions at the end following the
# autoPartitionSize.
partitions:
# A user friend name given to the partition used for Display (optional).
# default: ""
- name: canary
# A number or percentage of clusters that can be unavailable in this
# partition before this partition is treated as done.
# default: 10%
maxUnavailable: 10%
# Selector matching cluster labels to include in this partition
clusterSelector:
matchLabels:
env: prod
# A cluster group name to include in this partition
clusterGroup: agroup
# Selector matching cluster group labels to include in this partition
clusterGroupSelector: agroup

# 选择目标自定义 - 目标按序选择
targetCustomizations:
- name: prod # 名字仅用于展示 - 不设置会生成
# 覆盖命名空间
namespace: newvalue
# 覆盖 kustomize 选项
kustomize: {}
# 覆盖 helm 选项
helm: {}
# YAML 清单部署
# 定义 overlays/{name} 覆盖的名字列表 - 用于修改和添加资源
# 例如
# ./overlays/myoverlay/subdir/resource.yaml 会替代 ./subdir/resource.yaml
# ./overlays/myoverlay/subdir/resource_patch.yaml 会修改 ./subdir/resource.yaml
yaml:
overlays:
- custom2
- custom3
# 集群选择器 - metav1.LabelSelector
clusterSelector:
matchLabels:
env: prod
# 集群分组选择器
clusterGroupSelector:
matchLabels:
region: us-east
# 选择指定分组
clusterGroup: group1

资源

---
# 定义 Repo
kind: GitRepo
apiVersion: fleet.cattle.io/v1alpha1
metadata:
name: helm
namespace: fleet-local
spec:
repo: https://github.com/rancher/fleet-examples/
paths:
- single-cluster/helm
---
# 复杂 Repo
apiVersion: fleet.cattle.io/v1alpha1
kind: GitRepo
metadata:
name: my-deploy
# fleet 空间
namespace: fleet-default
spec:
branch: master
# ssh 密钥
clientSecretName: fleet-ssh-secret
paths:
- subpath
repo: git@gitea-ssh.gitea:my/repo
# 选择目标集群
targets:
- clusterSelector: {}
---
# 定义集群分组
apiVersion: fleet.cattle.io/v1alpha1
kind: ClusterGroup
metadata:
name: default
namespace: fleet-default
spec:
selector:
matchLabels:
env: prod
matchExpressions:
# - key: string
# operator: string
# values:
# - string