Skip to content

Commit

Permalink
feat(kubernetes): add ingress-nginx and external-dns
Browse files Browse the repository at this point in the history
  • Loading branch information
mrsimonemms committed Jul 7, 2024
1 parent 0dbc5fb commit 667e157
Show file tree
Hide file tree
Showing 7 changed files with 193 additions and 4 deletions.
20 changes: 20 additions & 0 deletions modules/kubernetes/.terraform.lock.hcl

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

12 changes: 12 additions & 0 deletions modules/kubernetes/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,13 +8,15 @@
| <a name="requirement_terraform"></a> [terraform](#requirement\_terraform) | >= 1.0.0 |
| <a name="requirement_helm"></a> [helm](#requirement\_helm) | >= 2.14.0, < 3.0.0 |
| <a name="requirement_kubernetes"></a> [kubernetes](#requirement\_kubernetes) | >= 2.31.0, < 3.0.0 |
| <a name="requirement_random"></a> [random](#requirement\_random) | >= 3.6.2, < 4.0.0 |

## Providers

| Name | Version |
|------|---------|
| <a name="provider_helm"></a> [helm](#provider\_helm) | 2.14.0 |
| <a name="provider_kubernetes"></a> [kubernetes](#provider\_kubernetes) | 2.31.0 |
| <a name="provider_random"></a> [random](#provider\_random) | 3.6.2 |

## Modules

Expand All @@ -25,25 +27,35 @@ No modules.
| Name | Type |
|------|------|
| [helm_release.cluster_autoscaler](https://registry.terraform.io/providers/hashicorp/helm/latest/docs/resources/release) | resource |
| [helm_release.external_dns](https://registry.terraform.io/providers/hashicorp/helm/latest/docs/resources/release) | resource |
| [helm_release.hcloud_ccm](https://registry.terraform.io/providers/hashicorp/helm/latest/docs/resources/release) | resource |
| [helm_release.hcloud_csi](https://registry.terraform.io/providers/hashicorp/helm/latest/docs/resources/release) | resource |
| [helm_release.ingress_nginx](https://registry.terraform.io/providers/hashicorp/helm/latest/docs/resources/release) | resource |
| [kubernetes_annotations.hcloud_ccm](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/annotations) | resource |
| [kubernetes_namespace.cluster_autoscaler](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/namespace) | resource |
| [kubernetes_namespace_v1.external_dns](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/namespace_v1) | resource |
| [kubernetes_secret_v1.cluster_autoscaler](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/secret_v1) | resource |
| [kubernetes_secret_v1.external_dns](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/secret_v1) | resource |
| [kubernetes_secret_v1.hcloud](https://registry.terraform.io/providers/hashicorp/kubernetes/latest/docs/resources/secret_v1) | resource |
| [random_integer.ingress_load_balancer_id](https://registry.terraform.io/providers/hashicorp/random/latest/docs/resources/integer) | resource |

## Inputs

| Name | Description | Type | Default | Required |
|------|-------------|------|---------|:--------:|
| <a name="input_cloudflare_api_token"></a> [cloudflare\_api\_token](#input\_cloudflare\_api\_token) | Cloudflare API token | `string` | n/a | yes |
| <a name="input_cluster_autoscaler_version"></a> [cluster\_autoscaler\_version](#input\_cluster\_autoscaler\_version) | Version of Cluster Autoscaler to use - defaults to latest | `string` | `null` | no |
| <a name="input_external_dns_version"></a> [external\_dns\_version](#input\_external\_dns\_version) | Version of External DNS to install - defaults to latest | `string` | `null` | no |
| <a name="input_hcloud_network_name"></a> [hcloud\_network\_name](#input\_hcloud\_network\_name) | Hetzner network name | `string` | n/a | yes |
| <a name="input_hcloud_token"></a> [hcloud\_token](#input\_hcloud\_token) | Hetzner API token | `string` | n/a | yes |
| <a name="input_hetzner_cloud_config_manager_version"></a> [hetzner\_cloud\_config\_manager\_version](#input\_hetzner\_cloud\_config\_manager\_version) | Version of the HCloud CCM to use - defaults to latest | `string` | `null` | no |
| <a name="input_hetzner_csi_driver_version"></a> [hetzner\_csi\_driver\_version](#input\_hetzner\_csi\_driver\_version) | Tag of the CSI driver to use - defaults to latest | `string` | `null` | no |
| <a name="input_ingress_nginx_version"></a> [ingress\_nginx\_version](#input\_ingress\_nginx\_version) | Version of Ingress Nginx to install - defaults to latest | `string` | `null` | no |
| <a name="input_k3s_cluster_cidr"></a> [k3s\_cluster\_cidr](#input\_k3s\_cluster\_cidr) | CIDR used for the k3s cluster | `string` | `"10.244.0.0/16"` | no |
| <a name="input_kube_context"></a> [kube\_context](#input\_kube\_context) | Kubernetes context to use | `string` | `"default"` | no |
| <a name="input_kubeconfig"></a> [kubeconfig](#input\_kubeconfig) | Kubeconfig for the cluster | `string` | n/a | yes |
| <a name="input_load_balancer_region"></a> [load\_balancer\_region](#input\_load\_balancer\_region) | Region to use for the load balancer | `string` | n/a | yes |
| <a name="input_load_balancer_type"></a> [load\_balancer\_type](#input\_load\_balancer\_type) | Type of load balancer to use | `string` | `"lb11"` | no |
| <a name="input_worker_pools"></a> [worker\_pools](#input\_worker\_pools) | Cluster autoscaler configuration | <pre>list(object({<br> cloud_init = string<br> firewall_id = string<br> image = string<br> labels = list(object({<br> key = string<br> value = string<br> }))<br> network_id = string<br> pool = object({<br> instanceType = string<br> minSize = number<br> maxSize = number<br> name = string<br> region = string<br> })<br> ssh_key_id = string<br> taints = list(object({<br> key = string<br> value = string<br> effect = string<br> }))<br> }))</pre> | `[]` | no |

## Outputs
Expand Down
102 changes: 102 additions & 0 deletions modules/kubernetes/ingress.tf
Original file line number Diff line number Diff line change
@@ -0,0 +1,102 @@
# Copyright 2024 Simon Emms <[email protected]>
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

resource "kubernetes_namespace_v1" "external_dns" {
metadata {
name = "external-dns"
}

wait_for_default_service_account = true
}

resource "kubernetes_secret_v1" "external_dns" {
metadata {
name = "cloudflare"
namespace = kubernetes_namespace_v1.external_dns.metadata[0].name
}

data = {
cloudflare_api_token = var.cloudflare_api_token
}
}

resource "helm_release" "external_dns" {
chart = "oci://registry-1.docker.io/bitnamicharts/external-dns"
name = "external-dns"
atomic = true
cleanup_on_fail = true
namespace = kubernetes_namespace_v1.external_dns.metadata[0].name
reset_values = true
version = var.external_dns_version
wait = true

set {
name = "provider"
value = "cloudflare"
}

set {
name = "cloudflare.secretName"
value = kubernetes_secret_v1.external_dns.metadata[0].name
}

set {
name = "podAnnotations.secret"
value = sha512(yamlencode(kubernetes_secret_v1.external_dns.data))
}
}

resource "random_integer" "ingress_load_balancer_id" {
min = 1000
max = 9999
}

resource "helm_release" "ingress_nginx" {
chart = "ingress-nginx"
name = "ingress-nginx"
atomic = true
cleanup_on_fail = true
create_namespace = true
namespace = "ingress-nginx"
repository = "https://kubernetes.github.io/ingress-nginx"
reset_values = true
version = var.ingress_nginx_version
wait = true

dynamic "set" {
for_each = {
"load-balancer.hetzner.cloud/name" = "k3s-${random_integer.ingress_load_balancer_id.result}"
"load-balancer.hetzner.cloud/network-zone" = var.load_balancer_region
"load-balancer.hetzner.cloud/type" = var.load_balancer_type
"load-balancer.hetzner.cloud/disable-private-ingress" = "true"
"load-balancer.hetzner.cloud/use-private-ip" = "true"
"load-balancer.hetzner.cloud/uses-proxyprotocol" = "true"
}
content {
name = "controller.service.annotations.${replace(set.key, ".", "\\.")}"
value = set.value
}
}

set {
name = "controller.config.use-proxy-protocol"
value = "true"
}

# Depend upon the HCloud CCM to allow the load balancer to be deleted on destroy
depends_on = [
helm_release.hcloud_ccm,
helm_release.hcloud_csi,
]
}
4 changes: 4 additions & 0 deletions modules/kubernetes/terraform.tf
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,10 @@ terraform {
source = "hashicorp/kubernetes"
version = ">= 2.31.0, < 3.0.0"
}
random = {
source = "hashicorp/random"
version = ">= 3.6.2, < 4.0.0"
}
}
}

Expand Down
29 changes: 29 additions & 0 deletions modules/kubernetes/variables.tf
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,18 @@ variable "cluster_autoscaler_version" {
default = null
}

variable "cloudflare_api_token" {
type = string
description = "Cloudflare API token"
sensitive = true
}

variable "external_dns_version" {
type = string
description = "Version of External DNS to install - defaults to latest"
default = null
}

variable "hcloud_network_name" {
type = string
description = "Hetzner network name"
Expand All @@ -41,6 +53,12 @@ variable "hetzner_csi_driver_version" {
default = null
}

variable "ingress_nginx_version" {
type = string
description = "Version of Ingress Nginx to install - defaults to latest"
default = null
}

variable "k3s_cluster_cidr" {
type = string
description = "CIDR used for the k3s cluster"
Expand All @@ -59,6 +77,17 @@ variable "kube_context" {
default = "default"
}

variable "load_balancer_region" {
type = string
description = "Region to use for the load balancer"
}

variable "load_balancer_type" {
type = string
description = "Type of load balancer to use"
default = "lb11"
}

variable "worker_pools" {
type = list(object({
cloud_init = string
Expand Down
20 changes: 20 additions & 0 deletions stacks/dev/kubernetes/.terraform.lock.hcl

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 6 additions & 4 deletions stacks/dev/kubernetes/terragrunt.hcl
Original file line number Diff line number Diff line change
Expand Up @@ -27,13 +27,15 @@ dependency "hetzner" {
hcloud_network_name = "some-network-name"
k3s_cluster_cidr = "some-cluster-cidr"
kubeconfig = "some-kubeconfig"
region = "some-region"
worker_pools = []
}
}

inputs = {
hcloud_network_name = dependency.hetzner.outputs.hcloud_network_name
k3s_cluster_cidr = dependency.hetzner.outputs.k3s_cluster_cidr
kubeconfig = dependency.hetzner.outputs.kubeconfig
worker_pools = dependency.hetzner.outputs.worker_pools
hcloud_network_name = dependency.hetzner.outputs.hcloud_network_name
k3s_cluster_cidr = dependency.hetzner.outputs.k3s_cluster_cidr
kubeconfig = dependency.hetzner.outputs.kubeconfig
load_balancer_region = dependency.hetzner.outputs.region
worker_pools = dependency.hetzner.outputs.worker_pools
}

0 comments on commit 667e157

Please sign in to comment.