Skip to content

feat: change kafka to redpanda #1771

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 5 commits into
base: develop
Choose a base branch
from
Draft

feat: change kafka to redpanda #1771

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
1afa22f
feat: change kafka to redpanda
TartanLeGrand May 14, 2025
3721a22
feat: update configuration to support Redpanda alongside Kafka
TartanLeGrand May 15, 2025
ef19a4d
feat: update Redpanda configuration and adjust Kafka fallback settings
TartanLeGrand May 26, 2025
7314b28
feat: update Redpanda configuration and listeners settings
TartanLeGrand May 27, 2025
073ffeb
feat: add Redpanda configuration for auto topic creation and disable …
TartanLeGrand May 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions charts/sentry/Chart.lock
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,9 @@ dependencies:
- name: kafka
repository: oci://registry-1.docker.io/bitnamicharts
version: 29.3.14
- name: redpanda
repository: https://charts.redpanda.com
version: 5.10.2
- name: clickhouse
repository: https://sentry-kubernetes.github.io/charts
version: 3.14.1
Expand All @@ -23,5 +26,5 @@ dependencies:
- name: nginx
repository: oci://registry-1.docker.io/bitnamicharts
version: 18.2.5
digest: sha256:2b19e9605468921ff96afb9f393ffe09d3121e5b91f32789e025851f0b66ff63
generated: "2025-01-17T18:17:43.022337376+06:00"
digest: sha256:4dec91142eae48683df30b2e28d775b40dbfbd2f6a5870c88ac921b59f0ac5ce
generated: "2025-05-14T22:42:24.544964974+02:00"
4 changes: 4 additions & 0 deletions charts/sentry/Chart.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,10 @@ dependencies:
repository: oci://registry-1.docker.io/bitnamicharts
version: 29.3.14
condition: kafka.enabled
- name: redpanda
repository: https://charts.redpanda.com
version: 5.10.2
condition: redpanda.enabled
- name: clickhouse
repository: https://sentry-kubernetes.github.io/charts
version: 3.14.1
Expand Down
7 changes: 5 additions & 2 deletions charts/sentry/templates/_helper.tpl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -443,7 +443,7 @@ True
Set Kafka Confluent host
*/}}
{{- define "sentry.kafka.host" -}}
{{- if .Values.kafka.enabled -}}
{{- if or (.Values.kafka.enabled) (.Values.redpanda.enabled) -}}
{{- template "sentry.kafka.fullname" . -}}
{{- else if and (.Values.externalKafka) (not (.Values.externalKafka.cluster)) -}}
{{ required "A valid .Values.externalKafka.host is required" .Values.externalKafka.host }}
Expand All @@ -454,7 +454,10 @@ Set Kafka Confluent host
Set Kafka Confluent port
*/}}
{{- define "sentry.kafka.port" -}}
{{- if and (.Values.kafka.enabled) (.Values.kafka.service.ports.client) -}}
{{- if or
(and .Values.kafka.enabled .Values.kafka.service.ports.client)
.Values.redpanda.enabled
-}}
{{- .Values.kafka.service.ports.client }}
{{- else if and (.Values.externalKafka) (not (.Values.externalKafka.cluster)) -}}
{{ required "A valid .Values.externalKafka.port is required" .Values.externalKafka.port }}
Expand Down
4 changes: 2 additions & 2 deletions charts/sentry/templates/hooks/sentry-db-check.job.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -141,7 +141,7 @@ spec:
done
echo "Zookeeper is up"
{{- end }}
{{- if .Values.kafka.kraft.enabled }}
{{- if or (.Values.kafka.kraft.enabled) (.Values.kafka.redpanda.enabled) }}
KAFKA_REPLICAS={{ .Values.kafka.controller.replicaCount | default 3 }}
echo "Kafka Kraft is enabled, checking if Kraft controllers are up"
KRAFT_STATUS=0
Expand All @@ -162,7 +162,7 @@ spec:
done
echo "Kraft controllers are up"
{{- end }}
{{- else if (not (.Values.externalKafka.cluster)) }}
{{- else if and (not (.Values.externalKafka.cluster)) (not (.Values.redpanda.enabled)) }}
KAFKA_HOST={{ .Values.externalKafka.host }}
if ! nc -z "$KAFKA_HOST" {{ $kafkaPort }}; then
KAFKA_STATUS=0
Expand Down
12 changes: 11 additions & 1 deletion charts/sentry/values.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2196,10 +2196,20 @@ zookeeper:
# persistence:
# size: 8Gi

redpanda:
enabled: true
statefulset:
replicas: 3
listeners:
kafka:
authenticationMethod: "none"
console:
enabled: false

# Settings for Kafka.
# See https://github.com/bitnami/charts/tree/master/bitnami/kafka
kafka:
enabled: true
enabled: false
Copy link

@Fabccc Fabccc Jun 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi!
I think the default broker should be set as kafka, changing it would cause every user to lost all the data stored in kafka.

Copy link
Contributor

@zacharyarnaise zacharyarnaise Jul 7, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think it will be that much of a big deal, one could lose some unprocessed events in the transition but isn't that's something to be excepted when doing an upgrade anyways?

Copy link
Contributor Author

@TartanLeGrand TartanLeGrand Jul 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes I make a guide for upgrade.

provisioning:
## Increasing the replicationFactor enhances data reliability during Kafka pod failures by replicating data across multiple brokers.
# Note that existing topics will remain with replicationFactor: 1 when updated.
Expand Down