Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inability to combine properties (masking definitions) between docker compose file and included config yml #744

Open
4 tasks done
ivanbishop opened this issue Jan 2, 2025 · 0 comments
Labels
status/triage/completed Automatic triage completed status/triage/manual Manual triage in progress type/bug Something isn't working

Comments

@ivanbishop
Copy link

ivanbishop commented Jan 2, 2025

Issue submitter TODO list

  • I've looked up my issue in FAQ
  • I've searched for an already existing issues here
  • I've tried running main-labeled docker image and the issue still persists there
  • I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)

When I define masking parameters in the docker compose and define my cluster there also, I see masking working on docker compose up via the UI. But, when I define my cluster in the compose file and instead include the masking commands in my configYML masking does NOT work (nor does it clock errors). Should I move my cluster definitions OUT of the docker compose file and into the configYML file? Attaching my compose file and configYML that DOES work on masking test_masking topic with a simple key "id"

Expected behavior

I expect if I define masking NOT in the compose file but instead in the extended config YML that it would work.

Your installation details

build: 9f79a56

cofigYML (1).txt
composeNEW (1).txt

Steps to reproduce

If I include my masking for key "id" in my launch docker compose I see masking. this works

 KAFKA_CLUSTERS_0_MASKING_0_TYPE: REPLACE
      KAFKA_CLUSTERS_0_MASKING_0_FIELDS_0: "id"
      KAFKA_CLUSTERS_0_MASKING_0_TOPICKEYSPATTERN: "test_masking.*"
      KAFKA_CLUSTERS_0_MASKING_0_TOPICVALUESPATTERN: "test_masking.*"

BUT, If i omit the masking from the compose file and instead try to combine with parameters in the config YML i.e.

kafka:
  clusters:
    - name: mycluster
      masking:
        - type: REPLACE
          fields: [ "id" ]
          topicValuesPattern: "test_masking.*"
          topicKeysPattern: "test_masking.*"

Doesnt work. no errors in log either

Screenshots

Screenshot 2024-12-31 105755

Logs

No response

Additional context

Happy to trouble shoot with team

@ivanbishop ivanbishop added status/triage Issues pending maintainers triage type/bug Something isn't working labels Jan 2, 2025
@kapybro kapybro bot added status/triage/manual Manual triage in progress status/triage/completed Automatic triage completed and removed status/triage Issues pending maintainers triage labels Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status/triage/completed Automatic triage completed status/triage/manual Manual triage in progress type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant