Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can you choose disk location for topic event log? #24520

Open
Andrew9317 opened this issue Dec 11, 2024 · 1 comment
Open

Can you choose disk location for topic event log? #24520

Andrew9317 opened this issue Dec 11, 2024 · 1 comment

Comments

@Andrew9317
Copy link

Andrew9317 commented Dec 11, 2024

We have a use case where we want 90% of topics written to ephemeral ramdisk since persistence doesn't matter for these and the data is required to not be stored on disk, but we require a few select topics to be persistent and stored on disk. Is there a way to have individual topic locations in one broker or do we need to spin up a second broker for the ones we need on file system?

JIRA Link: CORE-8519

@dotnwat
Copy link
Member

dotnwat commented Dec 12, 2024

hey @Andrew9317 yeh we've seen similar use cases. redpanda doesn't provide that level of granularity of data placement yet, but I'm pretty sure that at least one cluster has worked around it with some clever use of file system mounting to get the desired layout. lemme know if that doesn't work there might be some other tricks. also, it should be noted, that we don't test this kind of setup. it should work, but i'm not sure what kind of issues you might encounter. happy to field questions though with what you find!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants