Different retention period by tenant

[Mojito2110]

Hello folks

good jobs for mimir;

Is it possible to configure different retention period for each tenant ?
tenant-a retention : 3 months
tenant-b retention : 1 year

If it s possible how can we do that ?

[pstibrany]

Hello,

yes, this is definitely possible by using "runtime configuration". For example you can put this into your runtime configuration file:

overrides:
    "tenant-a":
        compactor_blocks_retention_period: 12w
    "tenant-b":
        compactor_blocks_retention_period: 1y

We cannot use 3m for 3 months, because m is used for minutes. We can only use y for years, w for weeks or d for days.

https://grafana.com/docs/mimir/latest/operators-guide/configuring/about-runtime-configuration/

[shichanglin5]

Could configure different retention for the local tsdb of different tenants ?

[dimitarvdimitrov]

that's not possible at the moment

[shichanglin5]

Please consider this requirement. Compared with s3(store-gateway), querying data from local disks has better performance. Different tenants have different query requirements. For example, core monitoring has frequent data access within one month, while other monitoring may only have frequent access within one week. we could configure the local disk data retention time according to different access requirements to reduce disk usage, while ensuring query performance

[shichanglin5]

@dimitarvdimitrov

[pstibrany]

We don't plan to expose per-tenant TSDB retention config option. That would complicate Mimir in many ways, eg. it would make it very difficult to estimate disk capacity of ingesters, or configure queriers correctly.

[KrishnaJyothika]

Hi @pstibrany

I have tried this but for some reason the retention policy is still considering to default one only (30d in my case).
I can see it is updated in /overrides-exporter/runtime_config?mode=diff api, but not seeing under limit_name of cortex_limits_overrides metric. I can also see only last 30d blocks present in storage account for this tenant.

Am I missing anything here? Please help me here

overrides:
  "tenant-1":
    compactor_blocks_retention_period: 60d