[OSPP 2025] Tracking issues: Support time series data structure and commands

[yezhizi]

Search before asking

• I had searched in the issues and found no similar issues.

Motivation

Part of OSPP 2025.
This task is to implement the time series data structure and its commands on Kvrocks.

We have broken down the task into multiple subtasks and will track them in this issue.

• Initialize metadata. (feat(ts): initialize metadata and subkey encoding  #3072)

• Write Operations(TS.CREATE/TS.ADD/TS.MADD): Support uncompressed chunk storage. (feat(ts): Add data structures for uncompressed chunks #3091 feat(ts): Add support for data writing and TS.CREATE, TS.ADD/MADD commands #3107 )

• Query Operations(TS.INFO/TS.GET/TS.RANGE): Implement time-range scans with chunk iteration. (feat(ts): Add TS.INFO command #3133 feat(ts): Add data query support and TS.RANGE command #3140 feat(ts): Add TS.GET command #3142 )

• Multi-Series Queries(TS.MGET/TS.MRANGE): Support label-based indexing and filter expressions. (feat(ts): Add label-based indexing support and TS.MGET command #3164 feat(ts): Add TS.MRANGE command #3167 )

• Downsampling Rules(TS.CREATERULE): Implement downstream_key metadata and aggregation logic. (feat(ts): Add support for writing downstream timeseries and TS.CREATERULE command #3151 )

• Remove/recycle related label index in Index CF when a TS key was deleted/expired.

• Retention: Implement retention policy with compaction filters.

• Out-of-Order Writes & Deletion(TS.DEL, TS.INCRBY/DECRBY): Handle non-append writes.

• (Optional) Compressed Chunk Support: Integrate Gorilla compression for timestamps/values.

Solution

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!

[PragmaTwice]

Proposal can be found here: #3044

[LindaSummer]

Hi @yezhizi ,

Thanks for your effort! 😊
When these tasks are ready for the community to participate, we'd better list the dependencies of each sub-task.
It will help us to pick up the available tasks first and work in the expected order in your plan.

Best Regards,
Edward

[yezhizi]

Hi! @LindaSummer

Thank you for the reminder. Since this is an OSPP 2025 project, according to the project requirements, most of the functional code needs to be completed independently by me and will take around three months. I’ve already started working on this (progress might be slow at first because I’m quite busy during this days). So this tracking issue is being used to monitor progress.

After the project is completed, we can proceed in this way to involve the community. 😊

When these tasks are ready for the community to participate, we'd better list the dependencies of each sub-task.

[PragmaTwice]

Maybe we can support TS.INFO earlier so that we can use it in debug and golang test cases. cc @yezhizi

[PragmaTwice]

Hi @yezhizi, glad to see so much progress for this project : )

Would you like also add some documentation of the design of data structure on the website?

Refer to https://kvrocks.apache.org/community/data-structure-on-rocksdb.