Skip to content

Clickhouse module#58

Merged
SiskaPavel merged 14 commits intomainfrom
clickhouse
Sep 2, 2025
Merged

Clickhouse module#58
SiskaPavel merged 14 commits intomainfrom
clickhouse

Conversation

@SiskaPavel
Copy link
Collaborator

Description:
Introduces a new ClickHouse module for Nemea. This module converts Unirec records into ClickHouse format and stores them into configured ClickHouse database.

@SiskaPavel SiskaPavel self-assigned this Sep 1, 2025
@SiskaPavel SiskaPavel force-pushed the clickhouse branch 4 times, most recently from bda6ca7 to 9ec884b Compare September 1, 2025 14:35
@SiskaPavel SiskaPavel changed the base branch from main to ci-remove-fedora-40 September 1, 2025 14:52
Base automatically changed from ci-remove-fedora-40 to main September 1, 2025 18:03
Pavel Siska added 9 commits September 1, 2025 21:26
Adds config for clickhouse database connection, number of insterter
threads, interface data template accepted as input etc.
needed for communication between manager and inserter in their own threads
needed for communication between manager and inserter in their own threads
- Suppresses -Wpedantic and -Wsign-conversion warnings
- Wraps <clickhouse/client.h> with GCC diagnostic pragmas
used for converting unirec types and data into clickhouse equivalents
Inserters for inserting blocks into clickhouse database.
Manager takes care of handling inserters, processing unirec data with
datatype and storing it into blocks. Edited main for this and also to
check if the template in input interface matches template specified in
config
@SiskaPavel SiskaPavel merged commit 766e02b into main Sep 2, 2025
14 checks passed
@SiskaPavel SiskaPavel deleted the clickhouse branch September 2, 2025 10:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants