dependency failed to start: container signoz-clickhouse is unhealthy #6741

JackySu · 2025-01-02T08:52:46Z

The fix is part of the latest release v0.44.0.

@TheShubhendra Kudos for sharing the quickfix with us. 👍

Originally posted by @prashant-shahi in #4891

Bug description

signoz/deploy on  release/v0.63.x 
❯ docker compose -f docker/clickhouse-setup/docker-compose.yaml up -d
[+] Running 29/29
 ✔ otel-collector-migrator-sync Pulled                                                                                                                                                                                                               7.7s 
 ✔ frontend Pulled                                                                                                                                                                                                                                  17.7s 
   ✔ 068b4536fb82 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 9301b75a59e7 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ f69e73dd210e Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 6715a1066dac Already exists                                                                                                                                                                                                                     0.0s 
   ✔ a19f1e837fdf Already exists                                                                                                                                                                                                                     0.0s 
   ✔ ede6cd11b305 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 10e76302afc6 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 792c6d1e6517 Pull complete                                                                                                                                                                                                                      8.9s 
   ✔ cbb63515bc8a Pull complete                                                                                                                                                                                                                      9.2s 
   ✔ be85e465a8c2 Pull complete                                                                                                                                                                                                                     10.2s 
   ✔ decd2a1afdd8 Pull complete                                                                                                                                                                                                                     12.9s 
 ✔ otel-collector Pulled                                                                                                                                                                                                                            13.7s 
   ✔ 38a8310d387e Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 8d9dbc11bf4c Pull complete                                                                                                                                                                                                                      2.1s 
   ✔ 92f4c373ad0a Pull complete                                                                                                                                                                                                                      9.0s 
   ✔ 7e20d50d8836 Pull complete                                                                                                                                                                                                                      9.0s 
 ✔ query-service Pulled                                                                                                                                                                                                                             14.2s 
   ✔ da9db072f522 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ 8c9d3ff6dca2 Pull complete                                                                                                                                                                                                                      4.6s 
   ✔ 4f4fb700ef54 Pull complete                                                                                                                                                                                                                      4.6s 
   ✔ c33924f8e428 Pull complete                                                                                                                                                                                                                      9.4s 
   ✔ d4dc822484a2 Pull complete                                                                                                                                                                                                                      9.4s 
   ✔ 1449a21227c4 Pull complete                                                                                                                                                                                                                      9.5s 
   ✔ e425b29c7114 Pull complete                                                                                                                                                                                                                      9.5s 
 ✔ otel-collector-migrator-async Pulled                                                                                                                                                                                                              7.7s 
   ✔ fbcfea79c1c4 Already exists                                                                                                                                                                                                                     0.0s 
   ✔ d8a1bb33dda6 Pull complete                                                                                                                                                                                                                      3.1s 
[+] Running 11/11
 ✔ Container signoz-zookeeper-1     Running                                                                                                                                                                                                          0.0s 
 ✔ Container load-hotrod            Running                                                                                                                                                                                                          0.0s 
 ✘ Container signoz-clickhouse      Error                                                                                                                                                                                                            0.7s 
 ✔ Container hotrod                 Running                                                                                                                                                                                                          0.0s 
 ✔ Container otel-migrator-async    Recreated                                                                                                                                                                                                        0.1s 
 ✔ Container signoz-otel-collector  Recreated                                                                                                                                                                                                        0.2s 
 ✔ Container signoz-query-service   Recreated                                                                                                                                                                                                        0.1s 
 ✔ Container otel-migrator-sync     Recreated                                                                                                                                                                                                        0.1s 
 ✔ Container signoz-frontend        Recreated                                                                                                                                                                                                        0.1s 
 ✔ Container signoz-alertmanager    Created                                                                                                                                                                                                          0.0s 
 ✔ Container signoz-logspout        Created                                                                                                                                                                                                          0.0s 
dependency failed to start: container signoz-clickhouse is unhealthy

Expected behavior

I just want it to work please

How to reproduce

Follow the steps on https://signoz.io/docs/install/docker/#install-signoz-using-docker-compose

Version information

Signoz version: v0.63.x
Browser version: Google Chrome 131.0.6778.139 (Official Build) (64-bit)
Your OS and version: Linux 6.12.4-arch1-1 # 1 SMP PREEMPT_DYNAMIC Mon, 09 Dec 2024 14:31:57 +0000 x86_64 GNU/Linux
Your CPU Architecture(ARM/Intel): AMD x64_86

Additional context

tried both main and release/v0.63.x branch neither works

Thank you for your bug report – we love squashing them!

The text was updated successfully, but these errors were encountered:

welcome · 2025-01-02T08:52:48Z

Thanks for opening this issue. A team member should give feedback soon. In the meantime, feel free to check out the contributing guidelines.

TheShubhendra · 2025-01-02T09:20:15Z

Hi @JackySu can you please share your docker version and the logs of the failed container.

docker --version
docker logs signoz-clickhouse

JackySu · 2025-01-02T09:21:45Z

Hi @JackySu can you please share your docker version and the logs of the failed container.
docker --version
docker logs signoz-clickhouse

❯ docker --version
Docker version 27.3.1, build ce1223035a

❯ docker logs signoz-clickhouse
ClickHouse Database directory appears to contain a database; Skipping initialization
Processing configuration file '/etc/clickhouse-server/config.xml'.
Merging configuration file '/etc/clickhouse-server/config.d/cluster.xml'.
Merging configuration file '/etc/clickhouse-server/config.d/docker_related_config.xml'.
Logging information to /var/log/clickhouse-server/clickhouse-server.log
Logging errors to /var/log/clickhouse-server/clickhouse-server.err.log
{"date_time":"1735809298.613346","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"SentryWriter","message":"Sending crash reports is disabled","source_file":"src\/Daemon\/SentryWriter.cpp; void SentryWriter::initialize(Poco::Util::LayeredConfiguration &)","source_line":"131"}
{"date_time":"1735809298.660973","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Starting ClickHouse 24.1.2.5 (revision: 54482, git hash: b2605dd4a5a30131444dba7e6149a1412e83b8eb, build id: 10E44DD06215CD8F54CEB01CC942EE9BAC9B41E1), PID 1","source_file":"","source_line":"0"}
{"date_time":"1735809298.661117","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"starting up","source_file":"","source_line":"0"}
{"date_time":"1735809298.661157","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"OS name: Linux, version: 6.12.4-arch1-1, architecture: x86_64","source_file":"programs\/server\/Server.cpp; virtual void DB::Server::initialize(Poco::Util::Application &)","source_line":"425"}
{"date_time":"1735809298.664196","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Available RAM: 14.85 GiB; physical cores: 16; logical cores: 16.","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"712"}
{"date_time":"1735809298.664587","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Context","message":"Linux transparent hugepages are set to \"always\". Check \/sys\/kernel\/mm\/transparent_hugepage\/enabled","source_file":"","source_line":"0"}
{"date_time":"1735809298.664925","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Context","message":"Delay accounting is not enabled, OSIOWaitMicroseconds will not be gathered. Check \/proc\/sys\/kernel\/task_delayacct","source_file":"","source_line":"0"}
{"date_time":"1735809298.675968","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"AsynchronousMetrics","message":"Hardware monitor 'thinkpad', sensor '8' exists but could not be read: errno: 6, strerror: No such device or address.","source_file":"src\/Common\/AsynchronousMetrics.cpp; void DB::AsynchronousMetrics::openSensorsChips()","source_line":"261"}
{"date_time":"1735809298.805592","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Integrity check of the executable successfully passed (checksum: 93E18079F437E54959F2392B6B7DC32B)","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"909"}
{"date_time":"1735809298.805734","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"It looks like the process has no CAP_IPC_LOCK capability, binary mlock will be disabled. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_ipc_lock=+ep \/usr\/bin\/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems.","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"979"}
{"date_time":"1735809298.811780","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Lowered uncompressed cache size to 7.43 GiB because the system has limited RAM","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1189"}
{"date_time":"1735809298.812337","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"SensitiveDataMaskerConfigRead","message":"1 query masking rules loaded.","source_file":"src\/Common\/SensitiveDataMasker.cpp; DB::SensitiveDataMasker::SensitiveDataMasker(const Poco::Util::AbstractConfiguration &, const std::string &)","source_line":"162"}
{"date_time":"1735809298.818475","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Setting max_server_memory_usage was set to 13.37 GiB (14.85 GiB available * 0.90 max_server_memory_usage_to_ram_ratio)","source_file":"programs\/server\/Server.cpp; auto DB::Server::main(const std::vector<std::string> &)::(anonymous class)::operator()(ConfigurationPtr, bool) const","source_line":"1293"}
{"date_time":"1735809298.818513","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Setting merges_mutations_memory_usage_soft_limit was set to 7.43 GiB (14.85 GiB available * 0.50 merges_mutations_memory_usage_to_ram_ratio)","source_file":"programs\/server\/Server.cpp; auto DB::Server::main(const std::vector<std::string> &)::(anonymous class)::operator()(ConfigurationPtr, bool) const","source_line":"1321"}
{"date_time":"1735809298.818529","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Merges and mutations memory limit is set to 7.43 GiB","source_file":"programs\/server\/Server.cpp; auto DB::Server::main(const std::vector<std::string> &)::(anonymous class)::operator()(ConfigurationPtr, bool) const","source_line":"1334"}
{"date_time":"1735809298.818845","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"BackgroundSchedulePool\/BgBufSchPool","message":"Create BackgroundSchedulePool with 16 threads","source_file":"src\/Core\/BackgroundSchedulePool.cpp; DB::BackgroundSchedulePool::BackgroundSchedulePool(size_t, CurrentMetrics::Metric, CurrentMetrics::Metric, const char *)","source_line":"163"}
{"date_time":"1735809298.820413","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"BackgroundSchedulePool\/BgSchPool","message":"Create BackgroundSchedulePool with 512 threads","source_file":"src\/Core\/BackgroundSchedulePool.cpp; DB::BackgroundSchedulePool::BackgroundSchedulePool(size_t, CurrentMetrics::Metric, CurrentMetrics::Metric, const char *)","source_line":"163"}
{"date_time":"1735809298.848235","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"BackgroundSchedulePool\/BgMBSchPool","message":"Create BackgroundSchedulePool with 16 threads","source_file":"src\/Core\/BackgroundSchedulePool.cpp; DB::BackgroundSchedulePool::BackgroundSchedulePool(size_t, CurrentMetrics::Metric, CurrentMetrics::Metric, const char *)","source_line":"163"}
{"date_time":"1735809298.849875","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"BackgroundSchedulePool\/BgDistSchPool","message":"Create BackgroundSchedulePool with 16 threads","source_file":"src\/Core\/BackgroundSchedulePool.cpp; DB::BackgroundSchedulePool::BackgroundSchedulePool(size_t, CurrentMetrics::Metric, CurrentMetrics::Metric, const char *)","source_line":"163"}
{"date_time":"1735809298.851218","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"CertificateReloader","message":"One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.","source_file":"src\/Server\/CertificateReloader.cpp; void DB::CertificateReloader::tryLoad(const Poco::Util::AbstractConfiguration &)","source_line":"72"}
{"date_time":"1735809298.851609","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Application","message":"Listen [::]:9009 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.1.2.5 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0<\/listen_host> . Example for disabled IPv4: <listen_host>::<\/listen_host>","source_file":"programs\/server\/Server.cpp; void DB::Server::createServer(Poco::Util::AbstractConfiguration &, const std::string &, const char *, bool, bool, std::vector<ProtocolServerAdapter> &, CreateServerFunc &&) const","source_line":"354"}
{"date_time":"1735809298.851777","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Listening for replica communication (interserver): http:\/\/0.0.0.0:9009","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1631"}
{"date_time":"1735809298.857048","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Context","message":"Initialized background executor for merges and mutations with num_threads=16, num_tasks=32, scheduling_policy=round_robin","source_file":"src\/Interpreters\/Context.cpp; void DB::Context::initializeBackgroundExecutorsIfNeeded()","source_line":"4900"}
{"date_time":"1735809298.857561","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Context","message":"Initialized background executor for move operations with num_threads=8, num_tasks=8","source_file":"src\/Interpreters\/Context.cpp; void DB::Context::initializeBackgroundExecutorsIfNeeded()","source_line":"4910"}
{"date_time":"1735809298.858419","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Context","message":"Initialized background executor for fetches with num_threads=16, num_tasks=16","source_file":"src\/Interpreters\/Context.cpp; void DB::Context::initializeBackgroundExecutorsIfNeeded()","source_line":"4925"}
{"date_time":"1735809298.858780","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Context","message":"Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8","source_file":"src\/Interpreters\/Context.cpp; void DB::Context::initializeBackgroundExecutorsIfNeeded()","source_line":"4935"}
{"date_time":"1735809298.859839","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"DNSCacheUpdater","message":"Update period 15 seconds","source_file":"src\/Interpreters\/DNSCacheUpdater.cpp; void DB::DNSCacheUpdater::start()","source_line":"48"}
{"date_time":"1735809298.859893","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Loading metadata from \/var\/lib\/clickhouse\/","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1740"}
{"date_time":"1735809298.863620","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"DatabaseAtomic (system)","message":"Metadata processed, database system has 3 tables and 0 dictionaries in total.","source_file":"src\/Databases\/DatabaseOrdinary.cpp; virtual void DB::DatabaseOrdinary::loadTablesMetadata(ContextPtr, ParsedTablesMetadata &, bool)","source_line":"131"}
{"date_time":"1735809298.863723","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"TablesLoader","message":"Parsed metadata of 3 tables in 1 databases in 0.003509793 sec","source_file":"src\/Databases\/TablesLoader.cpp; LoadTaskPtrs DB::TablesLoader::loadTablesAsync(LoadJobSet)","source_line":"63"}
{"date_time":"1735809298.918262","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"DatabaseCatalog","message":"Found 0 partially dropped tables. Will load them and retry removal.","source_file":"src\/Interpreters\/DatabaseCatalog.cpp; void DB::DatabaseCatalog::loadMarkedAsDroppedTables()","source_line":"1029"}
{"date_time":"1735809298.918500","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"DatabaseAtomic (default)","message":"Metadata processed, database default has 0 tables and 0 dictionaries in total.","source_file":"src\/Databases\/DatabaseOrdinary.cpp; virtual void DB::DatabaseOrdinary::loadTablesMetadata(ContextPtr, ParsedTablesMetadata &, bool)","source_line":"131"}
{"date_time":"1735809298.918522","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"TablesLoader","message":"Parsed metadata of 0 tables in 1 databases in 4.1016e-05 sec","source_file":"src\/Databases\/TablesLoader.cpp; LoadTaskPtrs DB::TablesLoader::loadTablesAsync(LoadJobSet)","source_line":"63"}
{"date_time":"1735809298.918566","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"loadMetadata","message":"Start synchronous loading of databases","source_file":"src\/Interpreters\/loadMetadata.cpp; LoadTaskPtrs DB::loadMetadata(ContextMutablePtr, const String &, bool)","source_line":"261"}
{"date_time":"1735809298.918578","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"loadMetadata","message":"Start synchronous startup of databases","source_file":"src\/Interpreters\/loadMetadata.cpp; LoadTaskPtrs DB::loadMetadata(ContextMutablePtr, const String &, bool)","source_line":"263"}
{"date_time":"1735809298.918666","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"UserDefinedSQLObjectsLoaderFromDisk","message":"Loading user defined objects from \/var\/lib\/clickhouse\/user_defined\/","source_file":"src\/Functions\/UserDefined\/UserDefinedSQLObjectsDiskStorage.cpp; void DB::UserDefinedSQLObjectsDiskStorage::loadObjectsImpl()","source_line":"123"}
{"date_time":"1735809298.918749","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Tasks stats provider: procfs","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1864"}
{"date_time":"1735809298.918767","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"It looks like the process has no CAP_SYS_NICE capability, the setting 'os_thread_priority' will have no effect. It could happen due to incorrect ClickHouse package installation. You could resolve the problem manually with 'sudo setcap cap_sys_nice=+ep \/usr\/bin\/clickhouse'. Note that it will not work on 'nosuid' mounted filesystems.","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1873"}
{"date_time":"1735809298.918980","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Application","message":"Listen [::]:8123 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.1.2.5 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0<\/listen_host> . Example for disabled IPv4: <listen_host>::<\/listen_host>","source_file":"programs\/server\/Server.cpp; void DB::Server::createServer(Poco::Util::AbstractConfiguration &, const std::string &, const char *, bool, bool, std::vector<ProtocolServerAdapter> &, CreateServerFunc &&) const","source_line":"354"}
{"date_time":"1735809298.919124","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Application","message":"Listen [::]:9000 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.1.2.5 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0<\/listen_host> . Example for disabled IPv4: <listen_host>::<\/listen_host>","source_file":"programs\/server\/Server.cpp; void DB::Server::createServer(Poco::Util::AbstractConfiguration &, const std::string &, const char *, bool, bool, std::vector<ProtocolServerAdapter> &, CreateServerFunc &&) const","source_line":"354"}
{"date_time":"1735809298.919253","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Application","message":"Listen [::]:9004 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.1.2.5 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0<\/listen_host> . Example for disabled IPv4: <listen_host>::<\/listen_host>","source_file":"programs\/server\/Server.cpp; void DB::Server::createServer(Poco::Util::AbstractConfiguration &, const std::string &, const char *, bool, bool, std::vector<ProtocolServerAdapter> &, CreateServerFunc &&) const","source_line":"354"}
{"date_time":"1735809298.919384","thread_name":"","thread_id":"1","level":"Warning","query_id":"","logger_name":"Application","message":"Listen [::]:9005 failed: Poco::Exception. Code: 1000, e.code() = 0, DNS error: EAI: Address family for hostname not supported (version 24.1.2.5 (official build)). If it is an IPv6 or IPv4 address and your host has disabled IPv6 or IPv4, then consider to specify not disabled IPv4 or IPv6 address to listen in <listen_host> element of configuration file. Example for disabled IPv6: <listen_host>0.0.0.0<\/listen_host> . Example for disabled IPv4: <listen_host>::<\/listen_host>","source_file":"programs\/server\/Server.cpp; void DB::Server::createServer(Poco::Util::AbstractConfiguration &, const std::string &, const char *, bool, bool, std::vector<ProtocolServerAdapter> &, CreateServerFunc &&) const","source_line":"354"}
{"date_time":"1735809298.967777","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"CertificateReloader","message":"One of paths is empty. Cannot apply new configuration for certificates. Fill all paths and try again.","source_file":"src\/Server\/CertificateReloader.cpp; void DB::CertificateReloader::tryLoad(const Poco::Util::AbstractConfiguration &)","source_line":"72"}
{"date_time":"1735809298.978645","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Listening for http:\/\/0.0.0.0:8123","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1965"}
{"date_time":"1735809298.978784","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Listening for native protocol (tcp): 0.0.0.0:9000","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1965"}
{"date_time":"1735809298.978855","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Listening for MySQL compatibility protocol: 0.0.0.0:9004","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1965"}
{"date_time":"1735809298.978942","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Listening for PostgreSQL compatibility protocol: 0.0.0.0:9005","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1965"}
{"date_time":"1735809298.983913","thread_name":"","thread_id":"694","level":"Information","query_id":"","logger_name":"ZooKeeperClient","message":"Connected to ZooKeeper at 172.18.0.3:2181 with session_id 72059342669479938","source_file":"src\/Common\/ZooKeeper\/ZooKeeperImpl.cpp; void Coordination::ZooKeeper::connect(const Nodes &, Poco::Timespan)","source_line":"550"}
{"date_time":"1735809298.985665","thread_name":"","thread_id":"694","level":"Information","query_id":"","logger_name":"ZooKeeperClient","message":"Keeper feature flag FILTERED_LIST: disabled","source_file":"src\/Coordination\/KeeperFeatureFlags.cpp; void DB::KeeperFeatureFlags::logFlags(LoggerPtr) const","source_line":"88"}
{"date_time":"1735809298.985760","thread_name":"","thread_id":"694","level":"Information","query_id":"","logger_name":"ZooKeeperClient","message":"Keeper feature flag MULTI_READ: disabled","source_file":"src\/Coordination\/KeeperFeatureFlags.cpp; void DB::KeeperFeatureFlags::logFlags(LoggerPtr) const","source_line":"88"}
{"date_time":"1735809298.985797","thread_name":"","thread_id":"694","level":"Information","query_id":"","logger_name":"ZooKeeperClient","message":"Keeper feature flag CHECK_NOT_EXISTS: disabled","source_file":"src\/Coordination\/KeeperFeatureFlags.cpp; void DB::KeeperFeatureFlags::logFlags(LoggerPtr) const","source_line":"88"}
{"date_time":"1735809298.985832","thread_name":"","thread_id":"694","level":"Information","query_id":"","logger_name":"ZooKeeperClient","message":"Keeper feature flag CREATE_IF_NOT_EXISTS: disabled","source_file":"src\/Coordination\/KeeperFeatureFlags.cpp; void DB::KeeperFeatureFlags::logFlags(LoggerPtr) const","source_line":"88"}
{"date_time":"1735809298.985904","thread_name":"","thread_id":"1","level":"Information","query_id":"","logger_name":"Application","message":"Ready for connections.","source_file":"programs\/server\/Server.cpp; virtual int DB::Server::main(const std::vector<std::string> &)","source_line":"1969"}

Thank you!

JackySu · 2025-01-02T09:46:40Z

Hi @JackySu can you please share your docker version and the logs of the failed container.
docker --version
docker logs signoz-clickhouse

fyi I have access to http://localhost:8123/ping to check clickhouse is running fine, but http://0.0.0.0:8123/ping doesn't work

TheShubhendra · 2025-01-02T09:52:19Z

Hi @JackySu can you please share your docker version and the logs of the failed container.
docker --version
docker logs signoz-clickhouse
fyi I have access to http://localhost:8123/ping to check clickhouse is running fine, but http://0.0.0.0:8123/ping doesn't work

ok thanks for sharing this.
can you update the endpoint here

signoz/deploy/docker/clickhouse-setup/docker-compose-minimal.yaml

Line 16 in 28d27bc

test: ["CMD", "wget", "--spider", "-q", "0.0.0.0:8123/ping"]

from 0.0.0.0:8123/ping to localhost:8123/ping to see if it works

JackySu · 2025-01-02T09:58:23Z

Hi @JackySu can you please share your docker version and the logs of the failed container.
docker --version
docker logs signoz-clickhouse
fyi I have access to http://localhost:8123/ping to check clickhouse is running fine, but http://0.0.0.0:8123/ping doesn't work
ok thanks for sharing this. can you update the endpoint here

signoz/deploy/docker/clickhouse-setup/docker-compose-minimal.yaml

Line 16 in 28d27bc

test: ["CMD", "wget", "--spider", "-q", "0.0.0.0:8123/ping"]

from 0.0.0.0:8123/ping to localhost:8123/ping to see if it works

unfortunately no it doesn't

TheShubhendra · 2025-01-02T10:23:54Z

I tried to reproduce but it's all working for me :/

JackySu · 2025-01-02T10:32:52Z

I tried to reproduce but it's all working for me :/

oh, I have to use proxy to access my company's internal network (for all network traffic) and that could be the cause, though idk how to address this issue.
Anyway thanks for your help, I will try another way around.
Should I leave this issue open?

TheShubhendra · 2025-01-02T10:35:17Z

I tried to reproduce but it's all working for me :/

oh, I have to use proxy to access my company's internal network (for all network traffic) and that could be the cause, though idk how to address this issue. Anyway thanks for your help, I will try another way around. Should I leave this issue open?

Yes, please leave the issue open in case someone else has insights or a similar experience to share.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

dependency failed to start: container signoz-clickhouse is unhealthy #6741

dependency failed to start: container signoz-clickhouse is unhealthy #6741

JackySu commented Jan 2, 2025 •

edited

Loading

welcome bot commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025

JackySu commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025 •

edited

Loading

TheShubhendra commented Jan 2, 2025

dependency failed to start: container signoz-clickhouse is unhealthy #6741

dependency failed to start: container signoz-clickhouse is unhealthy #6741

Comments

JackySu commented Jan 2, 2025 • edited Loading

Bug description

Expected behavior

How to reproduce

Version information

Additional context

Thank you for your bug report – we love squashing them!

welcome bot commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025

JackySu commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025 • edited Loading

TheShubhendra commented Jan 2, 2025

JackySu commented Jan 2, 2025 •

edited

Loading

JackySu commented Jan 2, 2025 •

edited

Loading