Skip to content
Discussion options

You must be logged in to vote

It shouldn’t negatively impact Logwise to start with c7g.xlarge (4 vCPU, 8 GB RAM) given the current low WPS.

Based on our testing so far, even with 4 vCPU and 8 GB RAM, the system is able to comfortably handle ~3–4 MBps ingestion, with CPU utilization staying around 30–40%. So from a compute perspective, this configuration is sufficient for the current load, and scaling up later is straightforward if throughput increases.

One important thing to ensure, however, is storage. Please make sure we provision at least 100 GB gp3 EBS. Kafka has a default retention of 1 hour, and depending on the incoming log volume, data will accumulate quickly on disk. Storage tends to be the first bottleneck b…

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by onkar-dream11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants