Skip to content
Merged
47 changes: 44 additions & 3 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 4 additions & 0 deletions changelog.d/internal_log_component_id_field.breaking.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
Vector's internal topology logs now use the `component_id` field name instead of `component` or `key`.
If you are monitoring or filtering Vector's internal logs based on these field names, update your queries to use `component_id`.

authors: pront
23 changes: 23 additions & 0 deletions docs/DEVELOPING.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@
- [Minimum Supported Rust Version](#minimum-supported-rust-version)
- [Guidelines](#guidelines)
- [Sink healthchecks](#sink-healthchecks)
- [Disabling internal log rate limiting](#disabling-internal-log-rate-limiting)
- [Testing](#testing)
- [Unit tests](#unit-tests)
- [Integration tests](#integration-tests)
Expand Down Expand Up @@ -328,6 +329,28 @@ that fall into a false negative circumstance. Our goal should be to minimize the
likelihood of users needing to pull that lever while still making a good effort
to detect common problems.

### Disabling internal log rate limiting

Vector rate limits its own internal logs by default (10-second windows). During development, you may want to see all log occurrences.

**Globally** (CLI flag or environment variable):

```bash
vector --config vector.yaml -r 1
# or
VECTOR_INTERNAL_LOG_RATE_LIMIT=1 vector --config vector.yaml
```

**Per log statement**:

```rust
// Disable rate limiting for this log
warn!(message = "Error occurred.", %error, internal_log_rate_limit = false);

// Override rate limit window to 1 second
info!(message = "Processing batch.", batch_size, internal_log_rate_secs = 1);
```

## Testing

Testing is very important since Vector's primary design principle is reliability.
Expand Down
1 change: 1 addition & 0 deletions lib/tracing-limit/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ criterion = "0.7"
tracing = "0.1.34"
mock_instant = { version = "0.6" }
tracing-subscriber = { workspace = true, features = ["env-filter", "fmt"] }
serial_test = { version = "3.2" }

[[bench]]
name = "limit"
Expand Down
Loading
Loading