Skip to content

A high-performance observability data pipeline.

License

MPL-2.0, Unknown licenses found

Licenses found

MPL-2.0
LICENSE
Unknown
license-tool.toml
Notifications You must be signed in to change notification settings

astradot/vector

This branch is up to date with vectordotdev/vector:master.

Folders and files

NameName
Last commit message
Last commit date
Sep 14, 2023
Feb 9, 2024
Mar 17, 2025
Dec 4, 2024
Feb 24, 2025
Mar 17, 2025
Nov 8, 2024
Jun 14, 2024
Mar 11, 2025
Jan 16, 2025
Mar 17, 2025
Jul 24, 2023
Jan 7, 2025
Jan 29, 2025
Jan 16, 2025
Nov 20, 2023
Mar 10, 2025
Mar 17, 2025
Apr 9, 2024
Mar 5, 2025
Aug 10, 2023
Mar 10, 2025
Mar 19, 2025
Jan 9, 2023
Jul 20, 2022
Sep 20, 2023
Mar 11, 2024
Nov 9, 2020
Jun 21, 2023
May 11, 2022
Aug 26, 2021
May 26, 2022
Mar 4, 2025
Mar 17, 2025
Mar 17, 2025
Mar 11, 2024
Sep 3, 2020
Mar 17, 2025
Oct 4, 2024
May 24, 2023
Mar 5, 2025
Mar 12, 2025
Sep 12, 2024
Jan 18, 2023
Oct 15, 2024
Jan 2, 2025
Jan 18, 2023
Jan 7, 2025
Jan 7, 2025
Oct 15, 2024
Mar 12, 2025
Jan 15, 2025
Feb 26, 2025

Quickstart  •   Docs  •   Guides  •   Integrations  •   Chat  •   Download  •   Rust Crate Docs

Vector

What is Vector?

Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. Collect, transform, and route all your logs and metrics to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Additionally, it is open source and up to 10x faster than every alternative in the space.

To get started, follow our quickstart guide or install Vector.

Principles

  • Reliable - Built in Rust, Vector's primary design goal is reliability.
  • End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
  • Unified - Logs, metrics (beta), and traces (coming soon). One tool for all of your data.

Use cases

  • Reduce total observability costs.
  • Transition vendors without disrupting workflows.
  • Enhance data quality and improve insights.
  • Consolidate agents and eliminate agent fatigue.
  • Improve overall observability performance and reliability.

Community

  • Vector is relied on by startups and enterprises like Atlassian, T-Mobile, Comcast, Zendesk, Discord, Fastly, CVS, Trivago, Tuple, Douban, Visa, Mambu, Blockfi, Claranet, Instacart, Forcepoint, and many more.
  • Vector is downloaded over 100,000 times per day.
  • Vector's largest user processes over 30TB daily.
  • Vector has over 100 contributors and growing.

About

Setup

Reference

Administration

Resources

Comparisons

Performance

The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.

Test Vector Filebeat FluentBit FluentD Logstash SplunkUF SplunkHF
TCP to Blackhole 86mib/s n/a 64.4mib/s 27.7mib/s 40.6mib/s n/a n/a
File to TCP 76.7mib/s 7.8mib/s 35mib/s 26.1mib/s 3.1mib/s 40.1mib/s 39mib/s
Regex Parsing 13.2mib/s n/a 20.5mib/s 2.6mib/s 4.6mib/s n/a 7.8mib/s
TCP to HTTP 26.7mib/s n/a 19.6mib/s <1mib/s 2.7mib/s n/a n/a
TCP to TCP 69.9mib/s 5mib/s 67.1mib/s 3.9mib/s 10mib/s 70.4mib/s 7.6mib/s

To learn more about our performance tests, please see the Vector test harness.

Correctness

The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:

Test Vector Filebeat FluentBit FluentD Logstash Splunk UF Splunk HF
Disk Buffer Persistence
File Rotate (create)
File Rotate (copytruncate)
File Truncation
Process (SIGHUP)
JSON (wrapped)

To learn more about our correctness tests, please see the Vector test harness.

Features

Vector is an end-to-end, unified, open data platform.

Vector Beats Fluentbit Fluentd Logstash Splunk UF Splunk HF Telegraf
End-to-end
Agent
Aggregator
Unified
Logs
Metrics
Traces 🚧
Open
Open-source
Vendor-neutral
Reliability
Memory-safe
Delivery guarantees
Multi-core

⚠ = Not interoperable, metrics are represented as structured logs


Developed with ❤️ by Datadog - Security Policy - Privacy Policy

About

A high-performance observability data pipeline.

Resources

License

MPL-2.0, Unknown licenses found

Licenses found

MPL-2.0
LICENSE
Unknown
license-tool.toml

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Rust 61.3%
  • CUE 35.7%
  • HTML 1.3%
  • TypeScript 0.8%
  • JavaScript 0.3%
  • Shell 0.1%
  • Other 0.5%