Skip to content

Latest commit

 

History

History
93 lines (78 loc) · 3.01 KB

prom-scraper.md

File metadata and controls

93 lines (78 loc) · 3.01 KB
Raw

Prom Scraper

Prom Scraper can be used to scrape Prometheus Exposition style endpoints on localhost and forward those metrics to Loggregator.

Usage

Instrumenting Applications

Configuring scraping

Add a config file matching one of the globs in the config_globs property in prom scraper.

  • By default, prom scraper looks for a prom-scraper-config.yml file in each job's config directory

File contents

port: Required - port on localhost where metrics endpoint is available
source_id: Optional - the source ID to set on scraped metrics (defaults to infra_job_name) 
instance_id: Optional - the instance ID to set on scraped metrics (defaults to "")
scheme: Optional - the scheme to use when scraping the target metrics endpoint. Either "http" or "https" (defaults to "http")
path: Optional - the path to the metrics endpoint (defaults to "/metrics")
headers: Optional - a map of headers to add to the scrape request
labels: Optional - a map of labels that will be added to all metrics

Example prom-scraper-config.yml.erb

port: 6061
source_id: "my-job-name"
instance_id: <%= spec.id || spec.index.to_s %>
scheme: https
path: /metrics/prometheus
headers:
  "Authorization": "lemons" 
labels:
  bosh_job: my-cool-bosh-job

Output

  • Prom Scraper will scrape the endpoint defined in the scrape config file.
  • It will add the source_id and instance_id values as tags to all metrics
  • The scraped metrics will be converted to Loggregator metrics and emitted through Loggregator Agent

Deploying Prom Scraper

To deploy prom scraper, add the following jobs to all instance groups and the variables to the variables section. Any other components deployed on the same VM with scrapable endpoints should have tls certs signed by the metric_scraper_ca

Notes

jobs:
- name: prom_scraper
  release: loggregator-agent
  properties:
    scrape:
      tls:
        ca_cert: "((prom_scraper_scrape_tls.ca))"
        cert: "((prom_scraper_scrape_tls.certificate))"
        key: "((prom_scraper_scrape_tls.private_key))"
    metrics:
      ca_cert: "((prom_scraper_metrics_tls.ca))"
      cert: "((prom_scraper_metrics_tls.certificate))"
      key: "((prom_scraper_metrics_tls.private_key))"
      server_name: prom_scraper_metrics

variables:
- name: prom_scraper_scrape_tls
  type: certificate
  options:
    ca: metric_scraper_ca
    common_name: prom_scraper
    extended_key_usage:
    - client_auth

- name: prom_scraper_metrics_tls
  type: certificate
  options:
    ca: metric_scraper_ca
    common_name: prom_scraper_metrics
    extended_key_usage:
    - server_auth

- name: metric_scraper_ca
  type: certificate
  options:
    is_ca: true
    common_name: metricScraperCA