Skip to content

sample_latency_report.md

Latest commit

 

History

History
169 lines (157 loc) · 10.8 KB

sample_latency_report.md

File metadata and controls

169 lines (157 loc) · 10.8 KB
Raw

Latency Report

Markdown report generated by ./scripts/latency_report.sh --report --limit 3.

Generated: 2026-05-19 03:50:22
Project: my-gcp-project Dataset: agent_logs.agent_events Location: us-central1
Sessions: 3

Session: conv_9bd6eab9
Time: 23:15:55  Total: 26.5s
──────────────────────────────────────────────────────────────────────
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [5.0s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [5.0s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       └── knowledge_supervisor > LLM_RESPONSE [5.0s, ttft=5.0s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [5.9s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [5.9s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       └── knowledge_supervisor > LLM_RESPONSE [5.9s, ttft=5.9s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [2.8s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [2.8s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       └── knowledge_supervisor > LLM_RESPONSE [2.8s, ttft=2.8s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
└── knowledge_supervisor > INVOCATION_COMPLETED [2.7s]
    ├── knowledge_supervisor > AGENT_STARTING
    └── knowledge_supervisor > AGENT_COMPLETED [2.7s]
        ├── knowledge_supervisor > LLM_REQUEST
        └── knowledge_supervisor > LLM_RESPONSE [2.7s, ttft=2.7s]

Waterfall:
────────────────────────────────────────────────────────────────────────────────────────────────────
  knowledge_supervisor > LLM_RESPONSE #1                  ███████ 5.0s
  knowledge_supervisor > AGENT_COMPLETED #1               ███████ 5.0s
  knowledge_supervisor > INVOCATION_COMPLETED #1          ███████ 5.0s
  knowledge_supervisor > LLM_RESPONSE #2                                ████████ 5.9s
  knowledge_supervisor > AGENT_COMPLETED #2                             ████████ 5.9s
  knowledge_supervisor > INVOCATION_COMPLETED #2                        ████████ 5.9s
  knowledge_supervisor > LLM_RESPONSE #3                                          ████ 2.8s
  knowledge_supervisor > AGENT_COMPLETED #3                                       ████ 2.8s
  knowledge_supervisor > INVOCATION_COMPLETED #3                                  ████ 2.8s
  knowledge_supervisor > LLM_RESPONSE #4                                                  █ 2.7s
  knowledge_supervisor > AGENT_COMPLETED #4                                               █ 2.7s
  knowledge_supervisor > INVOCATION_COMPLETED #4                                          █ 2.7s
                                                   ────────────────────────────────────────
                                                   0                   13.2s                   26.5s

Session: conv_c72130ab
Time: 23:15:46  Total: 17.9s
──────────────────────────────────────────────────────────────────────
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [20.7s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [9.3s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       ├── knowledge_supervisor > LLM_RESPONSE [1.8s, ttft=1.8s]
│       ├── knowledge_supervisor > TOOL_STARTING (transfer_to_agent)
│       ├── knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent) [0ms]
│       ├── policy_agent > AGENT_STARTING
│       └── policy_agent > AGENT_COMPLETED [7.2s]
│           ├── policy_agent > LLM_REQUEST
│           ├── policy_agent > LLM_RESPONSE [2.4s, ttft=2.4s]
│           ├── policy_agent > TOOL_STARTING (lookup_company_policy)
│           ├── policy_agent > TOOL_COMPLETED (lookup_company_policy) [0ms]
│           ├── policy_agent > TOOL_STARTING (lookup_company_policy)
│           ├── policy_agent > TOOL_COMPLETED (lookup_company_policy) [0ms]
│           ├── policy_agent > LLM_REQUEST
│           └── policy_agent > LLM_RESPONSE [4.9s, ttft=4.9s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── policy_agent > INVOCATION_STARTING
└── policy_agent > INVOCATION_COMPLETED [5.5s]
    ├── policy_agent > AGENT_STARTING
    └── policy_agent > AGENT_COMPLETED [5.5s]
        ├── policy_agent > LLM_REQUEST
        └── policy_agent > LLM_RESPONSE [5.5s, ttft=5.5s]

Waterfall:
───────────────────────────────────────────────────────────────────────────────────────────────────────────────
  knowledge_supervisor > LLM_RESPONSE                             ████ 1.8s
  knowledge_supervisor > TOOL_COMPLETED (transfer_to_agent)       █ 0ms
  policy_agent > LLM_RESPONSE #1                                       █████ 2.4s
  policy_agent > TOOL_COMPLETED (lookup_company_policy) #1             █ 0ms
  policy_agent > TOOL_COMPLETED (lookup_company_policy) #2             █ 0ms
  policy_agent > LLM_RESPONSE #2                                                  ██████████ 4.9s
  policy_agent > AGENT_COMPLETED #1                                               ████████████████ 7.2s
  knowledge_supervisor > AGENT_COMPLETED                                          ████████████████████ 9.3s
  knowledge_supervisor > INVOCATION_COMPLETED                                     ████████████████████ 20.7s
  policy_agent > LLM_RESPONSE #3                                                                     █ 5.5s
  policy_agent > AGENT_COMPLETED #2                                                                  █ 5.5s
  policy_agent > INVOCATION_COMPLETED                                                                █ 5.5s
                                                              ────────────────────────────────────────
                                                              0                   8.9s                   17.9s

Session: conv_f3bee407
Time: 23:16:10  Total: 13.6s
──────────────────────────────────────────────────────────────────────
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [3.2s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [3.2s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       └── knowledge_supervisor > LLM_RESPONSE [3.2s, ttft=3.2s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
├── knowledge_supervisor > INVOCATION_COMPLETED [3.3s]
│   ├── knowledge_supervisor > AGENT_STARTING
│   └── knowledge_supervisor > AGENT_COMPLETED [3.3s]
│       ├── knowledge_supervisor > LLM_REQUEST
│       └── knowledge_supervisor > LLM_RESPONSE [3.3s, ttft=3.3s]
├── knowledge_supervisor > USER_MESSAGE_RECEIVED
├── knowledge_supervisor > INVOCATION_STARTING
└── knowledge_supervisor > INVOCATION_COMPLETED [1.7s]
    ├── knowledge_supervisor > AGENT_STARTING
    └── knowledge_supervisor > AGENT_COMPLETED [1.7s]
        ├── knowledge_supervisor > LLM_REQUEST
        └── knowledge_supervisor > LLM_RESPONSE [1.7s, ttft=1.7s]

Waterfall:
────────────────────────────────────────────────────────────────────────────────────────────────────
  knowledge_supervisor > LLM_RESPONSE #1                    █████████ 3.2s
  knowledge_supervisor > AGENT_COMPLETED #1                 █████████ 3.2s
  knowledge_supervisor > INVOCATION_COMPLETED #1            █████████ 3.2s
  knowledge_supervisor > LLM_RESPONSE #2                                      █████████ 3.3s
  knowledge_supervisor > AGENT_COMPLETED #2                                   █████████ 3.3s
  knowledge_supervisor > INVOCATION_COMPLETED #2                              █████████ 3.3s
  knowledge_supervisor > LLM_RESPONSE #3                                                  █ 1.7s
  knowledge_supervisor > AGENT_COMPLETED #3                                               █ 1.7s
  knowledge_supervisor > INVOCATION_COMPLETED #3                                          █ 1.7s
                                                   ────────────────────────────────────────
                                                   0                   6.8s                   13.6s

Summary


======================================================================
Summary
======================================================================
  Sessions: 3
  Avg:  19.3s
  P50:  17.9s
  P95:  26.5s
  Min:  13.6s
  Max:  26.5s

  Per-agent latency (avg):
    policy_agent                       5.2s  (n=6)
    knowledge_supervisor               4.4s  (n=24)