Fleet control · Narwhal
Narwhal Orchestrator · Grafana
{{chrome.url}}
NARWHAL
Fleet control
Connected
Dashboard ↗
ADMISSION
Ready
ALERTS
none firing
SESSION
{{strip.sessId}}
{{strip.sessMeta}}
From session start ↗
BENCHMARK
{{strip.benchJob}}
{{strip.benchState}}
{{strip.benchTime}}
IN PROGRESS
{{strip.progText}}
none
DRAIN DEADLINE
default
s
{{strip.btnLabel}}
Engines
?
8 · split {{c.split}}
prefill
decode
colocated
{{ch.label}}
{{ch.count}}
Find engine
All roles
1–8 of 8
ENGINE ↑
ROLE
STATE
RESIDENT
LAST ACTION
ACTIONS
{{r.id}}
{{r.role}}
{{r.stateText}}
{{r.resident}}
{{r.last}}
{{r.main}}
⋯
LAST ACTION
{{c.last.label}}
{{c.last.time}}
state
{{c.last.from}} →
{{c.last.to}}
resident
{{c.last.res}}
No engine actions in this session yet
Benchmark
Results
Activity
{{rp.job}}
{{rp.status}}
{{rp.time}}
WORKLOAD
Short chat
RATE (REQ/S)
4
ARRIVAL
Random (default)
CONCURRENCY
32
RAMP-UP (S)
10
DURATION (S)
150
REQUESTS
WARM-UP
10
Generated chat prompts of about 512 tokens with 256-token answers. Set a Rate, a Concurrency or both, and a Duration, a Requests limit or both.
Start job
Stop job
{{bench.note}}
{{res.status}}
COMPLETED
{{res.completed}}
ERRORS
0
REQUESTS/S
{{res.rps}}
OUTPUT TOK/S
{{res.tok}}
WITHIN SLO
{{res.slo}}
LATENCY
P50
P95
P99
TARGET
Time to first token
{{res.t50}}
{{res.t95}}
{{res.t99}}
2.1 s
Inter-token latency
{{res.itl}}
{{res.itl}}
{{res.itl}}
45 ms
Request latency
{{res.r50}}
{{res.r95}}
{{res.r99}}
-
Completed requests per second
0:00
{{res.elapsedLabel}}
Time to first token, p95
target 2.1 s
0:00
{{res.elapsedLabel}}
session 7e9ecb
Download session log
#
STARTED (UTC)
ACTION
TARGET
DURATION
OUTCOME
{{a.n}}
{{a.started}}
{{a.action}}
{{a.target}}
{{a.dur}}
{{a.out}}
{{m.label}}
{{m.note}}
{{dlg.title}}
{{dlg.body}}
Cancel
{{dlg.confirm}}
Home
›
Dashboards
›
Narwhal Orchestrator
Fleet control ↗
Last 5 minutes
{{g.clock}} UTC
5s
Router
Admission
Ready
Alerts
0
Requests
Within SLO
Offered
Completed
Cancelled
Dropped
Refused
Rejected
Failed
Expired
{{g.slo}}
{{g.offered}}
{{g.completed}}
0
0%
0
0
0
0
Latency
TTFT p95 of SLO
TPOT p95 of SLO
{{g.ttftPct}}
{{g.tpotPct}}
Request outcomes
job-001
{{an.label}}
6 req/s
4 req/s
2 req/s
0 req/s
00:07:00
00:08:00
00:09:00
00:10:00
offered
completed
dropped
Token throughput
3 K
2 K
1 K
0
00:07:00
00:08:00
00:09:00
00:10:00
prompt tokens/s
output tokens/s
Engines
Engine ↑
Role
State
Resident
Engine running
KV cache
Prefix hits
Tokens/s
{{e.id}}
{{e.role}}
{{e.state}}
{{e.res}}
{{e.run}}
{{e.kv}}
0%
{{e.tok}}
{{cap.step}}
{{cap.text}}
NARWHAL · OPERATE
Controlling the fleet
Drive engines and load jobs from the console. Watch Grafana react.
Every action timed, logged
and marked on your charts.
athrael-soju.github.io/Narwhal
{{ctl.time}}
Timeline position
{{chp.label}}