Fleet control · Narwhal
Narwhal Orchestrator · Grafana
{{chrome.url}}
Narwhal logo
NARWHAL Fleet control
Connected
ADMISSION Ready
ALERTS none firing
SESSION
{{strip.sessId}} {{strip.sessMeta}} From session start ↗
BENCHMARK
{{strip.benchJob}} {{strip.benchState}} {{strip.benchTime}}
IN PROGRESS {{strip.progText}} none
DRAIN DEADLINE
defaults
Engines ? 8 · split {{c.split}}
prefill decode colocated
{{ch.label}}{{ch.count}}
Find engine All roles 1–8 of 8
ENGINE ↑ROLESTATERESIDENTLAST ACTIONACTIONS
{{r.id}} {{r.role}} {{r.stateText}} {{r.resident}} {{r.last}}
LAST ACTION {{c.last.label}} {{c.last.time}} state {{c.last.from}} → {{c.last.to}} resident {{c.last.res}} No engine actions in this session yet
{{rp.job}} {{rp.status}} {{rp.time}}
WORKLOAD Short chat
RATE (REQ/S)4
ARRIVALRandom (default)
CONCURRENCY32
RAMP-UP (S)10
DURATION (S)150
REQUESTS
WARM-UP10
Generated chat prompts of about 512 tokens with 256-token answers. Set a Rate, a Concurrency or both, and a Duration, a Requests limit or both.
{{bench.note}}
{{res.status}}
COMPLETED{{res.completed}}
ERRORS0
REQUESTS/S{{res.rps}}
OUTPUT TOK/S{{res.tok}}
WITHIN SLO{{res.slo}}
LATENCYP50P95P99TARGET
Time to first token{{res.t50}}{{res.t95}}{{res.t99}}2.1 s
Inter-token latency{{res.itl}}{{res.itl}}{{res.itl}}45 ms
Request latency{{res.r50}}{{res.r95}}{{res.r99}}-
Completed requests per second
0:00{{res.elapsedLabel}}
Time to first token, p95target 2.1 s
0:00{{res.elapsedLabel}}
session 7e9ecbDownload session log
#STARTED (UTC)ACTIONTARGETDURATIONOUTCOME
{{a.n}}{{a.started}}{{a.action}}{{a.target}}{{a.dur}}{{a.out}}
{{m.label}}{{m.note}}
{{dlg.title}} {{dlg.body}}
Home›Dashboards›Narwhal Orchestrator
Fleet control ↗ Last 5 minutes {{g.clock}} UTC 5s
Router
AdmissionReady
Alerts0
Requests
Within SLOOfferedCompletedCancelledDroppedRefusedRejectedFailedExpired {{g.slo}}{{g.offered}}{{g.completed}}00%0000
Latency
TTFT p95 of SLOTPOT p95 of SLO {{g.ttftPct}}{{g.tpotPct}}
Request outcomes
job-001
{{an.label}}
6 req/s 4 req/s 2 req/s 0 req/s 00:07:00 00:08:00 00:09:00 00:10:00
offered completed dropped
Token throughput
3 K 2 K 1 K 0 00:07:00 00:08:00 00:09:00 00:10:00
prompt tokens/s output tokens/s
Engines
Engine ↑RoleStateResidentEngine runningKV cachePrefix hitsTokens/s
{{e.id}} {{e.role}} {{e.state}} {{e.res}} {{e.run}} {{e.kv}} 0% {{e.tok}}
{{cap.step}}{{cap.text}}
Narwhal logo
NARWHAL · OPERATE Controlling the fleet Drive engines and load jobs from the console. Watch Grafana react.
Narwhal logo
Every action timed, logged
and marked on your charts.
athrael-soju.github.io/Narwhal
{{ctl.time}}