Skip to content

Narwhal fleet configuration and deployment reference

A fleet file configures one router process and one engine fleet for one model. A deployment with several models runs one router and one fleet per model, and ingress selects the model.

Print an annotated example fleet file:

.venv/bin/narwhal-check --print-example-config

narwhal-serve, narwhal-profile and narwhal-check read the fleet file named by --fleet. create_app() reads the path from the NARWHAL_FLEET environment variable.

Every fleet file declares this header:

{
  "schema": "narwhal.fleet",
  "schema_version": 2
}

The declared schema and version must match a supported interface version.

Ingress handles client identity and content capture. The Narwhal router holds one global admission budget, and request records hold timings, identifiers, placements and outcomes.

Fleet and deployment contracts