Conductor Inference Server
One server, every framework, real batching.
Production inference server with continuous batching, paged attention, prefix caching, multi-model loading and per-model autoscaling, exposing OpenAI-compatible and gRPC interfaces.
Specifications
| Backends | Kiln, PyTorch, ONNX, vLLM, XGBoost |
|---|---|
| Batching | Continuous + prefill/decode split |
| Caching | Radix prefix cache, KV offload |
| APIs | OpenAI-compatible, gRPC, HTTP |
| Family | Inference & Serving |
| Software stack | FLUX — source-compatible across the whole catalog |
Disclosure
Conductor Inference Server is invented. The numbers above were written to be internally consistent and plausible, not measured. Treat every figure on this site as placeholder content for layout, search and API testing.
Related
Often deployed together
Kiln Compiler
Take a trained model, get a fast engine.
- Inputs
- PyTorch, ONNX, JAX export, GGUF
- Quantization
- FP8, FP4, INT8, INT4 + accuracy report
AXION Cells
Pre-built model containers with one API each.
- Catalog
- 310 model containers
- Deploy targets
- K8s, bare metal, edge, cloud
Slipstream Distributed Serving
Disaggregated inference across a whole rack.
- Architecture
- Disaggregated prefill/decode
- KV transfer
- HyperLink and RDMA
Sentinel Guardrails
Programmable rails around a model endpoint.
- Rails
- Topic, safety, PII, grounding, tool-auth
- Latency
- +11 ms typical