4.6.1 Service topology

• Gateway: public API surface, auth, QoS hooks, request normalization

• Scheduler: distributes inference jobs, load balancing

• Miners: perform ONNX inference (CPU), expose internal endpoints

Topology schema

flowchart LR
  U[Client / App] -->|POST /v1/detect/image\nx-api-key\noptional x-prvx-address| G[Gateway :7070]
  G --> S[Scheduler]
  S --> M1[Miner1 :6061\nONNX inference]
  S --> M2[Miner2 :6062\nONNX inference]
  M1 --> S
  M2 --> S
  S --> G
  G --> U