Providers & GPU Nodes

A provider is any GPU that runs ComfyUI. FlixML doesn’t care where it lives — a box under your desk, a server across the network, or serverless GPU. The API stays identical; the location is just configuration.

Configuration

Declare your GPUs in config.json:

{
  "gpu_nodes": [
    { "id": "gpu-1", "roles": ["image"], "comfyui": { "url": "http://<host>:<port>" } },
    { "id": "gpu-2", "roles": ["video"], "comfyui": { "url": "http://<host>:<port>" } }
  ]
}

Role-based routing

Each node declares roles. FlixML routes each job to a node that can serve it, so a video job never lands on an image-only node. Common roles:

• image — image generation
• video — video generation

A single node can carry multiple roles (["image", "video"]) if its VRAM can handle both.

Scaling out

Add more nodes to gpu_nodes and FlixML load-balances across them by role — no code changes. Start with one GPU; add more when you need throughput.

Discovering providers at runtime

Ask the API what’s configured and healthy:

curl <your-api-url>/api/providers

Reference a provider by its id when you generate. See the Agent API.