Deploy

Pick a model, see how many nodes can run it right now and the cheapest live hourly rate, then deploy it on one of them.

LLMs

3 templates
Popular

Ollama

Run open-weight models locally behind an OpenAI-compatible API. Pull a model and serve it on the node.

no nodes available for this model right now

Docker image

ollama/ollama

Min VRAM 8 GBAny NVIDIA GPU (CPU inference also works)
Docs

llama.cpp server

Minimal GGUF inference server. Lightweight footprint, well suited to small nodes and quantised models.

no nodes available for this model right now

Docker image

ghcr.io/ggerganov/llama.cpp:server

Min VRAM 8 GBAny CUDA GPU (CPU inference also works)
Docs
Popular

vLLM

High-throughput inference server with an OpenAI-compatible endpoint. Best fit for sustained multi-user serving.

no nodes available for this model right now

Docker image

vllm/vllm-openai

Min VRAM 24 GBNVIDIA L4, A10G or larger
Docs

Image generation

2 templates
Popular

ComfyUI

Node-graph interface for image diffusion workflows. Good for batch generation and pipeline experiments.

no nodes available for this model right now

Docker image

comfyanonymous/comfyui

Min VRAM 12 GBNVIDIA RTX 3060 or larger
Docs

Stable Diffusion WebUI

The familiar AUTOMATIC1111 web interface for Stable Diffusion, with img2img, inpainting and extensions.

no nodes available for this model right now

Docker image

sd-webui

Min VRAM 8 GBNVIDIA GTX 1080 or larger
Docs

Speech & audio

1 templates

Whisper API

Speech-to-text HTTP service wrapping Whisper, with transcription and translation endpoints.

no nodes available for this model right now

Docker image

onerahmet/openai-whisper-asr-webservice

Min VRAM 4 GBAny NVIDIA GPU (CPU inference also works)
Docs

Developer & rendering

2 templates

Blender headless

Blender in background mode for scripted renders, EEVEE/Cycles jobs and batch scene processing.

no nodes available for this model right now

Docker image

linuxserver/blender

Min VRAM 8 GBAny NVIDIA GPU
Docs

PyTorch + Jupyter

PyTorch with CUDA, paired with a Jupyter notebook server for interactive training and evaluation.

no nodes available for this model right now

Docker image

pytorch/pytorch

Min VRAM 8 GBAny NVIDIA GPU
Docs