The guide shelfFrom hardware
to useful answers.
Start with the architecture. Then get into the memory math, the software, and the choices that make a homelab useful.
Ghost is currently in private preview. The launch guide is being prepared for publication. Public article links will appear here when they’re available. Follow along below for updates.
01Multi-GPU inference / Launch guideFour GPUs, Zero Cloud: Running LLMs Across a Heterogeneous Home GPU Cluster
A Windows and Ubuntu setup across NVIDIA and Intel. Separate model servers, a single front door, VRAM estimates, and Tailscale-only remote access.
PRIVATE PREVIEW
02Memory / Planned follow-upVRAM, quantization, and the context-window budget
What the weight file tells you, what the KV cache adds, and why “it loads” is different from “it fits comfortably.”
COMING SOON
03Software / Planned guideOne front door for your local model servers
Connecting the serving stack, choosing an endpoint, and keeping remote access private.
COMING SOON
04Hardware / Planned guideChoose the workload before the next GPU
VRAM capacity, backend compatibility, power, and the tradeoffs worth checking before you buy.
COMING SOON