On-Prem AI 17 min read
GPU passthrough cost me nothing — until the GPUs had to talk to each other
A year after virtualizing my edge AI supercomputer, I finally measured what the hypervisor costs: single-GPU work is free — the VM even won — and four-way tensor-parallel serving pays a third.