HARDWARE·3 days agoA Modder’s RTX 4080 Was Enough To Play AAA Games, But Not For Running LLMs, So He Integrated NVIDIA’s Tesla V100 At A Throwaway Price To Run 27B AI ModelsWccftech
HARDWARE·3 days agoAI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower to gaming PC for $266 — 32GB VRAM rig can run 27 billion parameter model at 32 tokens per secondTom's Hardware