HARDWARE·5 days agoSingaporean Startup’s Gelix 1 AI Chip With 20-Core CPU, 273GB/s Bandwidth, Said To Beat M4 Pro In AI Inference, Can Run Up To 100B LLMs While Using Up A Mac mini’s FootprintWccftech
HARDWARE·6 days agoA Modder’s RTX 4080 Was Enough to Play AAA Games, But Not to Run LLMs, So He Integrated NVIDIA’s Tesla V100 at a Throwaway Price to Run 27B AI ModelsWccftech
HARDWARE·6 days agoAI enthusiast adds Nvidia Tesla V100 as loud as a lawnmower to gaming PC for $266 — 32GB VRAM rig can run 27 billion parameter model at 32 tokens per secondTom's Hardware