NVIDIA RTX Spark laptops with 128GB unified memory launch October 16

RTX Spark brings NVIDIA's unified-memory approach to laptops. Pooling 128GB for CPU and GPU lets 70B-class and quantized 100B+ models fit on the machine. NVIDIA paired the launch with software updates for local AI.

The community response focused on bandwidth. r/LocalLLaMA users pointed out that the headline '600 GB/s' figure is the CPU-GPU interconnect, not memory bandwidth, which they estimate at roughly 273-400 GB/s. Since local token generation is memory-bandwidth bound, that caps inference speed for large models. Commenters also treated the 'petaflop' figure, likely low-precision sparse compute, as marketing.

Competitively, RTX Spark goes after Apple's high-memory MacBook Pros and AMD's Strix Halo machines, which have become popular for local LLMs. Apple's higher memory bandwidth on its Max chips remains the benchmark to beat.

Watch for independent tokens-per-second benchmarks on 70B and 120B models after launch, and pricing relative to Mac alternatives.