I changed one llama.cpp flag, and my 8GB laptop GPU now runs a 35B model faster than I can read

The Quick Take
I changed one llama.cpp flag, and my 8GB laptop GPU now runs a 35B model faster than I can read XDA
Ground Level News gathers headlines from public news feeds. This page shows a short summary only; the full article and all rights belong to XDA.

