How to size hardware for a local LLM: weights, KV cache and memory bandwidth, checked against official specs for 12 open models and 9 GPUs and Macs.
Some results have been hidden because they may be inaccessible to you
Show inaccessible resultsSome results have been hidden because they may be inaccessible to you
Show inaccessible results