Simon Willison
@simonw
What's the best open weight Mixture-of-Experts LLM for coding that fits in less than 60GB of RAM?
I think MoE might be necessary to get reasonably interactive speeds on the hardware I have access to - I want something faster than 12 tokens/second
I think MoE might be necessary to get reasonably interactive speeds on the hardware I have access to - I want something faster than 12 tokens/second
158 333