sambanova

Groq's LPU runs open LLMs at 500-1000+ tokens per second, roughly 10x faster than typical GPU inference. Here's how and why it matters.