Cerebras hits 969 tokens/second on Llama 3.1 405B, 75x faster than AWS Claims industry-low 240ms latency, twice as fast as ...
we're extending our lead to Llama 3.1 405B – delivering 969 tokens per second. By running the largest models at instant speed ...