Taalas’ silicon Llama achieves 17K tokens/sec per user, nearly 10X faster than the current state of the art, while costing 20X less to build, and consuming 10X less power. (taalas.com)
in technology@lemmy.ml from yogthos@lemmy.ml on 21 Feb 01:11
comments (0)