Isaac Rehg

With a new generation of data center accelerator hardware and using optimization techniques such as KV cache compression and speculative decoding, we’ve made large language model (LLM)

Isaac Rehg and Jesse Kipp

We are thrilled to give developers around the world the ability to build AI applications with Meta Llama 3 using Workers AI. We are proud to be a launch partner with Meta for their newest 8B Llama 3 model

Michelle Chen, Davina Zamanzadeh, Isaac Rehg, and Nikhil Kothari

Today we’re excited to announce that we’ve added the Mistral-7B-v0.1-instruct to Workers AI

Jesse Kipp and Isaac Rehg