LiteRT.js runs machine learning models locally with CPU, GPU and emerging NPU acceleration, potentially reducing server infrastructure, inference charges and data movement.
Thinking Machines Lab released Inkling on July 15, 2026, its first model trained from scratch. The full weights ship under Apache 2.0. It is a 975B-parameter Mixture-of-Experts transformer with 41B ...