TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI
We present Turing-20B-A2B, a 20B-parameter Mixture-of-Experts language model that activates approximately 2B parameters per token, designed for long-context and latency-sensitive physical AI applications. The model adopts Quantile Routing in a dynamic top-k configuration, enabling token-adaptive expert allocation while maintaining balanced expert utilization and a controlled average compute…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
