China's Moonshot AI launches Kimi K3.1 Pro; plans full model weights release by November

Chinese artificial intelligence company Moonshot AI has unveiled Kimi K3.1 Pro, a 3-trillion-parameter model featuring a 1-million-token context window. The launch includes a high-speed variant known as Kimi K3.1 Pro Highspeed, according to the Economic Times Tech.

SiliconANGLE reports that the new large language model is a post-trained upgrade of an algorithm released in July. The previous model, Kimi K3, consists of 896 individual neural networks and only activates 16 at once to reduce inference costs. SiliconANGLE notes that Kimi K3.1 Pro may utilize Kimi Delta Attention, a custom implementation of Gated DeltaNet technology designed to reduce RAM usage.

The company stated that the post-training workflow for this model used significantly more processing power than previous projects and utilized an upgraded post-training stack with automated quality checks. SiliconANGLE also reports that the model delivers competitive output quality in the area of 3D modeling.

Brief written by urgent.news from Economic Times Tech, SiliconANGLE — 2 reports on this story. Machine-written — may contain errors; check the original before relying on it.