Another great open-source LM from China: Kimi2 has 1000 billion parameters with only 32 billion active
Another great open-source LM from China: Kimi2 has 1000 billion parameters with only 32 billion active

huggingface.co
moonshotai (Moonshot AI)

Another great open-source LM from China: Kimi2 has 1000 billion parameters with only 32 billion active
moonshotai (Moonshot AI)
And deepseek arch! This is a great thing, it means its compatible instead of reinventing the wheel.
Seems like a prime candidate for distillation.