Xiaomi released MiMo-V2.6, marketing it as multimodal 'frontier intelligence, all the modalities, built in public,' with a launch page at mimo.xiaomi.com/mimo-v2-6. The company says the model's total training cost was $3.5M. It also ships a live 'benchmaxxing' dashboard for tracking benchmark performance.
Xiaomi's MiMo-V2.6 explainer: omni-modal model family built for self-improvement via reinforcement learning
Xiaomi's MiMo-V2.6 explainer: omni-modal model family built for self-improvement via reinforcement learning
A technical report introduces the MiMo-V2.6 series, an omni-modal model family trained by scaling reinforcement learning compute along batch size, environment diversity, and grader compute. The team built mid-training on multimodal corpora, froze the MoE router, and added multi-layer defenses against reward hacking to keep large-scale RL stable. Training dynamics, RL environments, and the RL framework are open-sourced for reproduction.
A technical report introduces the MiMo-V2.6 series, an omni-modal model family trained by scaling reinforcement learning compute along batch size, environment diversity, and grader compute. The team built mid-training on multimodal corpora, froze the MoE router, and added multi-layer defenses against reward hacking to keep large-scale RL stable. Training dynamics, RL environments, and the RL framework are open-sourced for reproduction.
Community watches Xiaomi MiMo 2.6 live training dashboard
Community watches Xiaomi MiMo 2.6 live training dashboard
Xiaomi's MiMo team diagnosed and fixed a tool-call repetition issue in the MiMo-V2.6 model series, which had caused repeated identical tool calls burning context and stalling tasks. The root cause was a reward blind spot in scaling RL, fixed via a lightweight repetition-specialized RL teacher merged at ~4% of a full retrain's cost.
Xiaomi's MiMo team diagnosed and fixed a tool-call repetition issue in the MiMo-V2.6 model series, which had caused repeated identical tool calls burning context and stalling tasks. The root cause was a reward blind spot in scaling RL, fixed via a lightweight repetition-specialized RL teacher merged at ~4% of a full retrain's cost.
Xiaomi has uploaded the official DFlash weights for MiMo-V2.5-DFlash to Hugging Face. The model has 300B+ parameters and runs at 8-10 tokens/second on 2x24GB cards with offloading; DFlash could double that speed. The MTP head was shared but does not work yet.
Xiaomi has uploaded the official DFlash weights for MiMo-V2.5-DFlash to Hugging Face. The model has 300B+ parameters and runs at 8-10 tokens/second on 2x24GB cards with offloading; DFlash could double that speed. The MTP head was shared but does not work yet.