IQuest released IQuest-Q1 on Hugging Face, a Mixture-of-Experts model targeting agentic coding, reasoning, and multi-step tool use. The model has roughly 320B total parameters with an estimated 15B activated per token, making it a sparse MoE design aimed at efficient inference for agent workloads.
Meta released MobileMoE, a family of on-device Mixture-of-Experts language models with sub-billion active parameters, aiming to improve the quality-efficiency trade-off for mobile LLMs. The family includes three scales (S/M/L) with 0.3B/0.5B/0.9B active parameters, each available in Base, SFT, and QAT variants.
Meta released MobileMoE, a family of on-device Mixture-of-Experts language models with sub-billion active parameters, aiming to improve the quality-efficiency trade-off for mobile LLMs. The family includes three scales (S/M/L) with 0.3B/0.5B/0.9B active parameters, each available in Base, SFT, and QAT variants.
Tencent's Hy Team released Hy3, a 295-billion-parameter Mixture-of-Experts (MoE) language model with 21B active parameters and a 3.8B MTP layer. The model outperforms similar-sized models and rivals open-source models with 2-5x parameters. It is available on Hugging Face in full (598GB) and FP8 quantized (300GB) versions.
Tencent's Hy Team released Hy3, a 295-billion-parameter Mixture-of-Experts (MoE) language model with 21B active parameters and a 3.8B MTP layer. The model outperforms similar-sized models and rivals open-source models with 2-5x parameters. It is available on Hugging Face in full (598GB) and FP8 quantized (300GB) versions.
DeepSeek released V4.1-Flash, an open-weight (MIT) MoE model built on a new causal encoder-decoder architecture with asymmetric active parameters — 8B for input/prefill and 16B for output/decode. The release adds vision input, 1M-token context, and aggressive KV-cache compression, drawing independent praise as the new top open-weight model on cost-adjusted intelligence. It succeeds V4 Pro, which DeepSeek is quietly retiring, and several commentators argue the '0.1 version' label understates a fundamental architectural overhaul.
DeepSeek released V4.1-Flash, an open-weight (MIT) MoE model built on a new causal encoder-decoder architecture with asymmetric active parameters — 8B for input/prefill and 16B for output/decode. The release adds vision input, 1M-token context, and aggressive KV-cache compression, drawing independent praise as the new top open-weight model on cost-adjusted intelligence. It succeeds V4 Pro, which DeepSeek is quietly retiring, and several commentators argue the '0.1 version' label understates a fundamental architectural overhaul.
Dots Studio released dots3-note preview, the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and 512K token context support, capable of processing text, images, video, and audio while producing text outputs.
Dots Studio released dots3-note preview, the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and 512K token context support, capable of processing text, images, video, and audio while producing text outputs.
Motif Technologies has released Motif-3, a 314-billion-parameter Mixture-of-Experts language model with a 256K context window. The model is built from the ground up, suggesting a new architecture rather than a fine-tune. This release marks a significant entry in the large MoE model space.
Motif Technologies has released Motif-3, a 314-billion-parameter Mixture-of-Experts language model with a 256K context window. The model is built from the ground up, suggesting a new architecture rather than a fine-tune. This release marks a significant entry in the large MoE model space.