Baidu AI Cloud's Baige team launched LoongForge, an open-source training framework on GitHub, announced via Show HN. It targets faster, cheaper training of mainstream LLMs, VLMs, diffusion, and embodied models, making it relevant to practitioners looking to cut training costs across modalities.
LoongSage, a production-grade reinforcement learning framework for LLMs, appeared on GitHub with validated training recipes. It targets high-efficiency RL post-training, giving practitioners a ready-to-use option for tuning large language models.
LoongSage, a production-grade reinforcement learning framework for LLMs, appeared on GitHub with validated training recipes. It targets high-efficiency RL post-training, giving practitioners a ready-to-use option for tuning large language models.
OpenArch: PyTorch implementations of modern LLM architectures released on GitHub
OpenArch: PyTorch implementations of modern LLM architectures released on GitHub
xllm: lightweight infrastructure for express LLM pre-training
xllm: lightweight infrastructure for express LLM pre-training
Three papers from July 2026 collectively advance on-policy distillation (OPD) for LLMs. One introduces a 'delta signal' reward that compares teacher and base model outputs to improve token-level supervision. Another systematically studies OPD dynamics, finding it acts as an exploration catalyst and that prompt diversity matters more than per-problem sampling. The third presents EasyOPD, a unified framework built on verl to standardize fragmented OPD implementations, improving reproducibility and extensibility.
Three papers from July 2026 collectively advance on-policy distillation (OPD) for LLMs. One introduces a 'delta signal' reward that compares teacher and base model outputs to improve token-level supervision. Another systematically studies OPD dynamics, finding it acts as an exploration catalyst and that prompt diversity matters more than per-problem sampling. The third presents EasyOPD, a unified framework built on verl to standardize fragmented OPD implementations, improving reproducibility and extensibility.
Horus-runtime is a tool that lets you train a small language model from scratch, aimed at developers and researchers who want to understand LLM training or build custom small models. It provides a runtime environment for training, likely with a focus on simplicity and educational value.
Horus-runtime is a tool that lets you train a small language model from scratch, aimed at developers and researchers who want to understand LLM training or build custom small models. It provides a runtime environment for training, likely with a focus on simplicity and educational value.