Releases·Model Release
SupraLabs releases SupraGDN-5M, a 5M-parameter GatedDeltaNet trained on 2B tokens
The SupraGDN team released SupraGDN-5M on r/LocalLLaMA, a 5M-parameter GatedDeltaNet (GDN1) model trained on 2B tokens. The post claims it competes with other community small models despite training on much less data. It matters to practitioners exploring efficient linear-attention architectures at extreme small scale.
20 engagement1 sourceThu, Sep 3, 2026, 02:37 PM
AI Overview
- SupraLabs released SupraGDN-5M, a tiny GatedDeltaNet (GDN1) model trained on 2B tokens, available on Hugging Face
- SupraLabs claims SupraGDN-5M nearly matches community models trained on much more data, crediting the GDN architecture
- SupraLabs teased a Supra3-family of upcoming models
Related
Releases·Model Release
SupraBrain-50M-v0.1 released: hybrid linear-attention LM trained on 5B tokens
SupraBrain-50M-v0.1 is a new hybrid language model combining Gated DeltaNet linear recurrence, Sliding-Window Attention, and Surprise-Gated updates. Despite training on only 5B tokens versus 20B for Supra-Base-50M, it achieves nearly comparable performance.
SupraBrain-50M-v0.1 is a new hybrid language model combining Gated DeltaNet linear recurrence, Sliding-Window Attention, and Surprise-Gated updates. Despite training on only 5B tokens versus 20B for Supra-Base-50M, it achieves nearly comparable performance.
45 engagement1 sourceredditMon, Aug 3, 2026, 08:49 AM
Releases·Model Release
SupraLabs releases Supra2-Medium-Base, a 25M-parameter Qwen3 model
SupraLabs released Supra2-Medium-Base, a 25M-parameter model built on the Qwen3 architecture and trained from scratch on a new rig with RTX 5060 Ti 16GB and RTX 5060 8GB. The model reportedly competes with their previous 50M-parameter Supra-50M-Base in benchmarks, despite being half the size. It is a base model only; an instruction-tuned version may follow.
SupraLabs released Supra2-Medium-Base, a 25M-parameter model built on the Qwen3 architecture and trained from scratch on a new rig with RTX 5060 Ti 16GB and RTX 5060 8GB. The model reportedly competes with their previous 50M-parameter Supra-50M-Base in benchmarks, despite being half the size. It is a base model only; an instruction-tuned version may follow.
82 engagement1 sourceredditThu, Aug 20, 2026, 02:50 PM
Releases·Model Release
Developer releases BetterGPT-150M, a 152M-parameter model trained on 15B tokens
A developer released BetterGPT-150M, a compact causal language model with ~152 million parameters trained on 15B tokens. Benchmarks show it outperforms GPT-2 Small while matching models trained on larger token budgets. A live Hugging Face Space demo is available.
A developer released BetterGPT-150M, a compact causal language model with ~152 million parameters trained on 15B tokens. Benchmarks show it outperforms GPT-2 Small while matching models trained on larger token budgets. A live Hugging Face Space demo is available.
1 engagement1 sourceredditWed, Jul 29, 2026, 06:47 AM
Releases·Model Release
Aurora-80K releases: an 80K-parameter tiny language model
Aurora-80K, a language model with exactly 80,000 parameters, has been released on Hugging Face. It uses a factorized 4,096-token vocabulary to achieve compact representation. Benchmarks show Wikitext-2 BPB of 3.2902, BLiMP 52.31%, and Arc-Easy 26.05%.
Aurora-80K, a language model with exactly 80,000 parameters, has been released on Hugging Face. It uses a factorized 4,096-token vocabulary to achieve compact representation. Benchmarks show Wikitext-2 BPB of 3.2902, BLiMP 52.31%, and Arc-Easy 26.05%.
246 engagement1 sourceredditThu, Aug 20, 2026, 11:45 AM
Developments·Paper
Researcher publishes Silia neural network architecture paper and 0.5M-parameter model trained on Fineweb-edu
Srijan-Srivastava published a research paper on a new neural network architecture called Silia, along with a 0.5M-parameter model trained on 1B tokens of Fineweb-edu. The model and paper are available on Hugging Face and Zenodo.
Srijan-Srivastava published a research paper on a new neural network architecture called Silia, along with a 0.5M-parameter model trained on 1B tokens of Fineweb-edu. The model and paper are available on Hugging Face and Zenodo.
33 engagement1 sourceredditThu, Jul 23, 2026, 03:51 PM