Releases·Tool Release
TNLearn: Open Source Python Package for Task-based Neurons Joins PyTorch Ecosystem
Researchers introduced TNLearn, an open-source Python package for building and training task-based neurons and networks, published on arXiv. The package automates construction of task-specific neurons, a paradigm the authors argue captures prior knowledge from task-related data, and it has joined the PyTorch ecosystem.
0 engagement1 sourceWed, Sep 23, 2026, 08:48 AM
AI Overview
- TNLearn, an open-source Python package, automates construction and training of task-based neurons and networks
- Task-based neurons customize neuron design per task, capturing prior knowledge from task-related data, unlike task-based architectures
- TNLearn is open-sourced on GitHub and has become a PyTorch ecosystem project, with online documentation, API reference, and examples
Entities
Related
Releases·Tool Release
ParaRNN open-sources PyTorch/Triton library for parallel training of non-linear RNNs via Newton scans
A developer open-sourced ParaRNN, a PyTorch/Triton library that parallelizes training of non-linear recurrent architectures (sLSTM, RWKV-7, CfC, Titans) across time using Newton-Raphson iterations mapped to associative prefix scans. It targets the historical bottleneck of slow sequential unrolls while preserving the O(1) inference advantage of non-linear RNNs. Reported speedups reach ~200x over sequential BPTT, making time-parallel training of such architectures practical on consumer GPUs.
A developer open-sourced ParaRNN, a PyTorch/Triton library that parallelizes training of non-linear recurrent architectures (sLSTM, RWKV-7, CfC, Titans) across time using Newton-Raphson iterations mapped to associative prefix scans. It targets the historical bottleneck of slow sequential unrolls while preserving the O(1) inference advantage of non-linear RNNs. Reported speedups reach ~200x over sequential BPTT, making time-parallel training of such architectures practical on consumer GPUs.
1 engagement1 sourceredditMon, Sep 7, 2026, 10:31 AM
Products·building
KernelMind AI - converts PyTorch operations into fused Triton GPU kernels
KernelMind AI is a tool that transforms standard PyTorch operations into fused OpenAI Triton GPU kernels, reducing VRAM memory round-trips for faster inference/training. The builder is soliciting feedback from Triton/CUDA engineers on operator fusion patterns, edge cases, and fallback heuristics. It targets ML engineers who manually fuse kernels in production.
KernelMind AI is a tool that transforms standard PyTorch operations into fused OpenAI Triton GPU kernels, reducing VRAM memory round-trips for faster inference/training. The builder is soliciting feedback from Triton/CUDA engineers on operator fusion patterns, edge cases, and fallback heuristics. It targets ML engineers who manually fuse kernels in production.
1 engagement1 sourceredditSat, Sep 5, 2026, 05:23 AM
Developments·Paper
Task-structured modularity emerges in artificial networks and aligns with brain architecture
Task-structured modularity emerges in artificial networks and aligns with brain architecture (Nature paper shared on Reddit)
Task-structured modularity emerges in artificial networks and aligns with brain architecture (Nature paper shared on Reddit)
2 engagement1 sourceredditSun, Oct 11, 2026, 06:00 AM
Releases·Tool Release
OpenArch – PyTorch implementations of modern LLM architectures
OpenArch: PyTorch implementations of modern LLM architectures released on GitHub
OpenArch: PyTorch implementations of modern LLM architectures released on GitHub
168 engagement2 sourceshackernews, redditMon, Sep 14, 2026, 07:55 AM
Releases·Tool Release
OpenLanguageModel: A Readable PyTorch Library for Small Language Model Pretraining
OpenLanguageModel (OLM) is an open-source PyTorch library designed for building and pretraining small language models with transparent, readable code. The library uses modular components like Block, Residual, Repeat, and Parallel to make model architectures explicit, and supports moving from teaching notebooks to full pretraining runs. It integrates tokenizers, datasets, optimization, mixed precision, and hardware-aware execution for CPU, single-GPU, and multi-GPU setups.
OpenLanguageModel (OLM) is an open-source PyTorch library designed for building and pretraining small language models with transparent, readable code. The library uses modular components like Block, Residual, Repeat, and Parallel to make model architectures explicit, and supports moving from teaching notebooks to full pretraining runs. It integrates tokenizers, datasets, optimization, mixed precision, and hardware-aware execution for CPU, single-GPU, and multi-GPU setups.
0 engagement1 sourcearxivSat, Jul 18, 2026, 06:55 AM