An independent research project published AkbasCore 2.0, an inference-time activation-steering framework using Damped Resonance Alignment and multi-axis orthogonal steering, with no weight changes. Tests 88 (C++ CPU kernel) and 89 (first GPU-native CUDA kernel) ran Qwen2.5-7B-Instruct on a single free-tier T4 with full raw logs and one-click Colab reproduction. The GPU kernel matched the CPU kernel within 4.66ร10โปยนโฐ on synthetic checks, but throughput was unchanged, attributed to a CUDA_LAUNCH_BLOCKING=1 debugging setting.
AkbasCore is an open-source tool that lets users steer a frozen Qwen2.5-7B model without fine-tuning. It reads the model's internal activations to identify opposing directions for behavioral dimensions (e.g. detailed vs brief, creative vs conservative), injects steering vectors live during inference, and visualizes activity across all 28 layers. It targets developers wanting interpretability and behavior control without touching model weights.
AkbasCore is an open-source tool that lets users steer a frozen Qwen2.5-7B model without fine-tuning. It reads the model's internal activations to identify opposing directions for behavioral dimensions (e.g. detailed vs brief, creative vs conservative), injects steering vectors live during inference, and visualizes activity across all 28 layers. It targets developers wanting interpretability and behavior control without touching model weights.
In TEST 85, the AkbasCore 1.2 Damped Resonance Alignment (DRA) steering sweep was applied to Qwen2.5-1.5B, revealing no degradation threshold, unlike TinyLlama in TEST 84. The result suggests architectural differences in how the two models respond to steering.
In TEST 85, the AkbasCore 1.2 Damped Resonance Alignment (DRA) steering sweep was applied to Qwen2.5-1.5B, revealing no degradation threshold, unlike TinyLlama in TEST 84. The result suggests architectural differences in how the two models respond to steering.
A new arXiv paper argues that activation steering layers should be chosen per input instance rather than fixed globally per task, and presents a deployable method for per-instance, multi-layer selection. On two 8B open-weight models and six binary persona traits, the best layers vary per instance, and no fixed global layer set recovers the per-instance benefit on most trait-model pairs.
A new arXiv paper argues that activation steering layers should be chosen per input instance rather than fixed globally per task, and presents a deployable method for per-instance, multi-layer selection. On two 8B open-weight models and six binary persona traits, the best layers vary per instance, and no fixed global layer set recovers the per-instance benefit on most trait-model pairs.
An arXiv paper introduces IDEEA, a training-free steering method that aligns LLMs by injecting activation biases at inference time, avoiding costly weight updates like SFT or RL. Unlike existing training-free methods that apply one fixed direction to all inputs, IDEEA adapts steering to each input via activation cluster matching.
An arXiv paper introduces IDEEA, a training-free steering method that aligns LLMs by injecting activation biases at inference time, avoiding costly weight updates like SFT or RL. Unlike existing training-free methods that apply one fixed direction to all inputs, IDEEA adapts steering to each input via activation cluster matching.
A new arXiv paper proposes Reflection Steering, a training-free framework that disentangles reflection-related activations from reasoning in LLMs to control reflection-associated computation. This aims to reduce wasted reasoning tokens and latency when reflection merely re-checks established results, improving the accuracy-efficiency trade-off.
A new arXiv paper proposes Reflection Steering, a training-free framework that disentangles reflection-related activations from reasoning in LLMs to control reflection-associated computation. This aims to reduce wasted reasoning tokens and latency when reflection merely re-checks established results, improving the accuracy-efficiency trade-off.