FastVideo released FastH3 V1, an open-weight distilled version of MiniMax H3 that runs in 4 steps using sparse distillation. The team reports a 14x speedup on NVIDIA Blackwell GPUs. The release gives practitioners a faster open option for H3-class models on current-generation hardware.
A new set of FP4 attention kernels optimized for NVIDIA's B300 GPU delivers up to 1.69x speedup compared to FlashAttention-4. The kernels leverage the B300's FP4 tensor core capabilities to accelerate attention computation, a key bottleneck in transformer inference.
A new set of FP4 attention kernels optimized for NVIDIA's B300 GPU delivers up to 1.69x speedup compared to FlashAttention-4. The kernels leverage the B300's FP4 tensor core capabilities to accelerate attention computation, a key bottleneck in transformer inference.
Drehbuchstudio Pro is an open-source prompt engine and reference anchor generator for multi-scene cinematic AI video generation. It uses LLM-assisted structured prompting to prevent token truncation from multi-line prompts and to anchor character and film-stock consistency across short cut windows. It targets creators using video diffusion models like MiniMax H3, Kling, Runway, and Maestro.
Drehbuchstudio Pro is an open-source prompt engine and reference anchor generator for multi-scene cinematic AI video generation. It uses LLM-assisted structured prompting to prevent token truncation from multi-line prompts and to anchor character and film-stock consistency across short cut windows. It targets creators using video diffusion models like MiniMax H3, Kling, Runway, and Maestro.
A new arXiv paper presents Sol-H3, a full-stack inference pipeline accelerating the 33-billion-parameter MiniMax-H3 open-source video diffusion model on both cloud (NVIDIA GB200) and edge (DGX Spark) hardware. It combines a two-stage cross-resolution generation scheduler with a Recursive Self-Improvement kernel-search loop, achieving up to 30x end-to-end speedup and 20% lower memory.
A new arXiv paper presents Sol-H3, a full-stack inference pipeline accelerating the 33-billion-parameter MiniMax-H3 open-source video diffusion model on both cloud (NVIDIA GB200) and edge (DGX Spark) hardware. It combines a two-stage cross-resolution generation scheduler with a Recursive Self-Improvement kernel-search loop, achieving up to 30x end-to-end speedup and 20% lower memory.
A new paper presents an attribution study that decomposes end-to-end speedups from quantized inference into runtime improvements and kernel/quantization gains. On four NVIDIA RTX A5000 GPUs with NVLink, the full stack achieves 2.58× speedup under greedy decoding, with runtime changes accounting for about two-thirds of the gain on a logarithmic scale.
A new paper presents an attribution study that decomposes end-to-end speedups from quantized inference into runtime improvements and kernel/quantization gains. On four NVIDIA RTX A5000 GPUs with NVLink, the full stack achieves 2.58× speedup under greedy decoding, with runtime changes accounting for about two-thirds of the gain on a logarithmic scale.
A blog post demonstrates that running Ollama on an integrated GPU (iGPU) instead of the CPU can yield up to 3x faster inference. The post provides practical guidance for configuring Ollama to leverage the iGPU, which is significant for users without discrete GPUs.
A blog post demonstrates that running Ollama on an integrated GPU (iGPU) instead of the CPU can yield up to 3x faster inference. The post provides practical guidance for configuring Ollama to leverage the iGPU, which is significant for users without discrete GPUs.