FLUX 3 Image Klein runs in 8GB, but not with the upsampler it wants
Black Forest Labs says Klein runs on 8GB RTX cards. The INT8 generator and text encoder files already total 10.69 GB, and the 9B prompt upsampler BFL recommends adds 6.72 ...
Tag: self-hosting
Beam’s weights are out, and vLLM support is still an open pull request
Reflection published Beam 1.0 weights on 16 October: 1,002.68 GB in BF16, 293.65 GB in NVFP4, plain Apache 2.0. Transformers 5.20.1 loads it; the vLLM day-0 support is an unmerged ...
Qwen3.8-Flash-Next runs 6B active and weighs 173 GiB
Somebody on the team read "6B activated" and asked which of our boxes could run it. Fair question, wrong number: the FP8 checkpoint for Qwen3.8-Flash-Next is about 173 GiB of ...
Inkling-Small out-codes the 975B flagship at 276B
Two weeks ago we said the honest problem with Inkling was that you probably couldn't run it. Two terabytes of VRAM will do that. Thinking Machines seems to have agreed, ...
Laguna S 2.1: 118B open weights on one DGX Spark
Somebody forwards you the headline: an open model that beats rivals ten times its size. Then you open Poolside's own benchmark table and Kimi K3 is sitting there at 88.3 ...
The Kimi K3 weights are 1.4 TB, and that is the catch
Somebody on your team is going to ask whether you can just host Kimi K3 yourselves. Short version: the weights land by July 27, and they weigh roughly 1.4 terabytes. ...
Fireworks raised $1.5B, and a raise ships no code
You read our piece on Qwen 3.8, nodded at the open weights, then hit the same wall we always do. Great, now where do you actually run a near trillion-parameter ...
Inkling is a 975B open model that loses benchmarks on purpose
Mira Murati's lab spent about nine months in near silence, and on July 15 it shipped weights instead of a waitlist. Inkling is a 975B mixture-of-experts model under Apache 2.0, ...
Is Tencent’s 295B Hy3 really free?
Another giant model landed on Hugging Face, and this one is worth stopping for. On July 6 Tencent open-sourced Hy3, a 295B mixture-of-experts model under a plain Apache 2.0 license, ...