Search

1. Nvidia-Backed Reflection Debuts Beam, Its First Open-Weight Frontier Model: 501B Params, 23B Active

   

   …pen-weight model: a text-only MoE with 501B total params and 23B active per token, pretrained on 23.8T tokens …

   Stories·Oct 6

2. Open-Source Strata Runs a 125-Billion-Parameter Model on a 12GB Gaming PC

   

   …tars in 12 days; the trick is MoE sparse activation plus tiered expert offloading, up to 94 tokens/s on an RTX…

   Stories·Oct 5