Search
-
Open-Source Strata Runs a 125-Billion-Parameter Model on a 12GB Gaming PC
…tars in 12 days; the trick is MoE sparse activation plus tiered expert offloading, up to 94 tokens/s on an RTX…
…tars in 12 days; the trick is MoE sparse activation plus tiered expert offloading, up to 94 tokens/s on an RTX…