Search

Companies

Topics

Filters

colibri Hits GitHub Trending: Pure-C Engine Runs a 744B Model on Ordinary PCs

…footprint of a 744B-parameter MoE model down to about 9.9 GB, so a computer with 8 GB of RAM can start such a …

Flash·Oct 12
Open-Source Strata Runs a 125-Billion-Parameter Model on a 12GB Gaming PC

…tars in 12 days; the trick is MoE sparse activation plus tiered expert offloading, up to 94 tokens/s on an RTX…

Stories·Oct 5