#edge-inference

1 articles

01 ·Agents·★ MEMBER·PAPER·13 min read Paper Explained: FreeToken — Treating Your Own PC as a Single Elastic Inference Platform FreeToken is an edge-native serving system for frontier-scale MoE models on personal hardware. Its centerpiece is a q* policy that decides how many missed experts to ship over PCIe versus execute in place on the CPU — using nothing but two measured bandwidths.