Tencent's Hy4 Preview jumps to 770B parameters and a 1M-token context
Tencent released Hy4 Preview, an open-weight text-only model with 770B total parameters, 49B active per token, and a 1M-token context — a 1.56TB download that more than doubles July's Hy3 at 295B total, 21B active, and 256K context. Open weights plus OpenRouter serving put a model at this scale within reach as a download rather than an API-only product, though 1.56TB keeps self-hosting to those with a large GPU cluster.
Source: simonwillison.net ↗
770B total parameters, 49B active parameters, 1M token context window, 1.56TB on Hugging Face.
Simon Willison
Why this matters
- → 770B open-weight model now downloadable, not API-only
- → 1M-token context enables longer document processing
- → Chinese LLM progress narrows capability gap with Western labs
China's LLM scale race