Peaked at #8 Off the board
StepFun Open-Sources 600B Step 5 Model
StepFun open-weights its 600B MoE Step 5 Preview, with 1M context and long-horizon agent tasks.
Original post
Congrats to StepFun on Step 5 Preview 🙌 Their largest open weights release.
The 600B MoE model is built to handle agent tasks lasting up to 24 hours.
The model runs at nearly 8K tokens/sec/GPU on NVIDIA GB300 using NVFP4.
NVP4 checkpoint: https://t.co/poBcZXeWqY
Deploy with @SGL_project - https://t.co/2iE8ytEk50 or @vLLM_project - https://t.co/PedItg9OR4
Post-train with NeMo Automodel: https://t.co/KxNt53Sb8k
Run it with NVIDIA NIM using a single command: https://t.co/UOWllHNEMWQuoting @StepFun_ai: Step 5 Preview is now open weights.
BF16 and FP8 weights are live on Hugging Face and ModelScope, together with our technical blog.
• Sparse MoE: 600B total, 27B active per token
• 1M-token context window
• Native text and vision input
• Built for long-horizon agentic work: coding, software engineering, professional knowledge work and finance
Frontier intelligence, open weights. Build what's
What others are saying
1 more-
vLLM announces Day-0 support for Step 5 Preview, covering sparse attention, MoE, multi-token prediction and vision across Blackwell and Hopper.
View on X
Discussion 0
Sign up Sign in to join the discussion
No comments yet. Start the conversation.