NoFOMO
Search 中EN Sign in Sign up

Peaked at #8 Off the board

StepFun Open-Sources 600B Step 5 Model

StepFun open-weights its 600B MoE Step 5 Preview, with 1M context and long-horizon agent tasks.

Rank over time

Original post

NVIDIA AI @NVIDIAAI 349.2K followers

Congrats to StepFun on Step 5 Preview 🙌 Their largest open weights release. The 600B MoE model is built to handle agent tasks lasting up to 24 hours. The model runs at nearly 8K tokens/sec/GPU on NVIDIA GB300 using NVFP4. NVP4 checkpoint: https://t.co/poBcZXeWqY Deploy with @SGL_project - https://t.co/2iE8ytEk50  or @vLLM_project - https://t.co/PedItg9OR4 Post-train with NeMo Automodel: https://t.co/KxNt53Sb8k Run it with NVIDIA NIM using a single command: https://t.co/UOWllHNEMWQuoting @StepFun_ai: Step 5 Preview is now open weights. BF16 and FP8 weights are live on Hugging Face and ModelScope, together with our technical blog. • Sparse MoE: 600B total, 27B active per token • 1M-token context window • Native text and vision input • Built for long-horizon agentic work: coding, software engineering, professional knowledge work and finance Frontier intelligence, open weights. Build what's
Post image
269likes 24reposts 23replies 11.9Kviews

View on X Save

What others are saying

1 more
  1. vLLM @vllm_project 39

    vLLM announces Day-0 support for Step 5 Preview, covering sparse attention, MoE, multi-token prediction and vision across Blackwell and Hopper.

    View on X

Discussion 0

No comments yet. Start the conversation.

Suggest a source

Is there a first-hand source we're missing, or a topic we should watch? Tell us. Once approved, everyone's board covers it.

@username or profile link