DNA News

Brief, mostly signal

DeepSeek V4.1-Flash-1017 cuts per-task cost on agent benchmarks

Vendor-reported 77.0% on DeepSWE at under $0.20 per task, versus $0.50 for the prior version. Weights are open on Hugging Face and ModelScope.

Read the source at egamers.io

What the research found

DeepSeek V4.1-Flash-1017 scores 77.0 on DeepSWE versus 74.2 for the prior version at under $0.20 per task versus about $0.50; these are vendor-only figures, tuned for DeepSeek Harness v0.2.1-rc.1 or later, and weights are open on Hugging Face and ModelScope.

Claims and how well the evidence supports them

  1. DeepSeek V4.1-Flash-1017 scores 77.0 on DeepSWE versus 74.2 for the prior version 98%
  2. Cost per task is under $0.20 versus about $0.50 for the prior version 97%
  3. Results are vendor-reported and tuned for DeepSeek Harness v0.2.1-rc.1 or later 96%

Evidence

Actionability rated medium.