Installation
dsh plugin --profile eval add dsh-evalCopy
dsh plugin --profile web add github:hccccc01333/dsh-evalCopy
Plugins in this repository dsh-eval v0.3.0 ✓
Agent evaluation platform: benchmark YAML, headless run orchestration, trace-based metrics, and run reports
Official core packages (6) @deepseek-ai/cordis^4.0.1 shared @deepseek-ai/dsh-cmdline^0.1.0-rc.6 shared @deepseek-ai/dsh-invariants^0.1.0-rc.6 shared @deepseek-ai/dsh-llm^0.1.0-rc.6 shared @deepseek-ai/dsh-llm-retry^0.1.0-rc.6 shared @deepseek-ai/dsh-session^0.1.0-rc.6 shared Paths are pinned to commit 47f39d7c1453
Overview Agent evaluation platform for DeepSeek Harness: benchmark YAML, headless dsh orchestration, trace-based metrics, LLM judge, paired A/B, keyless replay, and cross-harness import.
Repository check result Results are bound to the listed commit and cover only static checks run by this registry. The Evidence Score measures reviewable information; it is not a compatibility percentage or a security guarantee.
Static repository check Sep 1, 2026, 5:40 AM High risk
Evidence Score 76/100
Static risk High risk
Files scanned 2
Findings 1 Evidence breakdown Source provenance 22/25
Install documentation 25/25
Maintenance 12/20
Compatibility evidence 14/20
Security signals 3/10
Compatibility confidence: Limited
Install-time scripts (1) packages/eval/package.json#prepackpnpm run build Findings (1) Not run Dependency advisory database scan Installation execution test Runtime behavior verification Scanner 1.0.0 · Scorer 1.0.0