Community directory previewDeepSeek Harness is in developer preview
DE

dsh-eval

PluginConfirmed pluginCommunity

hccccc01333/dsh-eval · updated 18 days ago

Installation

dsh plugin --profile eval add dsh-eval
dsh plugin --profile web add github:hccccc01333/dsh-eval

Plugins in this repository

  • dsh-evalv0.3.0

    Agent evaluation platform: benchmark YAML, headless run orchestration, trace-based metrics, and run reports

    Official core packages (6)
    • @deepseek-ai/cordis^4.0.1shared
    • @deepseek-ai/dsh-cmdline^0.1.0-rc.6shared
    • @deepseek-ai/dsh-invariants^0.1.0-rc.6shared
    • @deepseek-ai/dsh-llm^0.1.0-rc.6shared
    • @deepseek-ai/dsh-llm-retry^0.1.0-rc.6shared
    • @deepseek-ai/dsh-session^0.1.0-rc.6shared

Paths are pinned to commit 47f39d7c1453

Overview

Agent evaluation platform for DeepSeek Harness: benchmark YAML, headless dsh orchestration, trace-based metrics, LLM judge, paired A/B, keyless replay, and cross-harness import.

Repository check result

Results are bound to the listed commit and cover only static checks run by this registry. The Evidence Score measures reviewable information; it is not a compatibility percentage or a security guarantee.

Static repository check

High risk
Checked commit
47f39d7c1453
Evidence Score
76/100
Static risk
High risk
Files scanned
2
Findings
1

Evidence breakdown

Source provenance22/25
Install documentation25/25
Maintenance12/20
Compatibility evidence14/20
Security signals3/10

Compatibility confidence: Limited

Install-time scripts (1)
  • packages/eval/package.json#prepackpnpm run build
Findings (1)
Not run
  • Dependency advisory database scan
  • Installation execution test
  • Runtime behavior verification

Scanner 1.0.0 · Scorer 1.0.0