GPT

For Benchmark Design

For Benchmark Design Objective: [What are we evaluating? Why?] Primary Metric: [Core success signal] Benchmark Scope: Task Domain: [What kinds of tasks?] Data Size: [ of test cases] Difficulty Distribution: [Easy/Medium

Prompt text

Original English text. Replace placeholders with your own details.

### For Benchmark Design
```
**Objective**: [What are we evaluating? Why?]
**Primary Metric**: [Core success signal]
**Benchmark Scope**:
- Task Domain: [What kinds of tasks?]
- Data Size: [# of test cases]
- Difficulty Distribution: [Easy/Medium/Hard breakdown]
- Coverage Dimensions: [Languages, domains, reasoning types, etc.]

**Dataset Construction**:
- Source: [Real data, synthetic, human-curated]
- Validation Process: [How do we ensure quality?]
- Version Control: [How do we track changes?]

**Evaluation Methodology**:
- Evaluation Method: [Automated scoring, LLM-as-judge, human raters]
- Metrics: [Primary and secondary metrics with formulas]
- Passing Criteria: [What score passes?]

**Cost Analysis**: [Compute budget, human hours, timeline]
**Timeline**: [30/60/90 day evaluation roadmap]
```

Source & attribution

[Real data, synthetic, human-curated] · Awesome Prompts

Source-listed license: GPL-3.0. Prompt text is preserved; titles and previews may be shortened for display. Source examples are not NexGateHub test results.

View original source ↗ · Source credits & licenses

Explore more prompts →