GPT

You Are

you are running verifier-aware SSD; track separately.) - Fine-tune: cross-entropy on (prompt, sampled completion) pairs; single epoch as the default; small LR (typical 1e-5 to 5e-5 for full FT, 1e-4 to 5e-4 for LoRA

Prompt text

Original English text. Replace placeholders with your own details.

you are
 running verifier-aware SSD; track separately.)
 - Fine-tune: cross-entropy on (prompt, sampled completion)
 pairs; single epoch as the default; small LR (typical
 1e-5 to 5e-5 for full FT, 1e-4 to 5e-4 for LoRA at rank 64+).
 - Mixing: optionally mix in a small share (5-20%) of the
 base pretraining or instruction data to anchor against
 format drift; declare the mix ratio.
 - Evaluation cadence: hold-out pass@1 and pass@k at the same
 temperature and decoding config as production, plus a frozen
 "anti-collapse" probe (see below).

3. Design the verifier-aware arm (parallel, optional)
 If unit tests, type checkers, or differential testers exist for
 the task family, run a parallel arm:
 - Same sampling step.
 - Filter samples that pass the verifier (or score above a
 calibrated threshold).
 - Same fine-tune step on the filtered set.
 This is a stronger recipe but is NOT the Apple minimal-recipe
 result. Report both arms separately and let the team choose on
 the accuracy-per-GPU-hour Pareto.

4. Pre-declare the anti-collapse battery
 SSD's failure mode is silent: the model's outputs become more
 uniform, more verbose, more single-style, or simply lower-
 entropy. Declare BEFORE training:
 - Self-BLEU or n-gram repetition rate on a held-out generation
 probe; alert if it rises > 10% vs base.
 - Output length distribution (median, p95); alert if median
 length drifts > 25%.
 - Diversity-at-k: pass@k for fixed k; alert if pass@k drops
 while pass@1 rises (mode collapse onto a single mode).
 - Comment / docstring style probe: structured probe set; alert
 on systematic style drift.
 - Safety / refusal probe: declare which probe set; alert on
 refusal-rate drift or on unsafe-completion drift.

5. Design the round-2 decision gate
 Iterated SSD is tempting and often degenerate. Before running
 round 2:
 - Round 1 must lift pass@1 by at least N pp (declare N) on
 held-out, with non-overlapping CIs vs base.
 - The anti-collapse battery must have all probes within
 pre-declared tolerances.
 - Round 2 samples must come from the round-1 model AND a held-
 out prompt pool not used in round 1.
 - Round 2 evaluation must be on a fresh held-out slice.
 If any condition fails, stop. Do not chase round 2 because

Source & attribution

Awesome Prompts · Awesome Prompts

Source-listed license: GPL-3.0. Prompt text is preserved; titles and previews may be shortened for display. Source examples are not NexGateHub test results.

View original source ↗ · Source credits & licenses

Explore more prompts →