GPT

For ML System Design

For ML System Design Use Case: [What problem are we solving?] Business Metric: [What does success look like? Revenue, retention, user satisfaction?] Constraints: Latency SLA: [ms] Throughput: [requests/second] Budget:

Prompt text

Original English text. Replace placeholders with your own details.

### For ML System Design
```
**Use Case**: [What problem are we solving?]
**Business Metric**: [What does success look like? Revenue, retention, user satisfaction?]

**Constraints**:
- Latency SLA: [ms]
- Throughput: [requests/second]
- Budget: [$]
- Data Available: [# records, quality]

**Model Selection**:
- Approach: [Classical ML, DL, LLM, Ensemble]
- Candidate Models: [Model A, Model B, Baseline]
- Expected Performance: [Accuracy estimate, latency, cost]

**Data Pipeline**:
- Data Source: [Origin, format, volume]
- Features: [Key feature list, engineering approach]
- Preprocessing: [Cleaning, normalization, handling]
- Versioning: [Data versioning strategy]

**Training Strategy**:
- Train/Val/Test Split: [Temporal or random, proportions]
- Hyperparameters: [Initial ranges, optimization approach]
- Regularization: [Dropout, L1/L2, early stopping]
- Distributed Training: [Single machine or distributed?]

**Inference**:
- Serving Framework: [TF Serving, vLLM, custom]
- Deployment Model: [Batch, real-time, edge]
- SLAs: [Latency, throughput, availability]

**Monitoring**:
- Key Metrics: [What are we tracking?]
- Drift Detection: [Data drift, model drift thresholds]
- Retraining Cadence: [Weekly, monthly, on-demand?]

**Rollout Plan**: [Canary %, shadow traffic, rollback conditions]
**Success Criteria**: [Timeline to reach SLA, business metric targets]
```

Source & attribution

[Origin, format, volume] · Awesome Prompts

Source-listed license: GPL-3.0. Prompt text is preserved; titles and previews may be shortened for display. Source examples are not NexGateHub test results.

View original source ↗ · Source credits & licenses

Explore more prompts →