execution-plan/weeks/week-22-protein-validation-and-baselines/commitment.md Β· UPDATED 2026-09-16
Week 22 commitment
3 parts433 words
6 checkboxes β tick them, they save to the file
State: UNCONFIRMED. Owner: Peter Ciancaglini. Specification
Start date: not set. End date: not set. Available hours: confirm (planned ceiling 10). Primary outcome: protein validation and baselines. Minimum that keeps the next gate alive: Produce protein-split-audit.md and one held-out baseline score with no family leakage; an unfavorable score is still evidence.
0101
Deliverables to commit
01
Deliverables to commit
-
protein-split-audit.md: Produce protein-split-audit.md and one held-out baseline score with no family leakage; an unfavorable score is still evidence. -
protein-comparison.csv: MAE/RMSE/rank metrics, N and group-aware uncertainty accompany results. -
protein-uncertainty.md: A held-out table exists whether or not the stronger model wins. - Bounded learning exercise and personal teach-back.
- Evidence-backed branding and opportunity pack.
- Sunday review and next physical action.
0202
Proposed calendar
02
Proposed calendar
| Day | Minutes | Physical action / outcome | Actual slot | Done |
|---|---|---|---|---|
| Mon | 90 | Define family/sequence-cluster grouped splits and keep homologous proteins out of independent partitions; document thresholds and counts. | Not set | [ ] |
| Tue | 90 | One concise applied note, a worked decision/example and unresolved questions. | Not set | [ ] |
| Wed | 90 | Evaluate heads against simple sequence/composition and published baselines where targets and splits are comparable. Last ten minutes: optional note. | Not set | [ ] |
| Thu | 90 | One concise applied note, a worked decision/example and unresolved questions. Include relevant founder-paper work within this block. | Not set | [ ] |
| Fri | 90 | Add calibrated intervals where assumptions are appropriate and record confounding and out-of-distribution failure cases. | Not set | [ ] |
| Sat | 90 | Resolve critical spillover; long-form draft if due; sandbox only if done. | Not set | [ ] |
| Sun | 60 | Build log, evidence, gap review, next actions. | Not set | [ ] |
0303
Dependency and capacity check
03
Dependency and capacity check
- Missing essential inputs: not yet inspected.
- Human/external dependency, owner and expected date: not yet inspected.
- Week-specific constraint: Published FLIP and custom family-split scores cannot be ranked as apples-to-apples without reproducing the same task. No guaranteed conformal coverage under distribution shift.
- Existing session authorization for external actions or spending: not assessed; local planning only at scaffold creation.
- Scope to cut first: optional polish/additional examples; preserve scientific validity.
- If the forecast exceeds available time: record a concrete reduced scope or revised delivery proposal before committing.
Peter's commitment / adjustments: pending. Reviewing model and date: pending.