Read the week in plain language, refresh the foundations, follow each challenge step by step, and check what evidence to keep. Includes worked examples, answer keys and prompts for visual study resources.
Implement schema-constrained extraction with provenance and fake/API/local adapters; smoke-test five development papers and log model/prompt versions. Acceptance: Invalid JSON, absent values and unsupported evidence fail visibly.
Implement field-specific precision/recall/F1, numeric unit/tolerance checks and provenance correctness on frozen paper-level splits. Acceptance: Each field has counts and scoring rules; development scores are not called held-out performance.
Inspect five worst fields, make one development-only revision, compare before/after, and choose a documented per-field floor and cost budget for scale-up. Acceptance: Unchanged held-out data and a backend decision with quality/cost evidence are recorded.
Checklist, learning assessment, gate status, shortfalls, next actions and carryover
Notes on artifact states
These filenames are outputs to prepare during this week's execution; this scaffold does not claim they already exist. Drafts and measured results have different states. Technical code/data stay in the canonical project repository and are referenced from these coordinating files.
During preparation, future measured tables get column definitions, input requirements and run instructions with PENDING status. During execution, replace pending values only with measured outputs. Do not create realistic-looking fake evidence.
▦
600 MINUTES MAXIMUM
Seven-day plan
Monday90 min· 1 card, 30 min
Target. Implement schema-constrained extraction with provenance and fake/API/local adapters; smoke-test five development papers and log model/prompt versions. Stop when: Invalid JSON, absent values and unsupported evidence fail visibly.
Target. MIT OCW 7.016 Introductory Biology (Fall 2018) lectures on protein structure and enzymes — ocw.mit.edu (search 7.016); Khan Academy "Enzyme kinetics" Produce: Michaelis-Menten fitted in Python to a public dataset
Target. Implement field-specific precision/recall/F1, numeric unit/tolerance checks and provenance correctness on frozen paper-level splits. Stop when: Each field has counts and scoring rules; development scores are not called held-out performance. Reserve the last 10 minutes for the optional Wednesday note.
Target. Inspect five worst fields, make one development-only revision, compare before/after, and choose a documented per-field floor and cost budget for scale-up. Stop when: Unchanged held-out data and a backend decision with quality/cost evidence are recorded.
Target. Resolve the earliest critical spillover or dependency. Prepare any long-form publication draft from existing figures here if needed. Sandbox only after commitments are met.
Target. 20 min build-log draft/publication when authorized; 5 min evidence/checklist; 20 min source-grounded gap review; 15 min next week's six physical actions.
Block ritual: read your next action → start the 90-min timer → open one file. Close: write tomorrow's action and one log line.
Feels pointless? Does today's Done when need it? No → skip it and log it. Yes → let AI do the boring part, you review. Still stuck → the smallest version in 25 minutes. Pulled into a rabbit hole? Write it in Parked thoughts and save it for Saturday.
The model must turn these into exact physical actions using the observed files and available inputs. Each 90-minute block includes start/stop rituals. All calls, posts, debugging, reading and exercises consume this same capacity.
The source lists more material than necessarily fits. Select exact excerpts for the learning objective and park the remainder; no full-course completion requirement.
◎
WHAT TO WATCH, READ AND RUN
Materials for this week
Now the junior analyst meets the answer key. You build extract/agent.py with two brains, a frontier model through the API and a local Qwen on your 3050, plus a fake brain for tests. Then you do the thing that distinguishes an AI scientist from an AI enthusiast: you measure it per field, not as one flattering average. It will be very good at "organism" and bad at "working volume", and that unevenness is the finding. …
In the plan's running order: each card says which block it belongs to and what has to come
before it. The seven-day plan lists the same cards under the day that owns them.
Zheng et al. (2023), "Judging LLM-as-a-judge with MT-Bench and Chatbot Arena"
Monday build block
· Read it inside Monday's build block
Build-block reading · Zheng et al. (2023), "Judging LLM-as-a-judge with MT-Bench and Chatbot Arena", NeurIPS Datasets & Benchmarks, sections 1-3 (judge biases you must avoid in week 14)
Tutorial on "information extraction" in the docs: define a signature, a metric (your F1), and let an optimizer improve the prompt. Only after your manual baseline exists
This week delivers the three concrete artifacts below and the supporting learning/branding/opportunity pack. The scientific or commercial outcome follows the preserved source brief, while the acceptance checks make its evidence testable. The career objective is to turn this work into something a scientist, hiring manager or buyer can inspect.
Scientific/build priority: Implement schema-constrained extraction with provenance and fake/API/local adapters; smoke-test five development papers and log model/prompt versions.
Public/profile priority: Prepare per-field evaluation chart and one failure example with permissible source quotation.
Career/relationship/commercial priority: Show a narrow evaluation question to a domain reviewer; prepare feedback requests without implying validation already happened.
02
READ FIRST
Deeper walkthrough (v6)
Read v6 · Week 7 · The extraction agent, measured before Monday. It carries this week's v5 brief unchanged and adds the Welcome analogy, Learn it (▶ core and + deeper sources), Run it (repos with a 20-40 minute exercise), the NotebookLM kit and the mentor check below. Standing v6 rules: resource rules, NotebookLM protocol, chapter anatomy. v6 adds depth only; it does not change a goal, gate, output or the 600-minute cap, so this specification still governs execution.
Act II · Threads: B, M, FL · Next gate: 8
Where this week sits.
- ← From: week 5 schema, week 6 gold set, your Vara telemetry habits.
- → Feeds: week 8 (F1 table public), week 9 (you pick the cheapest backend that meets the F1 floor), week 14 (the calibrated judge for fuzzy fields), week 15 (M15 evaluation writing), week 34-35 (local vs cloud comparison for labdocs).
- ⟳ Returns in: Paper 1 Table 2 (per-field precision/recall/F1) and in every Loop Audit prototype.
Goals.
- 🎯 This week: agent extracts 5 papers with provenance; eval/score.py prints per-field P/R/F1 for 50 papers; one round of error analysis logged with before/after.
- 🏁 Next milestone: Gate 8.
- 🌟 Final: the method section reviewers of Paper 1 will test hardest.
Mentor check."I can read my own F1 table aloud, say why the worst field fails, and explain why tuning on the gold set is dangerous."
03
OPEN WHEN NEEDED
Required inputs and dependency check
Week 06: inspect its actual evidence and review; source/code artifacts must exist before the dependent task begins.
Inspect the actual canonical repository state, available data, existing figures and required human/external inputs. Never assume a previous week succeeded from its folder name.
Verify current resource links, versions, dataset rights and any live company/venue information before relying on them. Use source catalog; explicitly record inaccessible resources.
04
READ FIRST
Learning specification
Biology/domain unit
Source unit: B7 · Protein structure and enzyme kinetics
Material: MIT OCW 7.016 Introductory Biology (Fall 2018) lectures on protein structure and enzymes — ocw.mit.edu (search 7.016); Khan Academy "Enzyme kinetics"
Produce: Michaelis-Menten fitted in Python to a public dataset
Understanding check: You can fit Km and Vmax and say what they mean
During preparation, write one worked example connected to the week's actual task, one exercise with a separate answer key and five questions. Peter supplies answers; score explanation quality and flag misconceptions in QUESTIONS. Numeric/scientific conclusions require actual data or explicitly synthetic teaching values.
Produce: A simple Bayesian regression in PyMC or numpyro on titer data
Understanding check: You can read a credible interval
Use the prompt pack: P1 explanation ladder, P2 concept-to-project bridge and P3 quiz. Coding practice belongs within the allocated study/build block. Where the source asks for a favorable scientific result, substitute an honest measured comparison as explained below.
Founder/scientist paper
Select one verified founder/scientific-lead paper relevant to this week's domain. Use P11; save the question, method, numerical result with context, data workflow, three author questions and one connection sentence in founder-paper.md. Keep abstract-only access limitations explicit. On source weeks with no study, prioritize the commercial/submission task and log any skipped digest.
05
OPEN WHEN NEEDED
Branding and opportunity execution brief
Branding: Prepare per-field evaluation chart and one failure example with permissible source quotation.
Opportunity action: Show a narrow evaluation question to a domain reviewer; prepare feedback requests without implying validation already happened.
Use career asset contracts. Publish at most the agreed cadence; one figure and one supported number or admitted failure can support multiple drafts. In long-form weeks, prepare a 1,500–2,500-word article from existing evidence within the build/buffer allocation. In release/demo weeks, prepare a 60-second script: problem, input, command/action, result, limitation and proof link.
Verify individuals, jobs and affiliations at execution time. The GridX list and v4 company map are research seeds, not current facts. Do not reveal named company weaknesses or employer/client confidential information. Keep drafted/sent/replied/booked/held statuses separate. The planning request alone does not authorize external messages or publication; honor explicit authorization in the execution session.
06
OPEN WHEN NEEDED
Quality risks and week-specific constraints
The original gold set cannot be repeatedly tuned on and still serve as an untouched test set. Report prompt-development and final evaluation sets separately.
Apply the root scientific evidence contract: provenance; meaningful independent splits; no future-data leakage; baseline comparison; actual denominators/uncertainty; failed cases; human review where required. State whether data are simulated, public experimental, synthetic or partner-provided.
Keep source gates intact, and log scope/time conflicts in review. Missing people, money, access or results must not be replaced with invented evidence. Reduce optional polish first. A specific essential external dependency stays pending while independent preparation continues.
07
READ FIRST
Completion and gate review
This is an enabling week. Its deliverables feed the next scheduled gate: 8. Complete the acceptance checklist below; do not promote reputation from a draft.
Wednesday artifact satisfies: Each field has counts and scoring rules; development scores are not called held-out performance.
Friday artifact satisfies: Unchanged held-out data and a backend decision with quality/cost evidence are recorded.
Study pack is prepared; Peter's actual learning/quiz result is recorded separately.
Branding and opportunity drafts use supported claims and the correct external-action state.
Reproduction or document checks are recorded with file/version references.
This week's special gate, if any, has real evidence or remains explicitly pending.
Review, root progress/log and the next physical action are updated.
08
READ FIRST
Minimum viable week and recovery
Source-preserving minimum: the F1 table, whatever it says.
Operational first step if stalled: open extraction-runbook.md, write the required inputs and produce the smallest checkable example in ten minutes. If a more urgent missing gate dependency controls the week, use the source minimum above.
If the full week does not fit, use P14: retain one gate-critical deliverable and one directly supporting study exercise; record what is skipped versus moved. Do not mark the original full gate passed merely because the minimum was completed. After a missed week, reforecast from actual evidence and avoid a second unexamined lost week.
09
OPEN WHEN NEEDED
Handoff to the next model
In review, state exactly what exists, what was verified, what Peter can now explain, which external events remain pending, where the canonical code/data live, and the next file/function or draft paragraph to touch. Link each fact to evidence. Carry scientific assumptions, split definitions and rights constraints forward explicitly.
10
OPEN WHEN NEEDED
Ready-to-copy model prompt
Prepare Week 07 of this LABLOOP execution plan.
Read execution-plan/specs.md, execution-plan/DECISIONS.md,
execution-plan/GATES.md and
execution-plan/weeks/week-07-measured-extraction-agent/specs.md, commitment.md, evidence.md and review.md.
Read prior prerequisite reviews and inspect actual repository/data state.
Use v5 as the governing sequence, the v6 Week 07 chapter
(LABLOOP-Master-Plan-v6.md) as the deeper walkthrough, and v4 only for
retained details.
Produce the full local preparation pack and the exact week-specific files named
in the artifact table. Give me a bounded lesson with exercises/answer key,
daily physical actions, technical runbook or draft, branding drafts and
career/commercial actions. Keep the total to 600 minutes.
Separate prepared artifacts from measured results and my learning completion.
Verify sources and do not invent metrics, citations, papers, people or outcomes.
Do not execute external communications, publication or spending unless the
current session already authorizes the specific action.
Finish by updating evidence/review and TODAY with the next physical action.
11
OPEN WHEN NEEDED
Preserved original v5 weekly brief
v6 reproduces this brief unchanged inside v6 · Week 7 · The extraction agent, measured.
The following is source planning text, not a claim of completion. Apply the explicit evidence corrections in this specification and DECISIONS.md.
Week 7 · The extraction agent, measured
Goal: first per-field precision and recall.
Tue (B7): MIT 7.016 protein lectures; Michaelis-Menten fitted.
Thu (M7): Statistical Rethinking L3-4.
Build: Mon: extract/agent.py: one paper in, schema JSON out with provenance; Claude via API and local Qwen 7B as two backends; --fake backend for tests. Done when 5 papers extract. Wed: eval/score.py: per-field exact and fuzzy match against the gold set, precision/recall/F1, confusion by field. Done when the table prints for 50 papers. Fri: error analysis: the 5 worst fields, why; one round of prompt and schema fixes; re-score. Log both numbers.
Sun: L-Sun: "An LLM read 50 papers; here is where it was wrong" with the per-field table. L-Wed.
State: UNCONFIRMED. Owner: Peter Ciancaglini. Specification
Start date: not set. End date: not set. Available hours: confirm (planned ceiling 10).
Primary outcome: measured extraction agent.
Minimum that keeps the next gate alive: the F1 table, whatever it says.
☐ evaluation-protocol.md: Each field has counts and scoring rules; development scores are not called held-out performance.
☐ error-analysis.md: Unchanged held-out data and a backend decision with quality/cost evidence are recorded.
☐ Bounded learning exercise and personal teach-back.
☐ Evidence-backed branding and opportunity pack.
☐ Sunday review and next physical action.
Proposed calendar
Day
Minutes
Physical action / outcome
Actual slot
Done
Mon
90
Implement schema-constrained extraction with provenance and fake/API/local adapters; smoke-test five development papers and log model/prompt versions.
Not set
☐
Tue
90
Michaelis-Menten fitted in Python to a public dataset
Not set
☐
Wed
90
Implement field-specific precision/recall/F1, numeric unit/tolerance checks and provenance correctness on frozen paper-level splits. Last ten minutes: optional note.
Not set
☐
Thu
90
A simple Bayesian regression in PyMC or numpyro on titer data Include relevant founder-paper work within this block.
Not set
☐
Fri
90
Inspect five worst fields, make one development-only revision, compare before/after, and choose a documented per-field floor and cost budget for scale-up.
Not set
☐
Sat
90
Resolve critical spillover; long-form draft if due; sandbox only if done.
Not set
☐
Sun
60
Build log, evidence, gap review, next actions.
Not set
☐
Dependency and capacity check
Missing essential inputs: not yet inspected.
Human/external dependency, owner and expected date: not yet inspected.
Week-specific constraint: The original gold set cannot be repeatedly tuned on and still serve as an untouched test set. Report prompt-development and final evaluation sets separately.
Existing session authorization for external actions or spending: not assessed; local planning only at scaffold creation.
Scope to cut first: optional polish/additional examples; preserve scientific validity.
If the forecast exceeds available time: record a concrete reduced scope or revised delivery proposal before committing.
Peter's commitment / adjustments: pending.
Reviewing model and date: pending.
Execution state: NOT_STARTED. Specification
This file is a blank register with planned artifact names; none of the rows prove completion.
Item
Path / URL / version
State
Verification / actual result
Verified by / date
extraction-runbook.md
Not created
NOT_STARTED
Pending: Invalid JSON, absent values and unsupported evidence fail visibly.
—
evaluation-protocol.md
Not created
NOT_STARTED
Pending: Each field has counts and scoring rules; development scores are not called held-out performance.
—
error-analysis.md
Not created
NOT_STARTED
Pending: Unchanged held-out data and a backend decision with quality/cost evidence are recorded.
—
Learning exercise / Peter's quiz
Not created
NOT_STARTED
Peter's actual answers required
—
Founder paper digest
Not created
NOT_STARTED
Source/content and access checked
—
Branding pack
Not created
NOT_STARTED
Claims audited; drafted/public status distinct
—
Opportunity actions
Not created
NOT_STARTED
Drafted/sent/replied/booked/held distinct
—
Reproduction and scientific measurements
Question / metric
Dataset, N and unit
Split / seed / config
Command or verification method
Output path and measured value
Uncertainty / limitation
External events, when authorized and actually performed
Date
Action / counterpart
Receipt or private reference
State
Next action / date
Actual learning and decisions
Peter's teach-back / quiz score: not assessed.
Scientific assumptions and deviations: none recorded yet.
Budget allocated / spent: not assessed / no spend recorded.
Missing evidence and responsible owner: pending inspection.
Do not put API keys, source full texts with restricted rights, client data or invoice personal details in a public version of this register. Keep private evidence references private.
☐ Each field has counts and scoring rules; development scores are not called held-out performance. Evidence: pending.
☐ Unchanged held-out data and a backend decision with quality/cost evidence are recorded. Evidence: pending.
☐ Learning assessed from Peter's actual answers. Evidence: pending.
☐ Branding/opportunity states recorded correctly. Evidence: pending.
Learning and outcome
What Peter can explain or reproduce now: not assessed.
Quiz / teach-back gaps: not assessed.
Measured result and limitations: pending.
Best evidence link for a scientist/recruiter/buyer: pending.
What failed or changed, and why: pending.
Gate and capacity
Gate requirement: No standalone gate; check this week's acceptance criteria and next gate dependencies.
Gate status: NOT_STARTED.
Original target week: See next gate in specs.
Actual completion date / forecast: not set.
Missing external evidence: pending inspection.
Blocks completed / 7: not recorded.
Days with commits / 7: not recorded.
Sunday build log / optional Wednesday note: not recorded.
Founder conversations cumulative: not recorded.
Earned evidence level and proof: not assessed.
Consecutive lost weeks: not assessed.
Week-specific risk to revisit: The original gold set cannot be repeatedly tuned on and still serve as an untouched test set. Report prompt-development and final evaluation sets separately.
Decision and next-model handoff
Continue / recover / blocked: not decided.
Retain as the minimum: the F1 table, whatever it says.
Skipped permanently with reason: none recorded.
Carryover with owner, dependency and target week: none recorded.
Canonical repository paths and versions: pending.
Data permissions, split definitions or assumptions to preserve: pending.
External action authorization that still applies: not assessed.
Next physical action, exact file/function/paragraph: pending.
Updates to root PROGRESS / LOG / TODAY completed: ☐