WEEK 06 · THE GOLD SET (THE MOST IMPORTANT WEEK OF HALF 1)
Do one thing. Then you are ahead.
Here is a story from auditing. A company hires a new automated invoice-checking system. The vendor claims 98% accuracy. The CFO asks one question: "98% against what?" If nobody checked invoices by hand first, the number means nothing. This week you become that CFO. You read 50 fermentation papers yourself and write down, for each field, the value and the exact sentence that proves it. It is slow, it is humbling, and…
Zheng et al. (2023), "Judging LLM-as-a-judge with MT-Bench and Chatbot Arena"
Monday build block
· Read it inside Monday's build block
Build-block reading · Zheng et al. (2023), "Judging LLM-as-a-judge with MT-Bench and Chatbot Arena", NeurIPS Datasets & Benchmarks, sections 1-3 (judge biases you must avoid in week 14)
By Sunday you should be able to say: “I can explain why my 50 hand-annotated papers are worth more than 2,000 machine-extracted ones, and what a second annotator adds.”