LABLOOP · RIGHT NOW

WEEK 10 · INTER-ANNOTATOR AGREEMENT AND THE FIRST REAL ANALYSIS

Do one thing.
Then you are ahead.

Two referees watching the same match will not call every foul the same way. If they disagree constantly, the rules are unclear, not the players. Cohen's kappa measures how much two annotators agree beyond what chance alone would give, and it is the number that tells reviewers whether your gold set is a standard or an opinion. This week you compute it per field, sit down with the disagreements, adjudicate them, and f…

If you only do one thing this week: kappa
▶

THE NEXT BLOCK

How long have you got?

10 min 25 min 50 min 90 min 11 of 11 cards still open in week 10 · 11 finished overall
3/11 Read 45 min W10 Thursday AI & stats

Rasmussen & Williams, Gaussian Processes for Machine Learning, ch. 1-2 — gaussianprocess.org/gpm…

Rasmussen & Williams, Gaussian Processes for Machine Learning, ch. 1-2 — gaussianprocess.org/gpml (free) (45 min) after Görtler, Kehlbeck & Deussen (2019), "A Visual Exploration of Gaussian Processes", Distill — distill.pub/2019/visual-exploration-gaussian-processes (30 min, interactive; start here)

Open ↗

In: LABLOOP-W10 Notebook

By Sunday you should be able to say: “I can explain kappa to a founder with a referee analogy and tell them which FermLit fields are trustworthy.”

🔥

MOMENTUM

What you have actually done

0 min0 blocks on the timer
0 min0.0 hours measured, not estimated
0days in a row
11across the programme
0/11

Time on the timer, day by day last 14 days

S
M
T
W
T
F
S
S
M
T
W
T
F
S
⏱ Focus Focus25:00 0 min today