vibrantlabsai/ragas
Compute context recall and faithfulness on 10 of your Q&A; compare with your human labels before trusting it
In: LABLOOP-W34 Notebook
WEEK 34 · LABDOCS, PART 2
Do one thing.
Then you are ahead.
A librarian who answers confidently but sends you to the wrong shelf is worse than no librarian. This week you build "Ask the lab": local embeddings over the lab's records, answers that cite the exact protocol paragraph, and, as always, a measurement. You write 60 questions with human-labelled answers (your gold set again, now for retrieval), and you calibrate an LLM judge against your own labels so you know how muc…
If you only do one thing this week: the 60 labelled Q&A
▶
THE NEXT BLOCK
How long have you got?
By Sunday you should be able to say: “I can tell a lab exactly how often their assistant cites the right paragraph and how much to trust the automatic scores.”
🔥
MOMENTUM
What you have actually done
0 min0 blocks on the timer
0 min0.0 hours measured, not estimated
0days in a row
11across the programme
0/12
Time on the timer, day by day last 14 days
S
M
T
W
T
F
S
S
M
T
W
T
F
S
2026-09-29 18:29Finished: SciPy docs, scipy.integrate.solve_ivp2026-09-29 17:44Finished: LearnChemE (CU Boulder) · "Monod Cell Growth Example (Bio)"2026-09-28 22:11Finished: Crash Course Biology #3 · "Biological Molecules2026-09-28 21:50Finished: OpenStax Biology 2e2026-09-25 11:16Finished: OpenStax Biology 2e