Lewis et al. (2020), "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks"
Lewis et al. (2020), "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", NeurIPS, abstract + figure 1 (15 min)
In: LABLOOP-W34 Notebook
455 CARDS · 41 WEEKS · EVERY SOURCE THE PLAN NAMES
Every video, chapter, paper and repository in the programme, as one card each, with the time it costs and why it is there. Filter by how long you have.
12 cards shown. Stashes: LABLOOP-W00 Notebook (15) LABLOOP-W01 Notebook (18) LABLOOP-W02 Notebook (15) LABLOOP-W03 Notebook (19) LABLOOP-W04 Notebook (17) LABLOOP-W05 Notebook (16) LABLOOP-W06 Notebook (12) LABLOOP-W07 Notebook (12) LABLOOP-W08 Notebook (15) LABLOOP-W09 Notebook (10) LABLOOP-W10 Notebook (11) LABLOOP-W11 Notebook (12) LABLOOP-W12 Notebook (12) LABLOOP-W13 Notebook (13) LABLOOP-W14 Notebook (12) LABLOOP-W15 Notebook (10) LABLOOP-W16 Notebook (14) LABLOOP-W17 Notebook (13) LABLOOP-W18 Notebook (10) LABLOOP-W19 Notebook (10) LABLOOP-W20 Notebook (10) LABLOOP-W21 Notebook (13) LABLOOP-W22 Notebook (10) LABLOOP-W23 Notebook (9) LABLOOP-W24 Notebook (9) LABLOOP-W25 Notebook (12) LABLOOP-W26 Notebook (11) LABLOOP-W27 Notebook (10) LABLOOP-W28 Notebook (6) LABLOOP-W29 Notebook (7) LABLOOP-W30 Notebook (10) LABLOOP-W31 Notebook (8) LABLOOP-W32 Notebook (5) LABLOOP-W33 Notebook (13) LABLOOP-W34 Notebook (12) LABLOOP-W35 Notebook (10) LABLOOP-W36 Notebook (8) LABLOOP-W37 Notebook (7) LABLOOP-W38 Notebook (6) LABLOOP-W39 Notebook (6) LABLOOP-W40 Notebook (6)
Lewis et al. (2020), "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", NeurIPS, abstract + figure 1 (15 min)
In: LABLOOP-W34 Notebook
Tuesday · after Lewis et al. (2020), "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks"
Es et al. (2023), "RAGAS: Automated Evaluation of Retrieval Augmented Generation", arXiv:2309.15217 (30 min)
In: LABLOOP-W34 Notebook
Tuesday · after Es et al. (2023), "RAGAS: Automated Evaluation of Retrieval Augmented Generation"
Stanford CS224N lecture on retrieval/RAG (web.stanford.edu/class/cs224n; verify current lecture list) (30 min)
In: LABLOOP-W34 Notebook
Saturday sandbox
Anthropic, "Introducing Contextual Retrieval" (engineering blog, 2024)
In: LABLOOP-W34 Notebook
Saturday sandbox · after Anthropic, "Introducing Contextual Retrieval"
Thakur et al. (2021), "BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models", NeurIPS Datasets and Benchmarks
In: LABLOOP-W34 Notebook
Saturday sandbox · after Thakur et al. (2021), "BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information R…
Faysse et al. (2024), "ColPali: Efficient Document Retrieval with Vision Language Models", arXiv:2407.01449 — retrieval directly on page images
In: LABLOOP-W34 Notebook
Saturday sandbox · after Faysse et al. (2024), "ColPali: Efficient Document Retrieval with Vision Language Models"
Zheng et al. 2023 LLM-as-a-judge (carry over)
In: LABLOOP-W34 Notebook
Compute context recall and faithfulness on 10 of your Q&A; compare with your human labels before trusting it
In: LABLOOP-W34 Notebook
Only as a reference implementation of chunking and citation; keep your own pipeline small
In: LABLOOP-W34 Notebook
Try page-image retrieval on 20 scanned SOP pages; compare recall@5 with text chunks
In: LABLOOP-W34 Notebook
Wrap the 60 Q&A as an eval with a model-graded scorer and your human labels
In: LABLOOP-W34 Notebook
Serve the embedding model locally on the mini PC for the on-prem story
In: LABLOOP-W34 Notebook