Building reliable RAG and LLM applications: Grounding, evaluation and data leakage
A ready-made course you customise for your organisation, with a live session deck and two surveys. You only add the 6 details that are specific to your organisation.
- Length
- 45 min
- Lessons
- 7 lessons
- Frequency
- Before a team starts a first RAG or LLM project
- Last reviewed
- 21 Oct 2026
Retrieval returns near-duplicates from three document versions
Try it: this is one of 22 interactive activities in the course.
What's included
Three pieces that work together
Copy once, get everything. Learners prepare on their own, you answer questions live, and the surveys tell you what stuck.
Self-paced course
Short lessons with real workplace scenarios, not walls of text.
- 7 lessons, about 45 minutes
- Sorting activity, flashcards, timeline, accordion and quizzes
- 10-question final check, 80% to pass
Live session deck
An AhaSlides presentation to run after the course, in person or online.
- 10 slides
- Quiz, poll, word cloud, scale slides
- A closing slide for your contacts
Two surveys
Find out what landed, and whether people use it on the job.
- Post-course feedback, about 2 minutes
- 30-day check-in
- Anonymous by default
- Results feed your next refresher
Learning objectives
At the end of this course, learners can
Each objective and the lesson that covers it.
| ID | Objective | Source | Where it's covered |
|---|---|---|---|
| TO 127.0 | Achieve ≥ 80% on the final assessment | - | Whole course |
| SO 127.1 | Decide when RAG, long context, fine-tuning or a database query fits a problem | Best practice | Whole course |
| SO 127.2 | Explain tokens, context windows, embeddings and retrieval well enough to debug a weak answer | Best practice | Whole course |
| SO 127.3 | Design retrieval that respects document access permissions | OWASP Top 10 for LLM Apps 2025 LLM02 | Whole course |
| SO 127.4 | Prevent sensitive data disclosure and indirect prompt injection through retrieved content | OWASP Top 10 for LLM Apps 2025 LLM01, LLM02 | Whole course |
| SO 127.5 | Evaluate answers for grounding and faithfulness before release, and use the design review route + your info | NIST AI 600-1 GenAI Profile; organisation's review process | Whole course |
Your part: what a template can't do for you
- Your workplace details: fill in the 6 highlighted fields so the course describes your own policies, contacts and locations.
- Records: record completion in your own LMS or record system.
Course outline
7 lessons, about 45 minutes
Minutes per lesson are an estimate, shared out by page count.
1Outdated answers and exposed documents: a real failure
3 pages
7 min
Outdated answers and exposed documents: a real failure
3 pages
2Tokens, context windows, embeddings and retrieval basics
3 pages
7 min
Tokens, context windows, embeddings and retrieval basics
3 pages
3Choosing a pattern and building the RAG pipeline
3 pages
7 min
Choosing a pattern and building the RAG pipeline
3 pages
4Respecting document permissions during retrieval
3 pages
7 min
Respecting document permissions during retrieval
3 pages
5Resisting hidden instructions in retrieved content
3 pages
7 min
Resisting hidden instructions in retrieved content
3 pages
6Evaluation checklist and design review route
2 pages
5 min
Evaluation checklist and design review route
2 pages
7Final assessment
Assessment
5 min
Final assessment
Assessment
Live deck and surveys
10 slides to run live, two surveys to close the loop
Pink slides are interactive. Both surveys are anonymous; pink questions are written for this course.
Post-course feedback: 10 questions, about 2 min
- Overall rating 5 stars
- Relevant, realistic, right length, helpful activities agree/disagree grid
- What was most useful? multi-select
- Confidence before this course, and now 1-5 scale
- Have you built a RAG or LLM application? multiple choice
- How do you currently evaluate answer quality? multiple choice
- How confident are you choosing between RAG, long context and a database query? 1-5 scale
- One thing we should change or add open text
- Would you recommend this course? NPS
30-day check-in
- Have you used what you learned since the course? multiple choice
- How confident are you today? Compare with day 1 1-5 scale
- A moment where the training helped, or where you weren't sure open text
- Which topics should the next refresher focus on? ranking
Results show whether people use the training on the job, not just whether they finished it.
Make it yours
6 fields to fill in, and you're ready
Everything else is done. These are the details only your organisation knows; each one is highlighted inside the course.
- How document permissions are modelled
{{ACCESS_CONTROL_STANDARD}} - How LLM features are reviewed before release
{{DESIGN_REVIEW_ROUTE}} - Models and services engineers may use
{{APPROVED_AI_TOOLS}} - Surveys and completion record
{{SURVEY_1_URL}} - Surveys and completion record
{{SURVEY_2_URL}} - Surveys and completion record
{{LMS_OR_RECORD_SYSTEM}}
FAQ
Common questions
Can I run building reliable RAG and LLM applications: Grounding, evaluation and data leakage training online?
Yes. The course is self-paced and online, and the live deck lets you add a live session in the room or online.
How often is this training needed?
Before a team starts a first RAG or LLM project, and at each design review cycle.
Who needs this training?
Developers, data scientists and solution architects building LLM-based applications; run by engineering leads, data governance or L&D.
What records should I keep?
Record completion in your own LMS or record system, so you can show who finished the course and when.
Can I edit the content?
Yes, everything. Change the wording, swap scenarios for ones from your workplace, add your logo, or remove parts that don't apply.
Related templates
Often taught together
How generative AI works: Essentials for every employee
All staff · AI skills
Finding the right work for AI: Spotting, testing and prioritising use cases in your team
All staff and team leads · AI skills
Working smarter with generative AI: A safe everyday workflow for office tasks
All office staff · AI skills
Copilot at work: Safe, effective use of your office-suite AI assistant
All staff licensed for Copilot or Copilot Chat · AI skills
Ready to run it?
Open the live deck to see how the session runs alongside the course and both surveys.