RAG · LLM · AWS — capstone
QuizMark
A textbook PDF becomes a marked exam. An end-to-end RAG platform that ingests 600-page textbooks, drafts exam questions, and auto-marks student answers with written feedback.
- Ran a real graded quiz for ~150 students across five classes on a single EC2 box — 14 Docker services, 8 Celery workers — for $22.40 of model spend.
- Marking runs as four-tier triage, so most answers never reach an LLM — 67% of one exported sitting was marked with no model call.
- Retrieval from scratch: five indexes fused with Reciprocal Rank Fusion and re-ranked, scored offline on Recall@k / MRR / nDCG@k.
- Agreed with the instructor's own grading of 91 students at r = 0.80, within one mark on 92.5%. Shipped behind a large automated test suite and 3-provider failover that fired mid-pilot when one provider's credits ran out.