runbookify
← All plans
Staff Training & Enablement / Quizzes & Assessments

Proctored Final Exam Pass/Fail Gate: Certification That Actually Holds Up

Turn your question bank and exam blueprint into a timed, randomized, attempt-capped final exam that auto-scores against a hard pass mark and routes only verified passes to certificate issuance — with the exam owner approving the config and every flagged result.

IntermediateA weekendBuilds onNext.jsSupabaseResend
What you'll build

A web tool where the exam owner configures and approves a final exam, candidates take a timed randomized version with limited attempts, the tool auto-scores against the pass mark and enforces the attempt cap, the owner reviews any flagged or borderline result, and clean passes are routed to certificate issuance while fails go to remediation — with a full results CSV export.

Gated download

Enter your email — the plan downloads instantly and a copy lands in your inbox.

By submitting your email you'll also receive the weekly runbookify newsletter. You can unsubscribe at any time.

Before you start

  • A Supabase account (free)
  • A Vercel account (free)
  • A Resend account (free)
  • Your approved question bank (CSV or Google Sheet)
  • Your exam blueprint (length, time limit, pass mark, attempt cap)
  • Your candidate list
  • Claude Code or any AI coding agent

The problem this kills

A certificate is only worth something if the exam behind it is real. But most teams "test" with a casual quiz: no time limit, the same questions every time, unlimited retries, and a pass mark that's more of a suggestion. Someone fails, retakes it five minutes later with the same questions, and "passes." Then a regulator, an auditor, or a customer asks you to prove that the people holding your safety or role-qualification certificate actually demonstrated competence — and you can't.

You need a final exam that holds up: a time limit so it's not an open-book stroll, a randomized version so candidates can't share answers, a hard cap on attempts so failing means remediation rather than brute-force guessing, a strict pass mark applied the same way every time, and a record of exactly which exam version each person saw. And you need a human — the exam owner — in control of the configuration and any borderline or flagged result, because high-stakes certification can't be fully on autopilot. You don't need to be a developer to build this.

What you'll build

A simple internal web tool. The exam owner imports the approved question bank and sets the exam blueprint: how many questions, the time limit, the pass mark, and the attempt cap. They approve that configuration — and only an approved config can be taken. A candidate logs in, gets a randomized version drawn from the bank, and takes the exam against a live countdown; if time runs out, the exam auto-submits what's there. The tool auto-scores against the pass mark, enforces one active attempt and locks out anyone who hits the attempt cap, and logs the exact version each candidate saw. Borderline or flagged results (a suspected issue, an accommodation request, a timed-out submission) land in the owner's review queue to be approved or voided before anything happens. A clean pass is routed to certificate issuance; a fail is routed to remediation. Everything exports to a results CSV.

What's inside the Implementation Plan

The downloadable plan is a step-by-step file you paste into an AI coding agent. It opens by interviewing you about your business — what your question bank looks like and how it's structured, your real exam blueprint (length, time limit, pass mark, attempt cap), how you identify candidates, your accommodation and proctoring rules, what "borderline" means to you, and the messy edge cases like mid-exam disconnects — and then it tailors the data model, the scoring logic, and every later step to your answers. This is not a generic template; the agent reflects a short spec back to you and waits for your thumbs-up before it builds anything. From there it walks the agent through the bank import, the config-and-approve screen, the timed randomized exam runner, the auto-scoring and attempt enforcement, the owner review queue for flagged results, the pass-to-cert and fail-to-remediation routing, and the results export — each step with a ready-to-copy prompt. There's also a fallback so you can build the whole thing today even with no integration to your LMS.

The governance it includes (this is the point)

This is high-stakes certification tooling, so it ships with the controls a compliance owner needs: login so only your team and candidates can use it, row-level security so you only ever see your own organization's exams and results, a complete audit trail of who configured, took, scored, reviewed, approved, and voided which exams and when, a hard human-approval gate so the exam config must be approved before anyone takes it and any flagged result must be approved or voided before a certificate is issued, and duplicate guards keyed on candidate + exam + attempt number so the same attempt can't be scored or counted twice. One active attempt is enforced, time-outs are handled cleanly, and the attempt cap triggers a real lockout — so a pass means a pass.

Who it's for

Compliance and certification owners who need defensible final exams — safety, regulatory, and role-qualification programs where "they took a quiz once" isn't good enough. If you can describe how your exam should be scored and who's allowed to retake it, you can build this.

You've got this — start with the plan, paste the first prompt, answer the interview, and you'll see your first timed, randomized exam come to life the same weekend.

Gated download

Enter your email — the plan downloads instantly and a copy lands in your inbox.

By submitting your email you'll also receive the weekly runbookify newsletter. You can unsubscribe at any time.