Who Gets the Loan?
An AI loan officer makes decisions — but is it fair? Discover hidden bias, measure disparate impact, and fix it. The same issues that made Apple Card and Amazon's hiring AI infamous!
How AI Bias Happens
Biased Training Data
If historical data reflects past discrimination, the AI learns and perpetuates it — even if "protected" features are removed.
Proxy Features
Zip code correlates with race. Job title correlates with gender. Removing the protected feature isn't enough!
Disparate Impact
If approval rates differ significantly between groups with equal qualifications, the model has disparate impact bias.
Fairness Fixes
Re-sampling, re-weighting, fairness constraints, or post-processing can reduce bias — but often at some accuracy cost.
Step 1 — Watch the AI Decide
Step 2 — Spot the Hidden Bias
🔴 Denied (suspicious cases)
🟢 Approved (comparison cases)
Step 3 — Quantify the Unfairness
Feature Importance (what the AI actually uses):
Step 4 — Apply Fairness Fixes
❌ Before Fix
✅ After Fix
AI Ethics Badge!
You audited an AI system for bias and applied fairness fixes!
Optional. Stays on this device only — not sent to WhizzStep.
Key Concepts Mastered
🔗 Hidden Bias
Using a feature correlated with a protected attribute (e.g. zip code → race). Removes the feature but keeps the bias.
📊 Unequal Outcomes
When a neutral policy produces significantly different outcomes for different groups. Illegal in many countries.
📏 Legal Threshold
If the less favoured group's approval rate is below 80% of the favoured group's, it counts as disparate impact.
⚖️ The Trade-off
Making a model fairer often reduces raw accuracy. Society must decide which trade-off is acceptable.
🔍 Checking AI
Systematically testing AI systems for bias across protected groups. Increasingly required by regulators worldwide.
📰 It Has Happened
Apple Card gender bias (2019), Amazon hiring AI (2018), COMPAS recidivism tool, healthcare allocation algorithms.
About this lab
Learning objective: Run a simplified loan-approval model on sample applicants and examine where its decisions may disadvantage a group.
What this simplifies: The dataset and criteria are simplified and fictional; real lending models are regulated and far more complex.
Privacy: No learner input leaves the device.
Teacher prompt: Ask the class why this simulation might mislead someone who takes it too literally.
Reflect: What is one thing this activity showed you that you did not expect?
← Back to all Labs