⚖️ AI Ethics · Fairness

Who Gets the Loan?

An AI loan officer makes decisions — but is it fair? Discover hidden bias, measure disparate impact, and fix it. The same issues that made Apple Card and Amazon's hiring AI infamous!

👁️ Watch the AI Decide
🔍 Find the Bias
📊 Measure Fairness
🔧 Fix the Bias
🏆 Badge

How AI Bias Happens

📊

Biased Training Data

If historical data reflects past discrimination, the AI learns and perpetuates it — even if "protected" features are removed.

🔗

Proxy Features

Zip code correlates with race. Job title correlates with gender. Removing the protected feature isn't enough!

📏

Disparate Impact

If approval rates differ significantly between groups with equal qualifications, the model has disparate impact bias.

🔧

Fairness Fixes

Re-sampling, re-weighting, fairness constraints, or post-processing can reduce bias — but often at some accuracy cost.

⚖️
Wizzy the AI Tutor
Meet the AI Loan Officer! 🤖 It reviews loan applications and makes approve/deny decisions. Watch it process these 12 applications. The AI uses income, credit score, loan amount, and employment. Does anything look suspicious? Pay attention to the outcomes!

Step 1 — Watch the AI Decide

Click "Run All Decisions" to see how the AI processes each application.
⚖️
Wizzy the AI Tutor
🔍 Something is wrong. Look carefully at the approval rates by neighbourhood. Two applicants with identical income and credit scores get different decisions — one from South Mumbai, one from Dharavi. Can you see the hidden proxy discrimination?

Step 2 — Spot the Hidden Bias

🔴 Denied (suspicious cases)

🟢 Approved (comparison cases)

🚨 Bias Detector
Approval rate — Affluent areas
Approval rate — Working-class areas
The AI never directly uses neighbourhood as a feature — but income and credit score are correlated with neighbourhood due to historical inequality. This is called proxy discrimination.
⚖️
Wizzy the AI Tutor
Let's measure the bias precisely! The Disparate Impact Ratio compares approval rates between groups. A ratio below 0.8 (the "80% rule") means illegal discrimination in many countries. Which features are causing the most bias?

Step 3 — Quantify the Unfairness

Feature Importance (what the AI actually uses):

⚖️
Wizzy the AI Tutor
Now let's fix the bias! Try different fairness strategies and see how they affect both fairness AND accuracy. This is the real challenge — there's always a trade-off between accuracy and fairness. What's more important to you?

Step 4 — Apply Fairness Fixes

❌ Before Fix

✅ After Fix

Click a fairness strategy to apply it and see the before/after comparison.
⚖️
Wizzy the AI Tutor
🎊 You're now an AI Fairness Auditor! You identified proxy discrimination, measured disparate impact, and applied fairness constraints. These are the same skills used by AI ethics teams at Google, Microsoft, and governments worldwide. Responsible AI needs people like you!
⚖️

AI Ethics Badge!

You audited an AI system for bias and applied fairness fixes!

Optional. Stays on this device only — not sent to WhizzStep.

⚖️ WhizzStep AI Lab
Activity completion card for
Student Name
has completed AI Fairness & Ethics Audit Training
This records completion of a browser activity only. It is not an accredited certificate or proof of mastery.
AI Ethics Auditor
Bias Detective
Fairness Engineer
whizzstep.in

Key Concepts Mastered

Proxy Discrimination

🔗 Hidden Bias

Using a feature correlated with a protected attribute (e.g. zip code → race). Removes the feature but keeps the bias.

Disparate Impact

📊 Unequal Outcomes

When a neutral policy produces significantly different outcomes for different groups. Illegal in many countries.

80% Rule

📏 Legal Threshold

If the less favoured group's approval rate is below 80% of the favoured group's, it counts as disparate impact.

Fairness-Accuracy

⚖️ The Trade-off

Making a model fairer often reduces raw accuracy. Society must decide which trade-off is acceptable.

Algorithmic Auditing

🔍 Checking AI

Systematically testing AI systems for bias across protected groups. Increasingly required by regulators worldwide.

Real Cases

📰 It Has Happened

Apple Card gender bias (2019), Amazon hiring AI (2018), COMPAS recidivism tool, healthcare allocation algorithms.

About this lab

AI-18 Bias, Fairness and Inclusion Classes 9-12 18 min Applied

Learning objective: Run a simplified loan-approval model on sample applicants and examine where its decisions may disadvantage a group.

What this simplifies: The dataset and criteria are simplified and fictional; real lending models are regulated and far more complex.

Privacy: No learner input leaves the device.

Teacher prompt: Ask the class why this simulation might mislead someone who takes it too literally.

Reflect: What is one thing this activity showed you that you did not expect?

← Smart Farm Back to All Labs Deepfake Verification Lab →
Bring this learning to my school →