Rubric Configuration - Inspection Quality

Upload Rubrics

Pass Threshold (%)

Attention Threshold (%)

Pass Threshold (%)

Attention Threshold (%)

Pass Threshold (%)

Attention Threshold (%)

📊 Rubric Configuration Guide

🎯 What Are Rubrics?

Rubrics define the scoring criteria for inspection videos. Each rubric contains multiple checks that are evaluated based on keywords found in the video transcript.

🔍 How Keyword Matching Works

The system uses intelligent keyword matching with three layers:

Exact Match: Keywords are matched as substrings (case-insensitive)
Synonym Expansion: Common terms are automatically expanded. For example, "refrigerator" also matches "fridge", "nevera", and "refrigerador"
Fuzzy Matching: Catches typos and misspellings (e.g., "refridgerator" matches "refrigerator")

Tip: You don't need to add every variation—just the main keyword! The system handles synonyms automatically.

⚖️ How Weighting Works

Weights are relative importance multipliers, not percentages. They determine how much each check contributes to the overall score.

Scoring Formula:
Overall Score = (Sum of: weight × score) / (Sum of all weights)

Each check receives a binary score:

1.0 - Keywords found in transcript ✓
0.0 - Keywords not found ✗

🔢 Weight Examples

Weight	Importance	When to Use
3.0	Critical	Safety checks, key deliverables
2.0	Very Important	Quality standards, major items
1.5	Important	Significant procedures
1.0	Standard	Normal procedures (baseline)
0.5	Nice to Have	Bonus items, optional checks

📝 Practical Example

Cleaning rubric with 4 checks:

Check	Weight	Found?	Contribution
Introduction	1.0	✓ Yes	1.0 × 1.0 = 1.0
Kitchen verified	2.0	✓ Yes	2.0 × 1.0 = 2.0
Bathroom verified	2.0	✗ No	2.0 × 0.0 = 0.0
Final walkthrough	1.0	✓ Yes	1.0 × 1.0 = 1.0
Total	6.0		4.0 / 6.0 = 66.7%

Result: 66.7% score → "Attention" level (between 60% and 80%)

🎨 Skillset Rubrics

Cleaning - Used when CSV has skillset="cleaning"
Painting - Used when CSV has skillset="painting"
Generic - Fallback for "other" or unknown skillsets

📊 Score Thresholds

Pass: Score ≥ Pass threshold (default 80%)
Attention: Score ≥ Attention threshold (default 60%)
Fail: Score < Attention threshold

💡 Best Practices

Start with all weights at 1.0, then adjust
Use 2.0-3.0 for critical safety and quality items
Use 0.5 for nice-to-have bonus items
Add clear, specific keywords that appear in transcripts
Test your rubric with sample videos before deploying

🏷️ Keyword Tips

You Enter	Also Matches
refrigerator	fridge, nevera, refrigerador
stove	oven, range, cooktop, estufa, horno
toilet	commode, inodoro, baño
verify	verified, verification, verificar
clean	cleaned, cleaning, limpio, limpiar

Note: The system automatically handles typos (like "refridgerator") and matches both English and Spanish terms.

🔧 How to Use This Interface

Select a tab (Cleaning, Painting, or Generic)
Adjust threshold sliders for pass/attention levels
Click "Edit" on any check to modify it
Click "Add Check" to create new checks
Click "Save Changes" to activate your rubric

Note: Weights don't need to add up to 100% or any specific number - they're just relative to each other!