Tech Tree - Progressive Skill Development
A structured progression framework for infant cognitive development through interactive technology.
Core Principles
Anti-Overstimulation Guidelines
| Principle | Implementation | |-----------|----------------| | Single modality | One primary sense per interaction | | Slow transitions | 300-500ms minimum fade between states | | Limited palette | 2-3 colors max per experience | | Response latency | 150-400ms delay (contingent, not startling) | | Clear contingency | Action → predictable, consistent response | | Session limits | 5-10 minutes max |
Advancement Criteria
Do not advance to the next tier until current tier shows:
- Consistent engagement - looks at screen when interacting
- Anticipatory behavior - expects response before it happens
- Intentional repetition - does action to cause effect, not accidentally
Tier 0: Pure Contingency (8-10 months)
Goal: "I make things happen"
Cognitive targets: Cause-effect understanding, agency awareness, attention sustaining
0.1 Motion Canvas
Input: Body movement via webcam Output: Visual ripples from movement location
Progression:
0.1a - Any motion → response ✓
0.1b - Larger motion → bigger response ✓
0.1c - Motion location matters (spatial mapping) ✓
Success criteria: Baby intentionally moves to create effect, looks at screen during/after movement
0.2 Sound Mirror
Input: Any vocalization via microphone Output: Waveform visualization responds
Progression:
0.2a - Sound → waveform moves ✓
0.2b - Louder → bigger waves
0.2c - Duration matters (sustained = sustained response)
Success criteria: Baby babbles while watching screen, pauses to observe effect
0.3 Touch Ripple (tablet/touchscreen)
Input: Touch anywhere on screen Output: Ripple from touch point
Progression:
0.3a - Single touch → single ripple
0.3b - Multi-touch → multiple ripples
0.3c - Drag → continuous trail
Success criteria: Intentional touching (not just mouthing device)
Tier 1: Differentiated Response (10-12 months)
Goal: "Different actions make different things happen"
Cognitive targets: Action differentiation, prediction formation, category formation
1.1 Zone Canvas
Input: Movement in different screen regions Output: Different effects per zone
Layout:
Left zone → Blue ripples
Right zone → Orange ripples
Progression:
1.1a - 2 zones (left/right) ✓
1.1b - 4 zones (quadrants)
1.1c - Zones have different response types
Success criteria: Baby moves to specific zone for preferred effect
1.2 Sound Shapes
Input: Different vocalization types Output: Different visual shapes
Mapping:
Vowels (aaa, ooo) → Smooth, round shapes
Consonants (ba, da) → Angular, spiky shapes
Sustained sound → Growing shape
Rhythmic sound → Pulsing shape
Success criteria: Baby experiments with different sounds
1.3 Peek-a-Boo Machine ✓
Input: Face detection (visible vs occluded) Output: Character appears/hides in sync
Mechanics:
Face visible → Character visible, happy
Face hidden → Character hides
Face reappears → Celebration!
Progression:
1.3a - Simple appear/disappear ✓
1.3b - Character anticipates (starts hiding when hands rise)
1.3c - Character in different locations (object permanence)
Success criteria: Baby initiates peek-a-boo, anticipates character return
Tier 2: Pattern & Choice (12-14 months)
Goal: "I can predict and choose"
Cognitive targets: Pattern recognition, sequential memory, binary choice
2.1 Copy Cat Rhythm
Input: Sound/movement in rhythm Output: System plays pattern, waits for imitation
Sequence:
1. System plays pattern (flash, pause, flash)
2. Visual cue: "your turn"
3. Baby responds
4. Encouragement if roughly matched
Progression:
2.1a - Single beat
2.1b - Two beats
2.1c - Three beats with timing
2.2 Which One?
Input: Touch or gaze toward one of two options Output: Selected option animates
Progression:
2.2a - Two very different options
2.2b - Two similar options
2.2c - Options have consequences
2.3 Cause Chain
Input: Action A Output: A causes B, B causes C (visible chain)
Example:
Touch ball → Ball rolls → Hits bell → Bell rings
Progression:
2.3a - Two-step (A → B)
2.3b - Three-step (A → B → C)
2.3c - Baby can intervene at step B
Tier 3: Symbolic Mapping (14-18 months)
Goal: "Things have names and meanings"
Cognitive targets: Word-object association, symbolic representation, vocabulary
3.1 Word Spotlight
Input: Spoken word Output: Corresponding object highlights
Vocabulary (start with 5-8):
ball, dog, cat, baby, mama, dada, more, up, bye-bye
Progression:
3.1a - System says word → object highlights
3.1b - Parent says word → object highlights
3.1c - Baby approximates word → object responds
3.2 Sound-Symbol Match
Input: Characteristic sound plays Output: Baby touches matching picture
Example:
"Woof woof" → Three animals shown → Touch dog → Celebration
Progression:
3.2a - 2 options, very different
3.2b - 3 options
3.2c - 4 options, some similar
3.3 Action Words
Input: Movement demonstrating action Output: Word label appears
Actions:
Clapping → "CLAP"
Waving → "WAVE" / "bye-bye"
Bouncing → "BOUNCE" / "jump"
Progression:
3.3a - System labels spontaneous actions
3.3b - System requests, baby performs
3.3c - Baby requests by approximating word
Tier 4: Structured Play (18-24 months)
Goal: "Games have rules I can learn"
Cognitive targets: Rule understanding, turn-taking, goal-directed behavior
4.1 Simple Sorting
Input: Drag objects to containers Output: Correct = celebration, Wrong = gentle bounce-back
Categories:
Colors (red things → red bin)
Shapes (circles → circle hole)
Size (big → big box)
Progression:
4.1a - 2 categories
4.1b - 3 categories
4.1c - Mixed attributes
4.2 Sequence Builder
Input: Arrange items in order Output: Sequence plays when complete
Examples:
Train cars in order → train drives
Blocks stacked → tower stands, falls
Story panels arranged → animation plays
4.3 Request & Reward
Input: Verbal or gestural request Output: System provides requested item/action
Vocabulary:
"More" → repeat last action
"Again" → replay sequence
Object names → show object
Pointing → identify and label
Progression:
4.3a - "More" recognized
4.3b - Object names recognized
4.3c - Two-word combinations
Session Logging
Track progress with structured data:
interface Session {
id: string;
timestamp: Date;
duration_seconds: number;
tier: number;
activity: string;
// Engagement metrics
attention_events: number;
interaction_events: number;
anticipation_events: number;
// Progression signals
intentional_ratio: number;
sustained_attention_max: number;
// Notes
parent_notes?: string;
advancement_ready?: boolean;
}
Implementation Status
Phase 1: Core System ✓
- [x] Motion → ripple response
- [x] Audio → waveform response
- [x] Zone-based color differentiation
- [x] Amplitude scaling
- [x] Baby mode preset
Phase 2: Face Detection ✓
- [x] Face detection integration
- [x] Peek-a-boo game
- [ ] Face-position tracking for gaze
Phase 3: Sound Classification
- [ ] Vowel vs consonant detection
- [ ] Pitch tracking
- [ ] Rhythm detection
Phase 4: Touch Interface
- [ ] Tablet version
- [ ] Touch-specific games
- [ ] Multi-touch support
Phase 5: Language
- [ ] Speech recognition
- [ ] Word-object database
- [ ] Voice differentiation