Tech Tree - Progressive Skill Development

A structured progression framework for infant cognitive development through interactive technology.

Core Principles

Anti-Overstimulation Guidelines

| Principle | Implementation | |-----------|----------------| | Single modality | One primary sense per interaction | | Slow transitions | 300-500ms minimum fade between states | | Limited palette | 2-3 colors max per experience | | Response latency | 150-400ms delay (contingent, not startling) | | Clear contingency | Action → predictable, consistent response | | Session limits | 5-10 minutes max |

Advancement Criteria

Do not advance to the next tier until current tier shows:

  1. Consistent engagement - looks at screen when interacting
  2. Anticipatory behavior - expects response before it happens
  3. Intentional repetition - does action to cause effect, not accidentally

Tier 0: Pure Contingency (8-10 months)

Goal: "I make things happen"

Cognitive targets: Cause-effect understanding, agency awareness, attention sustaining

0.1 Motion Canvas

Input: Body movement via webcam Output: Visual ripples from movement location

Progression:
  0.1a - Any motion → response ✓
  0.1b - Larger motion → bigger response ✓
  0.1c - Motion location matters (spatial mapping) ✓

Success criteria: Baby intentionally moves to create effect, looks at screen during/after movement

0.2 Sound Mirror

Input: Any vocalization via microphone Output: Waveform visualization responds

Progression:
  0.2a - Sound → waveform moves ✓
  0.2b - Louder → bigger waves
  0.2c - Duration matters (sustained = sustained response)

Success criteria: Baby babbles while watching screen, pauses to observe effect

0.3 Touch Ripple (tablet/touchscreen)

Input: Touch anywhere on screen Output: Ripple from touch point

Progression:
  0.3a - Single touch → single ripple
  0.3b - Multi-touch → multiple ripples
  0.3c - Drag → continuous trail

Success criteria: Intentional touching (not just mouthing device)


Tier 1: Differentiated Response (10-12 months)

Goal: "Different actions make different things happen"

Cognitive targets: Action differentiation, prediction formation, category formation

1.1 Zone Canvas

Input: Movement in different screen regions Output: Different effects per zone

Layout:
  Left zone  → Blue ripples
  Right zone → Orange ripples

Progression:
  1.1a - 2 zones (left/right) ✓
  1.1b - 4 zones (quadrants)
  1.1c - Zones have different response types

Success criteria: Baby moves to specific zone for preferred effect

1.2 Sound Shapes

Input: Different vocalization types Output: Different visual shapes

Mapping:
  Vowels (aaa, ooo) → Smooth, round shapes
  Consonants (ba, da) → Angular, spiky shapes
  Sustained sound → Growing shape
  Rhythmic sound → Pulsing shape

Success criteria: Baby experiments with different sounds

1.3 Peek-a-Boo Machine ✓

Input: Face detection (visible vs occluded) Output: Character appears/hides in sync

Mechanics:
  Face visible → Character visible, happy
  Face hidden → Character hides
  Face reappears → Celebration!

Progression:
  1.3a - Simple appear/disappear ✓
  1.3b - Character anticipates (starts hiding when hands rise)
  1.3c - Character in different locations (object permanence)

Success criteria: Baby initiates peek-a-boo, anticipates character return


Tier 2: Pattern & Choice (12-14 months)

Goal: "I can predict and choose"

Cognitive targets: Pattern recognition, sequential memory, binary choice

2.1 Copy Cat Rhythm

Input: Sound/movement in rhythm Output: System plays pattern, waits for imitation

Sequence:
  1. System plays pattern (flash, pause, flash)
  2. Visual cue: "your turn"
  3. Baby responds
  4. Encouragement if roughly matched

Progression:
  2.1a - Single beat
  2.1b - Two beats
  2.1c - Three beats with timing

2.2 Which One?

Input: Touch or gaze toward one of two options Output: Selected option animates

Progression:
  2.2a - Two very different options
  2.2b - Two similar options
  2.2c - Options have consequences

2.3 Cause Chain

Input: Action A Output: A causes B, B causes C (visible chain)

Example:
  Touch ball → Ball rolls → Hits bell → Bell rings

Progression:
  2.3a - Two-step (A → B)
  2.3b - Three-step (A → B → C)
  2.3c - Baby can intervene at step B

Tier 3: Symbolic Mapping (14-18 months)

Goal: "Things have names and meanings"

Cognitive targets: Word-object association, symbolic representation, vocabulary

3.1 Word Spotlight

Input: Spoken word Output: Corresponding object highlights

Vocabulary (start with 5-8):
  ball, dog, cat, baby, mama, dada, more, up, bye-bye

Progression:
  3.1a - System says word → object highlights
  3.1b - Parent says word → object highlights
  3.1c - Baby approximates word → object responds

3.2 Sound-Symbol Match

Input: Characteristic sound plays Output: Baby touches matching picture

Example:
  "Woof woof" → Three animals shown → Touch dog → Celebration

Progression:
  3.2a - 2 options, very different
  3.2b - 3 options
  3.2c - 4 options, some similar

3.3 Action Words

Input: Movement demonstrating action Output: Word label appears

Actions:
  Clapping → "CLAP"
  Waving → "WAVE" / "bye-bye"
  Bouncing → "BOUNCE" / "jump"

Progression:
  3.3a - System labels spontaneous actions
  3.3b - System requests, baby performs
  3.3c - Baby requests by approximating word

Tier 4: Structured Play (18-24 months)

Goal: "Games have rules I can learn"

Cognitive targets: Rule understanding, turn-taking, goal-directed behavior

4.1 Simple Sorting

Input: Drag objects to containers Output: Correct = celebration, Wrong = gentle bounce-back

Categories:
  Colors (red things → red bin)
  Shapes (circles → circle hole)
  Size (big → big box)

Progression:
  4.1a - 2 categories
  4.1b - 3 categories
  4.1c - Mixed attributes

4.2 Sequence Builder

Input: Arrange items in order Output: Sequence plays when complete

Examples:
  Train cars in order → train drives
  Blocks stacked → tower stands, falls
  Story panels arranged → animation plays

4.3 Request & Reward

Input: Verbal or gestural request Output: System provides requested item/action

Vocabulary:
  "More" → repeat last action
  "Again" → replay sequence
  Object names → show object
  Pointing → identify and label

Progression:
  4.3a - "More" recognized
  4.3b - Object names recognized
  4.3c - Two-word combinations

Session Logging

Track progress with structured data:

interface Session {
  id: string;
  timestamp: Date;
  duration_seconds: number;
  tier: number;
  activity: string;

  // Engagement metrics
  attention_events: number;
  interaction_events: number;
  anticipation_events: number;

  // Progression signals
  intentional_ratio: number;
  sustained_attention_max: number;

  // Notes
  parent_notes?: string;
  advancement_ready?: boolean;
}

Implementation Status

Phase 1: Core System ✓

Phase 2: Face Detection ✓

Phase 3: Sound Classification

Phase 4: Touch Interface

Phase 5: Language


← Back to Overview | Try the Activities →