👁️ Module 3: Object Tracking

Following objects with vision

Use the camera to detect objects and make the robot respond to what it sees.

Learning Objectives

  • Understand object detection as "finding things in pixels"
  • Connect detected objects to robot actions
  • See how tracking enables interactive behavior

Hands-On Activities (Robot)

  • Object tracking: Robot follows a colored object in the camera view. Move the object and watch the arm track it. Experiment with different colors and lighting.
  • Hand tracking: Control the arm with hand gestures. Understand how the camera sees your hand and maps it to arm motion.
  • Test different objects and lighting: Try objects of different sizes, shapes, and colors. See what makes tracking easier or harder.

Off-Robot / Tactile Activity: Where's the Object?

Reinforces: Detection = finding (x, y) and size. Objects live at coordinates in the image.

How to Run It
  1. Show a grid with a "hidden" object (e.g., red square).
  2. Kids call out coordinates (row, column) to locate it. First to find it wins.
  3. Add a "bounding box" game: draw a rectangle around the object using 4 numbers (x, y, width, height).
👥 Team activity

Teamwork

  • One holds the object, one watches the screen and guides movement
  • Build a "tracking challenge" course with waypoints