← Back to Work

IBM Watson & Sesame Street: Intelligent Play and Learning Platform

IBM Research & Sesame Workshop · 2016-2018

Researcher, Early Childhood Learning & Children's Media Expert

Overview

This groundbreaking project brought together two industry giants from different domains: IBM Research (technology) and Sesame Workshop (media) to create the industry's first cognitive vocabulary learning app for young children. The platform used IBM Watson's AI capabilities to deliver personalized vocabulary learning experiences that adapt to each child's unique needs and progress.

As an early childhood learning and children's media expert on the IBM Research team, I worked alongside Machine Learning and Natural Language Processing researchers, serving as a critical bridge between the two organizations.

My Contributions

  • Bridge Between Domains: Acted as the critical link between IBM Research and Sesame Workshop, helping both teams understand each other's domains and methodologies.
  • Guided AI Application: Worked directly with Machine Learning and Natural Language Processing researchers to help advance their understanding of how children learn and play.
  • Educational Framework: Provided guidance on vocabulary acquisition research and best practices in early childhood education.
  • User Experience Design: Designed user interfaces appropriate for young learners interacting with emerging technologies like speech and visual recognition.
IBM Watson technology Sesame Street characters

The Word Web Innovation

At the heart of the platform was an innovative approach called "The Word Web"-a semantic network of curated vocabulary words connected by their relationships. This approach acknowledged that vocabulary learning is contextual and cultural, with no predetermined sequence that works for all children.

The Word Web was sourced from the Children's Book Test database and contained thousands of words. The system created personalized learning pathways that allowed children to explore Sesame Street videos and interactive content tailored to their individual vocabulary acquisition rates.

Why This is Original

  • First Industry Collaboration of its Kind: Unprecedented partnership between IBM Research (one of the world's most prestigious technology organizations) and Sesame Workshop (global leader in children's media and education)
  • AI for Early Learning: Original research on the use of Artificial Intelligence in language learning for young children
  • Personalized Assessments: Pioneered the use of AI in creating adaptive assessments that determine a child's current vocabulary range and deliver personalized learning experiences
  • Automated Assessment Generation: Developed technology that could automatically generate assessment questions, significantly reducing the time-intensive work traditionally required of educators

Pilot Results

The pilot program demonstrated that kindergarteners could learn advanced vocabulary words like "arachnid," "amplify," "camouflage," and "applause"-words typically considered above their grade level. Students not only learned the words but also understood and applied their meanings in context outside of the application.

In one memorable example, when a spider appeared in the classroom, a student excitedly shouted "arachnid!"-demonstrating real-world transfer of learning.