VIDEO
HIGHLIGHT
Log InSign up
Deb Roy: The birth of a word
SummaryTranscriptChat

Deb Roy: The birth of a word

The Journey of Capturing Life's Moments

Introduction to the Project

  • The speaker introduces a concept of recording life, capturing every spoken word and action for future reflection and analysis.
  • The moment of bringing their first child home is highlighted, marking the beginning of this unique journey with a special home video recording system.

Home Video Recording System

  • The house is equipped with cameras and microphones in every room, creating a comprehensive capture environment.
  • Over three years, approximately 250,000 hours of audio and video were recorded, making it the largest home video collection ever created.

Personal Impact and Scientific Purpose

  • The family has experienced immense personal value from these recordings while also aiming to study language acquisition in children.
  • Privacy measures were implemented as data was shared with a research team at MIT to analyze social influences on language learning.

Analyzing Everyday Patterns

  • Motion analysis techniques are employed to extract "space-time worms," allowing researchers to visualize activities within the home over time.
  • This technology enabled transcription efforts that resulted in over seven million words being documented from their daily interactions.

Language Development Insights

  • A time-lapse audio representation illustrates the evolution of the child's speech from "gaga" to "water" over six months.
  • By his second birthday, the child had learned 503 words; researchers began analyzing why certain words were acquired before others.

Caregiver Speech Complexity

  • A graph shows how caregiver utterances simplify when introducing new words, then gradually increase in complexity as the child learns.
  • This pattern suggests caregivers subconsciously adjust their language complexity based on the child's developmental milestones.

Feedback Loops in Language Learning

  • The interaction between child and caregivers creates feedback loops that enhance language acquisition through responsive communication strategies.

Visual Contextualization

Interactive Video Analysis of Language Learning

Observations from a Living Room Interaction

  • The speaker presents an interactive video showcasing 30 minutes of life in a living room, featuring him and his son. Video analytics track their movements, with the son leaving red ink and the speaker green ink.
  • Time is visualized on a vertical axis to reveal interaction traces, leading to the identification of "social hot spots" (knots of two colors) and "solo hot spots" (spiral threads), which may influence language learning.

Understanding Language Acquisition Patterns

  • The research aims to explore how exposure to words correlates with their acquisition by analyzing interaction patterns alongside language exposure.
  • An example is provided where the word "water" is tagged during an interaction between the nanny and child, allowing for data collection on every instance the child hears this word in context.

Creating Wordscapes from Data

  • The concept of "wordscapes" emerges, illustrating where specific words are used within different contexts; for instance, "water" predominantly appears in kitchen-related activities.
  • A comparison is made using the word "bye," showing its structured occurrence at home entrances, indicating varying contexts for different words.

Expanding Research Beyond Home Environments

  • The analysis extends beyond domestic settings into public media, treating mass media as common ground for language understanding.
  • By analyzing television content through event structures and social media comments (about three billion monthly), researchers can link conversations about TV content back to specific events.

Visualizing Communication Dynamics

  • This new approach generates a broader view of communication dynamics by linking commentary on social media directly to television content through semantic analysis.
  • Skyscrapers represent commentary linked to TV content rather than personal interactions; this method allows examination of engagement properties instead of mere viewership numbers.

Exploring Co-viewing Dynamics

  • Researchers can trace how specific pieces of content drive discussions across social networks, revealing complex relationships between viewers' comments and televised events.

Connecting Mass Media and Social Media

The Role of Influential Figures

  • Discussion on a "pro-amateur" media critic who has a significant following, illustrating how individual influencers can drive engagement with mass media.
  • This influencer acts as a crucial link between traditional mass media and social media platforms, enhancing the conversation around televised content.

Engagement with Content

  • Example of President Obama's State of the Union address highlights remarkable real-time engagement from the public, showcasing how specific content can ignite widespread discussion.
  • The ability to analyze unstructured language allows for a real-time understanding of national sentiment and social reactions to broadcasted events.

New Insights into Social Dynamics

  • As data collection capabilities improve, new social structures and dynamics are revealed that were previously invisible, akin to using a microscope or telescope for better visibility.
  • Personal reflection on passing down recorded memories to future generations emphasizes the profound implications of this data-driven understanding for individuals and society at large.

Memorable Family Moments

  • A personal anecdote about capturing a significant moment in his child's life illustrates the emotional impact of recorded memories and shared experiences.
Channel: TED
Video description

http://www.ted.com MIT researcher Deb Roy wanted to understand how his infant son learned language -- so he wired up his house with videocameras to catch every moment (with exceptions) of his son's life, then parsed 90,000 hours of home video to watch "gaaaa" slowly turn into "water." Astonishing, data-rich research with deep implications for how we learn. TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes. Featured speakers have included Al Gore on climate change, Philippe Starck on design, Jill Bolte Taylor on observing her own stroke, Nicholas Negroponte on One Laptop per Child, Jane Goodall on chimpanzees, Bill Gates on malaria and mosquitoes, Pattie Maes on the "Sixth Sense" wearable tech, and "Lost" producer JJ Abrams on the allure of mystery. TED stands for Technology, Entertainment, Design, and TEDTalks cover these topics as well as science, business, development and the arts. Closed captions and translated subtitles in a variety of languages are now available on TED.com, at http://www.ted.com/translate.