Welcome to the World of Audio Computers | Jason Rugolo | TED

Dreaming of the Future

The speaker reflects on childhood dreams about technology and discusses the need for a healthier relationship with technology.

Childhood Dreams and Technology

• Reflects on childhood dreams about the future of computers.

• Shares experience funding deep tech at ARPA-E and working at Google X.

• Expresses the need for a new kind of computer that aligns with human language.

Introducing the Audio Computer

The speaker introduces a prototype "audio computer" designed for natural language computing.

Prototype Introduction

• Unveils the concept of an "audio computer" that focuses on natural language interaction.

• Highlights that the device does not have a screen, emphasizing reliance on auditory space.

• Discusses how these devices aim to replace visual computers with audio-based user interfaces.

Conversational Interaction

Demonstrates conversational interaction with the audio computer prototype.

Conversational Demo

• Showcases a conversation between Jason and an AI assistant named Q.

• Illustrates how natural language conversation differs from robotic voice commands.

The Power of Spoken Language

Explores the significance of spoken language in communication and neuroscience.

Importance of Spoken Language

• Emphasizes spoken language as a fundamental form of human communication.

• Discusses how conversation facilitates collective thinking and emotional connection.

Audio Computing Revolution

Discusses the potential impact of audio computing on human-computer interaction.

Audio Computing Advantages

• Envisions a future where audio computing enhances user experiences beyond traditional phone interactions.

New Section

In this section, the speaker discusses the importance of reducing screen time and integrating auditory user interfaces into daily life for a more immersive experience.

Integrating Auditory User Interfaces

• The goal is to be heads-up and hands-free for more parts of the day by reducing reliance on visual apps like Instagram or TikTok.

• The device is designed as an all-day wearable for the ear, focusing on enhancing hearing capabilities while integrating a mixed-reality aspect to control personal soundscape.

• Through psychoacoustics research, they created a dome with custom speakers to simulate virtual soundscapes, offering unprecedented control over auditory experiences.

Exploring Mixed Audio Reality

This part delves into creating virtual auditory space through advanced technology and understanding neural algorithms for a compelling mixed audio-reality device.

Creating Virtual Auditory Space

• By hacking the auditory system and utilizing psychoacoustics research, they can transport users auditorily to various environments with precise sound positioning.

• Reverse-engineering neural algorithms allows them to code virtual auditory space into software, essential for a captivating mixed audio-reality experience.

Innovative Audio Transformations

The speaker showcases various applications of audio transformations done by software and highlights the endless possibilities for audio computers in different fields.

Applications of Audio Transformations

• Demonstrates beamforming, computational auditory scene analysis, denoising, transcription, translation, text-to-speech with style transfer apps—all showcasing diverse audio capabilities driven by software.