Full Keynote: Introducing Copilot+ PCs

Name: Full Keynote: Introducing Copilot+ PCs
Uploaded: 2024-05-21T00:00:00.000Z
Duration: 2 h 14 min 52 s

New Section

Satya Nadella introduces the event, reflecting on the history of Windows and the evolution towards AI in computing.

Reflection on Computing Evolution

Satya Nadella reminisces about past milestones in computing, highlighting the shift towards AI.

Discusses the historical pursuit of creating computers that understand humans rather than vice versa.

Emphasizes advancements in user interfaces, memory retention, and reasoning capabilities leading to anticipatory computing.

Windows Copilot Platform Shift

Satya Nadella discusses Microsoft Copilot as an everyday AI companion empowering users across various industries.

Microsoft Copilot Features

Introduction of Microsoft Copilot as an AI companion enhancing productivity and knowledge access.

Empowerment of individuals and organizations through Copilot for increased creativity and connectivity.

AI Wave Driving Computing Revolution

Delving into the fundamental role of scaling laws in driving the intelligence revolution through distributed computing.

Scaling Laws Impact

Comparison between Moore's Law and scaling laws of deep neural networks driving intelligence revolution.

Shift towards distributed AI experiences beyond Cloud to devices for enhanced performance and privacy.

Introduction of Copilot+ PCs

Unveiling a new category of Windows PCs engineered to leverage distributed AI capabilities across Edge and Cloud.

Features of Copilot+ PCs

Introduction to Copilot+ PCs designed to harness distributed AI power for enhanced user experience.

Rethinking core architecture with state-of-the-art AI models running locally for unprecedented performance.

Collaborative Ecosystem for Innovation

Highlighting collaboration with industry partners to bring forth innovative solutions leveraging AI on Windows platform.

Collaborative Approach

Partner-first strategy with AMD, Intel, Qualcomm, and OEMs fostering innovation in the Windows ecosystem.

Upgrade to Copilot+ PCs

In this section, the speaker discusses the advancements in PC technology, particularly focusing on the new generation of Copilot+ PCs and their enhanced features.

Most Powerful Windows PCs Ever Built

Copilot+ PCs are highlighted as the most powerful Windows PCs ever constructed.

These PCs offer access to advanced AI through Microsoft Copilot.

Introduces new productivity, creativity, and communication capabilities akin to superpowers.

Enhanced Performance of Copilot+ PCs

The new systems architecture of Copilot+ PCs integrates CPU, GPU, and an NPU capable of 40 trillion operations per second.

Windows 11 has been rearchitected for optimal performance and battery efficiency.

Copilot+ PCs outperform MacBook Air with M3 processor by 58% while maintaining all-day battery life.

Microsoft Copilot Enhancements

Updates to Microsoft Copilot make it more accessible and personalized on Windows.

Users can easily interact with Copilot through keyboard shortcuts or taskbar icons.

Offers a flexible app experience allowing resizing, snapping, or full-screen usage.

Enhanced User Experience with Microsoft Copilot

This segment delves into the improved functionalities of Microsoft Copilot within Windows settings and its seamless integration into daily tasks for enhanced productivity.

Seamless Integration of Microsoft Copilot

Users can effortlessly utilize two windows simultaneously and perform actions like drag-and-drop between them.

Provides helpful suggestions within Windows settings for streamlined configurations.

Enables quick actions within File Explorer without opening additional apps.

Integration of OpenAI Technology

Introduction of GPT-4o from OpenAI enhances text, voice, and vision capabilities in Copilot.

Demonstrates how developers can leverage these capabilities for improved user interactions during tasks like gaming.

Interactive Assistance with GPT-4o in Minecraft

This part showcases a practical demonstration where Ryan interacts with GPT-4o in Minecraft, highlighting its natural conversational abilities and problem-solving skills.

Interactive Gaming Assistance

Ryan engages in a natural conversation with GPT-4o while playing Minecraft.

GPT-4o assists Ryan in crafting items by analyzing his inventory within the game environment.

Adaptive AI Capabilities on PC

The discussion focuses on how adaptive AI technologies like GPT models enhance user experiences by understanding context and intent to provide tailored assistance seamlessly.

Adaptive AI Interaction

Demonstrates how GPT models adapt to user needs by identifying context-specific information on screens they analyze.

Shows how GPT models can tailor interactions based on real-time scenarios encountered by users.

Revolutionizing User Experience with On-device AI Models

This part emphasizes how on-device AI models empower PCs to process information efficiently based on user context rather than requiring users to adapt to technology interfaces.

Enhanced Processing Capabilities

Introduction of over 40 new on-device AI models enables efficient processing and reasoning based on user context.

Understanding the Challenge of Information Retrieval

The speaker discusses the challenges people face in finding information stored on their computers efficiently and how current methods like email reminders or keeping multiple browser tabs open are not effective.

The Challenge of Information Retrieval

People struggle to find files, browser tabs, or emails quickly on their computers.

Current workarounds like emailing oneself or keeping many browser tabs open are cumbersome and slow down PCs.

Human memory works differently from how PCs organize information; humans remember based on relationships, visuals, and unique experiences.

Introducing Recall: A Solution for Efficient Information Access

The introduction of Recall, a new system leveraging AI and enhanced PC performance to enable users to access any content they have ever seen on their PC efficiently.

Introducing Recall

Recall leverages AI and improved system performance to provide users with near-instant access to all content viewed on their PCs.

Carolina Hernandez explains how Recall helps her manage various tasks efficiently by quickly retrieving previously viewed content like dresses for her grandmother's wedding.

Example of using Recall to find specific items discussed in chat messages swiftly without scrolling through weeks of conversations.

Recall's Semantic Understanding and Work Application

Discussion on how Recall can understand semantic associations like color hues and its practical application in work scenarios for efficient collaboration and document retrieval.

Semantic Understanding and Work Application

Explanation of how Recall recognizes semantic associations such as colors to aid in search queries.

Recall Experience and AI Integration

In this section, the speaker discusses the Recall experience and emphasizes the integration of AI models into Windows 11 for enhanced user control and privacy.

Recall Experience Details

Recall is the first breakthrough experience enabled by Copilot+PC architecture. It ensures data remains local and secure on the device.

Users have complete control over their captured information, with the ability to edit or delete it.

The integration of AI models in Windows 11 allows for innovative experiences like Recall, utilizing multimodal language models for efficient content organization.

Windows AI Architecture and Breakthrough Experiences

This part focuses on Windows' commitment to making technology accessible through AI integration across various layers, resulting in breakthrough experiences unique to Windows.

Core Windows AI Architecture

Windows integrates AI from chip to cloud, leveraging edge computing for speed, privacy, and energy efficiency.

The reimagined core architecture enables breakthrough experiences exclusive to Windows by weaving AI into every layer of operation.

The Recall experience exemplifies a simple yet sophisticated solution powered by state-of-the-art AI models deeply integrated into Windows 11.

Privacy, Security, and Semantic Indexing

This segment delves into the robust privacy measures implemented within Recall and highlights the creation of a semantic index for efficient content retrieval.

Privacy Measures and Semantic Index

Users can pause, stop, or delete captured content in Recall for enhanced privacy control.

Specific websites or apps can be excluded from data capture by Recall's intelligent system running on-device without accessing private content.

Content captured is transformed into a new semantic index stored locally on devices for quick and intuitive content retrieval compared to traditional indexing systems.

Windows Copilot Runtime: Empowering Innovation

This part introduces the Windows Copilot Runtime as a powerful tool integrating over 40 AI models to drive innovation in app capabilities.

Role of Windows Copilot Runtime

The Windows Copilot Runtime empowers rich experiences like Recall through its diverse set of integrated AI models enhancing app functionalities.

Continuous updates within the runtime ensure quality maintenance of device models while accelerating innovation pace across applications.

AI-Powered Photo Editing with Copilot+PC

Here, the focus shifts towards envisioning an AI-first photos app powered by MPU under Copilot+PC architecture for creative image editing capabilities.

Future Vision: AI-Powered Photo Editing

The vision includes an AI-first photos app leveraging Copilot's capabilities to enhance image focus, composition creativity, and instant photo restoration using super-resolution features.

These summaries provide a detailed insight into key discussions around recall experiences empowered by advanced AI integration within Windows architecture while emphasizing user control over data privacy and security measures implemented within these innovative solutions.

Presentation of Next Generation PC Processors

Lisa Su, Pat Gelsinger, and Cristiano Amon introduce the next generation of PC processors that promise enhanced performance and capabilities for users.

Introducing Next-Gen PC Processors

Lisa Su announces the delivery of advanced PC processors enabling a new class of laptops.

Pat Gelsinger describes it as the beginning of a new era in PCs.

Cristiano Amon emphasizes inclusivity by stating it's for every person everywhere.

The partnership between companies like Intel and AMD is highlighted for this innovation.

Features of Copilot+PCs

Details about Copilot+PC features such as RAM, storage, neural processing units (NPUs), AI capabilities, power efficiency, and security are discussed.

Key Features

Copilot+PCs come equipped with 16GB RAM, 256GB SSD storage, and NPUs specialized for AI tasks.

NPUs in Copilot+PCs offer exceptional AI performance with over 40 trillion operations per second.

These NPUs are highly power-efficient even under full workload conditions.

Security features include Microsoft Pluton chip-to-cloud security on all Copilot+PC devices.

Arm Architecture Integration

The integration of Snapdragon X Series on Arm architecture brings extended battery life and superior performance to Copilot+PC devices.

Arm Architecture Advancements

Qualcomm's Snapdragon X Series integrated into Copilot+PC devices enhances battery life up to 15 hours for web browsing and 22 hours for video playback.

Performance comparisons show superiority over MacBook Air in various aspects like peak performance and sustained multi-performance levels.

App Compatibility and Emulation

Discussion on app compatibility on Copilot+PC devices including native Windows apps support on Arm architecture.

App Support

Major apps like Microsoft 365, Google Chrome, WhatsApp will run natively on Copilot+PC devices from day one.

Introduction of Prism arm emulator ensures efficient app running on Windows 11 platform with Snapdragon X series chips.

Windows Ecosystem Enhancements

Windows ecosystem improvements through Windows Copilot runtime enhancements enabling new experiences for users and developers.

Ecosystem Enhancements

Enhanced Windows Copilot runtime along with new silicon enables novel user experiences yet to be discovered.

Surface Laptop Features Overview

In this section, the speaker discusses the features of the new Surface Laptop, emphasizing its battery life and performance compared to previous models and competitors.

Surface Laptop Battery Life and Performance

The new Surface Laptop boasts the longest battery life on any Surface PC, with about half the battery drain for peak performance. It outlasts both the Surface Laptop 5 and the latest MacBook Air in a web browsing rundown.

With nearly double the battery life of its predecessor, it offers up to 22 hours of local video playback. Additionally, it features WiFi 7 for faster connectivity.

The Pixelsense touchscreen display delivers vivid colors, better contrast, and crisp details with HDR and Dolby Vision IQ technologies.

Typing is enhanced with a quiet, comfortable experience and a precision haptic touchpad that is smooth, responsive, and customizable.

The new Surface Laptop provides incredible performance in a thin, light package with AI experiences unique to Copilot+PCs.

Performance Comparison: New Surface Laptop vs. MacBook Air

This part focuses on a performance comparison between the new Surface Laptop and MacBook Air when running Adobe Photoshop for photo editing tasks.

Photo Editing Performance Test

Performance is crucial for photographers managing numerous photos. Multi-threaded processing performance is highlighted as essential for efficiency.

A comparison test between the new Surface Laptop and MacBook Air running Adobe Photoshop natively showcases responsiveness and precision in editing tasks.

The new laptop's CPU-intensive scenario demonstrates great multi-threaded performance capabilities with up to 32 gigabytes of RAM for handling data-intensive tasks concurrently.

The bright display at 600 nits with P3 color gamut enhances photo editing accuracy while maintaining speed and productivity over competitors like MacBook Air.

Creative Applications Integration

This segment discusses partnerships with Adobe Creative Cloud apps on Copilot Plus PCs like Photoshop, Lightroom, Firefly, Express along with DaVinci Resolve Studio integration.

Adobe Creative Cloud Integration

Adobe's flagship apps are optimized for Copilot Plus PCs including Photoshop, Lightroom, Firefly, Express available immediately; Illustrator Premier Pro coming soon after.

Partnerships aim to optimize these apps for Neural Processing Units (NPU) enhancing creative workflows on thin laptops.

DaVinci Resolve Studio Integration

Collaboration with Black Magic Design to integrate DaVinci Resolve Studio features onto NPU-powered devices like Copilot Plus PCs.

DaVinci Resolve Studio Collaboration

DaVinci Resolve Studio's post-production editing tools are offloaded onto NPUs enhancing visual effects capabilities on thin laptops.

Filmmaker Ron Ames praises NPU technology's impact on storytelling possibilities through tools like Magic Mask enabling instant color corrections in post-production workflows.

Magic Mask Feature Demonstration

Oyin demonstrates using Magic Mask feature for complex color corrections in filmmaking applications on her laptop.

Magic Mask Feature Showcase

Oyin showcases how Magic Mask enables complex color corrections across frames effortlessly by selecting keyframes and swiping to apply changes seamlessly.

Detailed Overview of Transcript

In this section, the speaker discusses the performance and capabilities of the NPU (Neural Processing Unit) in enhancing tasks on a PC.

Performance and Capabilities of NPU

The NPU is enabled, allowing for efficient task management.

CPU and GPU resources are mostly available for other tasks without slowing down the PC.

Mention of offloading Magic MasK to optimize performance.

Innovative Features: Live Captions and Translations

This part highlights the introduction of Live Captions with live translations as a new feature powered by the NPU across Copilot+PCs.

Live Captions and Translations

Live Captions provide real-time captions for any audio passing through the PC screen.

Enhances accessibility by making content more inclusive to a wider audience.

Demonstrates how live captions can aid global communication effortlessly.

Enhanced Translation Capabilities

The discussion focuses on translation capabilities, showcasing automatic switching between languages during video calls.

Translation Capabilities

Automatic switching between Spanish, Mandarin, and Russian languages demonstrated during video calls.

Windows feature ensures consistent translation across various apps locally on the NPU.

Translation from over 40 languages into English currently available with plans for more output languages in the future.

Introduction to Surface Pro: Enhanced Performance and Design

Introducing the all-new Surface Pro with enhanced performance features and design elements tailored for user convenience.

Surface Pro Features

Up to 90% faster than its predecessor, Surface Pro 9, emphasizing speed and performance improvements.

Introduction of OLED display with HDR technology for vivid visuals.

Enhanced camera capabilities including ultra-wide front-facing camera and support for 4K video recording.

Revolutionary Keyboard Design for Productivity

Discussing the innovative design aspects of the new Surface Pro keyboard aimed at enhancing productivity and accessibility.

Innovative Keyboard Design

Two-in-one keyboard designed for both attached and detached use, offering flexibility in positioning.

Additional layers of carbon fiber provide stability especially when used on laps or in varied environments.

Cocreator Experience Overview

In this section, the speaker discusses the Cocreator experience, highlighting how the generated output is influenced by both text prompts and ink strokes.

Understanding Cocreator Experience

The AI-generated output in the Cocreator experience is not solely guided by text prompts but also by ink strokes. This integration refines elements within the image, such as transforming blue blobs into a more detailed valley.

Five machine learning models operate locally on the NPU to enhance output quality efficiently. The co-creative process ensures that each stroke contributes to refining the generated image. A creativity slider allows users to control AI's influence on modifying images, balancing between originality and creative exploration.

Users can adjust a creativity slider to determine how closely the generated image resembles the original drawing. Moving towards increased creativity allows AI more freedom in interpreting and enhancing images. This balance empowers users to iterate further on their creations, fostering limitless expression and creative confidence.

Innovative Image Editing Features

This segment explores innovative features for image editing, emphasizing speed, accessibility, and creative possibilities.

Exploring Image Editing Capabilities

With Restyle Image functionality, users can instantly transform photos with a single click or delve deeper into customization by designing backgrounds using text prompts or preset filters like anime or watercolor for stylization.

The Image Creator tool enables users to generate unique images rapidly, catering to diverse needs such as biomimicry-inspired furniture designs or other abstract concepts not readily available in existing inventories.

Empowering Creative Potential with Copilot+PCs

The discussion focuses on how Copilot+PCs empower individuals through enhanced capabilities and seamless integration of AI technologies.

Unleashing Creative Potential

Copilot+PC devices leverage dedicated silicon layers like NPU for fast processing without relying heavily on cloud services or premium subscriptions. These devices facilitate efficient content creation across various applications like CapCut, enhancing speed and performance through AI-enabled features such as Auto Cutout.

Unmatched Human Creativity and Productivity in the PC Era

The transcript highlights the collaboration of various industry leaders in embracing a new chapter of the PC era, emphasizing unmatched human creativity, productivity, and capability.

Industry Leaders' Commitment

Acer, Asus, Dell, Lenovo, Samsung, HP are fully committed to this new chapter.

"HP is all in."

"All in" commitment from multiple industry leaders.

"What an incredible moment to see the industry coming together."

Exciting New Devices from Partner Companies

Partners showcase innovative devices with advanced features catering to diverse needs.

Partner Devices Overview

Acer's Swift 14 A: Copilot plus exclusive design with a 2.5K resolution touch screen for co-creating.

Asus VivoBook S15: Sleek all-metal design with a 3K OLED display and AI sense camera.

Dell's New Launches: Introducing several new Windows Copilot+PCs for consumers and businesses under XPS, Latitude, Inspiron ranges.

Innovative Offerings from Leading Brands

Leading brands introduce cutting-edge devices focusing on design, performance, sustainability, and enhanced user experience.

Brand Innovations

HP's OmniBook X and EliteBook Ultra: Feature sleek design, long battery life with fast charging capabilities and polystudio tuning for video conferencing.

Lenovo's Launches: Yoga Slim 7X with OLED touchscreen and Thinkpad T14 S adjusting PC performance based on usage patterns.

Diverse Range of High-Performance Devices Available

A wide array of high-performance devices are introduced by various companies offering unique features like extended battery life and cross-device AI integration.

Device Variety

Samsung Galaxy Book4 Edge: Features promise exceptional battery life along with cross-device AI integration between phone and tablet.

Microsoft Surface Pro & Laptop: Unveils new models adding to the impressive lineup of devices available for purchase.

Accessibility and Affordability of Copilot+PCs

Emphasis on availability through Microsoft.com and leading global retailers at competitive prices compared to other options in the market.

Availability Details

Copilot+PCs will be accessible on Microsoft.com as well as through major global retailers starting at $999.