Exploring the Future of Augmented Reality Glasses

Introduction to AR Technology

• The speaker introduces their experience with two rare augmented reality glasses: Meta Orion Smartglasses and Snapchat AR Spectacles, both not available to the public yet.

• A comparison is made between VR headsets and smartglasses, highlighting their respective strengths and weaknesses in terms of technology and usability.

The Quest for Augmented Reality

• The speaker discusses the challenge of creating a product that combines the immersive technology of VR with the everyday usability of smartglasses.

• They emphasize that both Meta and Snapchat are exploring different approaches to develop augmented reality glasses, which are still in prototype stages.

Meta Orion Project Overview

• The Meta Orion system consists of three components: glasses, a wireless computer puck, and a wrist strap for input.

• The experience provided by these glasses is described as unprecedented, allowing users to see digital overlays on real-world environments.

User Experience with Meta Orion

• Demonstrations included basic tasks like scrolling through Instagram in an augmented space, showcasing lightness (100 grams) and built-in audio features.

• Interaction was facilitated through gestures detected by a wristband rather than direct hand tracking; this wristband measures electrical impulses from the user's arm.

Innovative Input Methodology

• The EMG wristband uses electromyography to interpret muscle signals for gesture control, achieving about 80% accuracy during use.

Augmented Reality Glasses: A New Frontier?

Eye Control and Gesture Recognition

• The glasses allow for eye control and gesture recognition, enabling users to scroll through apps like Instagram seamlessly while looking at the interface.

• A demonstration showcased the ability to identify ingredients on a table using built-in AI, suggesting smoothie recipes based on what it recognizes.

Augmented Reality Features

• An impressive aspect of the demo was the AR feature that displayed blue dots labeling ingredients in real-time as the user moved around.

• This labeling effect created an immersive experience reminiscent of science fiction, enhancing interaction with physical objects.

Shared Experiences in 3D Space

• The final demo involved two users engaging in a shared 3D Pong game by focusing on a QR code, which served as an anchor point for their augmented reality experience.

• The game utilized hand tracking technology to map movements onto virtual paddles, creating a competitive yet fun environment exclusive to those wearing the glasses.

Technical Marvel of Design

• The glasses incorporate advanced technology including multiple sensors for eye and environment tracking, micro-LED projectors, and custom silicon for data processing.

• They are designed with thermal management in mind; materials like magnesium ensure rigidity while also acting as heat sinks for internal components.

Future Prospects and Challenges

• Despite showcasing this innovative product, Meta has no plans to sell these glasses currently; they view this as part of ongoing development rather than immediate commercialization.

Snapchat AR Spectacles vs. Meta Glasses: A Detailed Comparison

Overview of Snapchat AR Spectacles

• The Snapchat AR Spectacles present a more technological appearance compared to previous models, integrating augmented reality directly into the glasses without needing additional hardware.

• Unlike Meta's glasses, which require a separate smartphone-sized computer, the Snapchat glasses operate independently with all necessary components built into the frames.

Design and Build Quality

• The materials used in the Snapchat glasses are primarily black plastic, which contributes to weight savings while maintaining rigidity; however, they include metal bands for heat dissipation.

• Weighing 228 grams, these spectacles are described as large and heavy but aim for balance despite their mass.

Display Features

• Upon activation, two key differences in display become apparent: resolution and field of view. The Snapchat glasses offer higher resolution menus compared to Meta's pixelated visuals.

• The field of view is notably less at 46 degrees versus Meta's 70 degrees; this difference becomes significant during use when head movement can lead to clipping of displayed content.

Immersion and User Experience

• Users may not initially notice the limited field of view while engaged with applications but will experience interruptions when moving their heads or looking around.

• An example involving a golf game illustrates how peripheral vision limitations affect gameplay; users must frequently shift focus between different points within their limited view.

Unique Technological Features

• One standout feature is the electrochromic tint that adjusts from clear to tinted automatically, enhancing readability and immersion by fading out background distractions.

• This technology allows users to feel more immersed in experiences similar to VR headsets by creating a clearer separation between overlaid content and real-world surroundings.

Developer Focus and Product Status

What Can You Do with AR Glasses?

Overview of Snap's AR Glasses and Applications

• Users can start developing apps for Snap's AR glasses by joining the developer program, which requires a $100 monthly fee and a one-year commitment. This opens up opportunities to create various applications, including lenses for Snap OS.

• Several applications are already available for the glasses, such as a golf app, a browser app, and a music creation app. Notably, there is an equivalent to "Beat Saber" called "Beatboxer," along with impressive shared space experiences that do not require QR code scanning.

• The strategy of releasing these glasses early allows users to explore their potential uses creatively. This approach encourages innovation in how people interact with augmented reality (AR).

Personal Use Cases for AR Glasses

• One envisioned use case involves learning musical instruments through visual overlays similar to "Guitar Hero." This could enhance the learning experience by providing real-time guidance on playing various instruments.

• Another exciting idea is an airplane app that outlines territories or states visible from the window. It would highlight landmarks and monuments as users look out, enriching their travel experience with contextual information.

Challenges Facing Current AR Technology