John Maeda's Design in Tech Report 2024: Design Against AI | SXSW 2024

Design Against AI

The speaker introduces the topic of Design Against AI and mentions that this presentation is different from previous ones.

Designing with AI

• The speaker discusses the complexity of AI, mentioning that it can be both loved and questioned by people.

• Talks about the predictability of a certain type of AI, comparing it to human behavior in known situations.

• Discusses the unpredictability of how AI may change professions and questions the outcomes when using AI to scale small ideas.

Conversational Design Evolution

• Explores conversational design's history, dating back to the 1960s, highlighting its significance as an interface.

• Mentions Nicholas Negroponte's book from 1967 predicting a model for conversation adaptation by machines.

Ethical Concerns with Chatbots

• Discusses Joseph Weizenbaum's cautionary tale about chatbots and their potential impact on users' perceptions.

• Highlights Weizenbaum's concerns about creating a delusion of real interaction through chatbots.

Audience Interaction

• Engages the audience with polls to gauge their feelings towards AI, showcasing varying perspectives within the room.

Narrative on Design Systems and Technology Trends

In this section, the speaker discusses the impact of designing systems in the field of design, delving into AI, design thinking, computational design, and technology trends.

Cloning Voice and AI Impact

• The speaker mentions cloning their voice using a less performant model and realizing the potential to automate tasks.

• Reflecting on the cost-effectiveness of creating voice clones through AI models.

Three Categories of Design

• The speaker categorizes design into classical design, design thinking, and computational design.

• Discusses how classical designers view design thinkers and emphasizes the importance of inclusive design.

Technology Trends

• Highlights the rise of AI and machine learning trends in 2018.

• Emphasizes the importance of inclusive design and addresses challenges related to automation imbalance.

Shift Towards Inclusive Design and Remote Work

This segment focuses on making technology and design more inclusive while exploring emerging trends like remote work.

Inclusive Design Challenges

• Discusses strategies for making both technology and design more inclusive.

• Mentions how inclusive design was seen as a response to ethical concerns in technology.

Remote Work Dynamics

• Talks about the rising trend of remote work before its widespread adoption.

• Reflects on companies adapting to digital relevance due to technological shifts accelerated by COVID-19.

Transition to Security Industry & Reflection on Past Events

The speaker transitions into discussing their shift towards focusing on security issues while reflecting on past events like pandemics.

Focus on Security Industry

• Describes transitioning into the security industry due to an interest in life-threatening situations.

• Reflecting on significant global events that impacted society's perception of safety measures.

Pandemic Impact Reflection

• Acknowledges the profound impact of past pandemics with a focus on recovery rates post-pandemic.

• Shares personal reflections on how individuals were affected by pandemic-related losses.

Illustrations Depicting Work Dynamics & Resilience

Illustrations are used to depict work dynamics during challenging times, emphasizing resilience amidst adversity.

Work Dynamics Illustrations

• Showcases illustrations depicting different aspects of working from home versus returning to physical workplaces.

Resilience Amidst Adversity

• Introduces an ambigram illustration symbolizing resilience evolving from adversity.

Insights from Security Industry & Common Misconceptions

** Section Overview: ** Insights from being part of the security industry are shared along with dispelling common misconceptions regarding threats.

Insights from Security Industry

Designing Against AI

In this section, the speaker discusses a list of regrets people have when they are dying and how it has impacted his life. He also delves into the concept of designing against AI and shares insights from the Design in Tech Report.

People's Regrets

• The speaker shares a list of common regrets people have when they are dying, emphasizing the importance of living authentically and maintaining connections with loved ones.

• Expressing feelings, staying in touch with friends, and allowing oneself to be happier are highlighted as crucial aspects to consider in life.

Designing Against AI

• The speaker reflects on designing against AI, finding interest in wordplay and sharing insights from the Design in Tech Report.

• He mentions a stop-motion samurai film made without computer graphics as an example that resonated with him.

Understanding Large Language Models

This part focuses on large language models and their implications for creativity and understanding. The speaker references Ted Chiang's work and emphasizes the importance of human creativity alongside AI capabilities.

Ted Chiang's Perspective

• The speaker introduces Ted Chiang's views on large language models as imperfect approximations that compress information like a blurry JPEG of the Web.

• Chiang argues that human creativity is essential for originality, suggesting that reliance solely on AI may hinder creative expression.

Explaining Large Language Models

• Newspapers are praised for their explainers on large language models, providing valuable insights into complex concepts through graphics and visuals.

AI Learning Resources and Cozy AI Kitchen

In this section, the speaker discusses various resources for learning about AI, including a John Oliver special and books. Additionally, they introduce the Cozy AI Kitchen as a platform to enhance AI skills.

John Oliver Special and AI Learning

• The John Oliver special is highly informative on AI topics.

• Various books are available for learning about AI.

• The Cozy AI Kitchen offers practical experience in enhancing AI skills.

Adapting to Change in the Field of AI

This part focuses on adapting to changes in the field of artificial intelligence by introducing the Acorn framework for AI engineering and providing real coding examples.

Adapting to Changes

• The Acorn framework aids in adapting to evolving trends in AI.

• Real coding examples are provided for practical understanding.

• Collaboration with the semantic kernel community enhances skill development.

Personal Anecdotes and Cooking with AI

Personal anecdotes are shared, highlighting the importance of hands-on experience with coding in understanding AI concepts. The speaker introduces cooking sessions related to AI at the Cozy AI Kitchen.

Importance of Hands-On Experience

• Coding experience is crucial for comprehending complex AI concepts.

• Practical recipes are provided for easy application.

• Engaging in coding activities leads to becoming proficient in AI skills quickly.

Family Anecdote on Technology Adoption

A humorous family anecdote is shared regarding technology adoption, emphasizing the need to adapt to new technologies based on individual preferences.

Family Technology Interaction

• An amusing incident involving technology adaptation within a family setting is recounted.

• The importance of accommodating individual preferences when using technology is highlighted.

• Flexibility and openness to changing technological preferences are essential.

Advancements in Robotics and Spatial Computing

This segment explores recent advancements in robotics, such as Optimus folding laundry, Figure Bot's learning capabilities, Boston Dynamic Atlas' agility, and spatial computing developments like Apple Vision Pro.

Robotics Advancements

• Optimus showcases efficiency by folding laundry autonomously.

• Figure Bot excels at rapid learning tasks with minimal training required.

• Boston Dynamic Atlas demonstrates remarkable agility through physical workouts.

Exploration of AR/VR Technologies

The discussion delves into augmented reality (AR) and virtual reality (VR) technologies, referencing a book by Jerri et al., experiences with AR/VR headsets, and personal preferences towards these immersive technologies.

AR/VR Technologies Discussion

• Insights from Jerri et al.'s book provide valuable information on AR/VR/XR technologies.

• Personal experiences with AR/VR headsets influence individual perspectives on their usage.

• Varied opinions exist regarding ownership and utilization of AR/VR devices among individuals.

Interactive Digital Creations by Students

Interactive digital creations made by high school students are showcased, including Sinerider—a math nerd game—and Poetry Camera that generates poems based on images captured by users.

Student-Created Digital Creations

• Sinerider offers an engaging way to interact with mathematical concepts through gameplay.

• Poetry Camera creatively combines photography with poetry generation for artistic expression.

New Section

In this section, the speaker introduces the ABCs of AI and discusses the evolution of large language models over the past decade.

Evolution of Large Language Models

• Large language models have been growing over the last 10 years, contrasting with VR technology that took 50 years to develop.

• The comprehensive survey on pretrained foundation models highlights the significant growth in size and complexity of these models over time.

• Different types of models are depicted in a graph: pink represents language models, blue for vision models, green for graph models, and unified pretrained models on the far right.

• Unified pretrained models aim to encompass various modes similar to "Lord of the Rings: one model to rule them all."

New Section

This part delves into how AI content on platforms like YouTube tends to be sensationalized and explores different aspects of AI terminology.

Sensationalization in AI Content

• The speaker observes that many AI-related YouTube videos feature sensational thumbnails designed to attract viewers' attention.

• Caution is advised when engaging with such content due to its sensational nature.

• The speaker presents a simplified way to understand AI through the ABCs framework, emphasizing distinctions between large and small models.

• Differentiating factors such as model size, openness, closedness, and multimodal capabilities are highlighted as essential considerations in understanding AI.

New Section

This segment elaborates on additional dimensions within AI terminology beyond the basic ABC framework.

Beyond ABCs: Advanced AI Terminology

• Apart from large vs. small and open vs. closed distinctions, other terminologies include mono-modal vs. multimodal models.

• The speaker mentions embeddings models versus completion models as well as full model fine-tuning versus lower fine-tuning approaches.

• Function-calling models are introduced as intriguing concepts within advanced AI terminology.

New Section

Here, the discussion expands further into nuanced aspects of advanced AI concepts beyond traditional categorizations.

Nuanced Concepts in Advanced AI Terminology

• The speaker introduces additional complexities in AI terminology beyond A-Z classifications.

• Concepts like embeddings vs. completion models and function-calling agents are discussed as emerging trends in advanced AI applications.

New Section

This part focuses on agents in artificial intelligence applications and their significance for future developments.

Significance of Agents in Artificial Intelligence

• Agentic UX is introduced as a concept where user experience shifts towards interacting through surrogates rather than direct interfaces.

• The prevalence of agents is expected to increase significantly this year according to industry insights shared by Kwame Nyanning.

New Section

Exploring creative human elements within artificial intelligence design processes is central to this segment.

Human-Centric Design Elements in Artificial Intelligence

• Shiny things represent handcrafted or speed-crafted elements within AI design processes that reflect unique human sensibilities not easily replicated by machines.

Section 1: Introduction and Speedcraft

In this section, John introduces the concept of Speedcraft and demonstrates how quickly audio can be generated using PlayHT.

Speedcraft Demonstration

• John showcases the generation of audio by pressing a button, which takes approximately 25 seconds.

• Latency in computation is rapidly decreasing, leading to predictive creations with negative milliseconds latency.

Section 2: Accelerating Changes in Technology

John discusses the increasing pace of technological advancements and its impact on various professions.

Technological Advancements

• Emphasizes the continuous acceleration of technology.

• Highlights the profound changes expected in product design and management due to AI tools enhancing skills.

Section 3: Impact on Marketing and Product Work

The discussion revolves around how AI is influencing marketing and product work.

Influence of AI

• Adoption of design systems and AI prompting are crucial computational skills.

• AI impacts both attraction (marketing) and retention (product) loops simultaneously.

Section 4: Function-calling Models

Exploring function-calling models and their implications on user journeys.

Function-calling Models

• Function-calling models revolutionize user journeys by enabling direct access to desired outcomes without traditional steps.

• Function-calling reshapes marketing and product relationships, transitioning towards Zero UI era.

Section 5: Makers vs. Talkers

Contrasting makers' roles with talkers' roles in technology development.

Makers vs. Talkers

• Discussion on makers being disrupted by new technologies like GitHub Copilot, impacting software development processes.

• Highlighting how designer-makers are adapting to novel ways of building products compared to traditional methods.

Conclusion: Embracing Change for Relevance

Encouraging adaptability to change for relevance in evolving industries.

Embracing Change

• Acknowledges the necessity of embracing change for relevance in dynamic fields like technology.

Critical Thinking and Design in the Age of AI

In this section, the speaker discusses the importance of critical thinking in the current era, contrasting its application in for-profit and not-for-profit sectors. The speaker also touches on various resources related to AI and critical thinking.

Critical Thinking and Time Constraints

• Critical thinking is a valuable skill that requires time and effort to develop.

• It involves deep thought processes that are time-consuming.

• Corporations focus more on scaling rather than critical thinking due to time constraints.

• Not-for-profits excel at critical thinking as they invest time in it.

Resources for Critical Thinking

• Various papers provide insights into foundation models, AI risks, and hard problems in AI.

• Papers like "Dangers of Stochastic Parrots" highlight crucial aspects of AI.

• Erik's work on human tasks versus AI automation offers a productive framing for skill development.

• Understanding new tasks facilitated by AI can enhance skill-building strategies.

Humanizing Technology Through Design

This part delves into how design humanizes technology, drawing parallels with historical contexts like the Bauhaus movement. The speaker emphasizes the role of design in shaping technology while navigating ethical considerations.

Humanization Through Design

• Design plays a crucial role in humanizing technology throughout history.

• The Bauhaus movement exemplifies designing products for user benefit.

• Despite humanizing technology through design, caution is advised against over-humanizing AI.

• Balancing between humanization and technological advancement is essential.

Value Proposition and Ethical Considerations

• Emphasizing critical value creation beyond tangible benefits like privacy is vital.

• Privacy as a value adds depth to product offerings.

• Acknowledging the responsibility to use AI ethically underscores the need for conscious decision-making.

• Sarah Gold's work on trust-building services highlights ethical considerations in design patterns.

New Section

In this section, the speaker discusses the unique properties of a new design material and its implications on product development.

Properties of New Design Material

• The material possesses three distinct properties:

• It never gets tired.

• It can span infinite space.

• It exhibits qualities that make it seem alive.

• These properties revolutionize product design by allowing for incomplete products and instrumentation to monitor changes over time.

New Section

This part delves into computational thinking, the impact of AI on work dynamics, and the importance of being critical in utilizing AI for customer use cases.

Key Points

• Computational thinking is crucial as it aids in understanding computation processes beyond just coding.

• AI will significantly alter work methodologies, emphasizing gradual change rather than immediate transformation.

• Being critical of AI applications in customer scenarios is essential to harness its value effectively.

New Section

The speaker emphasizes the gradual nature of technological advancements like AI integration and highlights the need for critical evaluation in business contexts.

Insights Provided

• Technological shifts, such as AI implementation, occur gradually rather than instantaneously.

• Critical assessment of AI's suitability for specific customer needs is pivotal for successful adoption and value creation within businesses.

New Section

This segment focuses on design's role in articulating and creating value through innovative approaches like those demonstrated by Sarah Gold.

Noteworthy Points

• Design plays a crucial role in articulating and generating value within evolving technological landscapes.