6 big ethical questions about the future of AI | Genevieve Bell

Let me tell you a story about artificial intelligence

In this section, the speaker introduces the topic of artificial intelligence and its presence in everyday life, particularly in buildings and systems.

The Fascination with Lifts

• The speaker expresses their fascination with lifts and how they are one of the places where AI is already being implemented.

• Lifts running algorithms and proto-artificial intelligence can anticipate people's presence before they even press the button.

• AI in lifts helps optimize energy usage and traffic flow within buildings.

AI Beyond Science Fiction

• The common association of AI with robots and science fiction is discussed.

• The connection between AI and the built world is highlighted as a less explored aspect.

• AI is already present in various places, including buildings and systems.

Scaling Technology Requires More

• Building a new branch of engineering for scaling AI safely, sustainably, and responsibly is introduced as the mission of the 3Ai Institute at the Australian National University.

• An experimental education program, research initiatives, and collaborative efforts are mentioned as approaches to achieve this goal.

• Emphasis on framing questions rather than just solving problems to build a curriculum that allows for diverse conversations and possibilities.

Creating Possibilities for Many

• The focus on creating possibilities for multiple AIs rather than a single one is emphasized.

• Efforts to decolonize imaginations by considering different perspectives and building a curriculum that accommodates various conversations are mentioned.

Approaching the Problem of Scaling AI

• Grounding in history as an initial step towards scaling AI is discussed.

• The speaker shares a personal experience visiting Brewarrina, an Aboriginal meeting place with ancient fish traps, highlighting the importance of understanding past systems.

Building a New Branch of Engineering for AI

In this section, the speaker explains how they are approaching the challenge of building a new branch of engineering for scaling AI.

Experimental Education Program

• The 3Ai Institute aims to establish a new branch of engineering through an experimental education program.

• Researching and teaching AI in diverse locations such as Shakespeare's birthplace, the Great Barrier Reef, and autonomous mines.

Theorizing Cybernetic Systems

• Attention is given to the complexities of cybernetic systems in order to build something new and useful.

• Focus on creating critical thinkers and doers for the next generation through research and engagement.

Collaborative Approach

• Collaboration and collective efforts are emphasized in teaching, research, and engagement activities.

• Framing questions is considered equally important as problem-solving in order to build a comprehensive understanding of AI's many pasts and stories.

Making Room for Different Conversations

• Efforts to decolonize imaginations by building a curriculum that allows for diverse conversations and possibilities are highlighted again.

• Continuous improvement and being open to change are acknowledged as part of the ongoing process.

New Section

This section discusses the fish-trap system as a means of ensuring food supply and its significance in terms of technical, cultural, and ecological knowledge.

The Fish-Trap System

• The fish-trap system was developed to provide sustenance for people gathering at a meeting point of rivers and cultures.

• It is not solely about the rocks or traps themselves but rather the system they create, which encompasses technical, cultural, and ecological knowledge.

• Archaeologists estimate that this system dates back as far as 40,000 years.

• The recorded use of this system goes back to the early 1900s.

• This system has demonstrated remarkable longevity and scale.

• The fish-trap system serves as an inspiration for building meaningful systems in a place with a history of sustainable systems across generations.

New Section

This section emphasizes the importance of understanding our history and legacy when establishing new branches of engineering.

Our History and Legacy

• Our history is intertwined with the legacy of building systems that have been sustained over time.

• Establishing a new branch of engineering requires building upon this legacy and having a clear framework for asking questions about the future.

• Asking challenging questions is crucial in moving beyond traditional problem-solving approaches towards more complex question asking and framing processes.

New Section

This section introduces six key questions that frame an approach for scaling AI safely, sustainably, and responsibly.

Six Key Questions for Scaling AI

1. Autonomy:

• Is the system autonomous?

• The example of an autonomous lift on Bligh Street is used to illustrate partial autonomy.

2. Agency:

• Does the system have agency?

• Controls and limits are necessary to prevent certain actions under specific conditions.

3. Assurance:

• How do we think about assurance in AI systems?

• Considerations include safety, security, trust, risk, liability, manageability, explicability, ethics, public policy, law, and regulation.

4. Interfaces:

• What will be our interfaces with AI-driven systems?

• Will there be communication between humans and machines or between machines themselves?

5. Indicators:

• What indicators will show that AI-driven systems are functioning well?

• Productivity and efficiency should be expanded to include sustainability, safety, and responsibility in the 21st century.

6. Intentionality:

• What is the intent of the AI system? Who determines its purpose and how it shapes the world we live in today?

New Section

This section raises questions about who gets to participate in conversations regarding AI system design and its impact on society.

Participatory Design

• The conversation around AI system design involves considering who gets to be part of it and how it is framed and imagined.

New Section

This section discusses the importance of critical questions and the need for a cohesive framework in AI development.

The Importance of Critical Questions

• Critical questions are essential for guiding AI development.

• Holding all these questions together is crucial.

Thinking about AI as a System

• The Institute focuses on understanding AI as a system and defining its boundaries.

• Drawing from the Macy Conferences on Cybernetics, they emphasize holistic thinking about humans, computers, and the environment.

• The Macy Conferences explored topics such as intelligence, learning, and technology's role in shaping our future.

Reclaiming the Idea of a Holistic System

• The conversations started at the Macy Conference often get overlooked when discussing AI.

• Emphasizing the importance of accommodating culture, technology, and the environment within an AI system.

New Section

This section highlights how systems thinking is core to their work at the Institute and introduces their diverse team.

Systems Thinking at the Institute

• Systems thinking plays a central role in their work at the Institute.

• They aim to bring together diverse perspectives through constant conversation and embracing conflict.

Introduction to the Team

• The team consists of anthropologists, engineers, computer scientists, physicists, journalists, policy experts, etc.

• Their range of experiences and expertise contributes to powerful collaboration but also presents challenges.

Building Something New Together

• Building a new way of doing things requires commitment and bringing others along on this journey.

• The Institute opened its doors to an education program and launched a master's program in 2018.

• They have had two cohorts of master's students and one cohort of PhD students from diverse backgrounds.

New Section

This section emphasizes the collective effort and shared purpose required to make a meaningful impact.

The Power of Collective Effort

• Real change is brought about by a collection of people with a shared sense of purpose, not just lone inventors.

• The speaker shares her experience in Silicon Valley, highlighting the importance of collaboration.

Starting Where You Stand

• Making a difference starts with acknowledging the traditional owners of the land and paying respect to their elders.

• Recognizing that we gather in many places and acknowledging the traditional owners and elders everywhere.

Acknowledging Aboriginal History

• Aboriginal people have continuously occupied Australia for at least 60,000 years, building social systems and technologies.

• As Australians, we carry the privilege and responsibility of this history wherever we go.

Thinking Differently and Collective Thinking

In this section, the speaker emphasizes the importance of thinking differently, asking different kinds of questions, and looking at the world holistically. They also highlight the significance of collective thinking for envisioning the future and achieving scalability.

The Power of Different Perspectives

• The speaker believes that to think about the future and scale effectively, it is crucial to think differently.

• Humans being in it together allows for responsible, safe, and sustainable thinking.

Embracing Holistic Thinking

• It is essential to ask different kinds of questions and look at the world holistically.

• By considering systems as a whole, we can gain a better understanding of complex issues.

Importance of Collective Thinking

• The only way to truly think about the future and achieve scalability is by doing it collectively.

• Finding like-minded individuals who want to embark on this journey together is crucial.

By embracing different perspectives, holistic thinking, and collective efforts, we can approach challenges with innovative solutions and create a sustainable future.