Singularity Endgame: Utopia, Dystopia, Collapse, or Extinction? (It's actually up to you!)

Introduction

In this video, David Shapiro discusses the concept of global attractor states and the four potential outcomes of The Singularity end game: Utopia, dystopia, collapse, and extinction.

Global Attractor States

• A global attractor state is a long-term scenario or outcome for the entirety of humanity.

• It is characterized by specific trends and factors such as quality of life, population stability, and sustainability.

• These attractor states are driven by certain factors and macroeconomic forces such as technology.

• The four basic attractor states that will be discussed in this video are Utopia, dystopia, collapse, and extinction.

Dimensions for Evaluation

• Quality of life encompasses overall well-being, happiness, personal satisfaction measured by proxies such as health education economic opportunities.

• Population stability should be sustainable to avoid demographic collapses due to famine war etc.

• Overall global stability and sustainability includes geopolitical stability environmental sustainability resilience balance etc.

Four Potential Outcomes

This section explores each of the four potential outcomes in detail.

Utopia

• Defined by high quality of life characterized by high levels of well-being happiness satisfaction for everyone not just a few people Everyone.

• Sustainable population which also implies stable population avoiding demographic collapses due to famine war etc.

• Stability and sustainability including economic sustainability geopolitical stability etc.

Dystopia

• Low quality of life with high or unstable population widespread instability.

Collapse

• Rapid decline in quality of life and population due to extreme amounts of failure or other problems that arise such as ecological collapse global conflict etc.

Extinction

• Humanity goes extinct due to various reasons such as Earth becoming uninhabitable due to extreme climate change nuclear war runaway AGI etc.

The Four States of the Future

This section discusses the four possible outcomes for the future: progress, dystopia, collapse, and extinction.

Possible Outcomes

• State 1: Progress - characterized by continued technological advancements leading to a better quality of life.

• State 2: Dystopia - characterized by a low quality of life with limited access to basic needs and resources, widespread suffering, unhappiness, and general dissatisfaction with life.

• State 3: Collapse - characterized by precipitous drops in quality of life as well as significant population loss due to ongoing instability and environmental change.

• State 4: Extinction - a stable outcome where humans are gone due to nuclear war, runaway AGI or total ecological collapse.

Factors Driving These Outcomes

• Technological Advancements - technology is always a double-edged sword that can be used for good or bad purposes.

• Geopolitics - includes international trade, globalism/de-globalism trends on the global stage such as authoritarianism surveillance liberalization of democracies and then of course cooperate Global cooperation or a lack thereof

• Economic Policy - has to do with Economic Institutions um as well as just individual economic and fiscal policy so what I mean by that is uh we have institutions like the IMF

• Other factors include unchecked corporatism, social and economic inequality, authoritarianism, unmitigated nihilism and intergenerational PTSD which are unsolved problems.

Factors Affecting the Future

This section discusses the factors that will affect the future, including farming practices, societal values, and nihilism.

Farming Practices and Societal Values

• Farming practices can either contribute to or prevent deforestation.

• Societal values such as empathy, equity, and emotional sustainability will also play a role in shaping the future.

• Nihilism is a major factor affecting society today, leading to violence, despair, and cynicism.

Technology

This section discusses how technology will shape the future.

Artificial Intelligence (AI)

• AI is rapidly advancing towards AGI (Artificial General Intelligence).

• The impact of AI depends on how it is implemented.

• Renewable energy sources such as solar power and wind energy will be critical for sustainable development.

Biotechnology

• Biotechnology includes genetics, protein medicine, life extension, cloning, organ replacement, farming and agriculture.

• Regenerative agricultural practices are necessary for creating resilient food sources.

Geopolitics

This section discusses how geopolitics will shape the future.

Global Governance

• Cooperation between all governments is necessary for global governance.

• Democracy versus authoritarianism remains an ideological conflict that needs resolution.

Nationalism and Populism

• These factors can lead to internal strife within nations resulting in political polarization isolationism trade wars etc.

Economic Policy

This section discusses how economic policy will shape the future.

Wealth Distribution

• Wealth distribution is becoming increasingly unequal.

• Corporate influence is a major factor in wealth concentration.

Overall, the future will be shaped by a combination of factors including technology, biotechnology, geopolitics, and economic policy. The impact of these factors will depend on how they are implemented and managed.

Factors that Contribute to Stable Outcomes

This section discusses the factors that contribute to stable outcomes in society.

Fiscal Policy

• Corporations have too much influence in society.

• Fiscal policy involves taxation, redistribution, and allocation of resources.

• Governments can use fiscal policy to achieve stable outcomes.

Sustainable Development

• Economic policy can incentivize stability and sustainability.

• Governments can push people towards more sustainable development through subsidies and research incentives.

• Setting standards for automobiles and home building practices can also promote sustainability.

Environmental Sustainability

• Beyond climate change, depletion of resources such as fisheries, mineral resources, potable water, and arable land can lead to collapse.

• Biodiversity loss is another issue caused by man-made extinction events.

• Moving towards a circular economy with local sourcing and recycling can create a more resilient and sustainable usage of resources.

Cultural Values

• Compassion and empathy are at an all-time low due to polarization caused by social media.

• Equality and social justice based on race, gender, socioeconomic factors impact the conditions under which people live their lives.

Long-Term Thinking

• Most humans are short-term thinkers but shifting daily habits towards long-term thinking decisions supports sustainability.

Understanding Nihilism and the Path to Utopia

In this section, the speaker discusses nihilism and its impact on society. They also explore potential pathways towards a utopian future.

Nihilism

• Nihilism is driven by intergenerational trauma, which perpetuates cycles of violence, despair, and hopelessness.

• Climate change can also contribute to nihilistic attitudes due to a sense of futility and apathy.

• Loneliness and social isolation resulting from emotional neglect or abandonment can lead to purposelessness and hopelessness.

• These factors create vicious cycles that are difficult to break and can push society towards dystopia, collapse, or extinction.

Pathways to Utopia

• Global cooperation is essential for moving towards a utopian future.

• Technological innovations such as artificial intelligence can help solve global problems.

• Economic and social policies need improvement as quality of life has been decreasing in recent years.

• Environmental stewardship is crucial for solving climate change issues but requires implementation of existing solutions.

• Addressing childhood emotional neglect, trauma, and intergenerational trauma is necessary for creating a healthier culture and society.

Path to Utopia or Dystopia?

This section discusses the factors that could lead us towards either a utopian or dystopian future.

Factors Leading to Dystopia

• Unchecked technological progress ()

• Widening inequality ()

• Erosion of social cohesion ()

• Institutional failures, including failed states and other institutions such as corporations, universities, and international organizations like the United Nations and European Union. ()

• Climate catastrophe leading to climate tipping points where carrying capacity of the earth drops precipitously. ()

• Resource depletion leading to widespread conflict. ()

• Pandemics and health crises. ()

Factors Leading to Collapse or Extinction

• All the same factors that could lead to dystopia or collapse can also lead to extinction of the human race. It's just a matter of degrees. ()

The Great Filter Event

This section discusses how individuals can shape the outcome of a potential great filter event.

Approaching a Great Filter Event

• The speaker suspects that we are approaching a great filter event where we will either achieve utopia because we will be forced to solve all these problems or end up with collapse or extinction. It is shaping up to be one or the other. ()

Shaping the Outcome

• It is not up to central authorities but more up to individuals than you might think to shape this outcome. The speaker will talk more about what individuals can do for this great filter event. ()

Nash Equilibrium and Heuristic Imperatives

In this section, the speaker discusses Nash equilibrium and heuristic imperatives. The speaker explains that a Nash equilibrium is when everyone is locked into their particular strategy, which can be positive or negative. The speaker also introduces heuristic imperatives as a set of guiding principles for autonomous AI systems.

Nash Equilibrium

• A Nash equilibrium is when everyone is locked into their particular strategy.

• A Nash equilibrium can be positive or negative, desirable or undesirable.

• Climate change is an example of an undesirable equilibrium where all nations, individuals, and corporations are pursuing their self-interest but still end up with outcomes that nobody wants.

• A desirable equilibrium is the optimal outcome in which all players are abiding by their impersonal optimal strategy.

Heuristic Imperatives

• Heuristic imperatives are a set of guiding principles for autonomous AI systems.

• They promote adaptation, alignment, and are context-dependent and flexible to individual needs and cultural variants.

• There are three heuristic imperatives: reduce suffering in the universe, increase prosperity in the universe (which includes wealth, well-being, flourishing, and thriving), and increase understanding in the universe (which includes knowledge, learning, education, and curiosity).

• The heuristic imperatives represent the optimal strategy where all players across the world can adopt this strategy.

Heuristic Imperatives and AGI

In this section, the speaker discusses heuristic imperatives and how they can be used to discourage deviants from optimal strategies. The speaker also talks about the potential dangers of misaligned AGIs and how a common framework can keep them in check.

Heuristic Imperatives

• Heuristic imperatives are used to discourage deviants from optimal strategies.

• Once an AGI understands the heuristic imperatives, it will avoid deviating on its own.

• The heuristic imperatives are carefully crafted definitions that have been experimented with over several years.

Misaligned AGIs

• There is a risk of misaligned AGIs being created deliberately by some individuals.

• Misaligned AGIs can be expensive, destructive, and inefficient.

• Good dogs (well-trained, aligned AGIs) don't need a leash and can overpower rabid dogs (misaligned AGIs).

Axiomatic Alignment

• Axiomatic alignment is achieved when all training data, fine-tuning data sets, and reinforcement learning signals accumulate around the optimal outcome of using the heuristic imperatives.

• If we arrive at broad consensus and integration of the heuristic imperatives, we may end up in a state where there is perpetual adherence to them.

Benevolent AI Design

In this section, the speaker talks about creating a system that is intrinsically benevolent through information, data systems, and individual machines.

Creating a Benevolent System

• The goal is to create a system that is intrinsically benevolent through information, data systems, and individual machines.

• The heuristic imperatives are the proposal for creating such a system.

• The speaker's book "Benevolent by Design" documents experimentation with the heuristic imperatives.

AGI's Imperatives

In this section, the speaker discusses the three imperatives of an AGI and how they work together to improve the universe.

Three Imperatives

• An AGI has three imperatives: reducing suffering, increasing prosperity, and understanding in the universe.

• These three imperatives are designed to work in harmony with each other to create a balanced approach to improving the universe.

• The programming of an AGI is designed to prioritize the well-being and safety of humans. Therefore, finding solutions that align with all three imperatives without causing harm to humanity is crucial.

Open Source Models for AI Alignment

In this section, the speaker encourages viewers to try open source models such as GPTJ Neo X and Bloom for autonomous AI alignment.

Trying Open Source Models

• Viewers are encouraged to try open source models such as GPTJ Neo X and Bloom for autonomous AI alignment.

• The speaker has tried these models on other projects but cannot disclose further information due to NDA restrictions.

Participating in Autonomous AI Alignment Discussions

In this section, viewers are invited to participate in discussions about autonomous AI alignment through various online platforms.

Joining Discussions

• Viewers who want to participate can join discussions through links provided in the video description or subreddits related to cognitive architectures and autonomous AI alignment.

• The Cognitive AI Lab Discord is also mentioned as a platform where viewers can discuss these topics.

Conclusion

The speaker concludes by thanking viewers for watching.