Mesa Redonda | Gobierno Corporativo en la era de la IA: riesgos digitales y deberes del Consejo

Mesa Redonda | Gobierno Corporativo en la era de la IA: riesgos digitales y deberes del Consejo

Corporate Governance in the Age of Artificial Intelligence

Introduction to the Roundtable Discussion

  • The session begins with a welcome message, emphasizing the focus on corporate governance amidst the rise of artificial intelligence (AI).
  • AI is framed not merely as a technological issue but as a significant factor influencing decision-making and risk management within companies.

Impact of AI on Corporate Governance

  • A report by Goldman Sachs predicts that AI could increase global productivity by 7% over the coming decades, significantly transforming various sectors including finance and consulting.
  • The discussion highlights a disparity between rapid AI adoption in businesses and the slower pace of adaptation in corporate governance practices.

Panelist Introductions

  • Flor Undacargo is introduced as an independent board member with extensive experience in corporate governance and sustainability (S.G.) practices.
  • José Antonio Quezada Palacios brings practical insights from his background in financial services and regulatory consulting, focusing on building robust governance structures.
  • Patricia Muñoz González Úbeda offers a supervisory perspective from her role at CNMV, highlighting Spain's stringent regulations regarding AI.

Key Questions on Board Adaptation to AI

  • An open question is posed about whether boards are adequately addressing the risks associated with AI technology.

Insights from Flor Undacargo

  • Flor emphasizes that discussions around AI are timely and relevant, reflecting its contemporary significance in corporate governance.
  • She contextualizes corporate governance history, noting its evolution over centuries and particularly its dynamic changes over recent decades due to various crises.

Challenges Faced by Boards Regarding AI

  • The need for boards to adapt their oversight roles is highlighted; however, there may be challenges in fully engaging all members with emerging technologies like AI.
  • Flor points out that previous changes were more familiar territory for boards compared to the complexities introduced by AI.

This structured summary captures key themes discussed during the roundtable while providing timestamps for easy reference.

Understanding the Challenges of AI Governance

Lack of Visibility in AI Implementation

  • The current reality shows a significant lack of visibility regarding where AI is functioning effectively, leading to diluted responsibilities within organizations.
  • There is uncertainty about dependencies on third parties and an overestimation of AI's capabilities, which are often viewed as a "magic wand" for precise solutions.

Need for Proper Approach to AI

  • Organizations must adopt a correct perspective and approach towards embracing and supervising AI in this new reality.

Importance of Governance in Business

  • In Spain, there is a growing recognition that governing AI is crucial for the future competitiveness of companies; reticence from large corporations could lead to lost opportunities.
  • Effective governance structures related to AI should be integrated into company boards, emphasizing that it transcends mere technology or management issues.

Evaluating AI's Impact on Business Decisions

  • Companies are dedicating significant time to assess how AI impacts business decisions and long-term value creation amidst various complexities.
  • Boards need continuous adaptation to emerging challenges posed by technologies like AI, requiring enhanced professionalization and training within organizations.

The Regulatory Landscape and Strategic Use of AI

Current State of Regulation

  • There exists a perception that while the U.S. innovates with technology, Europe focuses on regulation, creating a complex landscape where many aspects remain unregulated or ambiguous.

Strategic Integration of AI

  • The discussion emphasizes using AI not just as a strategic component but as an enabler for achieving pre-defined strategic objectives within businesses.

Risk Management in Financial Sectors

  • In regulated sectors like finance, adopting AI can significantly enhance risk management processes by reducing human error associated with fraud detection.

Human Resources Transformation

  • HR departments are being tasked with optimizing human resources through the integration of AI technologies while navigating regulatory frameworks that dictate leadership roles must remain human-centric despite technological advancements.

Understanding the Role of AI in Governance

Resistance to AI Adoption

  • The supervision of AI projects has led to misunderstandings among board members, causing resistance and slowing down adoption.
  • Decision-making and risk management are critical areas where ignorance about risks presents significant challenges for board members.

Evolving Board Composition

  • The composition of boards today differs significantly from that of 20 years ago, emphasizing the need for diverse knowledge bases.
  • Boards must actively lead transformation efforts in AI governance, requiring a balance between technological expertise and traditional governance skills.

Importance of Technological Competence

  • Traditional board profiles are insufficient; there is a low presence of technology experts on boards in Spain, even within large organizations.
  • Simply adding a tech expert does not address the core issues; understanding the broader context is essential for effective governance.

Understanding Risks and Responsibilities

  • Board members should be conceptually technologically literate to ask relevant questions regarding data quality, biases, and control mechanisms.
  • Effective governance requires more than just appointing an expert; it involves comprehensive training for all board members to mitigate ignorance-related reluctance.

Essential Skills for Modern Board Members

  • In Europe, strict regulations around AI necessitate informed decision-making by boards to avoid falling behind due to ignorance.
  • Modern board members should possess strategic vision, ethical judgment, and supervisory capabilities to ensure alignment with corporate values amidst AI integration.

Adapting to New Realities

  • Companies must adapt their governance structures proportionally without imposing unrealistic technological profiles on all board members.

Continuous Learning and Development

  • Ongoing training is crucial for equipping board members with necessary skills related to technology and its implications in business contexts.

Engaging with Technology Experts

  • Strategies are needed to attract technology-savvy individuals onto boards while ensuring existing members understand contemporary technological landscapes.

Addressing Organizational Pain Points

  • Organizations often seek experts based on immediate challenges rather than addressing underlying systemic issues within their governance frameworks.

Understanding the Challenges of AI in Corporate Governance

The Role of Technology Experts in Organizations

  • The integration of technology experts, particularly in cybersecurity, often leads to them becoming the primary communicators with functional leaders within organizations. This dynamic can be problematic as it may overshadow broader discussions.

Cultural and Conceptual Barriers

  • There are two significant challenges for boards: the novelty and intangible nature of AI-related issues, which makes consequences less apparent, and a traditional corporate culture focused on finance and business strategy.

Embracing Open-Mindedness

  • Boards face the challenge of fostering open-mindedness to acquire new knowledge and sensitivity towards emerging problems, including those posed by AI.

Risk Awareness in AI Implementation

  • Understanding risks associated with AI is crucial; while it offers efficiency and potential benefits, each positive step carries unseen risks that need to be acknowledged.

Functional Literacy in AI

  • Board members should aim for functional literacy regarding AI rather than deep expertise. This includes developing critical thinking skills applicable across disciplines to assess implications and responsibilities effectively.

Ethical Considerations in Decision-Making

  • Ethics must be integrated into daily decision-making processes. Current errors can have far-reaching impacts compared to past mistakes that were more localized.

Incremental Errors and Their Consequences

  • Modern errors can lead to serious repercussions due to their incremental nature; awareness of this risk is essential for understanding the full impact of technological advancements.

The Importance of Open-Minded Counselors

Preparing for Future Risks

  • Counselors must remain open-minded about understanding technology's implications while anticipating potential risks associated with decisions made based on automated processes.

Enhancing Decision-Making Efficiency

  • AI presents significant opportunities for improving efficiency in board operations by streamlining documentation preparation and scenario simulations without replacing human judgment.

Balancing Automation with Human Judgment

  • While leveraging AI enhances deliberation quality, there is a fundamental need to maintain human oversight to prevent erosion of critical judgment within boards.

Accountability for Automated Decisions

  • Ultimately, boards hold responsibility for decisions influenced by automated processes; understanding data traceability is vital for accountability when errors occur.

Evolving Information Management Practices

  • The volume of information available now influences decision-making significantly; boards must adapt their practices accordingly while ensuring they understand the responsibilities tied to these decisions.

Consequences of AI in Decision-Making

The Uncertainty of AI's Impact

  • Ben highlights the uncertainty surrounding the consequences of AI, suggesting that we are still in a premature stage of understanding its implications on decision-making processes.
  • José Antonio reflects on the rapid pace of change imposed by 2026, emphasizing how discussions have shifted towards strategic topics like energy prices and supply amidst high volatility.

Challenges for Advisors

  • The complexity and ambiguity of the current environment (BUCA: volatile, uncertain, complex, ambiguous) necessitate advisors with diverse expertise rather than specialists in singular fields.
  • The need for critical thinking is underscored as essential for advisors to navigate evolving tools and strategies effectively.

Information Overload and Responsibilities

  • There is a significant challenge regarding information overload; relevant data often lacks clarity, making it difficult for advisors to digest crucial insights.
  • Patricia emphasizes the responsibility of advisors in this context, highlighting their role in discerning valuable information from an overwhelming amount.

Human Oversight in AI Utilization

  • A discussion arises about the limitations of AI within advisory roles; while it can assist, it cannot replace human judgment or contextual understanding necessary for decision-making.
  • Virginia agrees with José Antonio that a collective competency matrix within boards is vital to address rapidly changing circumstances beyond just technological advancements.

Ethical Considerations and Governance

  • Florte introduces the principle of "human on the loop," stressing that human oversight is crucial at every decision point involving AI to ensure alignment with company values and long-term strategies.
  • The importance of having a human curator to validate decisions made by AI systems is emphasized as essential for maintaining accountability within governance frameworks.

Conclusion on AI's Role

  • It’s asserted that while AI serves as a powerful tool aiding boards, it should never replace human deliberation or critical analysis inherent to advisory roles.
  • Concerns are raised about potential job displacement due to AI; however, it's argued that its integration should enhance rather than substitute human capabilities within corporate governance.

Ethical Codes and AI Regulation

The Role of Ethical Codes in Organizations

  • Discussion on the importance of ethical codes within organizations, questioning if they can promote responsible and ethical use of AI when integrated into organizational policies.
  • Inquiry about whether a more regulated framework could enhance the ethical application of AI in organizations, highlighting the need for regulatory input.

Designing Effective Governance Structures

  • Emphasis on the necessity for specific capabilities among board members to foster critical thinking, which is essential for effective governance.
  • Importance of diversity and inclusion in board design to ensure relevant skills are present for critical decision-making regarding ethics and values.

Challenges in Small and Medium Enterprises (SMEs)

  • Acknowledgment that many SMEs lack formal ethical codes or documents outlining their values, often relying on individual leadership styles instead.
  • Warning against potential risks arising from unregulated behavior within organizations lacking documented ethical guidelines.

Corporate Governance and Regulatory Framework

  • Debate over whether boards should include strictly technological profiles or focus on enhancing the training of existing members to address technology-related issues.
  • Recognition that corporate governance must evolve beyond compliance to incorporate best practices related to strategy, innovation, inclusion, and diversity.

Legal Considerations in AI Implementation

  • Highlighting gaps in current regulations concerning emerging technologies like water management laws and energy usage with batteries; stressing the need for comprehensive legal frameworks.
  • Affirmation that a robust regulatory framework is crucial for providing legal security to market participants while addressing rapid technological changes.

Privacy Concerns with AI Usage

  • Discussion on privacy risks associated with data protection laws as they relate to AI usage; emphasizing the importance of understanding how information can be ethically utilized without breaching confidentiality.
  • Personal insights from an experienced lawyer regarding concerns over confidential documentation being uploaded into systems; expressing confidence in tools that ensure data remains secure within professional environments.

Risks and Benefits of AI in Organizations

Understanding the Risks of AI Implementation

  • The discussion begins with a focus on the risks associated with using artificial intelligence (AI) in organizations, emphasizing that this is a significant challenge for all advisors.
  • It is noted that while AI can be beneficial, there is a misconception that it serves as a "magic wand" to solve all problems, particularly in sustainability governance (SG).
  • The speaker highlights the asymmetry of information available in the market, which can lead to biases regarding performance levels and best practices within companies.
  • There are concerns about narratives created by organizations that may not reflect reality, potentially leading to practices like greenwashing due to misleading data interpretations.
  • The importance of critical judgment and ethical principles when interpreting data from AI tools is emphasized; organizations must discern what information truly aligns with their objectives.

Leveraging AI Effectively

  • Despite potential pitfalls, the ability to process vast amounts of information through AI can provide valuable insights into successful business cases and practices from other companies.
  • Critical analysis remains essential; advisors must utilize AI without losing their analytical capabilities or blindly trusting its outputs.
  • Acknowledgment of varying regulatory environments across industries suggests that understanding these differences is crucial before advancing with AI initiatives.

Industry-Specific Concerns

  • The conversation shifts to specific sectors such as finance and healthcare, highlighting differing implications when sensitive data breaches occur—financial data loss versus clinical record loss has vastly different consequences.
  • In telecommunications, sharing biometric data raises significant privacy concerns regarding who holds this sensitive information and how it will be protected.
  • Companies express concern over developing frameworks that ensure safe processing of information before implementing innovative solutions.

Conclusion: Navigating Challenges Ahead

  • The need for organizational maturity in addressing areas where development can safely occur is stressed; understanding fraud risks in financial sectors requires careful management of sensitive information.

AI Adoption in Business: Strategies and Recommendations

Importance of AI for Business Growth

  • The discussion emphasizes that AI can enhance business operations, making them more profitable. However, the adoption process should be layered and strategic.

Recommendations for Executives on AI Implementation

  • A question is raised about what recommendations to provide to executives considering AI adoption, highlighting the need to understand potential risks associated with AI.

Directives for High-Level Management

  • There is a focus on how to guide executives in adapting to AI technologies, stressing the necessity of clear directives and actionable steps.

Challenges in Successful AI Adoption

  • A humorous analogy compares current discussions around AI to adolescent experiences with sex—widely talked about but not widely experienced. Surveys indicate only about 30% of organizations achieve successful adoption of AI initiatives.

Evaluation and Monitoring of AI Projects

  • It’s crucial for organizations to establish a thorough evaluation process for their AI projects, including setting clear milestones and monitoring risks at the board level.

Addressing Reputational Risks Associated with AI

  • Boards must consider how using AI could impact their organization’s reputation and ensure they have clear lines of responsibility if issues arise from its use.

Strategic Analysis Before Implementation

  • Prior to any action, boards should analyze the potential impacts of adopting AI based on proportionality principles related to their objectives and strategies.

Need for Formal Mapping of Current AI Usage

  • Boards are encouraged to request a formal overview or map detailing where and how AI is currently being utilized within their organizations as part of understanding its implications.

Recognizing the Role of Customer Service in Business Core

  • The conversation highlights a shift in customer service dynamics due to increased reliance on artificial intelligence, questioning traditional notions about customer relationships being irreplaceable by technology.

Understanding Organizational Exposure to AI

  • Emphasizes the importance of recognizing existing uses of artificial intelligence within companies. This awareness helps bridge gaps between board members' knowledge and operational realities regarding technology use.

Discussion on AI and Independent Advisors

The Role of AI in Advisory Positions

  • A question arises regarding the impact of AI on independent advisors, suggesting that wealth managers may hire fewer independent consultants due to AI's capabilities.
  • The speaker emphasizes the transformative effect of AI in academia, noting that obtaining documented information will become easier, thus valuing experience and context more than theoretical knowledge.
  • In business schools, experienced professors will be favored over those who rely solely on academic papers, as real-life experiences are deemed more valuable than theoretical analyses generated by AI.

Valuing Experience Over Theory

  • Both wealth managers and independent advisors with substantial experience will continue to be highly valued for their practical insights into business operations.
  • There is a call for both types of advisors to focus on the company's best interests rather than just personal financial gain, highlighting a shared goal between them.

Challenges Facing Advisors

  • The importance of independent advisors is reaffirmed; however, they must adapt by understanding technological advancements without needing to be tech experts themselves.
  • A significant challenge identified is the rapid pace at which technology evolves compared to how quickly advisors can adapt and prepare for ethical and strategic challenges posed by AI decision-making models.

Risks Associated with Advisory Roles

  • The discussion raises concerns about whether advisors can evolve at the required pace alongside contemporary demands from tools like AI.
  • Increased risks associated with advisory roles may deter individuals from taking up such positions due to heightened responsibilities linked to technological advancements.

Accountability in Decision-Making

  • Advisors express concern over being held responsible for decisions made outside their expertise or understanding, emphasizing the complexity of modern governance.
  • A question is posed about delegating oversight of AI within boards; it highlights potential loss of control if technical aspects are entirely delegated away from board members' purview.

Governance Structures and Responsibilities

  • It’s clarified that ignorance does not absolve responsibility; board members must remain accountable regardless of their technical knowledge regarding decisions influenced by AI technologies.
  • Committees supporting boards (like audit committees) play a crucial role in analyzing details but ultimate decision-making authority rests with the board itself.
  • Board members should act as intermediaries between governance bodies and technical details, ensuring they ask critical questions about potential risks associated with algorithmic decisions.

Responsibility in AI Governance

The Complexity of Delegating Decisions to Algorithms

  • Discussion on the quantification of risks associated with delegating decisions to algorithms, highlighting the complexity introduced by third-party biases.
  • Emphasis on the non-delegable nature of responsibility in AI governance, asserting that ultimate accountability lies solely with the board.
  • The role of committees is to support decision-making but does not absolve the board from its responsibilities; critical thinking is essential for evaluating algorithm reliability.
  • Clarification that delegation refers to specific decision processes rather than overall corporate governance; companies must assess whether they can accept algorithmic consequences.
  • Importance of maintaining human critical thinking and training amidst technological disruption, stressing that understanding prompts is crucial for effective AI utilization.

Training and Understanding Prompts

  • Acknowledgment of the need for proper training in designing prompts, which directly impacts the reliability of AI outputs.
  • Recognition of a rich discussion surrounding these topics, indicating a desire for further exploration and dialogue on AI governance issues.

Conclusion on Board Responsibilities

  • Gratitude expressed towards participants for their contributions, suggesting a follow-up roundtable due to the depth of discussion required.
  • Reinforcement that while boards can seek advice and delegate tasks, they retain ultimate responsibility for ethical governance in an era dominated by artificial intelligence.
Video description

La inteligencia artificial está redefiniendo la toma de decisiones, la gestión de riesgos y las responsabilidades de los Consejos de Administración. Esta mesa redonda abordará cómo el gobierno corporativo debe evolucionar frente a los riesgos digitales, éticos y regulatorios asociados a la IA, así como los nuevos deberes del Consejo en materia de supervisión, transparencia y liderazgo responsable en la era digital.