The Future of AI Governance

New Research Publication Alert on AI Act Governance! 🚀 Regulation is nothing without enforcement. The AI Office is gearing up, AI Safety Institutes are springing into work. How can these institutions become a success? We are excited to share our collaborative paper, crafted by an interdisciplinary team from Digital Ethics Center (DEC), Yale University, the European New School of Digital Studies and the University of Agder. This paper presents a forward-thinking analysis of the European Union's Artificial Intelligence Act and proposes a robust, adaptive framework for AI governance. 🔍 Title: "A Robust Governance for the AI Act: AI Office, AI Board, Scientific Panel, and National Authorities" Authors: Claudio Novelli, Jessica Rose Morley, PhD, Philipp Hacker, Jarle Trondal and Luciano Floridi. Highlights of Our Study: 1. Anticipatory Regulation & Adaptive Governance: We emphasize the need for forward-looking perspectives on AI governance. We stress anticipatory regulation and the adaptive capabilities of governance structures to keep pace with technological advancements. 2. Five Key Proposals for Robust Governance: - Establish the AI Office as a Decentralized Agency: Similar to EFSA or EMA, this move aims to enhance its autonomy and reduce influences from political agendas at the Commission level. - Consolidate Advisory Bodies: Merge the Advisory Forum and the Scientific Panel into a single entity to streamline decision-making and improve the quality of advice wrt both technical and societal implications of AI. - Improve Coherence Among EU Bodies: Address overlapping or conflicting jurisdictions by strengthening the EU Agency Network and creating an EU AI Coordination Hub (EU AICH) - Authority of the AI Board: Give the AI Board more authority to revise national decisions to prevent inconsistent application of AI regulations across Member States, similar to issues with GDPR enforcement. - Introduce Mechanisms for Continuous Learning: Establish a dedicated unit within the AI Office for continuous learning and adaptation, sharing best (and worst) practices, and simplifying regulatory frameworks to aid compliance, especially for SMEs. 3. Future Outlook for AI Governance: - The paper acknowledges that the governance of AI in the EU is both promising and challenging. As AI technologies evolve, the AIA's governance structures must remain flexible and robust to address new developments and unforeseen risks. Ultimately, the AI Office could, and should, evolve into a cross-sectoral "digital agency," handling various laws relating to AI and emerging technologies. 📃 Read the full paper here: https://lnkd.in/ei8EnzTD Comments most welcome! #aiact #AI #Governance #eulaw #ArtificialIntelligenceAct #InterdisciplinaryResearch #AIRegulation #FutureOfAI

"The rapid evolution and swift adoption of generative AI have prompted governments to keep pace and prepare for future developments and impacts. Policy-makers are considering how generative artificial intelligence (AI) can be used in the public interest, balancing economic and social opportunities while mitigating risks. To achieve this purpose, this paper provides a comprehensive 360° governance framework: 1 Harness past: Use existing regulations and address gaps introduced by generative AI. The effectiveness of national strategies for promoting AI innovation and responsible practices depends on the timely assessment of the regulatory levers at hand to tackle the unique challenges and opportunities presented by the technology. Prior to developing new AI regulations or authorities, governments should: – Assess existing regulations for tensions and gaps caused by generative AI, coordinating across the policy objectives of multiple regulatory instruments – Clarify responsibility allocation through legal and regulatory precedents and supplement efforts where gaps are found – Evaluate existing regulatory authorities for capacity to tackle generative AI challenges and consider the trade-offs for centralizing authority within a dedicated agency 2 Build present: Cultivate whole-of-society generative AI governance and cross-sector knowledge sharing. Government policy-makers and regulators cannot independently ensure the resilient governance of generative AI – additional stakeholder groups from across industry, civil society and academia are also needed. Governments must use a broader set of governance tools, beyond regulations, to: – Address challenges unique to each stakeholder group in contributing to whole-of-society generative AI governance – Cultivate multistakeholder knowledge-sharing and encourage interdisciplinary thinking – Lead by example by adopting responsible AI practices 3 Plan future: Incorporate preparedness and agility into generative AI governance and cultivate international cooperation. Generative AI’s capabilities are evolving alongside other technologies. Governments need to develop national strategies that consider limited resources and global uncertainties, and that feature foresight mechanisms to adapt policies and regulations to technological advancements and emerging risks. This necessitates the following key actions: – Targeted investments for AI upskilling and recruitment in government – Horizon scanning of generative AI innovation and foreseeable risks associated with emerging capabilities, convergence with other technologies and interactions with humans – Foresight exercises to prepare for multiple possible futures – Impact assessment and agile regulations to prepare for the downstream effects of existing regulation and for future AI developments – International cooperation to align standards and risk taxonomies and facilitate the sharing of knowledge and infrastructure"

By 2028, Boards of Directors will not be able to treat AI as a side conversation or a delegated technical issue. AI is becoming a core governance responsibility. As risk velocity accelerates and corporate complexity deepens, boards must develop algorithmic awareness, AI fluency, and new oversight muscles. Fiduciary duty will increasingly depend on how well directors understand AI driven risk sensing, ethical governance, strategic foresight, board effectiveness, and stakeholder sentiment. The boards that lead will not just react faster. They will govern smarter, anticipate disruption earlier, and build long term trust with investors, regulators, and society. I break this down in the latest piece, 2028 Boardroom Playbook: Using AI to Lead, Govern, and Win, with five concrete AI use cases every board should understand now. Read more about it here: https://lnkd.in/evUMrFR2 AI is no longer just a tool for management. It is becoming a compass for modern governance.

I had the privilege of delivering a lecture yesterday at the School of Management at Harbin Institute of Technology (HIT) , one of China’s C9 universities, on a topic that will define the trajectory of our century: Governing Intelligence: The Future Architecture for Responsible AI in a Fragmented World. As AI capabilities accelerate from generative to agentic systems and move toward proto-AGI, humanity stands at a profound inflection point. Intelligence is rapidly becoming a new form of global infrastructure. Yet while AI advances in months, our governance systems evolve in years. This widening gap is one of the greatest strategic risks of our time. Across the world, the governance landscape is diverging: - The U.S. prioritizes innovation and competitive advantage, - China emphasizes sovereignty and control, - The EU focuses on rights and risk mitigation, - And the UAE, uniquely, is emerging as a strategic bridge connecting global blocs. These fragmented philosophies create a world where we innovate together but govern apart, with no shared definitions of safety, accountability, or acceptable risk. As I highlighted in the lecture, this fragmentation, if left unaddressed, will increase the probability of systemic failures, regulatory arbitrage, unchecked agentic AI, and even existential risk. To move beyond this trajectory, I introduced a Future Architecture for Responsible AI Governance, a layered global blueprint that brings coherence, clarity, and shared responsibility: - Global AI Principles & Frameworks grounded in human rights and universal values - Clear Red Lines where the world must say no, from fully autonomous lethal systems to unregulated AI-driven bioengineering - Green Lines that direct AI toward humanity’s highest priorities, healthcare, climate modeling, disaster prediction, education, and inclusion - A Full AI Safety & Assurance Stack to build systems that are safe, robust, verifiable, and governable in real-world conditions - A Global Responsibility Council, an “IAEA for AI”, to set safety baselines and coordinate responses to global AI incidents Five priority actions for the next five years: 1️⃣ Harmonize global interoperable standards 2️⃣ Invest in TEVV and AI assurance capacity 3️⃣ Build sovereign, culturally aligned, responsible models 4️⃣ Embed safety-by-design across ecosystems 5️⃣ Strengthen global tech diplomacy for a shared future What encouraged me most today was the energy of HIT’s faculty, researchers, and students, the future guardians of intelligent systems. Universities, as I noted, have a critical role to play: they are the anchors of ethical reflection, rigorous methodology, and cross-disciplinary thinking that the world urgently needs. If we aspire to an Intelligent Age that expands human potential rather than constrains it, the world must converge on shared frameworks, shared norms, and shared mechanisms for responsibility. We still have time to shape the future, but only if we act together.

AI is entering a phase where accountability and maturity will matter more than experimentation. In recent years, rapid pilots and bold GenAI initiatives drove incredible learning. But that pace also revealed important gaps: models rushed into production without guardrails, systems scaled with unclear ownership, and outcomes measured by activity rather than meaningful impact. In my view, SAS captures this shift exactly right in its 2026 AI and data predictions, underscoring the need to finally mop up the AI slop and rebuild on solid, accountable foundations. I enjoyed reading the prediction from Luis Flynn, Market Strategist for Applied AI, Open Source Software & ModelOPS. The next phase of AI is about focusing on real outcomes rather than the number of models we release. It is about treating governance as something that helps us grow, strengthening our data and infrastructure, and placing transparency and trust at the center of how we build. I see this not as slowing innovation but as strengthening it with reliability, sustainability, and meaningful business value. That is why one of the other SAS predictions that stood out to me, highlighted well by Brij kishore Pandey, was the growing accountability of agentic AI for business outcomes. If you want to explore what 2026 may look like, including accountability, agentic systems, governance, synthetic data, and more, the full set of SAS predictions is worth reading. SAS has been a steady voice in responsible innovation, and this perspective reflects that leadership clearly. You can read it here: https://lnkd.in/dUM4eUjc The future of AI belongs to teams that combine ambition with accountability. #artificialintelligence #AIGovernance #leadership #technology #responsibleAI

✨ AI at a crossroads: Can we steer it responsibly? The Association for the Advancement of Artificial Intelligence (AAAI) 2025 Presidential Panel on the Future of AI Research lays out a stark reality—AI is advancing at an unprecedented pace, but governance, safety, and evaluation mechanisms are struggling to keep up. 🌏 Having worked at the intersection of AI governance, responsible deployment, and multi-agent AI, I see a recurring challenge: we are building AI that is more powerful than our ability to govern it responsibly. 🔬 Key takeaways from the report & my perspective:- ✅ AI Reasoning & Trustworthiness:- While LLMs and Agentic AI are demonstrating emergent reasoning, we lack verifiable correctness. Can we afford AI-driven decision-making without reliability guarantees? ✅ Agentic AI & Multi-Agent Systems:- The integration of LLMs into autonomous, multi-agent AI systems is a double-edged sword. On one hand, these systems offer adaptive, cooperative intelligence—but on the other, they introduce complexity, opacity, and safety risks. We need governance models that balance autonomy and oversight. ✅ Responsible AI Development & Deployment:- Many organizations still focus on post-deployment fixes rather than AI safety by design. Alignment techniques today (RAG, constitutional AI, human feedback) remain fragile. We must shift toward "failsafe AI"—AI that degrades gracefully rather than unpredictably. ✅ AI Ethics & Governance:- AI risks—whether misinformation, deepfakes, or algorithmic bias—are no longer just theoretical. Geopolitical competition for AI dominance could further sideline ethical considerations. It is time for a convergence of policy, technical safety, and corporate governance models to ensure AI serves societal progress, not just market incentives. 👩💻 The Path Forward: A Call for Multidisciplinary Collaboration:- AI governance cannot be an afterthought. It must be woven into the DNA of AI systems—across research, regulation, and deployment. As someone deeply involved in AI governance and policy, I believe the future lies in co-regulation—where industry, academia, and policymakers collaborate proactively rather than reactively. ✨ How do we get there? 1️⃣ Bridging the gap between AI development and policy-making. 2️⃣ Building safety-aligned benchmarks for Agentic AI. 3️⃣ Embedding ethical constraints within AI architectures, not just in guidelines. 💡 AI is no longer just a tool—it is a co-pilot in decision-making, shaping economies, politics, and societies. The question is: can we govern it before it governs us? 🔎 Would love to hear your thoughts! What challenges do you see in ensuring AI remains safe, aligned, and trustworthy? #AIResearch #ResponsibleAI #AITrust #AgenticAI #Governance #AAAI2025 #AISafety #AIRegulation #EthicalAI

The next major frontier of artificial intelligence will not be generative AI alone, but autonomous AI agents: systems capable of reasoning, planning, learning and executing actions with increasing independence. And this raises a critical challenge: how do we govern systems that no longer simply respond, but actually act? The paper on the ETHOS model proposes an interesting answer: using blockchain and Web3 technologies to create a more traceable, verifiable and decentralized governance model for AI agents. Three technological alternatives stand out: A decentralized registry for AI agents A blockchain-based infrastructure where each agent has an identity, history, risk level, certifications and traceability of its actions. Verifiable compliance with Zero-Knowledge Proofs Allowing an agent to prove that it complies with ethical, regulatory or privacy requirements without revealing sensitive data, proprietary models or confidential information. Programmable accountability and decentralized justice, Smart contracts, DAOs and reputation systems to manage disputes, revoke certifications, activate insurance mechanisms or enforce consequences when an agent fails to comply. The point is not to use blockchain because it is fashionable. The point is that AI governance needs new infrastructures capable of providing: traceability, auditability, identity, verifiable compliance and accountability. Because if AI agents are going to make increasingly autonomous decisions, we will need more than ethical principles: we will need technical mechanisms to verify, supervise and enforce responsibility. Responsible AI will not depend only on better models. It will also depend on better governance systems. Lets build!

The future of enterprise AI isn't just automation, it’s accountable automation. Organizations that get governance right will earn something that is becoming increasingly difficult to win back: trust. Every executive should be paying attention not because of one lawsuit, but because it raises a broader governance question. As #AI becomes embedded in hiring, performance management, finance, and operations, the real competitive advantage won't come from using more AI. It will come from knowing where AI should inform decisions, where humans must make them, and how those decisions can be explained, audited, and challenged. A few principles every organization should consider as AI scales: • AI should augment judgment and should not replace accountability. Algorithms can identify patterns, but leaders remain responsible for decisions and outcomes. • High-impact AI decisions require transparency by design. People impacted by AI-driven decisions deserve clarity on what signals influence outcomes and how those systems are evaluated. • Efficiency cannot be the only success metric. The strongest AI systems optimize for productivity while protecting fairness, trust, and long-term organizational resilience. • Governance must scale with adoption. AI oversight cannot be an afterthought added after deployment; it needs to be embedded into architecture, processes, and culture from day one. The next generation of AI leaders will not be defined by who deploys the most models. They will be defined by who builds the most trusted systems. Read more on the discussion around AI-driven workforce decisions and the importance of responsible AI governance: https://lnkd.in/es-7N8PF #ArtificialIntelligence #ResponsibleAI #AITransformation #EnterpriseAI #DigitalLeadership

𝐌𝐚𝐩𝐩𝐢𝐧𝐠 𝐭𝐡𝐞 𝐅𝐮𝐭𝐮𝐫𝐞 𝐨𝐟 𝐀𝐈 As AI accelerates across industries, we need better ways to imagine its possible futures, not just in terms of technology, but in terms of society, governance, and trust. The chart below is a 2-axis matrix designed to visualize possible futures of AI. The vertical axis represents 𝐑𝐞𝐠𝐮𝐥𝐚𝐭𝐨𝐫𝐲 𝐒𝐭𝐫𝐞𝐧𝐠𝐭𝐡, ranging from strong governance at the top to a free market at the bottom. The horizontal axis represents 𝐏𝐮𝐛𝐥𝐢𝐜 𝐓𝐫𝐮𝐬𝐭, from widespread distrust on the left to deep societal acceptance on the right. Together, these axes create four quadrants, each describing a distinct scenario for how AI might evolve in everyday life. 1️⃣ Regulatory Strength: How far governments and institutions succeed in shaping AI through laws, standards, and oversight. 2️⃣ Public Trust: How much societies accept and rely on AI systems. These two dimensions matter because regulation defines who gets access and how risks are managed, while trust defines whether people actually adopt AI or resist it. Together, they shape the social contract around technology. 𝐊𝐞𝐲 𝐓𝐚𝐤𝐞𝐚𝐰𝐚𝐲 The future of AI won’t be shaped by algorithms alone. It will depend on how societies govern technology and whether people trust it. 𝐒𝐨 𝐰𝐡𝐚𝐭? I believe any future study has to imply actions: Who has to do what? Trust and governance don’t emerge automatically; they require deliberate action: 𝐏𝐨𝐥𝐢𝐜𝐲𝐦𝐚𝐤𝐞𝐫𝐬 𝐚𝐧𝐝 𝐫𝐞𝐠𝐮𝐥𝐚𝐭𝐨𝐫𝐬 must design adaptive, transparent frameworks that protect citizens without suffocating innovation. 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐥𝐞𝐚𝐝𝐞𝐫𝐬 𝐚𝐧𝐝 𝐭𝐞𝐜𝐡𝐧𝐨𝐥𝐨𝐠𝐢𝐬𝐭𝐬 must embed responsibility into product design, ensuring AI systems are explainable, fair, and aligned with human values. 𝐄𝐝𝐮𝐜𝐚𝐭𝐨𝐫𝐬 𝐚𝐧𝐝 𝐜𝐢𝐯𝐢𝐥 𝐬𝐨𝐜𝐢𝐞𝐭𝐲 must foster digital literacy, so people understand both the benefits and risks of AI. 𝐂𝐢𝐭𝐢𝐳𝐞𝐧𝐬 must stay engaged, voicing concerns and expectations, because public trust is earned through dialogue, not imposed. 👉 Achieving the Responsible AI scenario requires alignment between regulators, innovators, and society at large. Without this coalition, we risk sliding into futures of stagnation or chaos. #ArtificialIntelligence #FutureOfAI #ScenarioPlanning #AIGovernance #ResponsibleAI #DigitalTrust #InnovationStrategy #TechLeadership #FutureStudies #AITransformation Meet ETH Future of Humanity Institute (Oxford University) Stuart Russell Hesham Ghoneim Roland Busch Gerd Leonhard Francesca Rossi

The GRC market is quietly splitting in two. On the surface, it looks like convergence. Every major platform is adding AI capabilities. ServiceNow, MetricStream, Drata, Vanta. Chatbots that draft policies. Automation that gathers evidence. Assistants that summarise risk registers. The pitch is consistent: AI makes GRC faster. But underneath the feature announcements, something more interesting is happening. A separate category is forming around a different problem entirely. Not using AI to accelerate governance, but governing AI itself. Credo AI, Holistic AI, ModelOp, Fiddler. Gartner published its first Market Guide for AI Governance Platforms in November 2025, which suggests the analyst community sees these as distinct. The reason this matters is scope. Five years ago, AI governance meant a few ML models in fraud detection or recommendation engines. Narrow, contained, manageable. Today, AI is embedded in everything. Customer support runs on LLMs. Agents book meetings, write code, make purchasing decisions. Copilots sit inside every productivity tool. Shadow AI is everywhere because AI is everywhere. When AI was a feature, governing it was a checkbox. When AI becomes the operating layer for most business processes, governing it becomes the whole game. Traditional GRC wasn't built for this. It assumes periodic assessment, human-produced evidence, and systems that stay relatively stable between reviews. AI systems drift, learn, act autonomously, and change behaviour based on yesterday's data. The enterprise GRC vendors have distribution and existing budget ownership. The AI governance vendors have architectural fit for how these systems actually behave. Both have a case. I don't know yet whether these categories merge or stay separate. What I'm watching is whether the growth of AI as infrastructure forces a corresponding growth in AI-native governance, or whether the traditional platforms absorb the problem fast enough. If AI becomes the operating layer for most of your business processes, does your current GRC approach still make sense? #AISecurity #AIGovernance #GRC #CyberSecurity #CISO #AI