AI needs guardrails, human oversight to prevent systemic failures: Sanyal
Sanjeev Sanyal urges AI guardrails, human overrides and clear accountability to prevent cascading failures in critical infrastructure, advocating resilient, modular systems.
BENGALURU: Artificial intelligence systems must have safeguards, human intervention mechanisms and clearly defined accountability to prevent failures from spreading across critical infrastructure, Sanjeev Sanyal, member of the Economic Advisory Council to the Prime Minister, said at the Bengaluru Tech Summit 2026 on Tuesday.Sanyal warned against building highly interconnected AI systems, arguing that a failure in one could trigger widespread disruptions across banking, aviation, healthcare and electricity networks.“I’m a big advocate that we need to begin to think of specialised boxes with different buckets doing different things and this not being integrated,” he said, adding that such separation could reduce efficiency but improve resilience.He called for mandatory human overrides, multiple layers of authorisation, regular audits and predefined liability for AI-related failures.Sanyal described AI as a “complex adaptive system” whose evolution cannot be reliably predicted, making conventional regulatory approaches inadequate.Comparing regulatory frameworks across the US, UK, European Union and China, he said each had limitations. While the US favoured minimal intervention, Europe relied on risk-based regulation and China on extensive state oversight.He suggested drawing lessons from financial markets, which operate unpredictably but are governed through circuit breakers, firewalls, disclosure requirements and accountability mechanisms.India, he said, was currently adopting a fragmented approach, with sectoral regulators such as RBI and Sebi overseeing their respective domains. Sanyal argued that AI governance must similarly evolve through adaptive safeguards rather than relying solely on predictions of future risks.Money habits form by age 7. Is your child learning the right ones? Join the TOI Money Masterclass.
Topics in this story
Gathered from external sources. Rights to this text belong to whoever originally published it.