As AI becomes increasingly autonomous, building trust is paramount

The rapid rise of AI and its ability to continuously learn is driving new levels of autonomy across organisations. That could unlock massive benefits for business – but only if trust and AI governance are safeguarded, according to a new report by Accenture.
Now in its 25th edition, Accenture’s annual Technology Vision report focuses entirely on AI this year, in a clear testament of the technology’s rapid rise, impact and disruptive potential.
With its benefits are described as “momentous across sectors and domains”, the researchers focus mainly on what is needed to ensure that AI developments stay on the right path, and that AI use is ethically sound and morally acceptable.
“AI pushes enterprises and the people who use it into new and exciting ways to continuously reinvent,” said Julie Sweet, Chair and CEO of Accenture. “But unlocking the benefits of AI will only be possible if leaders seize the opportunity to inject and develop trust in its performance and outcomes in a systematic manner so businesses and people can unlock AI’s incredible possibilities.”
For people to trust AI, Accenture said that AI models will need to become more accurate, predictable, consistent and traceable, over and above the responsible use of AI. In a survey of business leaders, 77% of executives told Accenture that the true benefits of AI will only be possible when built on a foundation of trust.
Autonomous systems
AI autonomy is considered one of the key risks that needs to be contained. “Advancements in digitizing knowledge, new AI models, agentic AI systems and architecture enables enterprises to create their own unique cognitive digital brains,” said Karthik Narain, CTO of Accenture.
“The autonomy created by these generalized AI systems can help organizations be more dynamic and intention-driven than ever. It will allow leaders to rethink how digital systems are designed, how people work, and reinvent how they create products and interact with customers. But trust underpins it all, as systems will only ever be as autonomous as they are trustworthy.”
One way to achieve that goal is by embedding human-by-design principles in AI development, or by ensuring there is a continued close collaboration between people and robots.