Regulator sought for artificial intelligence in health sector

Citizens’ jury puts emphasis on keeping people at the heart of healthcare

The citizens’ jury said the integration of AI ‘represents a defining opportunity for Ireland’. Photograph: Joe Giddens/PA
The citizens’ jury said the integration of AI ‘represents a defining opportunity for Ireland’. Photograph: Joe Giddens/PA

Strong legislation and regulation must be enacted to ensure artificial intelligence is used ethically across the health sector, a citizens’ jury has recommended.

Organised by IPPOSI – the Irish Platform for Patient Organisations, Science and Industry – a jury of 24 individuals, representative of the population of Ireland, convened from September to December 2024 to make recommendations on the use of AI in healthcare.

Their final report, published on Monday, made 25 recommendations which the jury said were centred around their fundamental belief that AI in healthcare “should always work alongside humans, never replacing them”.

The jury called for the establishment of a statutory regulator to oversee the use of AI in healthcare.

READ SOME MORE

According to the report, the body would be responsible for developing and enforcing standards for those using AI, including its licensing, data governance and monitoring, as well as imposing penalties for breaches.

It would also publish compliance reports to advance the development of AI technologies in healthcare that are secure, transparent and accountable, the report added.

In addition, the jury recommended the creation of a separate independent commissioner for AI in healthcare.

This role would seek to increase public awareness about how AI is being used in healthcare, make recommendations on the use of individuals’ health data by AI, and independently identify opportunities to strengthen compliance with regulatory standards.

Surgeons at Beaumont will be able to use AI in new digital operating theatreOpens in new window ]

The commissioner would also operate a complaints process for members of the public.

Acknowledging the importance of safeguarding health data, the jury called for strong legislation and robust regulation to prevent misuse of this data.

The jury also called for contingency plans to be put in place “to address potential failures in AI systems, ensuring patient care and safety are never compromised”.

In an open letter to Minister for Health Jennifer Carroll MacNeill and Minister for Enterprise Peter Burke, the jury said the integration of AI “represents a defining opportunity for Ireland”.

“By adopting these recommendations, the Government can lead with innovation and integrity, ensuring AI serves the common good while upholding the highest standards of patient care,” they said.

The HSE’s chief clinical information officer, Professor Richard Greene, a member of the independent jury oversight panel, said he welcomed the “strong emphasis” on keeping people at the heart of healthcare.

AI may be better than humans at reading cancer scans. Could bots have better bedside manner too?Opens in new window ]

“AI can support us in enhancing decision-making and in delivering better outcomes, but it is an aid to healthcare professionals, not a replacement,” he said.

“To avoid unintended consequences, its use requires continuous oversight, rigorous evaluation and clear accountability, with humans firmly in the loop.”

Joan Johnston, IPPOSI chairwoman, called on the Government to “immediately start work on a national strategy for the future use of AI in healthcare that reflects the priorities set out by jurors”.

Shauna Bowers

Shauna Bowers

Shauna Bowers is Health Correspondent of The Irish Times