The expectations for artificial intelligence (AI) in health and care are disproportionately high for how little societal debate there is on the ethical questions the technology’s use raises, the Center for Ethics and Health (CEG) said in a report on Monday. It urged the Dutch government and parliament to critically examine whether AI truly offers real answers to the challenges in the sector, and whether using the technology is desirable.

The CEG examined potential AI solutions for the widely recognized challenges in healthcare – staff shortages, the aging population, and increasing mental health problems. It found that the expectations are higher than the solutions currently offered, especially when also considering the ethical dilemmas.

The center urged the government to similarly consider how it wants to use AI in the healthcare sector. “If we do not think about which problems we want to solve, many AI applications in healthcare will be a plaster for a broken leg,” said physician, ethicist, and CEG chair Martine de Vries. “No one will deny the usefulness of a plaster, but for a broken leg, a plaster is not the best treatment. Moreover, the high-tech plaster called AI is often accompanied by fundamental ethical questions.”

For example, AI applications can be deployed to reduce the administrative burden on healthcare staff. But we do not yet know whether this actually works in practice, the CEG stressed. And it comes with downsides. “AI can actually increase the pressure on healthcare: making administration easier can increase the hunger for information and administration. The solution then exacerbates the problem.”

Another example is using AI-driven monitoring to promote the autonomy of elderly people living at home alone. But that reduces human contact, which can increase loneliness. It also means that care providers will work with a greater distance from their patients, which could result in AI use here making their work feel less meaningful.

The CEG also raised concerns about AI use potentially increasing healthcare disparities, being harmful to the environment, and making healthcare even more dependent on Big Tech companies.

“Moreover, the commercial drivers behind AI development can lead to ‘technosolutionism’ – the idea that all problems can be solved with technology, even though the reality is more complex. This can distract attention from the actual problems and from other potential solutions.“

The CEG urged the government to form a vision for how it wants to use AI in healthcare, focusing on whether AI is really the solution to the problems present. The CEG recommended involving key stakeholders, such as healthcare providers and patients, and keeping in mind the influence and role of large technology companies.

The Rode Hoed in Amsterdam is hosting a debate on the ethical dilemmas around using AI in healthcare on Monday evening. Participants include doctors and healthcare providers, as well as human rights and ethics experts.