NHS cracks down on dodgy AI software transcribing patient talks
NHS bosses have ordered GPs and hospitals to stop using AI transcription tools that break basic data protection and safety rules.
The controversy centers on Ambient Voice Technology (AVT), AI software that records and summarizes patient consultations. NHS England rolled out minimum standards for AVT in April, pitching the tech as a way to free up doctors’ time. 
But a surprise warning letter from NHS England’s chief clinical information officer on June 9 flagged that many AVT products on the market don’t meet minimum standards — yet are still widely used.
The letter said:
"We are now aware of a number of AVT solutions which, despite being non-compliant … are still being widely used in clinical practice."
"Proceeding with non-compliant solutions risks clinical safety, data protection breaches, financial exposure, and fragmentation of broader NHS digital strategy."
Doctors warned about AI "hallucinations"—where AI makes up info—in patient settings. Yet NHS England only sets standards. It does not specify which software is safe, leaving trusts to judge.
British Medical Association deputy chair Dr David Wrigley expressed frustration:
"We need that help and support from those who can check that the products are safe, check they’re secure, that they’re suitable for use in the consulting room, and NHS England should do that and help and support us."
"We’re absolutely in favour of tech … But it has to be done in a safe and secure way because otherwise we could have a free for all … And that just isn’t acceptable."
Matthew Taylor, NHS Confederation chief executive, called the warning "a really significant moment."
"The government should help in terms of the procurement decisions that trusts make and should advise on which AI systems … are safe."
"What you’ve seen with ambient voice technology is that kind of ‘let a thousand flowers bloom’ approach has got its limits."
Health Secretary Wes Streeting plans to focus on AI in the NHS’s 10-year reform plan next week. He previously noted some clinicians are already testing AI notetaking — even without official approval.
Doctors backing approved AVT products say the tech cuts admin and keeps patient info secure. GP Anil Mehta users the compliant Accurx Scribe and told Sky News:
"I spend 30% of my week doing paperwork … patients are extremely reassured. And I haven’t faced anybody that’s not wanted to have me do this."
"(Consultations) remain confidential … the concept of that confidentiality remains."
An NHS spokesperson promised ongoing work with providers to ensure AVT tools meet safety and security standards.
Is ChatGPT reliable despite its ‘hallucinations’? (1:59)
Matthew Taylor says the letter is "a really significant moment"
GP Anil Mehta says the AI software helps cut paperwork and patients are "extremely reassured"
