Just ask: why do medical consultations with AI attract scammers
Seeking medical advice from artificial intelligence (AI) systems carries a number of risks, researchers from the Oxford Internet Institute have warned. In particular, users may receive contradictory responses where useful information is mixed with potentially dangerous recommendations. However, scammers can also use this topic in various deception schemes. Details can be found in the Izvestia article.
Why are scammers interested in medical consultations with neural networks?
The modern development of artificial intelligence is at an early stage, says Alexandra Shmigirilova, GR director of the Security Code information security company, in an interview with Izvestia. Despite the active introduction of neural networks, their use leaves many important issues open, including reliability, so AI cannot be fully trusted yet.
"In controversial situations and with imperfect algorithms, there is a risk that fraudsters will take advantage of this confusion to gain access to confidential information that can be used or sold on the shadow market," says the specialist.
At the same time, medical issues are taken seriously, since we are talking about human health and life, notes Alexandra Shmigirilova. Trust in doctors is achieved due to the fact that people cannot always fully assess the situation and rely on professionals.
However, when AI performs diagnostics, ordinary people consider it more reliable: the machine is not subject to emotions and, therefore, it is attributed a lower probability of error. This creates the potential for scammers who can speak on behalf of the neural network, getting answers to their queries much easier.
What fraudulent schemes involving AI and medicine should we expect in 2025
The popularity of neural network chatbots in matters of medicine and self-diagnosis will encourage cybercriminals to distribute phishing applications based on AI, allegedly specially trained to diagnose and advise patients, says Roman Reznikov, an analyst at the Positive Technologies research group.
— In fact, such applications will only be a cover for collecting data and infecting the user's devices with malicious software. In addition, fraudsters can use large language models to generate more convincing fake medical text in phishing attacks," the expert explains.
For example, cybercriminals will send letters on behalf of hospitals or other medical institutions, informing them that the patient has serious health problems. "Treatment" will require an urgent purchase of expensive drugs, filling out documents with personal data, or installing services that monitor the body's condition, Roman Reznikov notes.
In addition, the massive use of fake medical chatbots and voice messages should be expected in 2025, predicts Andrei Razdymakho, an expert on cybersecurity at Angara Security. In particular, a fraudster will intimidate a potential victim by saying that they need money to save a loved one or pay for an urgent procedure.
— Separately, it is worth noting the risk of attacks on telemedicine platforms. For example, an attacker under a doctor's account can break into the system, change test results, or write fake prescriptions. Forgery of documents has not gone away either, certificates, referrals, benefits and insurance — everything can be forged and submitted," says the interlocutor of the publication.
In fact, the old methods of deception — fake clinics, fake medicines, fake certificates — will receive a new digital face against the background of the spread of AI, they will work faster and more sophisticated, and the schemes themselves will become widespread, Andrey Razdymakho emphasizes.
What medical schemes of scammers have been encountered before
Today, there are many illustrative examples of how fraudsters use neural networks in the context of medicine, Andrei Razdymakho says in an interview with Izvestia. So, earlier in Australia, they discovered a generated video in which experts advertised fictitious diabetes supplements.
— In April 2024, scammers used a fake image of a famous scientist, Dr. Karl Krushelnitsky, to sell miracle pills. The video has garnered more than 10 million views, and users have massively transferred money for non—existent drugs," says a cybersecurity expert.
And European ESET experts have identified dozens of TikTok and Instagram accounts (owned by the Meta Corporation, an extremist organization recognized in Russia), where AI doctors agitated subscribers to buy useless Ozempic supplements.
An important place in the arsenal of scammers is traditionally occupied by calls from imaginary medical institutions with offers to make an appointment with a doctor or undergo an examination, adds Alexandra Shmigirilova. The main purpose of this method is to gain access to the personal and financial information of victims, for example, by requesting an SMS code associated with a medical card. In fact, it can be an access code to "Public Services" or a banking application.
—Attackers actively use AI to collect and analyze information, which allows them to communicate more effectively with potential victims and gain more trust," says the specialist.
The direct use of neural networks in the medical context is a modern trend, says Alexander Mikhailov, head of GSOC at Gazinformservice. However, before mass access to large language models, such schemes were less common or unconvincing.
How to protect yourself from medical scams
The interest of medical fraudsters is primarily aimed at the most vulnerable groups of the population, says Alexander Mikhailov. These are gullible and less technologically savvy elderly people, as well as patients with chronic or severe illnesses who are desperate and ready to try anything.
— Those who do not have access to high-quality medical care or are looking for alternative methods due to the high cost of medical services are also at risk. At the same time, the dangers of fraudulent schemes in this area are very multifaceted," the Izvestia interlocutor shares.
The first of them is the direct loss of money due to fake services and products. This is followed by a leak of information that can be used for further deception or blackmail. However, the worst thing is following false recommendations, refusing necessary treatment in favor of AI methods, taking dangerous or useless drugs, which can lead to a deterioration in the condition of the victim of criminals, emphasizes Alexander Mikhailov.
To protect yourself, Andrey Razdymakho advises first of all to check the accuracy of the information. Question medical recommendations from social networks and messengers: check with familiar doctors or official clinics whether they were actually published.
— If you find a fake video or a suspicious medical offer on the Internet, be sure to mark it as questionable on the platform where the information is posted, or report it to law enforcement agencies, — the specialist recommends.
If you find out from someone about an unpleasant diagnosis, do not panic and do not transfer money for a miracle cure that will cure all diseases. Do not share personal and medical information with strangers or unverified services. It is important to always check information and act rationally, as well as clarify details in official channels and medical organizations, concludes the Izvestia interlocutor.
Переведено сервисом «Яндекс Переводчик»
