That’s outrageous! Just because I had a video conference,Directly defrauded of 180 million. This is a crime that has really happened in Hong Kong: the financial staff of a multinational company's Hong Kong branch, following the instructions of the "CFO", transferred a total of 200 million Hong Kong dollars (approximately 180 million yuan) to the other party's designated account. Who would have thought that this person who just had a "face-to-face" chat with him in the video conference was completelyDeepfakeCome out!
Don't rush to scold this big brother for being too vigilant. He has had the slightest suspicion, but this is not a one-on-one video call that is common in the fraud industry——
There were several familiar faces participating in the meeting. Whether it was faces or voices, the person involved described that "everyone looked very real."
No matter how you say it, the horror of this incident is a bit scary to netizens.
The topic of crimes committed through AI technology has suddenly become the focus of discussion on major platforms.
Marcus, who is on the front line of AI criticism, immediately led netizens to say, "Hey guys, this is the arrival of "Black Mirror."
The deepfake shit is getting real.
The whole story
Let’s call this deceived financial officer “Xiaoshuai” for the time being. The specific story of the matter is as follows...
Initially, Xiaoshuai received an email from the "CFO" at the British headquarters. Because the content mentions the need to perform ansecret deal, Xiaoshuai had some doubts at first and suspected that this was phishing information.
No, the scammer immediately took the next step and invited Xiaoshuai tovideoconference.
After Xiaoshuai entered the video conference, he was completely stunned by the scene in front of him: not only the company's CFO was there, but also some of Xiaoshuai's colleagues, as well as some external personnel.
The key is that these fake colleagues look and sound exactly the same as the real colleagues Xiaoshuai knows.
During the meeting, the fake CFO also asked Xiaoshuai to introduce himself, but the meeting was suddenly interrupted during the meeting.
The scammer then maintained contact with Xiaoshuai through instant messaging platforms, emails, and one-on-one video calls.
After such a series of tricks, Xiaoshuai finally fell into the scammer's trick. According to the instructions in the meeting, he made 15 transfers to 5 Hong Kong bank accounts, totaling 200 million Hong Kong dollars, which is about 25.6 million US dollars, or about 180 million RMB.
The whole incident lasted for about a week from the time the scammer contacted Xiaoshuai. It was not until Xiaoshuai verified the situation with the company headquarters that he was shocked to realize that the whole incident was just a well-planned fraud.
They then called the police. The police immediately launched an investigation and found that all participants in the meeting, except Xiaoshuai, were digital people reconstructed by scammers using public personal video and audio clips.
In the video, when Xiaoshuai introduces himself, he is not really interacting with him, but simply giving instructions using his avatar.
Police also revealed that the criminals used the same multi-person video call strategy to try to defraud another employee at the company's branch, contacting two to three employees in total. But police have not provided complete information about what happened to them.
The case is still under further investigation and the fraudster has not yet been arrested.
At a subsequent press conference, the Hong Kong police stated that they had arrested 6 people related to this type of fraud, and there were many more similar cases:
From July to September last year, 8 stolen Hong Kong ID cards were used to apply for 90 loans and register 54 bank accounts;
On at least 20 occasions, AIDeepfake has been used to imitate the portrait on an ID card to fool facial recognition programs.
How powerful is AI “cloning”?
It can be seen that in the entire case, one of the key points that finally made Xiaoshuai let down his guard was that the dummy in the video conference was too real.
So how real are today’s “digital clones”? Let’s take a look at some chestnuts.
For example, the following video of Swift speaking Chinese comes from a popular AI tool-HeyGen.
The timbre and mouth shape were reproduced so perfectly that netizens were so frightened that they called out:
In HeyGen's latest technology demonstration, real-time chatting with digital clones has become a reality.
In terms of AI speech synthesis, a startup company called 11Labs (ElevenLabs) has become quite popular recently.
11Labs can not only achieve speech generation in 29 languages, but also requires only as short as1 minute of audio material, can "clone" any person's voice very well, and can imitate the intonation and emotional changes in place.
The key is that nowadays, these AI cloning techniques are not only becoming more and more realistic, but the threshold is also gradually lowering...
For example, the following open source project can already implement real-time video face-changing in minutes.
The project homepage lists many ready-made facial models of different people. If you don't like it, you can train the model yourself.
“A digital clone of you is coming soon”
Perhaps influenced by this incident and the recent incident of Taylor Swift becoming a victim of Deepfake, the above-mentioned real-time face-changing project has gained attention again and has even made it to the GitHub trend list.
In the issues of this project, many netizens have been resistant to it for a long time.
But as many netizens mentioned, technology is not good or evil. And the more realistic problem is that there is no turning back when the bow is fired.
So many people focus on "how to defend".
In addition to the formulation of more regulations and policies, from a technical perspective, Nature mentioned in the article "Seven Technologies Most Worth Watching in 2024":
Letting developers add invisible watermark mechanisms to AI tools may be a solution.
From a personal perspective, heightened vigilance has become a proposition that must be faced in the era of AIGC technology explosion.
The Hong Kong police also stated in this incident that they will expand the alert system to warn in advance and prevent users from transferring funds to fraud-related accounts.
However, the fact that Deepfake fake CFO defrauded the company of 180 million is still a bit outrageous.
As a result, many netizens raised questions: Such a large company has no risk management measures? I'm afraid there's no one inside.
So, what do you think?