The phone number that appeared on the screen was unfamiliar. Jennifer DeStefano almost let it go to voicemail, but her 15-year-old was out of town skiing. Maybe there had been an accident. “I pick up the phone, and I hear my daughter’s voice, and it says, ‘Mom!’ and she’s sobbing,” DeStefano recalled. “I said, ‘What happened?’ And she said, ‘Mom, I messed up,’ and she’s sobbing and crying.”
In a split second, DeStefano’s confusion turned to terror. “Then I hear a man’s voice say, ‘Put your head back. Lie down,’ and I’m like, ‘Wait, what is going on?’” DeStefano said. “This man gets on the phone, and he’s like, ‘Listen here. I’ve got your daughter. This is how it’s going to go down. You call the police, you call anybody, I’m going to pop her so full of drugs. I’m going to have my way with her, and I’m going to drop her off in Mexico.’ And at that moment, I just started shaking. In the background, she’s going, ‘Help me, Mom. Please help me. Help me,’ and bawling.”
There was no doubt in DeStefano’s mind. Her daughter was in trouble. “It was never a question of who is this? It was completely her voice. It was her inflection. It was the way she would have cried,” she said. “I never doubted for one second it was her. That’s the freaky part that really got me to my core.”
But the 15-year-old never said any of it. The voice on the phone was just a clone created by artificial intelligence. “You can no longer trust your ears,” said Subbarao Kambhampati, a computer science professor at Arizona State University specializing in AI. He says voice cloning technology is rapidly improving. “In the beginning, it would require a larger amount of samples. Now there are ways in which you can do this with just three seconds of your voice. Three seconds. And with the three seconds, it can come close to how exactly you sound,” Kambhampati told On Your Side. “Most of the voice cloning actually captures the inflection as well as the emotion. The larger the sample, the better off you are in capturing those,” he said. “Obviously, if you spoke in your normal voice, I wouldn’t necessarily be able to clone how you might sound when you’re upset, but if I also had three seconds of your upset voice, then all bets are off.”
Deep learning technology currently has very little oversight, and according to Kambhampati, it is becoming easier to access and use. “It’s a new toy, and I think there could be good uses, but certainly, there can be pretty worrisome uses, too,” he said.
Dan Mayo, the assistant special agent in charge of the FBI’s Phoenix office, says scammers who use voice cloning technology often find their prey on social media. “You’ve got to keep that stuff locked down. The problem is, if you have it public, you’re allowing yourself to be scammed by people like this because they’re going to be looking for public profiles that have as much information as possible on you, and when they get a hold of that, they’re going to dig into you.”
According to the Federal Trade Commission, scammers will often ask victims to wire money, send cryptocurrency or pay the ransom with gift cards. Once the money or gift card numbers are transferred, getting them back is almost impossible. “Just think of the movies. Slow it down. Slow the person down. Ask a bunch of questions,” Mayo said. “If they have someone of interest to you, you’re going to know a lot of details about them that this scam artist isn’t going to know. You start asking questions about who it is and different details of their background that are not publicly available, you’re going to find out real quick that it’s a scam artist.”
There are other red flags. “If the phone number is coming from an area code that you’re not familiar with, that should be one red flag,” Mayo added. “Second red flag; international numbers. Sometimes they will call from those as well. The third red flag; they will not allow you to get off the phone and talk to your significant other. That’s a problem.”