Technology has made our life so much better but one cannot ignore the harmful aspect of it. We have already witnessed how AI voice clone and deepkfake tools have been used by trolls to imitate the voices of celebrities and make fake videos. The generated audio ranges in content from memes and erotica to virulent hate-speech.
11Labs new Ai voice cloning technology is scary. (Video Riddit.com)
ElevenLabs, the startup providing the voice cloning technology, has already announced additional safeguards it will be introducing to the platform in a Twitter thread. These will include stopping free users from creating custom voices, launching a tool to detect AI-generated audio, and banning accounts reported for creating “harmful content.”
Internet trolls are quickly embracing an AI business that enables anyone to instantly copy a target’s voice. Users of 4chan have flocked to the free voice synthesis platform ElevenLabs, where they may clone celebrities’ voices and read recordings ranging from hate speech and erotica to jokes and falsehoods.
ElevenLabs’ software, which appears to have become generally accessible over the weekend, offers a formidable combination of speed, quality, and availability—as well as a complete lack of safeguards—in contrast to the rapid advancement of such AI speech deepfakes during the previous few years.