The AI Arms Race: ElevenLabs Develops Multilingual Voice Cloning Model
The San Francisco-based startup ElevenLabs has announced their new AI model that can mimic voices fluently speaking in 30 different languages. This is a significant expansion from the original eight languages supported. The company used Lukeman Literary as an example, explaining that their new AI model has drastically reduced the time it takes to produce audiobooks in multiple languages.
- ElevenLabs’ Multilingual v2 model delivers emotionally-rich audio that captures natural speech inflections.
- The company offers a text-to-speech tool and a “VoiceLab” for cloning specific voices.
- Users can upload speech samples to create custom voice clones, which can be manipulated to say anything.
- The expanded linguistic capabilities now include languages like Swedish, Arabic, and Malay.
- ElevenLabs aims to market the tool for practical applications such as narrating audiobooks.
Addressing Concerns: Misuse and Ethical Implementation
While the development of AI voice cloning offers many practical benefits, concerns about misuse and ethical implementation persist. Deepfake audio presents risks of fraud and misinformation campaigns, as demonstrated by ElevenLabs’ previous platform exploitation. The company claims to have implemented stricter safeguards, but ethical concerns remain.
Rapid progress in AI voice cloning is unstoppable, despite the potential risks. Major tech firms like Meta have faced similar criticism for developing powerful AI without full transparency. However, ElevenLabs hopes to eliminate linguistic barriers to content and cover more languages and voices in the future.
Hot Take: Treading Carefully in the AI Arms Race
As the AI arms race continues, the development of multilingual voice cloning marks another significant milestone. While the benefits are clear, the risks of misuse and ethical concerns are real. It is crucial for companies like ElevenLabs to prioritize safeguards and responsible implementation to prevent the spread of misinformation and protect users from potential harm. As we navigate this evolving technology, balancing innovation and ethical considerations will be key to ensure a harmonious global communication landscape.
By
By
By
By