โThe voice is a fingerprint of the soul.โ โ Daniel Day-Lewis
โ What You’ll Learn
- How is voice cloning being used?
- How to become immortal?
- How to clone artistsโ voices?
- What are digital twins?
- How to use voice cloning to scale a podcast?
- How to build an audio content machine?
- How can voice cloning help you reach new audiences?
- How to narrate an audiobook with a cloned voice?
๐ Why It Matters
Voice cloning lets you create audio at scale.
๐ Problem
Your ability to create content is limited by time, energy and physical conditions.
You need to eat, sleep and rest. Youโre mortal.
๐ก Solution
Voice cloning helps you build an audio content machine that works anytime, anywhere.
Even once youโre gone.
๐ Players
Voice Cloning Tools
- ElevenLabs โข Realistic voice cloning for creators and publishers
- Descript โข Realistic voice cloning
- Deepsync โข Clone your voice and vocal nuance
- Respeecher โข Voice cloning for filmmakers, game developers and other content creators.
- Resemble AI โข Create dynamic and unique voice content
Voice Cloning Use Cases
- Audiobook Narration โข Use your voice or the voice of your favorite actor to narrate an audiobook. DeepZen narrated an audiobook using the voice of Edward Herrmann
- Podcasts โข Record new episodes anytime, anywhere. Seth Godin used AI to narrate this episode of Akimbo podcast
- YouTube Channels โข Narrate video scripts or build faceless YouTube channels. Shan Ruthra shares how you can use your cloned voice to make voice-overs for YouTube videos
- Localization โข Reach a wider audience by speaking more languages. ActionPark Media used multilingual Veritone Voice Network to expand Victory the Podcast into new markets.
- Films โข One voice actor can dub many films at once. Flawless dubbed the Fall movie into Japanese and Spanish
๐ฎ Predictions
- Voice cloning will be used to replicate the voices of deceased actors and musicians. Weโll see their posthumous performances in movies, music, TV shows and more.
- DeepZen used old recordings to bring Edward Herrmannโs voice to life.
- Morgan Neville used AI to create the voice of Anthony Bourdain for Roadrunner.
- Resemble AI and Netflix will use Andy Warholโs voice for The Andy Warhol Diaries.
- Session 42 โrevivedโ singers Ofra Haza and Zohar Argov to celebrate Israelโs 75th Anniversary.
- People will clone artistsโ voices to make new songs.
- Best AI Songs made Pressure by Travis Scott with AI.
- Hot AI Music shared an AI-generated album by Drake.
- Fireship made a song by Ye (Kanye West) about his YouTube channel.
- Weโll see digital twins. Instead of voices, entire people will be cloned.
- Rephrase AI builds custom avatars.
- Hour One builds virtual twins with cloned voices.
- Colossyan builds avatars that look and sound like you.
โ๏ธ Opportunities
- Scale your podcast with voice cloning. Save time recording and editing episodes by using your cloned voice.
- Seth Godin used AI to narrate this episode of Akimbo podcast.
- Rob Walling used voice cloning for the intro to Episode 649 of Startups for the Rest of Us podcast.
- Play.ht runs Podcast.ai with AI-generated episodes such as Joe Rogan Podcast with Steve Jobs.
- Turn your written content into audio content. Narrate a book, blog post or newsletter without spending time doing it yourself.
- audiostory.ai turns articles into podcast episodes.
- Chris Wrobel narrated Inside the Mind of My Digital Clone using his cloned voice.
- George Saoulidis is a book author who might use voice cloning to narrate his books.
- Cherie Hu made an audio version of the Music AI Deepfakes issue of Water and Music newsletter.
- Use your digital twin for course lessons, explainer videos, personalized messages and more. This lets you scale your presence without recording yourself each time.
- MattVidPro cloned himself.
- Ran.de built a 3D newsroom with virtual hosts.
- Berlitz made 8 virtual teachers for their language courses.
- DeFiance Media made a 24/7 newscaster of decentralized culture, finance, and tech news.
- Mondelฤz International made an avatar of Shah Rukh Khan for ads and personalized videos.
- Raymond Realty cloned its director Gautam Singhania to send personalized videos to prospects.
๐๏ธ Risks
- Impersonality โข AI voice lacks a human touch. Drew Carey used AI to produce a Friday Night Freakout episode. Fans werenโt pleased.
- Scam โข Scammers can use voice spoofing to fake a kidnapping, get system access, money and more. They only need a 3-second audio clip of your voice.
๐ Key Lessons
- Voice cloning helps you create audio content at scale. You can turn books, scripts and articles into audiobooks, podcasts and videos. All at once.
- You can reach new audiences. Some people prefer to listen than to read. Others prefer to listen in their first language.
๐ฅ Hot Takes
- Weโll be able to choose our favorite speakers as audiobook narrators.
- Family members and friends will become โimmortalโ. Weโll train AI on text messages, emails and conversations with them. Then use voice cloning to preserve their voices. HereAfter AI and MindBank let people chat with the virtual you.
๐ Haters
โHow can I prevent my voice from being cloned? This tech lets anybody use it without my consent.โ
Donโt ever speak in public. A better solution is to add safeguards to voice cloning tools such as live reading. Podcastle asks to record 70 short sentences directly in the app. Only account owners can do that.
โVoice cloning will make voice-over jobs less relevant.โ
True. AI can narrate content faster and cheaper than professional voice actors.
โModern tools such as Adobe Podcast make it easier to record audio without the right setup.โ
You still need a decent setup for them to work properly. They wonโt help if you record yourself on the construction site.
โItโs illegal to clone artistsโ voices to make music.โ
Copyright laws are tricky. Some say that an artistโs voice, style or flow is not protected by copyright. Courts say that using a widely known voice to boost sales of a product is a tort. Time will tell what position regulators will take.
โWhy would I pay for a cloned voice if I can clone it myself?โ
You need permission to use them commercially. Corporations are good at striking copyrighted content. Dae Lims made songs with the voices of John Lennon and Paul McCartney. They were taken down by Universal Music Group.
๐ Links
- Best AI Voice Generator โข Tutorial on how to clone a voice with ElevenLabs.
- Voice Cloning Guide โข Official voice cloning guide by ElevenLabs.
- Create a Magical Audiobook Experience โข How to create an audiobook with AI voices.
๐ Related Reports
- โโโThe Creator Economy โข Voice cloning helps to create audio content at scale
- โMillion-Dollar, One-Person Businesses โข Your voice is a form of leverage
- โPersonal Brands โข Your voice is part of your identity
- โAI-Generated Content โข Voice cloning is the next big thing in generative AI
- โPodcast Memberships โข You can make episodes without the right setup or vocal health
๐ Thanks
Thanks to Kevin, Alex Doda, Maciej Cupial, Stewart Townsend, Nicolรฒ Borghi, Darren Travel and Meiko S. Patton. We had a great time jamming on this report.
โ๏ธ Emin researched and wrote this report. Dru researched and edited this report.
๐ What else?
Trends PRO #0112 โ Voice Cloning has more insights.
What youโll get:
- 16 Voice Cloning Tools (220% More)
- 13 Voice Cloning Use Cases (160% More)
- 8 Predictions (167% More)
- 8 Opportunities (167% More)
- 4 Risks (100% More)
- 6 Key Lessons (200% More)
- 8 Hot Takes (300% More)
- 10 Links (234% More)
With Trends Pro youโll learn:
- (๐ Pro) How are scammers impersonating victims?
- (๐ Pro) How can voice cloning boost the quality of life?
- (๐ Pro) How to detect fake voices?
- (๐ Pro) How to monetize cloned voices?
- (๐ Pro) How to build a faceless YouTube channel?
- (๐ Pro) How to speak new languages?
- (๐ Pro) How to build a productized voice cloning service?
- (๐ Pro) How to lower key-person risk?
- (๐ Pro) How to offer personalized experiences?
- (๐ Pro) How to avoid legal issues with voice owners?
- (๐ Pro) How to trick banks with cloned voices?
- (๐ Pro) What are the copyright issues of AI-covered songs?
- (๐ Pro) How to future-proof your voice?
- And much moreโฆ
Get Weekly Reports
Join 54,000+ founders and investors
๐ Unlock Pro Reports, 1:1 Intros and Masterminds
Become a Trends Pro Member and join 1,200+ founders enjoying…
๐ง Founder Mastermind Groups โข To share goals, progress and solve problems together, each group is made up of 6 members who meet for 1 hour each Monday.
๐ย 160+ Trends Pro Reportsย โข To make sense of new markets, ideas and business models, check out our research reports.
๐ฌ 1:1 Founder Intros โข Make new friends, share lessons and find ways to help each other. Keep life interesting by meeting new founders each week.
๐ฒ 100k+ Startup Discounts โข Get access to $100k+ in startup discounts on AWS, Twilio, Webflow, ClickUp and more.
Brought to you by the team behind HeadsUp
