Rephrase.ai raises $1.5M to use synthetic media for personalized sales pitches

Published September 24, 2020

Bangalore-based Rephrase.ai has an ambitious vision for reshaping how movies and videos are made.

CEO Ashray Malhotra laid it out for me yesterday, saying that his co-founder Nisheeth Lahoti “came up with this concept — he wants to build an engine that can take any script as input and create a professional movie,” no filming required.

But Rephrase.ai is starting with what Malhotra said is a more “short-term, monetizable” goal: Offering technology that makes it easy to create personalized sales videos.

The startup was part of the Techstars Bangalore program in 2019 and is announcing today that it has raised $1.5 million in seed funding led by Lightspeed Venture Partners and AV8 Ventures.

Malhotra demonstrated the technology for me, showing me how a salesperson can select a model, a background and a voice, and enter text that the model will recite. They can then export that video for use in a variety of sales tools.

This is valuable for, he said, because sending personalized video messages in sales emails can lead to “an insane increase” in clickthrough rates. But creating all those videos can be a huge chore, if not downright impossible.

And while there are plenty of other startups working on synthetic media, Malhotra said Rephrase.ai is set apart by the 18 months the team spent developing technology that can take 10 minutes of footage and “predict how the lip movements of the person would have been if you’d shot them [saying any phrase] in an actual studio.”

You can see the results for yourself in the video above. Personally, I was impressed by the lip movements but disconcerted by the fact that Rephrase.ai customers can pair any model with any voice, leading to some strange combinations that feel more like badly dubbed movie than an effective sales pitch.

When I brought this up, Malhotra replied that some clients will want to take the time “perfecting it out, finding the right voices, the right costumes, the right personality of the actors,” while other clients might be fine spending less time to create something a little less convincing.

It’s also worth noting that Rephrase.ai has several policies designed to prevent the creation of deceptive deepfakes: Presenters can control who has the authority to create videos using their faces, the platform is only open to authorized businesses and videos are created from scratch, rather than transferring someone’s face onto an existing person.

Malhotra said Rephrase.ai is currently talking to a number of potential customers, but those discussions are in early stages. He also suggested that the technology could expand fairly quickly into areas like chatbots and education.

“I think it’s going to open a whole new world of creativity,” he said. “When you and I want to express something, we’re most likely to write a text document, but as a viewer, we want to see a video. They’ve been disconnected because video creation is really difficult.”

Sonantic is ready to convince listeners that synthetic voices can cry

The need-to-know takeaways from VidCon 2019

Published July 15, 2019

VidCon, the annual summit in Anaheim, CA for social media stars and their fans to meet each other drew over 75,000 attendees over last week and this past weekend. A small subset of those where entertainment and tech executives convening to share best practices and strike deals.

Of the wide range of topics discussed in the industry-only sessions and casual conversation, five trends stuck out to me as takeaways for Extra Crunch members: the prominence of TikTok, the strong presence of Chinese tech companies in general, the contemplation of deep fakes, curiosity around virtual influencers, and the widespread interest in developing consumer product startups around top content creators.

Newer platforms take center stage

Photo by Jerod Harris/Getty Images

TikTok, the Chinese social video app (owned by Bytedance) that exploded onto the US market this past year, was the biggest conversation topic. Executives and talent managers were curious to see where it will go over the next year more than they were convinced that it is changing the industry in any fundamental way.

TikTok influencers were a major presence on the stages and taking selfies with fans on the conference floor. I overheard tweens saying “there are so many TikTokers here” throughout the conference. Meanwhile, TikTok’s US GM Vanessa Pappas held a session where she argued the app’s focus on building community among people who don’t already know each other (rather than being centered on your existing friendships) is a fundamental differentiator.

Kathleen Grace, CEO of production company New Form, noted that Tik Tok’s emphasis on visuals and music instead of spoken or written word makes it distinctly democratic in convening users across countries on equal footing.

Esports was also a big presence across the conference floor with teens lined up to compete at numerous simultaneous competitions. Twitch’s Mike Aragon and Jana Werner outlined Twitch’s expansion in content verticals adjacent to gaming like anime, sports, news, and “creative content’ as the first chapter in expanding the format of interactive live-streams across all verticals. They also emphasized the diversity of revenue streams Twitch enables creators to leverage: ads, tipping, monthly patronage, Twitch Prime, and Bounty Board (which connects brands and live streamers).