In this presentation, Jeff For Local Marketing explains his workflow for creating consistent AI voice avatars using ChatGPT to generate voice prompts for HeyGen, paired with a fixed visual avatar. He highlights the challenge of "drift"—gradual changes in visual features or voice that break character consistency across multiple videos—and describes strategies to maintain a stable persona. Jeff showcases a case study with Art Alvarez, owner of Mortgage Works in Palm Springs, demonstrating how the avatar captures Alvarez’s speech mannerisms and delivers a scripted mortgage‑related message. He also recounts presenting this approach to a group of Palm Springs realtors, emphasizing the importance of avoiding a robotic sound that can cause pushback from industry professionals. The demo underscores the practical steps, tools, and client‑focused considerations for deploying AI‑generated video content that feels authentic and engaging.
Chapters
So basically what I did is I went into ChatGPT and I said, hey, this is what we're trying to achieve. Write the voice prompt for HeyGen, and I'm gonna design the voice for that. And now what I've done is if the client likes that, that becomes the voice for Cosmo along with the image in every video we make. So there's the consistency going along there. Now of each video, we don't lose the voice and we don't lose the image. And character consistency across many different videos has always been a challenge. And I say always, we've only been doing this for about a year, but it becomes a challenge. We call it drift. And so eventually, you know what happens is the eyes look different, a nose looks different, the hairstyle is different. There's noticeable changes that, wait a minute, that's not Cosmo anymore, that's somebody else. Or in this case, if it were a person, it would look like it's somebody else. So these are the couple things that you can do that can make a big difference. Now, I wanna take us back and let's go back to this just for a second. And let's go back home and I'm gonna show you some other examples of this. I have another client that, let's see, he has a mortgage company. And so what we did is we started making videos. These are all videos of this gentleman, His name is Art Alvarez. He has a mortgage company called Mortgage Minute, or excuse me, Mortgage Works in Palm Springs. And I won't play the whole thing, but I want you to get a feel of how this looks and how engaging it looks. And it doesn't matter which one I grab. Let's say, let's just grab this one.
You know, for years we've been told there's only one way to buy a home. You save up, you buy it yourself, and that's the path. But today, that model is changing fast. Let's be real for a moment. Rents are high, in some cases really high, and every single month, you're writing a check that builds someone else's wealth.
Now, for me, I get excited about this because this takes on his mannerisms, the pausing in his voice, the inflections, and all I basically do is I write a script for this avatar and then have it read it and it reads it in Art's voice. It has his tonality, has his inflections. And here's the thing, and I just did this last week, I spoke to a group in Palm Springs, California, realtors in the real estate industry. And I said, you know, one of the things we don't want— this is the biggest pushback when we talk about AI— is we don't want to sound like a robot. Yes or yes? I mean, you know, we don't want to sound like a robot.