WAN Video GeneratorWAN Video Generator

How to Create Talking Avatars with Wan AI: Step-by-Step Guide

Jacky Wangon 9 hours ago

Introduction

I spent last month helping a friend launch an online course. She's a subject matter expert — knows her material inside out — but hates being on camera. Every time we tried to record, it took twenty takes to get a clean segment, and the final result still had her glancing at notes, adjusting lighting, or apologizing for background noise.

We needed a way to turn her written lesson scripts into presenter-style videos without filming a single frame.

That's when I put together a workflow using Wan AI's speech-to-video (S2V) capabilities. We generated a reference avatar from a single photo, used Qwen3-TTS to create natural voiceovers from her scripts, and combined everything into talking avatar videos that look professionally produced.

In this guide, I'll walk you through exactly how to create talking avatars with Wan AI — from setting up your reference image to generating a finished video with lip-synced speech.

TL;DR

  • Wan AI's speech-to-video (S2V) model turns a reference photo + audio into a realistic talking avatar with natural lip-sync and facial animation
  • Qwen3-TTS generates natural-sounding voiceovers from text scripts — support for voice cloning, custom voices, and 10 languages
  • The complete workflow takes about 15 minutes per video: write script → generate audio → prepare reference image → generate avatar
  • No camera, microphone, or studio needed — everything runs in a browser at Wan Video Generator
  • The free tools handle most use cases — course content, explainer videos, internal training, and social media
  • Best results come from a clear front-facing photo and a script that matches the avatar's tone

What Is a Talking Avatar?

A talking avatar is a video where an AI-generated or AI-animated character speaks your script with natural lip movement and facial expressions. Unlike traditional text-to-video tools that create robotic-looking presenters, Wan AI's S2V model starts from a real photo and animates it to match your audio track.

The key difference between talking avatars and regular AI video generation:

Aspect Talking Avatar Standard AI Video
Input Reference photo + audio script Text prompt or text + reference image
Output A person speaking naturally Any scene described in the prompt
Lip-sync Yes — matches the audio precisely No — depends on the prompt
Facial animation Realistic, driven by voice Random or absent
Best for Presenter-style content Creative scenes, storytelling

What You Need Before Starting

  • A clear front-facing photo of a person (or a character) to use as the avatar reference
  • A written script for what the avatar will say
  • A browser — the entire workflow runs online

Step 1: Prepare Your Reference Image

The avatar's appearance depends entirely on your reference photo. Here's what I've learned from testing:

Choose a photo with:

  • Direct eye contact with the camera
  • Even lighting across the face (no harsh shadows)
  • A neutral or slight smile expression
  • High resolution (at least 800x800px)
  • Clean background or simple backdrop

Avoid:

  • Side profiles or extreme angles
  • Sunglasses or heavy face coverings
  • Extreme lighting (backlit, dramatic shadows)
  • Blurry or low-resolution images

The AI will preserve the person's face structure, expression baseline, and skin tone. A good reference photo is the single biggest factor in output quality.

If you want output today, start here: Launch Wan 2.2 Now →

Step 2: Generate the Voiceover with Qwen3-TTS

The voice is as important as the visual. Wan Video Generator integrates Qwen3-TTS, which offers three modes:

Mode How It Works Best For
Voice Design Describe the voice you want ("a calm female teacher, warm tone, moderate pace") When you don't have a reference audio
Voice Clone Upload a 3-second audio sample and the AI replicates it Recreating a specific person's voice
Custom Voice Choose from 9 premium pre-trained speakers Quick, consistent results

For my friend's course, I used Voice Design with "warm, professional female voice, friendly but authoritative, moderate pace." The result was natural enough that her students didn't realize it was AI-generated.

Quick tip: Write your script with short sentences and natural pauses. Qwen3-TTS handles punctuation well — commas and periods create realistic breath patterns in the audio.

Step 3: Generate the Talking Avatar

Now combine your reference image and audio in the speech-to-video tool.

  1. Upload your reference photo
  2. Upload or paste the generated audio file
  3. (Optional) Adjust settings like video duration
  4. Click generate and wait 1-3 minutes

The AI will animate the reference photo to match the audio waveform — lip movements, subtle head motions, and eye blinks are all synchronized to the speech.

What I noticed in my tests:

  • Shorter scripts (30-60 seconds) produce the most consistent lip-sync
  • Longer scripts (3+ minutes) may show slight drift in facial positioning
  • The avatar's expression stays relatively neutral — don't expect dramatic emotional shifts
  • The background remains static, so keep the focus on the presenter For a closer look at how it stacks up against other models, see Kling 2.6 Motion Control vs Wan 2.2 Animate.

Step 4: Review and Refine

After generation, review the video for quality:

  • Lip-sync accuracy: Does the mouth movement match the audio? Most passes are excellent on the first try.
  • Facial stability: Are there any glitches or warping? Minor issues can be fixed by regenerating with a better reference photo.
  • Audio clarity: Is the voiceover clear and natural? Re-generate the TTS audio if needed with adjusted tone or pace.

If the result isn't perfect, try:

  • A different reference photo (lighting differences matter a lot)
  • Shorter script segments (break a 3-minute script into three 1-minute clips)
  • The Voice Clone mode instead of Voice Design for more natural-sounding speech

Common Use Cases

Online Courses and Education

This is where talking avatars shine. I've seen creators use Wan AI avatars for:

  • Lesson introductions and summaries
  • Module overviews
  • Instructional demonstrations with voiceover
  • Course platform preview videos

Ready to try it yourself? Try Wan 2.2 Free →

The advantage is clear: one reference photo + script library = unlimited course content without recording fatigue.

Business Presentations and Training

Internal training videos, onboarding materials, and corporate presentations don't need a studio. A talking avatar delivers the information consistently every time — no flubs, no retakes.

Faceless YouTube and Social Media

For channels that prefer not to show the creator's face, a consistent talking avatar acts as a recognizable on-screen personality. Several faceless channels I follow use this exact workflow.

Customer Support and FAQ Videos

Replace static FAQ pages with a short avatar video explaining common questions. The personal touch improves engagement rates significantly.

Common Mistakes to Avoid

Mistake 1: Using a Low-Quality Reference Photo

This is the most common issue. A blurry or badly lit photo produces an avatar with unstable facial features — eyes may drift, mouth movements can look disconnected.

Fix: Invest time in getting a good source photo. Even a smartphone photo with proper lighting works well.

Mistake 2: Writing Scripts Without Natural Pauses

TTS engines perform best with natural speech patterns. Long run-on sentences without punctuation produce rushed, unnatural audio.

Fix: Write for speech, not for reading. Short sentences. Clear punctuation. Read the script aloud before generating.

Mistake 3: Expecting Emotional Range

Want to see the difference on your own footage? Start creating with Wan 2.2 →

Wan AI's S2V model creates natural talking avatars, not actors. The facial expression remains close to the reference photo's baseline.

Fix: Match the avatar's base expression to the tone of your content. A smiling reference for upbeat content, a neutral expression for serious topics.

Mistake 4: Overly Long Single Takes

The lip-sync quality degrades gradually in longer videos. I've found the sweet spot is 30-90 seconds per segment.

Fix: Break long scripts into chapters. Generate separate avatar clips for each section and stitch them together.

Related guides

FAQ

What is a talking avatar?

A talking avatar is an AI-generated video of a person speaking — created from a single reference photo and an audio track. The AI animates the photo to lip-sync with the audio, producing natural-looking presenter videos without filming.

How does Wan AI's speech-to-video work?

Wan AI's S2V model analyzes a reference image and an audio input, then generates a video where the person in the image appears to speak the audio. The lip movements, facial micro-expressions, and timing are all synchronized to the voice track.

Is the talking avatar free to create?

Yes. Both the Qwen3-TTS voice generator and the speech-to-video tool are free to use. There are no hidden costs for standard generation.

Can I use my own voice for the avatar?

Yes. Qwen3-TTS Voice Clone mode can replicate any voice from just 3 seconds of reference audio. Upload a short clip of your voice and the avatar will speak with your actual voice.

What languages does the talking avatar support?

Qwen3-TTS supports 10 languages: English, Chinese (Mandarin), Japanese, Korean, German, French, Russian, Portuguese, Spanish, and Italian. The lip-sync works across all supported languages.

Can I create a talking avatar from any photo?

The best results come from front-facing photos with even lighting and a clear view of the face. Side profiles, heavily shadowed faces, or low-resolution images produce lower quality avatars.

Can I use talking avatars for commercial projects?

Qwen3-TTS is released under Apache 2.0 license, which allows commercial use. For the Wan AI S2V model, check the specific terms on the platform for commercial usage rights.

How long does it take to generate a talking avatar?

The full workflow takes about 15 minutes: 2 minutes for script writing, 1 minute for TTS generation, 1 minute for photo preparation, and 3-10 minutes for the S2V generation depending on video length.

The Bottom Line

Talking avatars have become one of the most practical applications of AI video generation. The Wan AI workflow — reference photo plus Qwen3-TTS audio — produces professional-quality presenter videos without cameras, studios, or recording sessions.

For course creators, business trainers, and content producers who want a consistent on-screen presence without the production overhead, this workflow is worth testing today.

Start with a good reference photo and a short script. Generate your voiceover with Qwen3-TTS, then create your talking avatar in minutes. No filming required.

References

  • Wan2.2 Paper (S2V): https://arxiv.org/abs/2503.20314
  • Qwen3-TTS by Alibaba Qwen Team: https://github.com/QwenLM/Qwen3-TTS
  • Wan Video Generator: https://wanvideogenerator.com/
  • Wan2.2 S2V GitHub: https://github.com/Wan-Video/Wan2.2
Start Creating

Ready to Create with Wan 2.2?

Try Wan 2.2 for AI video generation — start free in your browser, no setup required.

Text to Video
Image to Video
No Setup Required
Free to Try