May 28, 2026
"Real-time video generation" as a product category contains at least three distinct use cases, and building for one while using technology designed for another produces reliable failure in production. A live streaming avatar that needs to respond within seconds requires a continuous streaming architecture. A marketing team animating product photos needs a model that preserves visual identity across frames. A brand building a character-consistent campaign needs reference-input consistency that general text-to-video models cannot provide.These three use cases share a name, but the technical infrastructure underneath each one is different, and the model selection that works for one will not transfer to the others.This piece maps each scenario to its requirements and to the model family built to meet them.
Three axes separate the scenarios:
The same generation speed, the same hardware, the same pricing structure can produce entirely different suitability depending on which scenario it is being applied to.
The technical definition here is strict. A virtual human that conducts live customer conversations, hosts a 24/7 TikTok stream, or runs interactive training sessions must deliver visible avatar response within 1 to 3 seconds of receiving input. It must stream video continuously rather than generating files. It must accept new text or voice input at any point and update the output accordingly.
This is a fundamentally different architecture from video file generation.Standard video diffusion models, regardless of how fast they generate, produce a completed file and return it. A live interactive avatar requires streaming architecture with WebRTC delivery. The frames arrive continuously. The avatar responds rather than renders.
HeyGen Avatar 4, accessed as heygen-avatar-4, is the production-ready implementation of this architecture. LiveAvatar runs the avatar rendering pipeline continuously, with LLM integration handling incoming user queries and avatar engine rendering lip-sync, gestures, and expressions in response. End-to-end latency across LLM processing, avatar rendering, and network delivery is typically 1 to 3 seconds.
Use cases where this architecture is the correct choice:
For any of these, the alternative to streaming avatar architecture is either human operators or a fundamentally broken user experience. A batch-generated video cannot substitute for a live conversational response.
The second scenario starts with a visual asset that already exists. A product photo. A brand image. A location shot. A character illustration. The goal is to add motion while preserving what the input image already established.
The key technical requirement is image-to-video fidelity. A model that generates motion plausibly but fails to preserve the composition, color palette, and subject identity of the reference image is not useful for production marketing or branded content. Cinematography awareness also matters: the ability to respond to directorial prompts like slow pan, rack focus, or specific camera movements means the generated motion is controlled rather than arbitrary.
wan2.7-i2v addresses this scenario. It animates still images into clips up to 15 seconds at up to 1080p, accepts first-and-last-frame control for compositional precision, and responds accurately to cinematography-language prompts. Object and product motion quality is strong for single-subject marketing use cases.
Generation time for Wan 2.7 I2V is approximately 4 minutes per clip on current infrastructure.This is a batch workflow, not an interactive one. The correct production pattern is queuing requests rather than expecting real-time iteration. For teams with large existing libraries of product photography or brand imagery, this model converts static assets into motion content at scale.
Use cases:
The third scenario involves a character whose visual identity must remain stable across independently generated clips. A brand spokesperson. A channel mascot. A training module presenter. Text descriptions of a character are insufficient for this use case because general video models will drift in facial features, body proportions, and visual style across generations.
The technical requirement is explicit reference binding. A model that accepts reference images and locks specific visual attributes to a character identity, maintaining consistency across generations, is a different product from a model that merely accepts text prompts.
wan2.7-r2v (Reference-to-Video) takes up to 5 reference inputs, which can include images, video clips, and audio samples. Explicit character binding using the platform's reference syntax achieves approximately 80% identity consistency across generations, compared to roughly 55% when character appearance is described in text only. That 25-point gap is the difference between a usable production workflow and one that requires extensive manual review and rejection.
Voice Reference capability in Wan 2.7 R2V adds voice cloning to the reference system. Providing a 5-10 second audio sample allows the model to generate video where the character speaks in a consistent vocal identity, not just a consistent visual identity. Combined, this produces content where the same person appears and sounds consistent across an entire campaign without requiring the actual person to record each piece.
Use cases:
HeyGen Avatar 4, Wan 2.7 I2V, and Wan 2.7 R2V are all accessible through GMI Cloud's MaaS layer under a single API key and per-request billing. The three models cover the three distinct use cases without requiring separate provider accounts for the streaming avatar platform, the image-to-video provider, and the reference-to-video provider.
For production teams building applications that span more than one of these use cases, a unified API surface reduces integration complexity. A platform that serves live avatar customer interactions through heygen-avatar-4 and produces reference-consistent branded video content through wan2.7-r2v can run both on the same infrastructure, with consistent monitoring, billing, and documentation across both integrations.
Full model documentation is atdocs.gmicloud.ai. The model library and console are atconsole.gmicloud.ai.
The three scenarios in this article all fall under the category of real-time video generation in 2026 product marketing. They are not interchangeable. A streaming avatar model does not generate files. An image-to-video model does not stream live responses. A reference-to-video model does not operate as a real-time conversational agent.
Identifying the scenario first produces a clear path to the correct model family. Selecting a model based on marketing positioning and then discovering it does not match the use case's architectural requirements is the more expensive version of the same decision.
Colin Mo
GMI Cloud helps you architect, deploy, optimize, and scale your AI strategies
