OtherArticle
The Photoreal Lip-Sync Wall: Testing and Abandoning wav2lip, MuseTalk, and LatentSync
A complete test record of three open-source lip-sync routes on a 16GB consumer GPU: measurement methods, hidden failures, and the evidence behind abandoning real-time lip sync.
Abstract
An evaluation of local real-time lip sync for a photoreal digital companion. wav2lip256 and MuseTalk v15 were measured on an RTX 5070 Ti with 16GB of VRAM for frame rate, latency, memory use, and mouth motion; LatentSync was tested offline. The record covers seven quiet failures, including memory fallback, reversed coordinate conventions, and duplicated-frame stutter. The conclusion is that photoreal real-time expression and lip sync currently require either far more than consumer-grade VRAM or a qualitative compromise in image quality or latency. The project therefore abandoned live lip sync in favour of prerendered clips and an independent voice layer. All figures apply only to the tested versions and machine.