VASA from Microsoft Research: It transforms a single photo and audio clip into hyper-realistic talking face videos, synchronizing lip movements with audio in real-time. Achieves up to 40 FPS with minimal latency, paving the way for lifelike virtual interactions.

【感動】たった一枚の写真で会話する動画を生成

マイクロソフトの最新プロジェクト「VASA-1」は、オーディオを用いて一枚の写真から会話する動画をリアルタイムで生成する技術を開発。これは衝撃ですね。

Ultra realistic AI-video from a photo

This is VASA-1 from Microsoft research

The improvements in quality we’re getting between each new release is incredible.

Links below

Microsoft just dropped VASA-1.

This AI can make single image sing and talk from audio reference expressively. Similar to EMO from Alibaba

10 wild examples:

1. Mona Lisa rapping Paparazzi

🚨 Microsoft Research just announced VASA-1.

All it needs is a picture and audio to create these talking videos!

Look at this real-time demo:

The First AI-Generated Video That Looks Super Real

Microsoft Research announced VASA-1.

It takes a single portrait photo and speech audio and produces a hyper-realistic talking face video with precise lip-audio sync, lifelike facial behavior, and naturalistic head movements…

🚨Microsoft just announced VASA-1.

This AI can make a picture talk and sing.

10 crazy examples:

🟢1. Mona Lisa rapping Paparazzi

Life na 50-50. - VASA

今天最重磅的新闻：微软发布了VASA-1，一张图生成视频。

microsoft.com/en-us/research…

下面这个牛逼的逼真人脸视频，就是这个模型生成的。

让照片说话这个功能很多人都在做，阿里之前的EMO拿奥黛丽赫本做的那个唱歌展示就很惊艳（贴在评论里），但我觉得还是因为赫本雕塑般的脸庞降低了处理难度，换成常人的脸效果就有点鬼畜

微软的VASA-1人工智能项目最新发布的展示，明显上了一个层次，拿孙红雷做例子对比一下

BREAKING:

Microsoft VASA-1 AI generates hyper-realistic, real-time talking face videos from photos and audio.

Is It Time?

Şu takıma gelenlerin çoğu evlendi bebekleri falan oldu bir bu adama vurmadı ama düşününce Vasa da evlenmedi kaderleri bir herhalde aralarından biri evlense diğeri de evlenir kesin mistik bir ikili

Let's breakdown the technical details in Microsoft's mind blowing Lifelike audio-driven talking faces framework - VASA and model VASA-1:

Summary of Summaries
- The paper introduces VASA, a framework for generating lifelike talking faces with appealing visual affective skills…

vasa seknd hendara

1枚の写真から音声に合わせてしゃべる動画を生成できる技術「VASA-1」をMicrosoftが発表！

超リアルな表情をリアルタイム生成する。

アリババの「EMO」に似て画期的。

ABUK SUBUK KİM VASA ENGELLİYORUM BU ARADA..2024 YASANARAK Bİ ÖĞRENİLSİN BAKALIM..EL Mİ YAMAN BEY Mİ GÖRELİM

Vasanin eniştesi geldi diye vasa forması giydim geldim anlatabiliyor muyum