Technology

59427 readers

2850 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

295

Microsoft’s VASA-1 can deepfake a person with one photo and one audio track (arstechnica.com)

submitted 7 months ago by return2ozma@lemmy.world to c/technology@lemmy.world

71 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] kromem@lemmy.world 6 points 7 months ago (1 children)

This project doesn't recreate or simulate voices at all.

It takes a still photograph and created a lip synched video of that person saying the paired full audio clip.

There's other projects that simulate voices.

[–] trolololol@lemmy.world 0 points 7 months ago (1 children)

Yep it's part of it to generate the sound track

One of the videos show the voice changing in mid sentence

[–] kromem@lemmy.world 3 points 7 months ago* (last edited 7 months ago)

No, it isn't. In that clip they are taking two different sound clips as they are switching faces. It's not changing the 'voice' of saying some phrase on the fly. It's two separate pre-recorded clips.

Literally from the article:

It does not clone or simulate voices (like other Microsoft research) but relies on an existing audio input that could be specially recorded or spoken for a particular purpose.