zzdcar
Home
/
Reviews
/
Culture
/
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync-July 2024
2024-02-19 EST 22:12:25

I’m not sure how closely you’ve been following the strange new field of AI-enabled and how shockingly accessible they’ve gotten for , but just trust me when I tell you that it’s easier than ever to make plausible-looking videos of people doing things they didn’t actually do. There’s even a goofy/impressive that can make a picture of anyone appear to lip-sync songs. So, it’s time to shove some cars in there.

So far I haven’t seen anyone really attempt to force this Wombo AI—likely a glowing orb in a tank of bluish gel—to anthropomorphize car front ends according to its complex and likely unknowable human face parameters to see how well it works.

As America’s first self-appointed Automotive Anthropomorphization Czar, it’s my responsibility to do so. So I did. And I picked the songs from the limited set available mostly at random, so try not to read too much into that.

I started with one of the most face-like automotive front ends I could think of, an Austin-Healey Bugeye Sprite:

wombo: Bugeye Sprite

As you can see, it did pretty well! It clearly pegged the headlights as eyes, the grille as a mouth, and the resulting morphed motion definitely feels like what a rubbery Bugeye Sprite would likely look like singing James Brown.

Now, let’s try something more confusing: Luigi, the Fiat 500 , which uses the debased

Wombo: Luigi (Fiat 500) Cars

Based on this result, I am not certain the Wombo AI has a preference of its own, as I can’t tell if its reading the windshield irises as eyes or forehead? Either set of eyes is kind of working here. Hm. (The AI has clearly chosen the windshield eyes.—ED)

More study is needed.:

Wombo: Pao

I think it made a good call with the bumper-mouth there, and I’m reading the main headlights as eyes, though it’s possible the foglamps confused it? I’m not sure, but I think it works surprisingly well.

What worked surprisingly unwell is a car that I’ve always felt to have a very identifiable face, a classic Volkswagen Beetle:

Wombo: Beetle

The lack of a grille/mouth opening seems to have really confused it, making the hood act as a sort of snout. I’m not clear where it thinks the eyes are, as the headlights are all but ignored?

Let’s try something with a much more obvious grille: this International semi truck:

Wombo: International Truck

The formatting of the videos here is cutting off a bit at the bottom where a lot of the mouth articulation is happening, but I think this one works pretty well. I believe that truck wants to go to Funkytown.

Wombo: Jaguar E-Type

I picked another obvious mouth-grille here, a Jaguar E-Type, and the result is, yes, the car looks like it’s singing. Even if the AI doesn’t know what to do with the eyes, I think our brains comfortably read the headlamps as eyes in this context, though I think I saw the wipers blink.

Let’s pick a more modern car with a very facial front end, a Mazda 3:

Wombo: Mazda 3

Obvious grilles clearly help this AI succeed. Let’s do one last one, the gloriously worried-face-looking Soviet UAZ 452 van:

Wombo: UAZ 452 van

Okay, that works, in its way! That old Iron Curtain van clearly is determined to survive. It seems to be singing more out of the side of its grille than the others, but that just adds some character.

I feel like there’s a hell of a lot more important research to be done here, and I strongly encourage everyone to find some good car-faces and try it out, loading the results in the comments so we can all scrutinize and attempt to better ourselves via understanding.

Really, I can’t imagine anything more important any of you would have to do, right?

Comments
Welcome to zzdcar comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Culture
Your Oranges-And-Black NSX Wallpaper Is Here
Your Oranges-And-Black NSX Wallpaper Is Here
The old NSX is the car we all should have bought ten years ago before they exploded in value. But we didn’t. Or at least I didn’t. The prices have been while the new NSXs are losing value. Why? Because the old one is better. Objectively better. Jalopnik reader...
Jul 11, 2025
The 250-Mile Fisker Ocean Will Be Way Cheaper Than The Tesla Model Y
The 250-Mile Fisker Ocean Will Be Way Cheaper Than The Tesla Model Y
Henrik Fisker, the designer behind cars like the and the Fisker Karma, has struggled to keep a car company afloat in the past. But he’s trying again with the , a 250-mile range electric crossover with a price that steeply undercuts the upcoming . To be clear, this is...
Jul 11, 2025
Ferrari Uses Drive-Thru At Restaurant That Doesn't Have One
Ferrari Uses Drive-Thru At Restaurant That Doesn't Have One
One person was hospitalized with minor injuries after a Ferrari F430 driver lost control and crashed into the restaurant Pump in West Hollywood. The restaurant is owned by Lisa Vanderpump, and is featured on Bravo’s “Vanderpump Rules.” The car crashed into the patio seating area before sliding through the...
Jul 11, 2025
The Ford F-150 Is Seemingly Unbeatable
The Ford F-150 Is Seemingly Unbeatable
The Ford F-150 will never die, Subaru thinks it can sell even better in the U.S., and Nissan is trying to figure out how to do the same. All of this and more in for Monday, Jan. 6, 2020. The 1.24 million trucks it sold in 2018 represents over...
Jul 11, 2025
Maybe We've Been Under-Appreciating The Honda CR-Z
Maybe We've Been Under-Appreciating The Honda CR-Z
It doesn’t happen too often, but every now and then I’ll have a chance encounter with a car that I’d completely forgotten about. That encounter will usually have one of two outcomes: either a long, overly dramatic exhale and a some loud statement to the person (likely imaginary) next...
Jul 11, 2025
100 Years Ago This Company Made Up A Meaningless Name And Started Making Cutting-Edge Cars
100 Years Ago This Company Made Up A Meaningless Name And Started Making Cutting-Edge Cars
You know what was a great decade for cars? The 20s. The last one I mean, not this one that we’re half a week into. Lots of great cars came out of the 20s, and a few great car companies. One of those companies was Alvis, which began making...
Jul 11, 2025
Copyright 2023-2025 - www.zzdcar.com All Rights Reserved