zzdcar
Home
/
Reviews
/
Culture
/
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync
Let's See How Well A Deepfake AI Can Make Cars Lip-Sync-May 2024
2024-02-19 EST 22:12:25

I’m not sure how closely you’ve been following the strange new field of AI-enabled and how shockingly accessible they’ve gotten for , but just trust me when I tell you that it’s easier than ever to make plausible-looking videos of people doing things they didn’t actually do. There’s even a goofy/impressive that can make a picture of anyone appear to lip-sync songs. So, it’s time to shove some cars in there.

So far I haven’t seen anyone really attempt to force this Wombo AI—likely a glowing orb in a tank of bluish gel—to anthropomorphize car front ends according to its complex and likely unknowable human face parameters to see how well it works.

As America’s first self-appointed Automotive Anthropomorphization Czar, it’s my responsibility to do so. So I did. And I picked the songs from the limited set available mostly at random, so try not to read too much into that.

I started with one of the most face-like automotive front ends I could think of, an Austin-Healey Bugeye Sprite:

wombo: Bugeye Sprite

As you can see, it did pretty well! It clearly pegged the headlights as eyes, the grille as a mouth, and the resulting morphed motion definitely feels like what a rubbery Bugeye Sprite would likely look like singing James Brown.

Now, let’s try something more confusing: Luigi, the Fiat 500 , which uses the debased

Wombo: Luigi (Fiat 500) Cars

Based on this result, I am not certain the Wombo AI has a preference of its own, as I can’t tell if its reading the windshield irises as eyes or forehead? Either set of eyes is kind of working here. Hm. (The AI has clearly chosen the windshield eyes.—ED)

More study is needed.:

Wombo: Pao

I think it made a good call with the bumper-mouth there, and I’m reading the main headlights as eyes, though it’s possible the foglamps confused it? I’m not sure, but I think it works surprisingly well.

What worked surprisingly unwell is a car that I’ve always felt to have a very identifiable face, a classic Volkswagen Beetle:

Wombo: Beetle

The lack of a grille/mouth opening seems to have really confused it, making the hood act as a sort of snout. I’m not clear where it thinks the eyes are, as the headlights are all but ignored?

Let’s try something with a much more obvious grille: this International semi truck:

Wombo: International Truck

The formatting of the videos here is cutting off a bit at the bottom where a lot of the mouth articulation is happening, but I think this one works pretty well. I believe that truck wants to go to Funkytown.

Wombo: Jaguar E-Type

I picked another obvious mouth-grille here, a Jaguar E-Type, and the result is, yes, the car looks like it’s singing. Even if the AI doesn’t know what to do with the eyes, I think our brains comfortably read the headlamps as eyes in this context, though I think I saw the wipers blink.

Let’s pick a more modern car with a very facial front end, a Mazda 3:

Wombo: Mazda 3

Obvious grilles clearly help this AI succeed. Let’s do one last one, the gloriously worried-face-looking Soviet UAZ 452 van:

Wombo: UAZ 452 van

Okay, that works, in its way! That old Iron Curtain van clearly is determined to survive. It seems to be singing more out of the side of its grille than the others, but that just adds some character.

I feel like there’s a hell of a lot more important research to be done here, and I strongly encourage everyone to find some good car-faces and try it out, loading the results in the comments so we can all scrutinize and attempt to better ourselves via understanding.

Really, I can’t imagine anything more important any of you would have to do, right?

Comments
Welcome to zzdcar comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
Culture
Toro y Moi -- 'Ordinary Pleasure'
Toro y Moi -- 'Ordinary Pleasure'
Traffic sucks, so why not start your morning off with some music? You provide the toast and we’ll provide the jams. You probably have to go to work today instead of hanging out at the beach, but this jam will make you feel like you’re there anyway. ...
May 25, 2026
European Noise Regulations Are Forcing Sports Car Makers to Resort to More Fake Engine Sounds
European Noise Regulations Are Forcing Sports Car Makers to Resort to More Fake Engine Sounds
There are certain cars that you just expect to be loud. and are among them, and yet, both Alpina and AMG now have no choice but to pipe fake exhaust sounds into their cabins. And you can thank a new European noise regulation for it. “The death knell has...
May 25, 2026
GM Prepares to Get Dunked On at the Democratic Debates in Detroit
GM Prepares to Get Dunked On at the Democratic Debates in Detroit
The Democratic debates in Detroit promise to take on problems in the auto industry, car sales might still be plummeting, and the world is still a tough place for low-emissions and autonomous vehicles. All this and more in for Tuesday, July 30, 2019. With two Democratic debates taking place...
May 25, 2026
Ohio's Long Battle Over Front License Plates Isn't Over Yet
Ohio's Long Battle Over Front License Plates Isn't Over Yet
Some states require front license plates, others don’t. Car enthusiasts say the cars look better without them. The police say they have captured violent criminals because of them. The state of Ohio is somehow still in the midst of this debate despite earlier this year abolishing the requirement. That...
May 25, 2026
Nearly 30,000 Volkswagen Tiguans and CCs Recalled for Faulty Airbag Modules
Nearly 30,000 Volkswagen Tiguans and CCs Recalled for Faulty Airbag Modules
Owners of model-year 2015 to 2016 and s should be aware that the National Highway Traffic Safety Administration has issued a recall for their cars over an airbag issue. If you’re reading this and you own a CC, then I commend you because I feel like almost nobody bought...
May 25, 2026
What Was the Last Supercar Flop?
What Was the Last Supercar Flop?
The is, in the year 2019, considered a classic of the early 1990s supercar era. It’s right up there in the Pantheon with the Ferrari F40s and the Bugatti EB110s. But when it finally went on sale in 1992, it was a total disaster. I don’t mean the car...
May 25, 2026
Copyright 2023-2026 - www.zzdcar.com All Rights Reserved