Watching This Neural Network Render Truly Photorealistic Faces Is Creepy And Mesmerising

In 2015, Google released DeepDream, a bonkers, art-generating neural net users put to work rendering everything from disturbing dog collages to even more disturbing psychedelic porn. DeepDream may have just been the prelude to less aesthetically off-putting but much more significant applications of the slightly creepy technology - such as generating photorealistic, high-definition images of people who never existed.

Graphics card and electronics manufacturer Nvidia released a paper on Friday showing off a new method of generating unique faces via a generative adversarial network (GAN), a class of algorithm where researchers pair two competing neural networks against each other. In a GAN, one of the two neural networks is put to a generative function (like rendering images or trying to solve a problem) while the other is put in an adversarial role, challenging the first's results. The intent is that the generative neural network will produce a superior result by bouncing its ideas its the adversarial counterpart.

Image: Screengrab via Nvidia

Nvidia's team wrote that with a new progressive training method, they were able to generate "images of unprecedented quality" using the CelebA-HQ database of photos of famous individuals, and that the results looked pretty good up to 1024 pixel resolution:

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively, starting from low-resolution images, and add new layers that deal with higher resolution details as the training progresses. This greatly stabilizes the training and allows us to produce images of unprecedented quality, e.g., CelebA images at 1024² resolution.

It's frankly pretty eerie, all these people that were never real floating past your eyes in uncanny detail - though it's only static images, meaning we're still pretty far off from the Matrix. Nvidia's method also allowed for very good generation of objects and scenery, which you can see in the video below.




    The intent is that the generative neural network will produce a superior result by bouncing its ideas its the adversarial counterpart.The intent there was try and write a sentence that makes sense and proof-read it before publishing.


    This would be useful for games that have to populate worlds with 1000s of NPCs. I just started playing Assassin's Creed Origins, and keep getting distracted by the number of twins, triplets and quadruplets living in ancient Egypt.

      Thought the same thing as soon as I saw it, also for creating photorealistic models where you don't actually have to pay any models or photographers. I can see a future where at some point generic model photos will be all created this way, it will only be celebs that will make any money from their likeness being used in an ad.

    Why does crap like this fascinate people? This is just a mix and match photo program, you can even recognise the faces it mixes up. This is lame.
    I'm sure some programmer bros high 5'd over that...

    A Scanner Darkly was way ahead on this stuff eh.

Join the discussion!