Disney’s New Lion King Is the VR-Fueled Future of Cinema

Director Jon Favreau shot the remake of the animated classic inside virtual reality. He doesn’t know what to call the result, but it looks like a real movie.

For the 26 million people who watched Friends in the mid-’90s, Jon Favreau was Pete Becker. Not the star filmmaker who would make Elf a holiday classic; or who’d launch the Marvel juggernaut by directing Iron Man; or who’d update The Jungle Book for the CGI generation. Just Becker, a tech whiz who—before wooing Monica in a six-episode arc—had become a gazillionaire by creating a piece of business software called Moss 865. It was so named for a reason. Moss 1 exploded. Moss 2 would only schedule appointments for January. Becker, convinced his idea would change the world, pressed on. Today, it’s hard to describe Favreau’s latest project, the much-anticipated Lion King remake, without thinking of Pete Becker.

In fact, it’s hard to describe the film at all.

There are some obvious facts, sure. The Lion King is the next installment in Disney’s series of reworked animation classics, which includes not just The Jungle Book but also live-action updates of Cinderella and Aladdin. The film’s Bambi-meets-Hamlet plot, in which an African lion cub named Simba flees his savanna-ruling family after his father’s death, is nearly identical to the 1994 megahit that remains the highest-­earning G-rated movie of all time. James Earl Jones reprises his role as the murdered king Mufasa, joined this time around by Chiwetel­ ­Ejiofor­, Beyoncé, Donald Glover, Seth Rogen, and others. If you’ve seen the trailer, there’s one other obvious fact: The new Lion King rides an atomically thin line between CGI animation and live-action.

This is where, to quote Simba’s meerkat friend Timon, the going gets tough. Achieving that photoreal look, the thing that trompes your oeils into thinking you might be watching a nature documentary, wasn’t simply a matter of employing space-age visual effects. Favreau and his crew shot The Lion King as one would any conventional movie: with dollies, cranes, and other tools that let cinematographer Caleb Deschanel get just the right angles. There were even lights and cameras. It’s just that the cameras and lights were nowhere to be found.

The Lion King was filmed entirely in virtual reality (well, save a single photographed shot). All the locations you know from the original—Pride Rock, the elephant graveyard, Rafiki’s Ancient Tree—exist, but not as practical sets or files confined to an animator’s computer. They live inside a kind of filmmaking video­game as 360-degree virtual environments, full of digitized animals, around which Favreau and his crew could roam. Headsets on, filmmakers had access to all the tools of the trade, just in virtual form. Say you’re getting ready for a scene in which young Simba talks to Zazu, his father’s adviser, and the “sun” isn’t falling on Simba’s face the way it should. Favreau or visual effects supervisor Rob Legato could just add a “light” to boost the intensity.

Outside, in the real world, is the so-called volume, which would be called a set if there were anything to it. Instead, the volume is a large open space in which the crew has set up dolly tracks or cranes—not for cameras, exactly, but for viewfinders, roughly the size and weight of the cameras they’re replacing. Those view­finders are festooned with pucks, hand-sized globs of plastic that broadcast infrared signals. Overhead on a metal truss, a matrix of 3D sensors tracks the signals and translates the viewfinders’ positions back into VR.

In order to block out a scene, the filmmakers would put on their headsets and figure out exactly where the cameras and lights would go to best capture the action, using handheld controllers to move the virtual equipment around like chess pieces. Then, real-world camera operators in the real-world volume would “shoot” the virtual environment by moving their tracked real-world viewfinders around—movements which were mirrored by the virtual cameras in the virtual environment. Two layers of reality, meatspace motions capturing digital dailies.

A decade ago, James Cameron’s Avatar pioneered a technique in which actors wearing motion-capture suits could be filmed inside digital backgrounds in real-time. Later, on films like Ready Player One and Solo: A Star Wars Story, filmmakers started using VR headsets to examine the virtual world and even plan shots. What Jon Favreau has cooked up for The Lion King transforms VR from a handy filmmaking accessory into a high-powered, improvisational medium in itself—a Pete Becker–sized leap forward and a stirring reminder that VR is changing the world in ways you don’t need a headset to see.

The year the original Lion King came out, Hollywood writers were in the grip of VR fever. Michael Crichton had just published his erotic corporate-sabotage thriller Disclosure, in which data gets visualized in a virtual world; soon after, the novel was made into a movie starring Michael Douglas and Demi Moore. (If you think that’s the most ’90s sentence possible, you’re almost correct.) Johnny Mnemonic and Strange Days, two cyberpunk films that made VR a significant part of their imagined futures, were both in production. Even the NBC sitcom Mad About You had an episode in which its lead characters toyed with investing in a VR startup, ultimately putting on headsets for virtual run-ins with Christie Brinkley and Andre Agassi. (Now that’s the most ’90s sentence possible.)

Still, for all the psychedelic dreams that trickled from science fiction to celluloid, virtual reality couldn’t seem to worm its way into our actual lives. The equipment was heavy and uncomfortable, and it delivered laggy graphics. Besides, something called the internet had gone wide. As abruptly as it had boomed, VR faded, eclipsed by the immediacy and accessibility of the web. LEARN MORE Disneys New Lion King Is the VRFueled Future of Cinema The WIRED Guide to Virtual Reality.

Visibility and viability are very different things, of course. When VR dropped off the cultural radar, it found a second life in the vast market situated next door: industrial application. As the Los Angeles Times wrote in 1995, “The technology is starting to find an important place in real estate, construction, medicine, and many other realms.” Pop culture had made the public think of VR as an entertainment medium, but that limited view effectively turned the technology into an iceberg, the paltry tip of which bore little resemblance to the enormity of what lurked beneath popular awareness.

A decade or so later, the smartphone came along, spawning an industry of miniaturized displays and sensors that facilitated VR’s 21st-century rebirth. Companies like Oculus realized that consumer VR hardware was finally viable, and the public began to reimagine the realm of virtual possibility—one that included a new approach to filmmaking. With 360-degree video placing viewers inside the movie, some predicted that “VR cinema” would be so transformative that audiences might never again be satisfied with watching a flat theater screen. Alas, a century of filmmaking conventions wasn’t undone so easily. When VR cinema failed to sweep away standard Hollywood blockbusters, the iceberg effect kicked in again: Guess VR won’t spark a film revolution after all!

The set of The Lion King, though, makes very clear that the VR revolution did happen. It just didn’t look at all like the soothsayers thought it would.

“You’re here watching us flap our wings,” Favreau says to me with a grin as he prepares for another take. It’s a February afternoon in 2018, nearly a year and a half before The Lion King hits theaters, and we’re standing inside the aforementioned volume, which is itself inside a squat, nondescript facility in LA’s Playa Vista neighborhood. This is where the movie took shape. It’s where the voice actors met to record their scenes, with cameras capturing them so animators could use their expressions and emotions as reference for the animals. It’s where those real cameras then got swapped out for virtual ones, so the crew could shoot the movie. Today is one of the last days of principal photography, and it’s a pivotal one, involving a tense scene between Simba (Glover), Scar (Ejiofor), Sarabi (Alfre Woodard), and a group of hyenas. Simba has returned to the pride after years away, ready to confront Scar about his role in Mufasa’s death.

Standing at the edge of the volume, I’m able to watch each take twice on the large screen monitors that overlook the action: once as they’re filming it, and once when they play it back to examine the results. (I also could have put on a VR headset and been there at Pride Rock itself.) At the moment, the scene isn’t overwhelmingly lifelike. The animals, synced with the actors’ voices, walk through their predetermined paths with a perfunctory stride; the environments look impressive but not breathtaking. All of it will later be polished to a high sheen, the footage handed over to editors and animators who will spend the next year and change optimizing each stride and snarl until the finished version vaults out of the savanna and past the uncanny valley. Before any of that, though, there’s a problem with the scene they’re trying to film: Every time cinematographer Deschanel yells “Three, two, one, go!” a troublesome hyena gets in the way of the Steadicam.

The Steadicam operator, Henry Tirl, is holding a harness-mounted rig with the general shape and feel of cameras he’s used on previous films (Thor, Dunkirk, plenty of others). Of course, the viewfinder doesn’t show him what’s happening in the empty volume—it shows Sarabi accusing Scar of murdering his own brother. As the action unfolds, Favreau and Deschanel watch both the monitors and the camera operator, cuing Tirl’s choreography. Once again, a virtual hyena walks into the frame, obscuring Sarabi.

To read more about Disney’s New Lion King Is the VR-Fueled Future of Cinema