Motion Capture: From 7 Dwarfs to Guardians of the Galaxy 3
Tracing the evolution of performance capture in film, spanning early rotoscoping techniques to its modern-day uses in visual effects-heavy movie franchises.
My fellow space cadets! Get ready to blast off for another epic adventure with the Guardians of the Galaxy crew! Who doesn't love a bunch of misfits with hearts of gold ๐, especially when theyโre kicking butt and taking names across the galaxy ๐? Marvel fans rejoice: the third installment of the trilogy has hit theaters, and itโs a wild ride full of heart, humor, and, of course, a killer soundtrack thatโll have you bopping along in your seat!
But have you ever wondered how some of the amazing characters in this movie (and other films) come to life? It's like magic, only cooler, and itโs called motion capture, and it has revolutionized the film industry. Weโre going to peek at how motion capture (also known as mocap or performance capture) has changed the game, so fasten your seatbelt, and enjoy the ride as we travel all the way back toโฆ
The 1970s - Animation and Virtual Worlds
We could go back even further and talk about how rotoscoping techniques (Animating frame-by-frame over the filmed movement of actors) are really the beginning of mocap. It was used in Disneyโs Snow White and the Seven Dwarfs (1937) and was the first time mainstream audiences witnessed animated characters move as realistically as a person. The 1970s saw an explosion of the technique through the works of animators like Ralph Bakshi. His animated adaptation of The Lord of the Rings used the style extensively.
But the 70s is also when a computer scientist named Myron Krueger developed a virtual reality system called โVideoplace.โ Sounds like a VHS rental spot ๐ผ from the 80s, right? But it was far more advanced than that! It allowed users to interact with computer-generated environments using their body movements. Talk about ahead of its time! This was really the basis for the kind of technology we mostly associate with motion capture today.
The 1980s and 1990s - a CGI Revolution
As motion capture technology continued to evolve, filmmakers started using it to create digital characters and special effects in ways that had never been done. Throughout the wackiness of the 80s and 90s, motion capture technology made some seriously cool strides. Picture researchers donning funky reflective markers and doing the robot dance to develop the VICON system. It was like a disco party meets science lab! Cameras were everywhere, capturing performersโ moves with the precision of a salsa dancer ๐ on roller skates. The system was used in the incredible VFX masterpiece Titanic to create dozens of small vignettes of digital characters populating the shipโall animated using performance capture through VICON. VFX Supervisor Rob Legado described his use of motion capture in the 1995 making of the film by saying:ย
โItโs really the way [a person] moves that makes you believe they are dramatically in that scene. Context makes these little vignettes come to life. We start to populate the ship with these people, and once they moved, you got the essence of their personality. All of a sudden, you sort of put these souls of these people that you transplanted through this process onto the deck of a ship.โ
The 21st Centuryโs dawn of the CGI character
It wasnโt until the turn of the millennium that motion capture started being used the way we know it now. The feature film Star Wars: Episode I - The Phantom Menace used motion capture extensively in 1999, where the character Jar Jar Binks was brought to life through the technique. And honestly, love him or hate him, he was ahead of his time too!
But it was with Peter Jacksonโs The Lord of the Rings trilogy that Mocap officially became a sole performer! The second film of the trilogy, The Two Towers, featured the first movie character exclusively created using performance capture technology. Gollum was not just motion captured but voiced, and therefore fully played, by the talented Andy Serkis. Gollum has become one of the most memorable and preciousssss characters in movie history, and Serkis has become a legend of performance capture.
His other great work in the field was as the intelligent ape Caesar in the newest reboot of the Planet of the Apes franchise. He and a cast of other actors wore motion capture suits and prosthetics to portray the apes, and their nuanced performances were realistic and emotionally charged. The technology also allowed for realistic ape movements and facial expressions, adding to the films' striking realism.
Mocap today
But let's get back to the Guardians of the Galaxy crew, shall we? The films have been pushing the boundaries of performance capture since the first film in 2014. The filmmakers even included a 1970s-style homage to rotoscoping in the recent Guardians of the Galaxy Holiday Special with animated scenes in the style of Ralph Bakshi.
But most notably, motion capture has been used in all of its films and offshoots to bring the smallest Guardian to life, Rocket Raccoon. Like Gollum and Caesar, Rocket was entirely computer-generated. Bradley Cooper provided the voice, while Sean Gunn (who also plays Kraglin, the Ravager) provided the motion capture movements and facial expressions. Thanks to the technology, the filmmakers could create an array of fantastic digital creatures for the film that looked and moved like real beings.
Guardians of the Galaxy Vol. 3 is no exception. In fact, this film focuses primarily on Rocketโs story and dives deep into his past. We learn about his origins as a testing animal in captivity, and we meet several old animal friends on the same path to genetic upgrade. These animalsโa bunny, a walrus, and an otterโwere motion captured as well by actors Mikaela Hoover, Asim Chaudhry, and Linda Cardellini. The film follows the four through flashbacks during their time in a cruel laboratory where their friendships โค๏ธ and dreams of freedom were their only solace. The scenes include some of the most emotionally grounded performances by motion capture artists to date and mark a huge milestone in the art form.
The Future of Motion Capture
Motion capture is even breaking into the virtual reality scene, where developers use it to create immersive and interactive environments that respond to usersโ movements and actions using haptic suits that respond to movement and even provide feedback to the wearer.ย
But some of the newest forms of mocap donโt even require suits. Instead, they employ phone cameras ๐ฑ, AR, and AI to interpret the filmed movement of an actor. Some even remove the motion subject from the shot entirely to make room for the digital counterpart.ย
In some cases, removal isnโt even necessary as the AI can simply augment features of the actor to look however it needs.
And even more advanced future forms would include AI tools that capture the movements of an actor simply as a training model to base a new computer-generated version that is dynamically adjustable and intelligent enough to be directed by the filmmakers in post-production to move in ways that the mocap actor did not.ย
These new forms of AI performance capture are set to upgrade the art form yet again and may create characters almost as convincing as their human counterparts. And who knows, maybe one day weโll get a motion capture performance from an AI-powered robot ๐ค that will so blow our minds (we hope not literally ๐คฏ) that it will win an Academy Award โ or at least the team that trained it.
Of course, some of this new tech is still in its infancy ๐ถ, so for now, we can sit back and enjoy the incredible performances of our favorite motion capture characters, like Rocket Raccoon, Jar Jar Binks, and Gollum. But letโs keep an eye on those machines because you never know when they might turn on us. After all, weโve seen what happened in The Matrix, and that wasnโt pretty ๐ณ.
Are you excited to see the new Guardians film? What other films do you love that feature motion capture technology? You can find and chat with other fans of films that use these cutting edge special effects on our Discord! Consider hosting a watch party and discussion of your favorite films on the Remarkist app! Remarkists specialize in geeking out over this stuff, and all are welcome to join in the fun!