The format of the show means that briefs aren't delivered until a week before the live broadcast, and are subject to change as the couple's choreography develops through training. We advise and guide the creative team about what will work well in AR, whilst encouraging all ideas that will enhance the setting and theme of each performance.
For the AR to feel real the graphics have to be rooted firmly in position, creatively tie in with the aesthetic of the performance, and realistically respond to an environment filled with lights and constant movement. Building on Potion's experience working on the show, and familiarity with the production process, designs were created in mind of camera movement limitations and directorial style - ensuring that visuals meshed with every performance.
MAKING LIVE AUGMENTED REALITY A REALITY
In 2020 covid restrictions meant that there would be no studio audience and limitations on stage crew meant that large props couldn't be used. Concerned that the ballroom would feel sparse, the producers approached Potion about the possibility of using Augmented Reality. Bringing in this new emerging technology into a pre-existing and well oiled show was an exciting challenge.
We used Epic Games's Unreal Engine to drive the graphics and MoSys's Startracker system to track the cameras. Having successfully demonstrated the potential to producers, we were commissioned to incorporate AR alongside the regular performance visuals. The show continued to use AR after the lifting of covid restrictions. The creative possibilities and audience reactions have never been stronger.
Watch the video below for AR highlights from the last few years.
The multi-award winning Strictly Come Dancing has used augmented reality since 2020 to bring even more of the glitz and glamour that make it the biggest entertainment show on British television.
The real-time rendering power of Unreal Engine was the natural choice to drive the AR. Integrating directly with Mo-Sys tracking via the VP plugin, our designers are able to craft concepts rapidly and reliably, within the challenging timescales of a live TV production.
Our workflow meant working closely with the studio director and the lighting team. We had regular meetings to showcase the looks in PreViz so the director could script the camera movements to suit both the choreography and the graphics. In studio, we tweaked the virtual lighting to match the real virtual lighting - and implemented virtual reflections and shadows on the dancefloor to further enhance the illusion of the AR really being there.
In addition to the AR overlay we also leveraged the N-Display workflow and camera tracking data, to create striking 3D projections graphics made possible by real-time off axis projection.
BRINGING IT ALL TOGETHER
Harnessing both creativity and technology immersed viewers at home in the world of each performance. So convincing were some of the graphics that 2020 winner Bill Bailey replied to one twitter user that he had not in fact been dancing with a real elephant.
As the series has progressed, creative ambitions have grown and we have incorporated motion capture to allow the professional dancers to provide the animation for dancing digital avatars such as penguins, zombies and robots. Feedback from audiences, particularly younger demographics have been overwhelmingly positive. Increasingly the real time rendering software is also being used for performance visuals allowing for a more flexible integrated workflow and more realistic results.
Introducing this technology has allowed the show to update its aesthetic and production values while staying true to its core enduring format.
