Amazon Web Services and Formula 1 are working together to migrate decades of race footage to a centralized database (opens in new tab) in the cloud, the pair have revealed.
The archive migration project is an extension of an existing partnership between the two organizations, the main objective of which is to create superior experiences for fans on race days by utilizing the latest cloud analytics (opens in new tab) technologies.
Speaking to TechRadar Pro, Rob Smedley, Chief Engineer and Director of Data Systems at F1, explained that order has now been applied to the mess of video content on file, some of which dates all the way back to the 1950s.
- Here's our list of the best cloud databases (opens in new tab) right now
- We've built a list of the best large capacity hard drives (opens in new tab) around
- Check out our list of the best cloud backup (opens in new tab) services out there
"Formula 1 has gathered a massive amount of data over the years,” he said. “Every race day, you can only imagine the amount of video data collected. But we needed to modernize that archive.”
“There’s such a rich seam of data available to us, but it’s about ensuring we can actually get to it all. It’s a typical big data problem: you can have masses and masses of data, but unless you can get to the bit you want (and quickly) that information is rendered almost useless.”
By bringing together the various disparate data sources and migrating the lot to the cloud (opens in new tab), F1 now has access to a complete and searchable archive of race footage, which Smedley says will set the stage for an “altogether richer fan experience”.
Rolling back the years
Mercifully, Formula 1 had already digitized all the footage that was previously stored on physical celluloid tape as part of a previous modernization project, which meant there was one less problem to worry about.
In this instance, the main challenge was drawing together video stored in multiple formats and across a range of different databases, and organizing it in a consistent way to maximize searchability (and therefore usability).
As Smedley explained, the organization’s database systems had expanded organically in line with demand from various different internal departments, creating a labyrinth of systems that made identifying specific footage extremely time-consuming, if not impossible.
To solve the problem, F1 and AWS effectively started from scratch. Smedley says the pair sat down with a “blank sheet of paper” to figure out a way to create “a single repository where all the data is normalized and captured so it can be put to use”.
The new archive was compiled using AWS Media2Cloud, a highly configurable service that helps to ingest video assets and metadata into the AWS environment. For the layman, an AWS spokesperson provided an F1-friendly analogy: shifting to a cloud-based system via Media2Cloud was akin to “taking the engine out, customizing it, and using it in the way we needed to”.
Over the years, the quantity and quality of the video footage captured at races has also risen sharply, creating capacity issues. In the 1970s, just a few reels of film were shot at each race, but the latest Grand Prix are captured from tens of different angles (including shots from the cockpit of each driver) and often at 4K resolution. For context, a single hour of 4K footage takes up hundreds of gigabytes of storage space.
Capacity concerns created yet another incentive for F1 to shift its video archive to the cloud, which can be scaled easily up and down with demand, unlike its old on-premise solutions.
“The amount of data collected is growing, if not exponentially then not far off, as we go from SD to HD to 4K and beyond, which is a major data archiving headache. This is why the flexibility and elasticity of the cloud is so important,” said Smedley.
“If we wanted to build out the technology business within Formula 1, the reality was that we had to be decisive. The partnership with AWS made perfect sense.”
Good news, sports fans
Now F1 is equipped with a comprehensive video archive dating back more than half a century, the obvious question is: how will it be used to the advantage of fans?
Smedley says the new consolidated archive will help contribute towards the wider objective of the F1-AWS partnership: to cater to a new generation of data-driven and digital-first viewers.
Thanks to F1 Insights (opens in new tab) powered by AWS, fans are already beginning to benefit from real-time statistics during races. To begin with, F1 was only able to provide basic stats like cornering speed, but the organization now performs on-the-fly calculations to predict tyre wear and other complex factors.
The idea is to provide greater insight into race strategy, the complexities of which Smedley says have never been analyzed and articulated well enough for the F1 audience.
According to Smedley, the new video archive will only enhance the quality and depth of products like F1 Insights. For example, the company plans to delve later this year into computer vision, an emerging field under the umbrella of AI that deals with the analysis of digital images and video.
“One of the whole points of the video archive is that we need to get to video data in a really efficient way, because insight is all about capturing the moment; there’s no point telling the story after it has already transpired,” he said.
On a simpler level, although fans won’t have direct access to the complete archive of footage themselves, it will become easier for media covering the races to create engaging video products that gesture back to the history of the sport. The archive could also feasibly create opportunities for new and more comprehensive documentaries covering Formula 1.
What’s more, F1 fans will not be the only group to benefit. AWS is also partnering with the NFL, NHL, PGA Tour, NASCAR and the German Bundesliga, all of which are pursuing similar projects to organize their video archives.
The Bundesliga, for example, is building a cloud-based archive that automatically tags specific frames with metadata including game, player, kit, team and venue. This means the organization can easily surface historical clips for the purposes of analysis.
Meanwhile, NASCAR is currently in the process of digitizing 70 years worth of content currently stored in its tape library. The sport’s organizing body has moved 15PB of video assets to the cloud so far, which will be used as the basis for new AI models that promise to offer “new entertainment experiences for fans”.
If these AWS partnerships are anything to go by, sports fanatics have plenty to look forward to.