Customer Case, Events

How the Associated Press is using AI to create automated Shot Lists

Jeroen Verbeeck
September 14, 2021

The Associated Press (AP) is one of the world’s leading news agencies. Since its inception in May 1846, the AP has been consistently at the forefront of innovation in news production. To achieve the next level of automation, the AP proposed ‘automatic shot listing’ as an innovation challenge in 2019. Limecraft, Vidrovr and Trint joined forces and built a solution that was successfully showcased at 2020 IBC Accelerators and subsequently brought to production in 2021.

The AP processes roughly 20.000 hours of original footage on a yearly basis, both live and non-live content. To reduce the time taken to edit and to ensure such content is available across the organisation and to its customers in the shortest possible timeframe, the AP was looking for a solution that processes audio and video, and that makes such automatically generated shot lists available to its editors and its customers.

Limecraft delivered a pipeline using Vidrovr for scene description, facial recognition and gesture detection, as well as utilizing Trint for audio transcription, together delivering a single coherent and frame-accurate description of each individual shot. Moreover, Limecraft cracked the challenge to execute such processing on expanding files. Doing so, the AP has effectively emancipated several hundreds of hours of manual labour, and significantly reduced their turn around times.

As part of IABM’s BaM Live ‘Designing Data-Driven Media Supply Chains’, Maarten Verwaest, CEO at Limecraft, and Sandy McIntyre, VP News at the AP, will explain in great detail why and how they came to this particular solution, and how to cope with inaccuracies and inconsistencies that may result from AI services.

Full programme and link to register for the event 👉 https://theiabm.org/bam-live/

To learn more about the use of AI in media and content-oriented automation, subscribe to our monthly newsletter.