The Re-Frame project focuses on the practices of re-use and framing of audiovisual data within journalism, by exploring how digital tools and AI techniques like Automatic Speech Recognition (ASR) and Computer Vision (CV) play a role in the retrieval, selection, interpretation and storytelling processes. Through content analysis, interviews and action-based production research with journalists, this project will explore the modalities of AI driven re-use and develop digital methods based on tool and data criticism that can be employed in journalistic practice and training.

• Mary-Joy van der Deure MA
• dr. Marleen te Walvaart

• prof. dr. Tamara Witschge (HvA)
• Frank Kloos (HvA)
• Maaike van Cruchten (HvA)
• Johan Oomen (NISV)
• dr. Roeland Ordelman (NISV)
• Ruben Brave (Make Media Great Again)

In CLARIAH WP5 we develop the 'Media Suite', a sustainable Dutch research infrastructure that supports mixed media scholarly research with large audiovisual data collections and available multimedia context collections. More specifically, we focus on a.o. supporting tool and data criticism, computer vision methods and automatic speech recognition of television, radio and film collections and related newspaper and social media collections. See mediasuite.clariah.nl

I am the operational workpackage leader of WP5 and co-lead of the CLARIAH Media Suite.

In addition, I supervise several Media Suite projects in which UU participates: teaching and training with the Media Suite (Media Suite LEARN), the development of the publication platform Media Suite Datastories, and the integration of (linked data in) broadcast and context collections such as viewing and listening rates and broadcast magazines.

Key in my view on research infrastructures and digital humanities are (1) tool and data criticism tools, methods and techniques, (2) user-centred development and (3) community engagement.

• C.G. (Christian) Olesen
• J.J. Keijzer
• dr. A.W. (Alec) Badenoch
• Mary-Joy van der Deure MA
• Daniël Everts MA

• prof. dr. Julia Noordegraaf (P.I./UvA)
• dr. Roeland Ordelman (NISV)
• dr. Norah Karrouche (EUR/VU)
• Jaap Blom (NISV)
• Johannes Wassenaar (NISV)
• Jonathan Blok (NISV)
• Willem Melder (NISV)
• Mari Wigham (NISV)
• dr. Jacco van Ossenbruggen (CWI/VU)
• dr. Victor de Boer (VU)
• dr. Willemien Sanders (UU/NISV)
• Han Sloetjes (MPI)
• Paul Trilsbeek (MPI)
• Caroline Rowland (MPI)

In this research pilot, historians will test and extend CLARIAH’s recipe AVResearcherXL. We will study the role of historical public debates on drugs and regulation (1945-1990) in newspapers, on radio and television. These debates are shifting in time and often fragmented since drugs (e.g. heroin, amphetamines and cannabis) move between medical, criminal and recreational spheres. We study the historically dynamic relation between governmental drug regulation and public discourse. To do that, we aim to enable our research strategy, which is to trace and understand public debates by alternating between distant reading and close reading, across textual and AV-datasets. AVResearcherXL is primarily developed as a distant reading tool with a focus on media representation research. By enriching the AVResearcherXL recipe with additional CLARIAH components we will make it suitable for alternating cross-media forms of distant and close reading. This will significantly improve the employability of AVRearcherXL for humanities researchers.

• prof. dr. A.H.L.M. (Toine) Pieters
• dr. B.J. (Berrie) van der Molen

• dr. Steven Claeyssens (KB)
• dr. Eva Baaren (NISV)
• dr. Roeland Ordelman (NISV)

MediaNow is a project funded within NWO’s Creative Industries program. MediaNow aims to develop and test open source search solutions for exploring large multimedia archives.

I am daily supervisor of MediaNow's subproject "Digital Framing Analysis of Television News: Investigating the Reuse of Archival Broadcast Material through Automatic Speech Recognition and Computer Vision Techniques", conducted by dr. Tom Slootweg. The subproject is a collaboration between MediaNow and CLARIAH WP5.

• prof. dr. Maarten de Rijke
• drs. Johan Oomen
• dr. Sabrina Sauer
• dr. Ilya Markov
• Nikos Voskarides MSc

CLARIAH is a large-scale infrastructural project, aiming at the development of a research infrastructure for humanities researchers. Within WP5 'Media Studies and Audiovisual Data', we develop a digital toolkit for Media Studies researchers in the Netherlands. 

Together with Maarten de Rijke (ILPS UvA), I am the project leader of "Project 2": Tools for simultaneous search across audiovisual collections, social media and print media. In this project, we develop the existing prototypes AVResearcherXL, CoMeRDa and TROVe in sustainable tools hosted by the Netherlands Institute for Sound and Vision. For more information: http://www.clariah.nl/projecten/focusgebieden/media-studies

• prof. dr. Julia Noordegraaf (P.I. UvA)
• prof. dr. Maarten de Rijke (UvA)
• prof. dr. José van Dijck (UvA/UU)
• dr. Thomas Poell (UvA)
• dr. Liliana Melgar (UvA)
• Johan Oomen (Beeld en Geluid)
• Jaap Blom (Beeld en Geluid)
• dr. Marijn Koolen (Beeld en Geluid)
• dr. Eva Baaren (Beeld en Geluid)
• dr. Roeland Ordelman (Beeld en Geluid)
• dr. Lora Aroyo (VU)
• dr. Victor de Boer (VU)
• Norah Karrouche (VU/EUR/UvA)

The partners will develop a demonstrator-tool with a distinct part of EYE's film collection: the Jean Desmet collection. Jean Desmet was the first professional film distributor in the Netherlands. His unique collection is part of UNESCO's world heritage, and consists of four different datasets: films, posters, photographs and a business archive. The KIEM-grant will be used for the development of a demonstrator, in which the four datasets will be explored, visualised and curated so as to create rich links between the datasets. The demonstrator will shed a data-driven light on one of the most important film collections in the Netherlands. This provides insight in the collection's potential and related technical and user-centred challenges. In addition, the demonstrator will be part of a scheduled exhibition on the Jean Desmet collection at EYE, hence presenting data-driven film historical research to a wider audience.

• prof. dr. Giovanna Fossati P.I. (UvA/EYE)
• dr. Eef Masson co-P.I. (UvA)
• Christian Olesen (UvA)
• prof. dr. Julia Noordegraaf (UvA)

The AVResearcherXL demonstrator will enable quantitative content analysis of television and printed media. Key is providing meaningful links to various streams of information relevant to media studies scholars. This includes television broadcasts, newspaper archives, metadata records and also time-based information, notably subtitle files. AVResearcherXL will expand the existing tool MeRDES (Media Researchers’ Data Exploration Suite) , developed in the NWO-CATCH project BRIDGE. MeRDES is an analysis tool that visualises trends in extensive catalogues maintained by archives. This tool will be expanded to support principles of quantitative content analysis and explore new data visualisation paradigms. The result will integrate wrappers that read and write metadata and provenance information provided by the CLARIN infrastructure. AVResearcherXL will be evaluated in a specific case study that enables media studies scholars to come to new insights about how representations of migrants on Dutch television are related to social, cultural and political values in Dutch society. AVResearcherXL was funded within the QuaMeRDES-project.

• prof. dr. Sonja de Leeuw

• Johan Oomen
• prof. dr. Maarten de Rijke
• dr. Fons Laan
• dr. Bouke Huurnink

This project delivers a search engine that enables digital humanities scholars to analyse the spread of information throughout the time across different media as broadcast television, print media, social media and blogs. The user interface is tailored to the needs of digital humanities scholars, notably supporting exploratory search, contextualization and monitoring.

• prof. dr. Sonja de Leeuw

• Johan Oomen
• prof. dr. Maarten de Rijke
• Pieter Vijn

The project addresses access to television archives. Television is not an isolated medium, but a key node in a complex information landscape. From an exclusive focus on producing radio, television and publishing program guides, broadcasting organisations have moved to cross-media production companies where users are directly involved in online follow-up discussions. To be meaningful, these additional materials need to be cross-linked to the traditionally archived television materials so as to arrive at a meaningful web of information.

The project will develop, test and deploy efficient, effective and robust methods for automatically creating meaningful links between dynamically expanding archived television data and other information sources that are centered around entities, themes and events.

• prof. dr. Sonja de Leeuw

• prof. dr. Maarten de Rijke (UvA)
• MA Marc Bron (UvA)
• MA Johan Oomen (Netherlands Institute of Sound and Vision)