VIAN-DH

The VIAN-DH is centered around creating a web application for viewing, querying, automatic annotation and analysis of multimodal interaction and language use in videos. The applicaiton contains corpus viewer that is specifically designed for corpora containing multiple modalities, such as text, video, audio and vairous types of annotations. It also includes a querying interface and a querying language created for multimodal corpora that allows searches through various alignments and corpus layers.

TheVIAN-DH web application (beta), is created by LiRI Language Technology Group.

The project further aims at facilitating creation and processing of multi-modal corpora by automating annotation and transcription tasks. It will integrate automated annotation of visual data using Computer Vision, speech transcription, as well as annotation of grammar and text using Natural Language Processing methods. 

The project team includes Teodora Vuković (PI), and Christoph Hottinger.

The project is co-advised by Noah Bubenhofer and Barbara Flückiger. Further project members are Wolfgang Kesselheim and Simon Spiegel. 
Project duration: October 1, 2021 until September 30, 2023.