Projects

  • MoReEye

    AI-Powered Report Generation Directly from Surgical Videos. MoReEye aims to reduce the burden on hospital staff by automating surgical report generation and preventing errors. This is based on the automatic analysis of routinely recorded surgical videos. Relevant information is extracted from these videos and then converted into a coherent draft report using a text-generation component. Surgeons always retain control.

    More …: MoReEye
  • RoGSiLT

    aims to advance the translation technologies for German Sign Language (DGS) and French Sign Language (LSF) by overcoming current limitations such as reliance on scarce gloss-annotated data, poor generalization, and unnatural translations.

    More …: RoGSiLT
  • MARSS

    The MARSS research project (Multimodal System for Combating Disinformation through the Reflection of Socio-Emotional Processes for Students) investigates how AI-based technologies can help students identify, critically reflect on, and combat disinformation and emotional manipulation in digital media.

    More …: MARSS
  • CLIKK

    The CLIKK research project (Chinese language teaching with large language models and a focus on intercultural communication skills) started place in October 2025. It investigates how AI-based virtual agents can support the acquisition of intercultural skills in Chinese language teaching.

    More …: CLIKK
  • CONFIDENCE

    is developing an interactive system that uses AI, sensors, and social-interactive agents to generate personalized content to help children ages eight to twelve boost their self-esteem and reduce bullying.

    More …: CONFIDENCE
  • Datenraum Health.AI

    builds the foundation for GDPR-compliant use of health data across the Health.AI alliance: a Trusted Research Environment (TRE) for storing, processing and sharing highly sensitive medical data, plus a data governance strategy for availability, portability and interoperability. Development follows security-by-design and is validated with data from parallel alliance projects. DFKI contributes its SEMLA platform and leads the work on the TRE and the TOM compendium.

    More …: Datenraum Health.AI
  • Skills4Kids

    addresses obesity in children and adolescents, is developing a digital therapy and diagnostic app, which targets emotional dysregulation, uses a social-digital AI assistance system to provide early, low-threshold access to evidence-based strategies derived from the START program. The goal is to promote emotional resilience and healthy habits in a wide range of young people, ultimately seeking approval for insurance reimbursement.

    More …: Skills4Kids
  • NEARBY

    The NEARBY project aims to develop variability-free BCI systems for use outside the laboratory. To this end, a comprehensive database will be created in which EEG data from various test subjects is recorded over longer periods of time under different conditions and in different environments.The aim is to better understand the variability of the data under different conditions and to develop new algorithms that can reduce or even completely suppress this variability.

    More …: NEARBY

Past Projects

  • HAIKU

    It is essential both for safe operations, and for society in general, that the people who currently keep aviation so safe can work with, train and supervise these AI systems, and that future autonomous AI systems make judgements and decisions that would be acceptable to humans. HAIKU will pave the way for human-centric-AI by developing…

    More …: HAIKU
  • Living Culture

    Platform Living Culture fills the gap between research, documentation and engagement in cultural heritage initiatives. It sets up a digital ecosystem for knowledge encoding, immersive and interactive display, and thematic perspectives, to support investigation and communication.

    More …: Living Culture
  • BIGEKO

    Sign Language Recognition Model for bidirectional translation of sign language and text including emotional information.

    More …: BIGEKO
  • MITHOS

    Interactive Training in Mixed-Reality to Dealing with Heterogeneity and Conflict Situations at School. The goal of MITHOS is to support a sustainable acquisition of social skills for the classroom through mixed-reality. MITHOS provides realistic socio-emotional training scenarios, in which teachers and teacher trainees can prepare better for the challenges when facing conflicts in heterogeneous groups…

    More …: MITHOS
  • EXPECT

    The main goal of the EXPECT project is the development of an adaptive, self-learning platform for human-robot collaboration that not only enables various types of active interaction, but is also capable of inferring human intention from multimodal data (gestures, speech, eye movements, and brain activity). In the project, methods for automated labeling and joint evaluation…

    More …: EXPECT
  • AVASAG

    focuses on two essential aspects for automatic sign animation for 3D avatars: 1. correctly and comprehensive input annotation – i.e., text input – as required for training data for machine learning (ML), 2. definition of an extended intermediate representation of signs, multi-modal signal streams, or MMS.

    More …: AVASAG
  • SignReality

    The research project “SignReality – Extended Reality for Sign Language Translation” aims to develop a model and an augmented reality (AR) application that visualizes an animated interpreter for German Sign Language (DGS).

    More …: SignReality
  • MePheSTO

    The vision is to break the scientific ground for the next generation of precision Psychiatry through social interaction analysis based on artificial intelligence methods.

    More …: MePheSTO