KETs2026 reloaded

24 Sept 2026 | Germany

Project cooperationUpdated on 18 August 2026

Evaluation and Benchmarking for AI Competitions

Assistant Professor at University of Southern Denmark

Odense, Denmark

About

The SDU Metaverse Lab at the University of Southern Denmark designs experiments and evaluates AI systems with users. In a challenge-driven project we take the evaluation side: the methodology that decides which solutions advance between stages, and the validation that shows they work with the people who will use them.

Our methods come from affective computing, human-computer interaction and games user research. We model engagement, workload and behavioural outcomes from multimodal data, including video, audio and interaction logs. We build interactive demonstrators, which suit the dissemination and visibility requirements of a competition format.

We contribute to consortia through:

  • Evaluation methodology, selection criteria and KPIs for the competition stages

  • Benchmarking protocols and progress monitoring across stages

  • Human-centred validation of AI solutions with end users

  • Behavioural and affective modelling of user response to AI systems

  • Interactive demonstrators for dissemination and stakeholder engagement

  • Technical and methodological support to participating teams

We seek to join a consortium as a research partner, ideally leading the evaluation and assessment work package. We work alongside user-industry partners who define the sector challenges.

Contact: davm@mmmi.sdu.dk

Similar opportunities