Updated on 18 August 2026
Evaluation and Benchmarking for AI Competitions
Assistant Professor at University of Southern Denmark
Odense, Denmark
About
The SDU Metaverse Lab at the University of Southern Denmark designs experiments and evaluates AI systems with users. In a challenge-driven project we take the evaluation side: the methodology that decides which solutions advance between stages, and the validation that shows they work with the people who will use them.
Our methods come from affective computing, human-computer interaction and games user research. We model engagement, workload and behavioural outcomes from multimodal data, including video, audio and interaction logs. We build interactive demonstrators, which suit the dissemination and visibility requirements of a competition format.
We contribute to consortia through:
-
Evaluation methodology, selection criteria and KPIs for the competition stages
-
Benchmarking protocols and progress monitoring across stages
-
Human-centred validation of AI solutions with end users
-
Behavioural and affective modelling of user response to AI systems
-
Interactive demonstrators for dissemination and stakeholder engagement
-
Technical and methodological support to participating teams
We seek to join a consortium as a research partner, ideally leading the evaluation and assessment work package. We work alongside user-industry partners who define the sector challenges.
Contact: davm@mmmi.sdu.dk
Similar opportunities
Project cooperation
Adaptive Human-AI Interaction and Knowledge Capture
David Melhart
Assistant Professor at University of Southern Denmark
Odense, Denmark
Project cooperation
Reliable Human Feedback for Frontier Model Alignment
David Melhart
Assistant Professor at University of Southern Denmark
Odense, Denmark
Project cooperation
Seeking an eligible European consortium for a healthcare AI challenge and evaluation workstream
- Early
- AI-GenAI /Data/Robotics
- Partner seeks Consortium
Göktuğ Özkan
Internal Medicine Specialist | Clinical AI Safety and Evaluation Researcher at Göktuğ Özkan — Independent Clinical-AI Research
Istanbul, Türkiye