Register
Register
Register

ExpertiseUpdated on 22 October 2026

XR & Digital Twins for Human-Robot Collaboration – Simulation of Deformable Objects

Professor of Computer Graphics at TH Köln - University of Applied Sciences

Cologne, Germany

About

The Computer Graphics Group (CGG) at TH Köln – University of Applied Sciences develops immersive XR systems in which humans, robots and digital twins work and learn together. Our profile combines multi-user XR for human-robot interaction with physics-based real-time simulation of deformable objects and haptic interaction. Our current research is carried out in several EU funded and co-funded projects.

XR for human-robot interaction and training

  • REACH (MASTER Open Call 1, funded by the EU): an extensible authoring system for multi-user VR/MR training environments that connect collaborative robots with their digital twins. CGG developed the robot’s digital twin and its multimodal control via gaze, voice and visual/auditory feedback. The system supports asymmetric trainer-trainee collaboration.

  • VIRAMM (MASTER Open Call 2, funded by the EU): a virtual learning factory that transfers a real learning factory of TH Köln, including human-robot cooperation, into immersive XR. Learners take industrial roles such as production planner, robot integrator or process optimiser. Developed together with TH Köln’s Institute of Production (IFP).

Real-time simulation of deformable objects, haptics and digital twins

  • VIRTOSHA (co-funded by the EU): a VR training environment with haptic feedback for surgical procedures on hard and soft tissue. CGG provides the real-time simulation of hard and soft tissue. Force feedback comes from haptic arms, and the project includes a drilling and screwing simulation with realistic tool-guided manipulation. First results were presented at IEEE Virtual Reality 2026.

  • HistoVeaR (co-funded by the EU): a pipeline for digitising historical garments and animating them in real time. The result is detailed, interactive digital twins of real garments for VR applications.

  • Transfer to manufacturing: tool-guided interaction with force feedback, such as drilling and screwing, maps directly onto assembly tasks. Real-time simulation of deformable materials enables realistic XR training and robot programming for handling cables, hoses, textiles, seals and other soft parts. Rigid-body digital twins typically fail on exactly these tasks.

Further competences

  • Full-body and hand tracking, avatars in shared virtual environments

  • Pass-Through Embodiement

  • Google Scholar Profile

What we offer in a consortium:

  • Work-package leadership or task contributions on:

    • XR interfaces and digital twins of workstations

    • multimodal human-robot interaction

    • haptic interaction

    • real-time simulation of deformable objects

  • A learning-factory environment at TH Köln for testing and validation

  • Ready-to-extend XR results from REACH, VIRAMM, VIRTOSHA and HistoVeaR as a TRL 4–5 starting point

What we are looking for:

  • Consortia for HORIZON-CL4-2027-02-DIGITAL-EMERGING-52 (Human/AI collaboration for the workforce of the future), and other XR, robotics, haptics and Industry 5.0 calls

  • A coordinator and partners in:

    • AI/ML (LLMs/VLMs, robot learning)

    • industrial end users, especially with assembly or handling of deformable parts

    • cobot and haptics manufacturers

    • SSH / work psychology

  • Role: partner / work-package leader (not coordinator)

Keywords:
Extended Reality, Mixed Reality, Human-Robot Interaction, Digital Twin, Cobots, Haptics, Force Feedback, Multimodal Interaction, XR Training, Upskilling, Industry 5.0, Physics-Based Simulation, Deformable Objects, Soft Tissue Simulation, Cloth Simulation, Real-Time Simulation

Field

  • Modelling, simulations and digitally aided design

Organisation

TH Köln - University of Applied Sciences

Higher Education (HES)

Cologne, Germany

Similar opportunities