Updated on 22 October 2026
XR & Digital Twins for Human-Robot Collaboration – Simulation of Deformable Objects
Professor of Computer Graphics at TH Köln - University of Applied Sciences
Cologne, Germany
About
The Computer Graphics Group (CGG) at TH Köln – University of Applied Sciences develops immersive XR systems in which humans, robots and digital twins work and learn together. Our profile combines multi-user XR for human-robot interaction with physics-based real-time simulation of deformable objects and haptic interaction. Our current research is carried out in several EU funded and co-funded projects.
XR for human-robot interaction and training
-
REACH (MASTER Open Call 1, funded by the EU): an extensible authoring system for multi-user VR/MR training environments that connect collaborative robots with their digital twins. CGG developed the robot’s digital twin and its multimodal control via gaze, voice and visual/auditory feedback. The system supports asymmetric trainer-trainee collaboration.
-
VIRAMM (MASTER Open Call 2, funded by the EU): a virtual learning factory that transfers a real learning factory of TH Köln, including human-robot cooperation, into immersive XR. Learners take industrial roles such as production planner, robot integrator or process optimiser. Developed together with TH Köln’s Institute of Production (IFP).
Real-time simulation of deformable objects, haptics and digital twins
-
VIRTOSHA (co-funded by the EU): a VR training environment with haptic feedback for surgical procedures on hard and soft tissue. CGG provides the real-time simulation of hard and soft tissue. Force feedback comes from haptic arms, and the project includes a drilling and screwing simulation with realistic tool-guided manipulation. First results were presented at IEEE Virtual Reality 2026.
-
HistoVeaR (co-funded by the EU): a pipeline for digitising historical garments and animating them in real time. The result is detailed, interactive digital twins of real garments for VR applications.
-
Transfer to manufacturing: tool-guided interaction with force feedback, such as drilling and screwing, maps directly onto assembly tasks. Real-time simulation of deformable materials enables realistic XR training and robot programming for handling cables, hoses, textiles, seals and other soft parts. Rigid-body digital twins typically fail on exactly these tasks.
Further competences
-
Full-body and hand tracking, avatars in shared virtual environments
-
Pass-Through Embodiement
What we offer in a consortium:
-
Work-package leadership or task contributions on:
-
XR interfaces and digital twins of workstations
-
multimodal human-robot interaction
-
haptic interaction
-
real-time simulation of deformable objects
-
-
A learning-factory environment at TH Köln for testing and validation
-
Ready-to-extend XR results from REACH, VIRAMM, VIRTOSHA and HistoVeaR as a TRL 4–5 starting point
What we are looking for:
-
Consortia for HORIZON-CL4-2027-02-DIGITAL-EMERGING-52 (Human/AI collaboration for the workforce of the future), and other XR, robotics, haptics and Industry 5.0 calls
-
A coordinator and partners in:
-
AI/ML (LLMs/VLMs, robot learning)
-
industrial end users, especially with assembly or handling of deformable parts
-
cobot and haptics manufacturers
-
SSH / work psychology
-
-
Role: partner / work-package leader (not coordinator)
Keywords:
Extended Reality, Mixed Reality, Human-Robot Interaction, Digital Twin, Cobots, Haptics, Force Feedback, Multimodal Interaction, XR Training, Upskilling, Industry 5.0, Physics-Based Simulation, Deformable Objects, Soft Tissue Simulation, Cloth Simulation, Real-Time Simulation
Field
- Modelling, simulations and digitally aided design
Organisation
Similar opportunities
Project cooperation
- Partner seeks Consortium
- Cluster 4 2027 Call - INDUSTRY
- Cluster 4 2027 Call - INDUSTRY FTRI
- Ideation - identifying the project idea
- Cluster 4 2027 Call - INDUSTRY two-stage
- General cooperation - beyond 2027 Industry calls
- General cooperation - beyond 2027 Industry calls
- CL4 | MAT-PROD-17: Expert network on Critical raw materials (CSA)
- CL4 | MAT-PROD-01: Advanced manufacturing for key products (IA) - MiE
- CL4 | MAT-PROD-16: Technologies for innovative processing of raw materials (IA)
- CL4 | MAT-PROD-03: Factory processes and automation for de- and re-manufacturing (RIA) - MiE
- CL4-FTRI | MAT-PROD-62: Fast Track to Innovation for breakthroughs in the Chemical Industry Action Plan (RIA)
- CL4 | MAT-PROD-42: Unlocking the potential of academic intellectual assets for industry, SMEs and startups (CSA)
- CL4-FTRI | MAT-PROD-61: Fast Track to Research and Innovation for breakthroughs in industrial technologies (RIA)
- CL4 | MAT-PROD-50: European network for upscaling venture builders’ roles in research performing organisations (CSA)
- CL4 | MAT-PROD-49: ‘Proof of market’ to improve valorisation and commercialisation of Horizon generated R&I results (IA)
- CL4 | MAT-PROD-47: Pilot access schemes to Technology Infrastructures for European startups, scaleups and innovative SMEs (CSA)
- CL4 | MAT-PROD-08: Textile circularity through advanced processing and manufacturing technologies and system approaches (IA) - ToF
- CL4-two-stage | DIGITAL-EMERGING-52: New approaches for Human/AI collaboration for the workforce of the future (RIA) - MiE and ADR
- CL4 | MAT-PROD-06: Circular innovative advanced materials: facilitating the transition from design to markets (RIA) - IAM4EU and MiE
- CL4-two-stage | MAT-PROD-32: Efficient energy input from renewable sources and energy management in the process industries (IA) - P4P and IAM4EU
- CL4 | MAT-PROD-22: Innovative advanced materials and new production processes – reducing dependencies on Critical and Strategic Raw Materials (IA) - IAM4EU and P4P
Raluca Stancu
Business Analyst European Projects at Software Imagination & Vision
Bucharest, Romania
Project cooperation
- Partner seeks Consortium
- Cluster 4 2027 Call - INDUSTRY
- Cluster 4 2027 Call - INDUSTRY FTRI
- Ideation - identifying the project idea
- Cluster 4 2027 Call - INDUSTRY two-stage
- General cooperation - beyond 2027 Industry calls
- General cooperation - beyond 2027 Industry calls
- CL4 | MAT-PROD-17: Expert network on Critical raw materials (CSA)
- CL4 | MAT-PROD-01: Advanced manufacturing for key products (IA) - MiE
- CL4 | MAT-PROD-16: Technologies for innovative processing of raw materials (IA)
- CL4 | MAT-PROD-03: Factory processes and automation for de- and re-manufacturing (RIA) - MiE
- CL4-FTRI | MAT-PROD-62: Fast Track to Innovation for breakthroughs in the Chemical Industry Action Plan (RIA)
- CL4 | MAT-PROD-42: Unlocking the potential of academic intellectual assets for industry, SMEs and startups (CSA)
- CL4-FTRI | MAT-PROD-61: Fast Track to Research and Innovation for breakthroughs in industrial technologies (RIA)
- CL4 | MAT-PROD-50: European network for upscaling venture builders’ roles in research performing organisations (CSA)
- CL4 | MAT-PROD-49: ‘Proof of market’ to improve valorisation and commercialisation of Horizon generated R&I results (IA)
- CL4 | MAT-PROD-47: Pilot access schemes to Technology Infrastructures for European startups, scaleups and innovative SMEs (CSA)
- CL4 | MAT-PROD-08: Textile circularity through advanced processing and manufacturing technologies and system approaches (IA) - ToF
- CL4-two-stage | DIGITAL-EMERGING-52: New approaches for Human/AI collaboration for the workforce of the future (RIA) - MiE and ADR
- CL4 | MAT-PROD-06: Circular innovative advanced materials: facilitating the transition from design to markets (RIA) - IAM4EU and MiE
- CL4-two-stage | MAT-PROD-32: Efficient energy input from renewable sources and energy management in the process industries (IA) - P4P and IAM4EU
- CL4 | MAT-PROD-22: Innovative advanced materials and new production processes – reducing dependencies on Critical and Strategic Raw Materials (IA) - IAM4EU and P4P
Monica Florea
Head of Unit European Projects at Software Imagination & Vision
Bucharest, Romania
Expertise
Research and Development under Contract
João Sousa
Science and Business Manager (International) at CCG/ZGDV Institute
Guimarães, Portugal