VOXReality
Voice-driven interaction in XR spaces
WELD-E
Enhanced-XR Human-Robot Interactive Collaboration for Welding Operations.
Challenge:
Full-Cycle Challenge
WELD-E objectives introduce a voice and vision-based AI system integrated into an XR environment to facilitate remote support from the experts to robowelders and remotely monitor the welding process via: 1) Speech recognition and automated translation models (multilingual user support, seamless communications and translation), 2) natural language models and conversation agents (more natural human-machine interfacing, facilitated communications), 3) a collaborative, Mixed-Reality (XR) environment (3D visualization, advanced interaction, welding operations, information modelling etc.). The solution will be tested, validated, benchmarked and demonstrated in realistic welding environments, in various scenarios, including (5-10) welding experts/users.
The solution is expected to create significant impact in the areas of: manufacturing (interactive, effective, more efficient and engaging operations), social and working conditions (safer, increased quality and accessibility, process performance monitoring), environmental (advanced sustainability, greener operations, cost effectiveness, accessibility). To maximize this ambitious impact, WELD-E intends to provide the solution as Open Source, while intends to be particularly active in contributing to clusters, alliances and other associations enhancing its already wide dissemination. In parallel, WELD-E commercial dimension will be supported by business plan, market positioning and calibration, including market-tailored dissemination activities, commercial steps and industrial presence.
Use Case Description
Welding operations have existed for decades, however, remain a critical technology in many industries, such as shipbuilding, oil, and gas industry, automotive and manufacturing. Advanced interaction and integration of AI models has revolutionized welding operations, emphasizing robotics and other digital technologies, paving the way for enhanced safety, productivity, and connectivity. Today, the welding industry faces challenges exacerbated by the inability to effectively support and interactively guide the workforce during robotic welding processes and the inability to continuously and real-time monitor the process itself. Therefore, there is an urgent need for innovative solutions that demonstrate adequate tailor-made guidance and ensure their effectiveness and adaptability in evolving industrial environments.
CONSORTIUM
KONNECTA SYSTEMS P.C.
An IT consulting and solutions SME specializing in Connected Intelligence Application Systems and Digital Transformation Solutions.
IKNOWHOW S.A
Technology provider and integrator, experienced in large scale product development and commercialization projects in the private and public sector. IKH’s core competencies are in designing and implementing Service Robotics (AGVs, robotic arm, mechatronics), Data Driven Intelligence (computer vision, cognitive control, human-machine interfaces), IoT, Digital Government, Industrial Internet, Digital Health.
TEAM
Aristea Zafeiropoulou
KONNECTA SYSTEMS
Computer Science (PhD), Senior Research Scientist and Team lead.
Georgios
Tsakiris
KONNECTA SYSTEMS
Electrical and Computer Engineering (MSc) and Solutions Architect
Leonidas Valavanis
KONNECTA SYSTEMS
Machine Learning (MSc) and Machine Learning Engineer
Konstantinos Loupos
KONNECTA
SYSTEMS
Electrical Engineer (MSc) and Head of Research.
Angeliki
Pilalitou
IKNOWHOW S.A
Experienced in EU and commercial project and program management for more than 6 years.
Christos Klaridopoulos
IKNOWHOW S.A
AI Engineer, Experienced in developing and integrating AI and machine learning modules in robotic systems for more than 4 years in the industry.
Georgios Argyropoulos
IKNOWHOW S.A
Background in robotics with plenty of experience in programming wide range of robotic applications (robotic arms, AGVs, SLAM, etc.). He is leading the development of the robotic welding solution the last 3 years.
Georgios Karafotias
IKNOWHOW S.A
Responsible for the development of AR application and functionalities. Experienced in Unity and integrations with AR headset.
Petros Tsampiras
IKNOWHOW S.A
5-year experience in robotics and the robotic welding solution that is being developed by IKH.
Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or Directorate-General for Communications Networks, Content and Technology. Neither the European Union nor the granting authority can be held responsible for them.
Copyright © 2024 VOXReality. All Rights Reserved.
