VOXReality
Voice-driven interaction in XR spaces
Welding operations have existed for decades, however, remain a critical technology in many industries, such as shipbuilding, oil, and gas industry, automotive and manufacturing. Advanced interaction and integration of AI models has revolutionized welding operations, emphasizing robotics and other digital technologies, paving the way for enhanced safety, productivity, and connectivity. Today, the welding industry faces challenges exacerbated by the inability to effectively support and interactively guide the workforce during robotic welding processes and the inability to continuously and real-time monitor the process itself. Therefore, there is an urgent need for innovative solutions that demonstrate adequate tailor-made guidance and ensure their effectiveness and adaptability in evolving industrial environments. In this context, Extended Reality (XR) models and applications emerge as a pivotal tool for addressing these challenges, offering immersive, interactive, and intuitive robotic welding process experience for welders. The integration of language and vision-based AI models in XR models/applications for interactive, robotic welding, guidance and control is still ongoing, with existing systems lacking support/monitoring capabilities, real-time performance feedback, and a truly immersive, interactive, and responsive manufacturing environment.
To answer the above, WELD-E objectives introduce a voice and vision-based AI system integrated into an XR environment to facilitate remote support from the experts to robowelders and remotely monitor the welding process via: 1) Speech recognition and automated translation models (multilingual user support, seamless communications and translation), 2) natural language models and conversation agents (more natural human-machine interfacing, facilitated communications), 3) a collaborative, Mixed-Reality (XR) environment (3D visualization, advanced interaction, welding operations, information modelling etc.). The solution will be tested, validated, benchmarked and demonstrated in realistic welding environments, in various scenarios, including (5-10) welding experts/users.
Use Case Description
Welding operations have existed for decades, however, remain a critical technology in many industries, such as shipbuilding, oil, and gas industry, automotive and manufacturing. Advanced interaction and integration of AI models has revolutionized welding operations, emphasizing robotics and other digital technologies, paving the way for enhanced safety, productivity, and connectivity. Today, the welding industry faces challenges exacerbated by the inability to effectively support and interactively guide the workforce during robotic welding processes and the inability to continuously and real-time monitor the process itself. Therefore, there is an urgent need for innovative solutions that demonstrate adequate tailor-made guidance and ensure their effectiveness and adaptability in evolving industrial environments.
IKNOWHOW S.A
Technology provider and integrator, experienced in large scale product development and commercialization projects in the private and public sector. IKH’s core competencies are in designing and implementing Service Robotics (AGVs, robotic arm, mechatronics), Data Driven Intelligence (computer vision, cognitive control, human-machine interfaces), IoT, Digital Government, Industrial Internet, Digital Health.
TEAM
Aristea Zafeiropoulou
KONNECTA SYSTEMS
Computer Science (PhD), Senior Research Scientist and Team lead.
Georgios
Tsakiris
KONNECTA SYSTEMS
Electrical and Computer Engineering (MSc) and Solutions Architect
Leonidas Valavanis
KONNECTA SYSTEMS
Machine Learning (MSc) and Machine Learning Engineer
Konstantinos Loupos
KONNECTA
SYSTEMS
Electrical Engineer (MSc) and Head of Research.
Angeliki
Pilalitou
IKNOWHOW S.A
Experienced in EU and commercial project and program management for more than 6 years.
Christos Klaridopoulos
IKNOWHOW S.A
AI Engineer, Experienced in developing and integrating AI and machine learning modules in robotic systems for more than 4 years in the industry.
Georgios Argyropoulos
IKNOWHOW S.A
Background in robotics with plenty of experience in programming wide range of robotic applications (robotic arms, AGVs, SLAM, etc.). He is leading the development of the robotic welding solution the last 3 years.
Georgios Karafotias
IKNOWHOW S.A
Responsible for the development of AR application and functionalities. Experienced in Unity and integrations with AR headset.
Petros Tsampiras
IKNOWHOW S.A
5-year experience in robotics and the robotic welding solution that is being developed by IKH.
TESTIMONIALS
George Tsakiris
KONNECTA SYSTEMS
“In shipbuilding we often have small welding jobs that need to be repeated again and again for two or more days. Normally this kind of work is tiring and unhealthy as welders are exposed to fumes, heat, and physical strain. Using RoboWeldAR has changed the way we approach these tasks. The robot can repeat the same welds with high precision, while the operator supervises instead of manually performing the welding. This makes the job much less stressful and much safer for our people. For us, the real value is that workers can focus on the quality of the job without putting their health at risk. It shows how robotics can make even the toughest jobs in shipbuilding easier, safer, and more sustainable.”
Moonisa Ahsan
CWI