Voice-driven interaction in XR spaces
XR Career Guidance and Training Assistant.
Challenge:
Full-Cycle Challenge
XR-CareerAssist aims to revolutionize career development through immersive Extended Reality (XR) experiences. The project seeks to provide personalized career paths and development plans by leveraging an extensive database of over 100,000 analysed CVs. By integrating cutting-edge AI models from VOXReality, XR-CareerAssist offers an interactive platform that engages users with career development questionnaires in an immersive and inclusive environment.
XR-CareerAssist integrates VOXReality’s advanced AI models, including vision-language models, speech recognition, and training agents, to create a transformative career development tool. The application communicates with CVC APIs to retrieve and analyse career data, presenting users with detailed visualizations and Sankey diagrams that illustrate potential career trajectories and required educational milestones. The solution ensures accessibility for diverse users through VOXReality’s multilingual support, utilizing automatic speech recognition and neural machine translation across six languages (English, Dutch, Greek, German, Spanish, and Italian). Vision-language models enhance visual understanding through scene-graph extraction, image and video captioning, and question answering. Training agent models support textual response generation for training manuals, providing interactive learning experiences.
XR-CareerAssist addresses the full-cycle challenge by extending and integrating VOXReality models into a fully operational XR application. This integration enhances user interaction and delivers tailored career advice through real-time feedback and interactive simulations. The project will significantly impact individuals by providing them with personalized and accessible career development tools, helping them make informed decisions about their career paths and educational needs. By offering a highly engaging and interactive experience, XR-CareerAssist aims to improve user engagement, understanding, and overall career satisfaction.
The XR-CareerAssist project is a collaboration between DASK and CVC. DASK specializes in developing digital applications, while CVC has expertise in analysing extensive CV data to design personalized career paths. Together, they bring a wealth of experience in AI, data analysis, and application development. The team is committed to leveraging their combined expertise to create an innovative and impactful career development tool. XR-CareerAssist is poised to transform the way individuals approach career development by providing an immersive, personalized, and accessible platform. Through the integration of advanced AI models and comprehensive data analysis, the project aims to deliver significant benefits to users, helping them navigate their career paths with confidence and clarity.
A user enters the immersive XR-CareerAssist environment via XR headset and interacts with a virtual assistant powered by Automatic Speech Recognition (ASR) and Neural Machine Translation (NMT). The platform collects user responses through questionnaires and analyzes them using a large database of over 100,000 analyzed CVs. Based on this data, the system provides real-time career guidance, offering personalized visualizations like Sankey diagrams to map out potential career paths, required skills, and educational milestones.
The platform also allows users to explore interactive career simulations, enabling them to adjust variables such as industry preferences and skill sets to visualize different career outcomes. These features are tailored for use in educational institutions and corporate training environments, where it will be piloted to gather user feedback and refine the solution.
DASKALOS APPS
XR and AI Applications Developer with 15 years of experience in web, SaaS, and middleware development.
DASKALOS APPS
Technical Project Manager with expertise in SaaS platforms, XR, software development, and digital transformation.
CVCOSMOS
AI Engineer with expertise in Machine Learning, Artificial Neural Networks, and Project Management
CVCOSMOS
Software Engineer with expertise in digital platforms, AI system integration, and project management.
HoloLight
Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or Directorate-General for Communications Networks, Content and Technology. Neither the European Union nor the granting authority can be held responsible for them.
visibility_offDisable flashes
titleMark headings
settingsBackground Color
zoom_outZoom out
zoom_inZoom in
remove_circle_outlineDecrease font
add_circle_outlineIncrease font
spellcheckReadable font
brightness_highBright contrast
brightness_lowDark contrast
format_underlinedUnderline links
font_downloadMark links