XR-CareerAssist

XR-CareerAssist revolutionises career development through immersive Extended Reality experiences, providing personalised career paths and development plans by leveraging an extensive database of over 100,000 analysed CVs. Through the integration of VOXReality’s cutting-edge AI models, the project delivers an interactive platform that engages users with career development pathways in an immersive and inclusive environment.

The primary objective achieved was the creation of a fully functional XR career guidance system that seamlessly integrated VOXReality’s advanced AI models, including vision-language models for interpreting career visualisations, automatic speech recognition enabling natural voice interactions with response times under 2 seconds, and training agents providing contextual career advice. The platform successfully demonstrated its capability to transform traditional career counseling into an engaging, technology-driven experience that resonates with modern users’ expectations.

The innovative solution implemented a sophisticated technical architecture combining Unity-based XR environments running on Meta Quest 3 hardware with cloud-based AI services hosted on AWS infrastructure. The application established robust communication with external APIs to retrieve and analyse career data, presenting users with detailed visualisations and Sankey diagrams that illustrated potential career trajectories and required educational milestones. The solution ensured accessibility for diverse users through VOXReality’s multilingual support, successfully implementing automatic speech recognition and neural machine translation across three validated languages during the pilot phase. Training agent models supported textual response generation for training manuals, providing truly interactive learning experiences.

The impact observed through the University of Exeter pilot demonstration with 23 participants was substantial and measurable. The platform achieved an 87% satisfaction rate with users rating their experience as either satisfied or very satisfied, indicating strong recommendation potential. Voice recognition accuracy exceeded expectations with most users reporting accurate or very accurate speech recognition, validating the integration of VOXReality’s ASR models. The pilot demonstrated that users found the career visualization features particularly valuable, with participants specifically praising the interactive Sankey diagrams and the ability to explore multiple career pathways dynamically.