Project results

AI Tools

VOXReality Integration

ACCESS HERE

T5 NLU

ACCESS HERE

Multilingual Translation

ACCESS HERE

Model Training and Inference Optimization

ACCESS HERE

video-language_cap

ACCESS HERE

Vision and Language Models

ACCESS HERE

Dialogue System

ACCESS HERE

vox_arta_lego_v2

ACCESS HERE

navigation_instructions

ACCESS HERE

intent_recognition

ACCESS HERE

navigation_intructions_v2

ACCESS HERE

src_ctx_aware_nllb_1.3B

ACCESS HERE

mistral-7B-navigation

ACCESS HERE

llama2-navigation

ACCESS HERE

src_ctx_and_term_nllb_600M

ACCESS HERE

whisper-small-el-adapters

ACCESS HERE

nllb-asr-synthetic-robust

ACCESS HERE

whisper-small-el-finetune

ACCESS HERE

t5_nlu_intent_recognition

ACCESS HERE

rgb_language_cap

ACCESS HERE

rgb_language_vqa

ACCESS HERE

navqa

ACCESS HERE

mistral-7B-navigation-new-instructions

ACCESS HERE

voxreality-arta-lego-llama2-7b-chat

ACCESS HERE

Scientific Publications

User centric Requirements for Enhancing XR Use Cases with Machine Learning Capabilities

ACCESS HERE

Analyzing the Attention Heads for Pronoun Disambiguation in Context-aware Machine Translation Models

ACCESS HERE

Using Augmented Reality and Machine Learning for Captioning in Theatrical Experiences

ACCESS HERE

Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters

ACCESS HERE

Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality

ACCESS HERE

Sequence Shortening for Context-Aware Machine Translation

ACCESS HERE

VOXReality: Voice driven interaction in XR spaces

ACCESS HERE

VOXReality: Immersive XR experiences combining language and vision AI models

ACCESS HERE

Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues

ACCESS HERE

Public Deliverables

D7.1 Open Call Documents Collection V1

ACCESS HERE

D4.1 Model Deployment Analysis V1

ACCESS HERE

D3.1 Advanced AI multi-model for XR analysis V1

ACCESS HERE

D2.3 Development Infrastructure and Integration Guidelines v1.0

ACCESS HERE

D2.1 Definition and Analysis of VOXReality Use Cases V1.0

ACCESS HERE