LUMIEA: Enhancing User Engagement in Storytelling: Empowering Personal Narratives through AI-Generated Environments and Tactile Interaction in Mixed Reality

Jun 30, 2025

https://openresearch.ocadu.ca/id/eprint/4667/

Item Type:	Thesis
Creators:	Dong, Ailin
Abstract:	Traditional storytelling is often constrained by linear structures, limiting engagement and interactivity. This research explores how AI-generated MR environments can enhance storytelling through speech-driven interactions, real-time adaptive narratives, and Tactile feedback. Users speak to real-world objects, transforming them into AI-generated characters and 3D elements that shape the story. A GPT-4-powered LLM ensures narrative consistency, while haptic feedback enhances immersion. Using Research Through Design (RTD) , this study develops prototypes to investigate how AI generated storytelling elements integrate with physical space and influence user engagement. The findings contribute to MR storytelling, AI-native games, and interactive media, reimagining storytelling at the intersection of human creativity and AI-generated worlds. Keywords: Mixed Reality (MR), Artificial Intelligence (AI), Interactive Storytelling, Spatial Interaction, User Driven Narratives,Haptics, Speech-Driven Narratives, Generative AI, AI-Native Games
Date:	2 April 2025
Divisions:	Graduate Studies > Digital Futures Research Labs > Adaptive Context Environments (ACE) Lab
Date Deposited:	06 May 2025 14:10
Last Modified:	06 May 2025 14:10
URI:	https://openresearch.ocadu.ca/id/eprint/4667

I have one paper ongoing under this topic.