Affordances of Immersive Virtual Spaces as a Medium for Representing an Inquiry Process

Thesis committee: Matt Lewis - advisor, Scott Swearingen, Shadrick Addy

This project is IN PROGRESS, I will be periodically updating this page with new iterations, videos, and images.
Primary research question: 
How can a personal process of inquiries be effectively organized and experienced
as an immersive virtual environment? 


Main goals I aim to accomplish in this project: 
•Code specific virtual environment affordances (e.g., lighting, interactive properties, etc.) with symbolic meanings linked to my practice and research, resulting in spatial metaphors that allow for conceptual organization
•Develop a system for interactive spatial annotations that embed insights about my design process and research interests within each virtual space 
•Build an immersive environment that fosters user exploration and interaction with virtual objects
•Implement a seamless transition from VR to AR space
Timeline: May 2023 - Present

Project description:
Using a research-through-design approach and the medium of mixed reality, I am exploring how 3D virtual worlds can uncover additional formats for presenting personal inquiries and sharing them with others. My project consists of immersive virtual spaces whose structures depict the core ideas and connections within my research interests over the past two years.
 This project, designed for the Meta Quest 3 headset using game engine Unity, explores utilizing virtual environment design to convey relationships between abstract concepts, while also cultivating a sense of personal connection to a digital space. 
The personal interest categories I incorporated in the design of this environment were derived from main themes within my MFA research, and they include the Intersection of Virtual and Physical Qualities, Clothing in Virtual Environments, Text in 3D Spaces, Interaction / Elements of Play, and the Intersection of Shared and Personal Spaces, each layered with their subtopics. To translate my research into a VR/AR space, I coded specific virtual elements (lighting, interactive properties...) with symbolic meanings. In this project, I am interested in how organizing conceptual inquiries into “navigable spatial diagrams” through experiential media can foster new insights through interactive engagement. 

Concept development:
During the first two years of the Design MFA program, I focused on formulating my “thesis thread” - the overarching connections within my broader research explorations. For me, this 'thread' has consistently revolved around the medium of immersive technologies and the concept of meaning-making within 3D virtual spaces, from both a designer’s and a user's experience perspective. This thread served as the foundational concept for my entire thesis project, as I decided to explore how virtual environments could provide a constructive medium for representing this personal inquiry process as an immersive experience, making it inviting and understandable for others who wish to explore and interact with the represented themes. 
I started developing this concept by creating mind maps of my main research interests and visualizing their relationships. These conceptual connections guided the coding of virtual environment affordances in this project, and these elements serve as the building blocks for constructing an interpretative virtual space. The interconnectedness of all the spaces within this virtual world mirrors the overlap and progression of my primary inquiries which drive the project’s design and methodology.
One of the themes represented within this environment is the Intersection of Virtual and Physical Qualities. Some of my earliest explorations in this realm have been in Augmented Reality, a domain where virtual elements exist in the physical environment. To visualize this aspect, I decided to integrate an augmented space accessed from within the VR environment itself, by pressing a button that transports the user into a scene that utilizes the Oculus Passthrough feature - facilitating a seamless transition from VR to AR space. This transition from virtual to augmented spaces within the same executable is one of the less-explored areas I am delving into with this project.
Augmenting a portion of this virtual environment extends its presence into the physical world. The AR space is smaller than the VR environment, as it is only a section of the experience, but it shares several common objects that the user encounters in the VR space. This intentional parallel emulates the process of users figuratively taking something with them from the virtual environment they just visited, into this transitionary AR space. Finally, it’s worth noting that this experience unfolds within the ACCAD sim lab 1 space, and this overlay shines a direct spotlight on the physical space that has been instrumental in developing my research and practice over the past three years.
The early storyboard below illustrates the transition from VR to AR space in my project, as well as the process of unveiling the spatial annotations, which I will describe next:
VR-TO-AR TRANSITION:
Augmented part of the virtual environment that uses the Oculus Passthrough feature (images taken inside Meta Quest 3):
SPATIAL ANNOTATIONS

Main goals of annotating this environment: 
•Provide access to insight (when wanted) about the represented inquiries and the design process
•Provide a visible thread that connects all the spaces/concepts and serves as a wayfinding tool 
•Provide a sense of engagement and discovery as each annotation is unveiled 

Another area where more research is needed is text positioning within mixed reality spaces. In this project, I am exploring ways of offering insights into my journey behind this virtual environment’s design directly within it, through annotations that users can unveil gradually as they explore each space. 
To build an interpretative experience for users, I structured a nonlinear narrative about my research that can be experienced by moving through the environment. I refer to the pieces of this narrative as spatial annotations. These annotations help communicate what can be done in a specific space, what it represents, and how that area is significant to my inquiry process.  
All the spatial annotations are connected with a continuous 3D string/thread object I created in Cinema 4D, which also has a wayfinding purpose, as it connects all the individual spaces within the environment. The string forms circular, emissive indicator spots that the visitors step onto to activate the hidden annotations. When activated, the text appears placed around the relevant space the user is in (on walls, floors, floating…). The emissive indicator spot then turns into a hollow circular outline after it has been stepped on to communicate to the user that they have ‘read’ this section. The indicator spot turns fully emissive again if the user steps on it again to communicate it is currently activated, and then returns to the hollow state once the user leaves the trigger area again. A recent iteration I made to this has been expanding the trigger area once the user activates it so that they can also move around the 3D space and experience the annotations from multiple perspectives, which better aligns with my motives for displaying text in immersive spaces. The spatial annotations engage visitors to unlock the narrative piece by piece while conveying how this environment is using related concepts by visualizing their connections through the continuous string object.​​​​​​
Images captured within Unity and Meta Quest 3:
Lobby - user begins the experience in this space
Lobby - user begins the experience in this space
This section below particularly encapsulates my interest in the spatial representation of text in immersive media. This space and the structure within visually resemble a project I worked on in my first MFA year when this interest was first sparked, after I created a 3D mind map installation in a virtual environment, containing keywords inside of a mesh-like structure that users can navigate around. The wording and the layout of the annotations here are still a work in progress:
Unveiling and repositioning a spatial annotation
Unveiling and repositioning a spatial annotation
Picking up a virtual object and scaling it up
Picking up a virtual object and scaling it up
Picking up a virtual object and scaling it up
Picking up a virtual object and scaling it up
3D assets from the project
3D assets from the project
During the early ideation phase of this project, I was experimenting with a variety of spatial layouts for VR and my first prototypes were the paper cutouts I was rearranging on my floor. I went through a few different versions before iterating the one I am implementing. To embed a trace of my making process and ideation within the actual VR environment, I decided to recreate these experiments in one of the spaces on the virtual floor. The miniature layout map that represents the current version that the virtual space is based on is interactive, so users can pick up the small paper pieces and rearrange them. Some of the older layout versions are also represented but they are non-interactive and not as bright in appearance, placed in a less focused spot under a desk in this same space. This implementation also serves as one of the examples of my methods of incorporating references to physical spaces that were influential to my work. I used the little 3D-printed gnome figurine (more on it soon) for a user-scale reference in this rough prototype, and I also included the same gnome in the virtual replica of this map: 
Early layout prototyping experiments using a tiny 3D printed gnome figurine and paper cutouts
Early layout prototyping experiments using a tiny 3D printed gnome figurine and paper cutouts
Same arrangement in the virtual space
Same arrangement in the virtual space
Even though it is an artificial environment, I want to instill a look that emulates an 'inhabited space'. I hope to achieve a visual intersection of a domestic and a public interior space, so I want to introduce some intentional imperfections in my design. I want to craft a personalized virtual world that not only effectively visualizes my research journey, but also infuses a personal touch into the environment design, almost like a domestic setting staged for someone else's presence.
One of the ways of doing this is by recreating objects and various references from my personal space in the physical world, such as decor and furniture. This parallel is particularly interesting to me as it connects the virtual and physical domains in really compelling ways. It has been interesting to sit and type this paragraph at a desk with the same framed picture as the one below and with the same couch in the back. This translation of experiences and meaning between the physical and virtual domains is something I am visualizing in this project, but also something I am still further thinking about as I think this virtual-physical relationship has a lot of potential:
A virtual space encompassing my inquiry in Text Positioning in 3D
A virtual space encompassing my inquiry in Text Positioning in 3D
Looking around the AR space and interacting with virtual objects
Looking around the AR space and interacting with virtual objects
One of the interests I explored during my graduate studies has been the intersection of fashion and virtual environments - specifically focused on how familiar and personal items like clothes presented in a virtual environment can infuse a sense of presence and comfort even in artificial surroundings. A portion of my environment is specifically dedicated to this interest, and it is nested within a larger section that represents my inquiries about the Intersection of Virtual and Physical Qualities, as I am using 3D scanning in this process - bringing physical objects (clothes in this case) into the virtual world. For translating these items to the virtual world, I am using the workflow and equipment (peel 3d) I am already familiar with and have access to, although this process can be done with many other alternatives:
 A space encompassing my inquiry into Clothing within Virtual Environments
A space encompassing my inquiry into Clothing within Virtual Environments
Currently, I am polishing the interactions embedded in various objects and also discovering the final optimization areas.
Back to Top