Design Brief:
In a professional collaboration with NASA’s JPL Studio Team, I was tasked with exploring concepts for an art and science exhibition around the theme “the future of connectedness”. I used my senior capstone project as an opportunity to develop augmented reality prototypes to pitch to the team as complimentary experiences to the main exhibit.
Role:
Design and Research Intern
Mentors:
Luke Johnson, Dan Goods, David Delgado
Year:
Spring 2023
Problem 🔎
Future technologies, interplanetary space travel, and biological advancements will dramatically change the way we live in the future. How might our exploration of the cosmos shape new relationships between humans, robots, and the environments we live in? What does the future of connectedness look like 50 to 100 years in the future?
Insights and Inspiration 💡
- Posthumanism theory and cyborg culture can be used as a reference to understand what it might mean to transcend the boundaries of being human. Additionally it allows us to identify the potential future implications of merging with technology.
- Artist Rafael Lozano-Hemmer’s experimentation with the ephemeral gives his audiences a feeling of impermanence and creates atmospheric moments in his exhibitions.
- Visual positioning systems enable custom landmarker technology used in AR to connect 3D virtual objects to physical objects in the real world. Implementing a concept that takes advantage of this affordance could be useful in connecting people to specific places for a unique experience.
Concept 01
Paradox
Paradox explores the complex relationships we might experience between future technologies and our natural world. It imagines the paradoxical identity of merging with technology to adapt to new environments while also maintaining our ancestral connection to planet earth.
Concept 02
Cosmic Atmospheres
Cosmic Atmospheres seeks to connect users with different environments across space using NASA's imagery or data to create an atmospheric simulation. Additionally the experience uses custom marker technology that can be used for marketing purposes - giving the audience a taste of what they can experience at the main exhibit.
Concept 03
Blending Worlds
An experimentation on using custom landmarks to connect people with places. The idea is centered around the notion that in the future we will want to bring the things we love most with us to Space. Additionally with future exploration across the universe, we will be able to simulate what it might be like to live and travel in Space.
Research + Process
I used research to inform my concepts and found inspiration from different artists who were incorporating science and technology in their work.
Research
Concept 01 → Paradox
Posthumanism
Katherine Hayles’ book How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics explores the transformation of human identity in the digital age. Her examination looks at how historical and cultural developments have blurred our ability to separate ourselves between physical and virtual realities. I applied her thought process that looks at the complex questions we face around our human identity as we become more reliant on technology to process and transmit data.
Cyborg Artists and Culture
I drew inspiration from cyborg artists who are already pushing the boundaries of what it means to integrate themselves with technology.
Manuel De Aguas
Manuel de Aguas has implanted weather sensory fins into his head to hear atmospheric pressure through sound conduction in his bones.
”I have always felt a special connection to the rain. I thought it would be good to create [an organ] that would connect me even more to rain, as well as other atmospheric phenomena.”
Moon Ribas
Moon Ribas is a performing artist with seismic sensors implanted in her feet. Her performances interpret seismic activity from Earth in real time.
"I don't want to feel the Earth. I want to feel WITH the Earth.”
Neil Harbisson
Neil Harbisson unable to see color has implanted a wifi enabled bone conduction antenna that allows him to sense color through vibrations.
"I don't feel that I'm using technology. I don't feel that I'm wearing technology. I feel that I am technology.””
Process
Concept 01 → Paradox
In my design process I prompted different AI image generation platforms like Dalle 2 and Dream Studio to get some inspiration for what I might create.
3D Modeling
I used Blender to build 3d elements to track the face. I envisioned one side of the face to represent the human connection to nature and the other side to a tech driven future. I modeled a floral face piece after cherry blossoms on the left side of the face and a futuristic metal head piece on the right side.
Paradox Prototype
For the final prototype I implemented ray tracing to add a realistic chrome effect to the headpiece and facial recognition that asks users to speculate on their future paradoxical identity. The face mask was made with layered AI generated images and blend modes.Ideally the next step for this concept would be to build the experience on an interactive mirror or screen. Allowing exhibition visitors to embody the Paradox with their entire bodies at a larger scale than a mobile phone will result in a more immersive experience.
Research
Concept 02 → Cosmic Atmospheres
Artist Inspiration
I drew inspiration and researched work from artist Rafael Lozano-Hemmer. He experiments with making things that are ephemeral giving the feeling of impermanence. Using computer-controlled ultrasonic atomizers he creates atmospheric events.
Process
Concept 02 → Cosmic Atmospheres
Animated Textures
I wanted to take this idea on experimenting with the ephemeral to captivate the user and create a similar atmospheric moment. To create this effect I looked at different shaders and experimented with blend modes.
Cosmic Atmospheres Prototype
For the final prototype I combined the shapes with the applied shaders and animated an atmospheric moment. The next iteration of this experience would be to input specific data or visual references from NASA while incorporating an interactive sound component to build on the sensory experience of a specific atmosphere.
Research
Concept 03 → Blending Worlds
Visual Positioning Systems (VPS)
Augmented reality has a unique affordance when it employs visual positioning systems or VPS. VPS utilizes computer vision algorithms and image recognition techniques to analyze real-world surroundings captured by a camera. A digital experience is triggered by scanning a physical environment in the real world. The infamous Pokemon Go is an example of how this strategy connected people to places in search of their favorite Pokemon.
The Biophilia Hypothesis
Pulling from the biophilia hypothesis, originally proposed by biologist Edward O. Wilson, I imagined how simulating a scene similar to our natural world might be helpful to space travelers far from earth in the future.
Process
Concept 03 → Blending Worlds
Custom Landmarker
The process began by creating 3D assets in blender and scanning my backyard to be used as the custom landmarker that would trigger the location specific experience. There was a lot of testing involved and moving things around in lens studio. I scanned the space multiple times to get the correct location and distance before building.
Blending Worlds Prototype
For the final prototype I created a majestic waterfall with crystal like iridescent stones and rotating moon. The experience relies on the user being located at the custom location to trigger the augmented overlay to appear via Snapchat. The next iteration for this project would be to clarify the story to integrate more clearly to the main exhibit. It could also be interesting to activate a community mural near the exhibition as a custom landmark trigger.
Reflection
Overall I loved working on this project and am very happy I pushed myself to create AR concepts around the Future of Connectedness brief. I learned a lot about the affordances and constraints around the medium. The project is extremely vast and it was hard to narrow in my ideas initially. I found capitalizing on unique tech features like facial recognition, custom marker, and custom landmarker helped to guide the build of each concept.