PilotVision
PilotVision is a wearable augmented reality contact lens that syncs with user data and identifies potential paths and hazards through a user-controlled navigation display with emergency notification capabilities.
Duration: 4 weeks
Teammates: Verli, Sabrina
My Role: Research, UI/UX Design, Idea Iteration, Prototype, Video Editing
Tools: After Effects, Procreate, Premiere, Illustrator
Design Problem
Accidents happen every minute and every second. The students may be injured by sports or influenced by nervous diseases. Traditional equipment can only temporarily replace the travel tools, but can not fundamentally solve the commuting difficulties.
Temporary mobility impairments expose students to a variety of new challenges that impact their learning: lack of accessible routes, hazard navigation, and an increase in commuting time.
HMW assist students with mobility impairments safely and efficiently navigate their environment?
Design Solution
PilotVision brings mixed reality and artificial intelligence to a wearable contact lens to help students with mobility impairments navigate their environments. The user-controlled display identifies potential paths and hazards, serving as an intuitive guide and warning system.
Research
Interview
We interviewed two students. One student suffered concussion all the time, and he had to be super careful about the danger around him because concussion has a high recurrence rate. Another student recently had back surgery because she fell off from a bike without paying attention to it immediately. They both have the inconvenience of commuting in daily life.
“A lot of time I thought I would hit my head then I got concussion again, that really made me anxious.. so my whole mental stress is about oh if I got concussion again"
“Beginning, wasn’t getting better, mentally and physically wasn’t doing anything, couldn’t stand up, laying down, cannot go to school, senior year, sad, suppressed, missing out my bike, miss trips with my friends.”
Insights

Define
User Goal
1. Make those routes equipped with ramps and elevators are more obvious and intuitive.
2. Fully cooperate with ordinary entertainment life in an easy way.
3. Using technology to make further prediction to improve commuting efficiency and safety.
Prototype
We draw a situational storyboard that showed the experience of using the concept and demonstrated how the product would work through a functional storyboard. Also we created a task diagram that integrated the task activity with technology intervention.
Product Sketch

Situational Storyboard

Functional Storyboard


Icon Design
Since it’s a wearable product, the design of interface should be considered thoroughly in order to avoid visual disturbance. Thus we designed a system of icons that were simple, and identifiable.

Final Deliverable
Calendar/Text Sync
The system can detect if the user would like to sync the calendar or text when they quickly blink the eye. Then the user can make his choice by looking at sideways for seconds. (Look at right means Yes, left means No)


Path Navigation
The interface of the path navigation has four elements. The route navigation and its written form appear on the top left corner; the warning icons appear on the left side; the current time appears on the top right corner, while the emergency call appears on the bottom right.

Danger Detection
Then the user is approaching a certain danger, the corresponding icon will enlarge. In the meantime, the direction of the path indicator will change to inform the user to avoid danger.

Path Selection
When the user are facing multiple routes options, the system will give different road obstacle prediction, and the corresponding icon will appear on the left side of the interface for users to determine the most suitable route. Users just need to move on, and the system will automatically identify which route they choose.
