DARI
PRODUCT DESIGN
UX STRATEGY
RESEARCH
INTERACTION
Dari is an AI-powered assistive technology that bridges the communication gap between Deaf and hearing individuals. It features the Woori armband, which interprets ASL gestures into speech, and Sari smart glasses, which provide real-time captions and environmental awareness. By combining gesture recognition, AI translation, and contextual alerts, Dari enables natural casual communication, fostering inclusivity and seamless interactions.
Specifications
Role: Team Lead, UX Strategy
Team:
Suji Kim, Visual Lead, UI Design Lead
Lukas Wiesner, Research Lead, UX Engineer
Lara Kurt, Branding Lead, Marketing Lead
Duration: 26 Weeks
Tools: Figma, Rhino 3D, Keyshot, Blender, Adobe Suite, After Effect, DaVinci Resolve
Why
Despite major technological advances, the Deaf community still encounters significant communication barriers, hindering their ability to engage in seamless everyday interactions.
How
Understand the nature of American Sign Language and the culture of the Deaf community to enable more fluent communication between Deaf and hearing individuals.
What
Through an ecosystem of wearables, an app, and a community website, we provide essential information seamlessly during casual conversations.
🖱️ Hover on the image to stop the slideshow!
Background
Uncovering the unnatural
Existing technologies primarily support one-way communication unless interpreters are involved. However, there are still gaps in ASL technology, which do not do justice to the language, including limitations in ASL gloves that hinder truly seamless interaction.
Research
Secondary Research
We needed to make sure we understand the Deaf community and the industry in general before getting into details in the how American Sign Language works.
I collected the meaningful information that would explain why we need to start this project in the beginning.
360 million people are considered Deaf
More than 90% of Deaf children are born to hearing parents.
More than 70 million Deaf individuals use sign language as their primary language
ASL and English are NOT word-to-word translation
Research
Stakeholder Map
I mapped out the stakeholder map to understand the people and services that are closely related to the lives of the Deaf individuals. This helped us visualize the daily interactions that Deaf individuals usually have in general.
Research
Market Research
Video Relay Service
Pros
Provides real-time, professional ASL interpretation; accurately conveys facial expressions and body language.
Cons
Requires a stable internet connection and an interpreter; not ideal for private or emergency situations.
ASL Sign Gloves
Pros
Portable and can potentially translate ASL into text or speech without needing an interpreter.
Cons
Often struggles with accuracy and lacks the ability to capture facial expressions and body language, which are crucial in ASL communication. It does not do a justice of the language.
Research
Primary Research
Now that we have a clear understanding of the scope and industry, I recruited Subject Matter Experts across the United States who are involved in the Deaf and Hard of Hearing community.
We first spoke to experts to validate the information and gather holistic view before engaging with Deaf individuals to prevent any miscommunication or misunderstanding.
Research
Semi-structured Interview
Interviews are held on Zoom
Topic guides are developed from the primary research questions
Interviews were recorded/transcribed
Research
Analysis
Using the transcription in Google Docs, we highlighted key quotes that provided important data points, either as validation or as insights to help us better understand the culture of the Deaf community.
Research
Synthesis
We used a reflexive thematic approach to analyze transcripts, engaging closely with the data to identify patterns. First, we extracted key excerpts individually, then assigned codes inductively as a group. Using reflexive notes and thematic maps in NVIVO, we refined themes and visualized the relationships, deepening our understanding and insights.
The team gained a clear understanding of the experiences of using English, text-based technology, ASL interpreters, and interactions with the hearing community.
Most importantly, we built strong relationships with experts throughout the project, which motivated us to maintain an empathetic perspective on the experiences of Deaf individuals.
Research
Insights
We used a reflexive thematic approach to analyze transcripts, engaging closely with the data to identify patterns. First, we extracted key excerpts individually, then assigned codes inductively as a group. Using reflexive notes and thematic maps in NVIVO, we refined themes and visualized the relationships, deepening our understanding and insights.
Understanding
POV Statement
Understanding
Key Performance Indicator
Ideation
Ecosystem
Ideation
Logistics
Initially, we designed the product to sit on top of the helmet for a unique look but later opted for a wraparound design for safety and durability. A top-mounted device could cause the nail effect, increasing danger, and would be harder to sustain if objects fell on it.
Ideation
Branding
The lo-fi design prioritized intuitiveness and boldness, ensuring visibility in all weather conditions by using simple and high-contrast elements. In contrast, the big bento design relies on sunlight for visibility, making it less effective in low-light or adverse weather.
Prototype
Physical Prototype
Nexstep one is named to not overlap any of the words that is used in the site to reduce the confusion while communicating. Nexstep one focuses easy installation and an intuitive design to ensure quick setup and user-friendliness. The flexible wire of the bone conduction headphones adapts to any head shape or size, providing comfort and versatility. Its robust construction withstands harsh weather to ensure durability, while the design allows devices and cameras to achieve 360-degree visibility for full access to AIs.
Prototype
Digital Prototype
Nexstep one is named to not overlap any of the words that is used in the site to reduce the confusion while communicating. Nexstep one focuses easy installation and an intuitive design to ensure quick setup and user-friendliness. The flexible wire of the bone conduction headphones adapts to any head shape or size, providing comfort and versatility. Its robust construction withstands harsh weather to ensure durability, while the design allows devices and cameras to achieve 360-degree visibility for full access to AIs.
User Testing
Atlanta Area School for the Deaf
The screens use high-contrast colors for visibility in sunlight, ensuring usability in outdoor construction settings. Designed for tablets commonly used by managers, with large, intuitive buttons, they enable quick and efficient interaction, even with thick gloves, improving on-site task management.
Tablet
User Testing
Three Rivers Association of the Deaf
The screens use high-contrast colors for visibility in sunlight, ensuring usability in outdoor construction settings. Designed for tablets commonly used by managers, with large, intuitive buttons, they enable quick and efficient interaction, even with thick gloves, improving on-site task management.
Tablet
Final Design
Vision
STRUCTR is a hands-free construction solution powered by AI vision. Bone conduction headphones enable open-ear telecommunication, ensuring workers stay aware of their surroundings. Additionally, the management app helps locate workers during emergencies and offers an intuitive scheduling feature for project oversight. We firmly believe STRUCTR will save countless lives while advancing construction technology worldwide.
