Building A Voice-Only UX for Illiterate Users: What We Learned

Deep insights from designing a voice-first UX for Nigerian truck drivers, and implications for an AI-led future

Voice as Primary Interface Layer

Cultural-First Design

AI Integration Ready

Why Voice-Only?

Low literacy, across the developing world, is more than an educational gap - it is an accessibility challenge. My beloved grandmother couldn't share in the lives of her great-grandchildren via smartphones simply because she was illiterate.

In Nigeria, you'll see this manifest daily in how semi-literate workers struggle to use text-heavy smartphone apps like WhatsApp:

  • Their texts frequently contain spelling errors despite autocorrect
  • They call instead of texting for multi-sentence communications
  • They primarily communicate with each other through voice notes, not text

Text-based interfaces either exclude them entirely or serve them poorly.

Reimagining Voice's Role in UX

The fundamental innovation in our project was reimagining voice not as a supplementary feature, but as the primary interface layer. This represents a profound shift from traditional UX design:

Voice as Primary Teacher

Instead of text tutorials or help documentation, voice becomes the constant teacher, actively guiding users through each interaction. Every screen starts with just a help button that, when pressed, triggers voice explanation of the screen's purpose and functionality.

Voice as Real-Time Guide

Rather than static text prompts, voice provides dynamic, contextual guidance. When users input a phone number, for instance, the voice system actively confirms correct inputs and immediately alerts users to errors, creating a conversational, supportive interaction model.

Voice as Confidence Builder

The system uses voice to actively manage user anxiety and build confidence. In error states, voice explicitly tells users not to panic and assures them that their "teacher" will help resolve any issues.

Voice as Progressive Revealer

Instead of presenting all UI elements at once with text labels, voice works in concert with progressive disclosure. UI elements only appear as they're explained by voice, creating a synchronized learning experience.

The Design Journey: Challenges and Breakthroughs

1. Unconventional Research Methods

Traditional UX research methods would have been too costly for developing my MVP. Instead of deploying professional researchers, I recruited an intelligent truck driver as our researcher.

Initially, I doubted whether my semi-literate driver could deliver detailed feedback. But through iterative coaching - emphasising storytelling with rich detail - I discovered he could provide surprisingly detailed insights.

2. Designing for Illiterate Users

Creating a voice-led UX for users with no prior smartphone experience meant discarding assumptions. Familiar icons, text-based cues, or complex interactions were off the table. Instead, design decisions relied on metaphors from their daily lives.

Core Design Principles for Voice-Led UX

Assume Your User Is Illiterate

Design with the baseline assumption that users cannot read or understand visual iconography. The only safe assumption: users can recognize numbers (due to currency handling). Everything else we take for granted is potentially alien.

Assume No Smartphone Experience

  • Expect to teach users basic interactions
  • Onboarding must be experiential
  • Error handling must prevent panic or embarrassment

Cultural Learning Patterns Matter

In Nigeria, storytelling often relies on relatable examples. We consistently leveraged this through:

  • Book page metaphors for transitions
  • Right-to-left animations to support the metaphor
  • Cultural references in UI elements

The Future of Voice-Led UX in an AI World

The emergence of advanced AI technology opens up exciting new possibilities for voice-led interfaces. Here's how AI could transform this space:

Dynamic, Adaptive Voice Guidance

Instead of pre-recorded voice prompts, AI could generate contextual guidance in real-time, enabling:

  • Personalized teaching styles based on user learning patterns
  • Dynamic adjustment of explanation depth
  • Natural handling of edge cases
  • Voice adaptation to local dialects

Cultural and Context Awareness

Modern language models could enhance the system's ability to bridge cultural gaps:

  • Dynamic generation of culturally relevant metaphors
  • Adaptation to local storytelling styles
  • Recognition and response to cultural context
  • Support for code-switching between languages

Key UX Innovations

Language Selection Breakthrough

Early failures taught us crucial lessons. And most came from the language selection screen.

For example, we used headshots of people in traditional headdress to represent 4 main languages in a grid layout, but this confused users:

  • The vocal guide could not trivially reference the position of the image it was referring to
  • Users identified with facial features as much as traditional dress, so our picture choices failed

We learnt that:

  • Stacking the buttons vertically allowed the voice guide to use numerical references
  • Photo selection should be tested locally for regional facial features before field testing

These changes provided multiple identification cues (position, features, headdress) and proved crucial to ease of use.

Help System Design

My core learning from the issues with language selection was that cognitive overload must be made redundant by design.

So I decided that every screen would start off blank with just a help button as the dominant feature. This approach reassures the user that they will always be handheld.

The user journey to this realisation was designed as follows:

  • Personified help as a "teacher" - culturally resonant metaphor
  • Help button uses user's language-selection face
  • Gentle animation draws attention without alarming
  • Error states indicated by changing colour and pulsating
  • Forced practice sessions during onboarding to ensure comprehension

Progressive Disclosure Taken to Extreme

  • Screens start completely blank except for a help button
  • Elements appear only as needed, perfectly synchronised with voice guidance

Input Validation

A good example of input validation is mobile number entry:

  • Leveraged familiarity with feature phone number pads
  • Immediate vocal feedback on invalid sequences
  • Visual feedback synchronised with voice guidance
  • Preference for UI elements to disappear when not needed instead of being disabled
  • Progress indicators explained vocally eg please wait while we send your number to our office so they can check it

Technical Implications

Progressive Loading

  • UI elements must load dynamically
  • Voice prompts must synchronize perfectly with UI changes (similar to SRT file usage for syncing captions in video)
  • State management becomes crucial

Error Handling

  • Every error needs voice feedback
  • Visual state must match vocal state
  • Recovery paths must be extremely clear

Performance Requirements

  • Voice prompt timing is critical
  • UI animation must match voice pacing
  • State transitions must feel smooth

3-Mode App Design

This work suggests mobile apps should evolve toward three user-selectable modes:

  1. Traditional text-based interfaces
  2. Voice-assisted hybrid modes
  3. Voice-led modes for illiterate users

Scalable Personalization

AI could make voice-led interfaces more scalable by:

  • Automatically generating voice guidance for new features
  • Creating personalized learning paths based on user behavior
  • Adapting to individual user preferences over time
  • Supporting new languages without extensive manual recording

The Path Forward

Designing for illiterate users is not just about technology—it's about empathy and creativity. By reframing the role of voice as a core UX element, we can expand digital accessibility and empower underserved communities.

The next wave of innovation in this space will likely come from combining the human-centered design principles we discovered with the powerful capabilities of AI.

Appendix: Case Study - Conceptual Communication in a Voice-Led UX

Communicating Complex Membership Tiers Through Cultural Metaphors

Communicating abstract concepts, such as tiered membership benefits, to illiterate or semi-literate users is a challenging task. During our design process, we successfully used a culturally resonant storytelling approach to explain the concept of membership levels to truck drivers.

The Challenge: Explaining Tiered Membership Levels

Our system offered three levels of membership for truck drivers, each with specific benefits. The challenge was to ensure users understood these levels and their associated rewards without relying on text-heavy descriptions or human intervention.

The Approach: Layered Metaphors

We combined two familiar metaphors—schooling and fishing—to guide users through the concept:

Introducing the Concept: School as a Framework

We began with a picture of children in a classroom and explained that the membership system was like a school with multiple levels. Each level represented progress, akin to moving to the next grade in school after passing exams.

Explaining Benefits: The Fisherman Story

To make the benefits at each level tangible, we transitioned to the familiar scenario of fishing:

Level 1: The Canoe Fisherman

A picture of a fisherman in a dugout canoe, paddling on open water without a catch, symbolized the starting level.

Level 2: The Small Catch

Next, we showed a fisherman with a modest-sized fish to represent initial benefits.

Level 3: The Big Haul

Finally, we presented a fisherman with a significant catch to represent premium benefits.

Key Success Factors

Double Metaphor Technique

  • School system established the structure
  • Fishing narrative provided emotional connection
  • Both metaphors reinforced the concept of progression

Visual Progressive Disclosure

  • Each image built on the previous one
  • Clear visual progression in catch sizes
  • Familiar local imagery throughout

Voice Synchronization

  • Voice guidance tightly coupled with visual transitions
  • Used local linguistic patterns
  • Maintained narrative continuity

Cultural Relevance

  • Used locally significant activities (fishing)
  • Referenced familiar experiences (school)
  • Employed local visual references (dugout canoes)

Results

The approach proved remarkably successful:

  • Users understood the membership system on first exposure
  • No additional human explanation was required
  • Concept retention was high
  • Users could explain the system to others using the same metaphors

This case study demonstrates how combining cultural metaphors, progressive disclosure, and synchronized voice guidance can make complex concepts accessible to illiterate users. The success of this approach suggests that similar metaphor-based explanations could be effective for other abstract concepts in voice-led interfaces.

You May Also Be Interested In

Diesel Discount App Validation
When Innovation Meets Reality: Validating a Diesel Discount App

How we saved $50,000 and months of development by validating a voice-only app for Nigerian truckers

Read case study