TK

Messaging on AI Glasses

Creating a multimodal messaging experience using Meta Ray-Ban Display Glasses with Neural Band.

How should people communicate when keyboards are no longer the primary interface?

Role
Product Designer
Timeline
2023 – 2024
Collaborators
Product Manager · AI/ML Engineers · Interaction Design · UX Research · Content Design · Engineering

Impact

As the lead product designer for the Communications workstream during the early development of Meta’s display glasses, I defined the interaction model for Meta Ray-Ban Display Glasses messaging with Neural Band.

Working closely with Product, AI, Engineering, Interaction Design, and UX Research, I redesigned the Message Composer and Message Thread, established the Day 0 communication framework, and co-authored the Messaging PRD. Through rapid prototyping and cross-functional collaboration, I helped define how communication should work on a display glasses before transitioning to a new team during a company reorganization. The interaction principles established during this work continued to inform the evolution of messaging on the platform.

The Challenge

Smartphone messaging assumes users have two free hands, a full keyboard, and unlimited attention. AI glasses changes all of those assumptions.

The challenge wasn’t fitting messaging onto a smaller display - it was determining which communication modality best fits each moment.

Should AI suggest a response? Should the user dictate? Type? Write by hand? React with an emoji?

Rather than treating every input method equally, I designed an interaction framework that prioritized the right communication method based on user context, effort, and confidence.

Designing the Experience

Instead of adapting an existing messaging app, I designed communication specifically for wearable AI. My work focused on:

  • Defining a new Message Composer that prioritized AI-assisted replies while supporting dictation, handwriting, keyboard, emoji, and quick reactions.
  • Redesigning the Message Thread to make long conversations, inline reactions, notifications, attachments, and scrolling feel natural on a glanceable display.
  • Establishing interaction patterns for cross-device communication, including seamless transitions between glasses and phone when opening links or continuing conversations.
  • Unifying messaging experiences across Messenger, Instagram Direct, WhatsApp, and native messaging into a cohesive communication system.
  • Developing a dictation-first, keyboard-as-supplement input strategy that better matched the constraints of wearable computing.

Throughout the project, prototypes became decision-making tools that helped Product, Engineering, and Design evaluate interaction models, prioritize features, and establish new communication patterns before implementation.

Message Composer concepts — Button Rail and Share Sheet

Design Principles

Intent over input

Users shouldn’t have to decide how to communicate. The system should prioritize the interaction that best fits the moment.

Glance over scroll

Communication should fit naturally into moments of attention without pulling users away from the world around them.

AI as a collaborator

AI should reduce effort while preserving clarity, confidence, and user control.

Reflection

Designing communication for wearable AI fundamentally changed how I think about interaction design. The future isn’t about replacing keyboards with voice or AI - it’s about understanding user intent and selecting the interaction that best fits the moment. Great AI experiences reduce cognitive effort while preserving confidence, control, and human connection.