SmartHQ Assistant - Voice-first Experience in the Kitchen

SmartHQ Assistant - Voice-first Experience in the Kitchen

Designing the first MVP experience for GE Appliances’ SmartHQ Assistant on a built-in LCD appliance screen.

MY ROLE

Solo UI/UX and Interaction Design Intern
Interaction System Mapping (Voice + Touch Hybrid)

Visual & Motion Design System Updates for LCD UI

Engineer Collaboration from ideation to handoff

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

team

1 UI/UX Intern (it's me!)

1 Design System Designer

2 Project Managers

1 Contract Engineer

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

tools

Figma

Jitter

After Effects

Token Studios

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

my impact

Shipped end-to-end MVP feature

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

company

GE Appliances by Haier

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

key insight

Hands-Free Interaction
Emerges as a Top User Need

Hands-Free Interaction
Emerges as a Top User Need

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

Project scope

Same Assistant with More Opportunities

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

key challenges

Redefining Interaction
for a New Context

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

Hence for sprint, I need to deliver: a cohesive design system that convey the assistant intelligence, provides contextual awareness, and clear affordances regarding its states.

Challenge #1

Challenge #1

Challenge #1

No prior voice-assistant visuals, UI architecture, and interaction model on appliance screens.

Challenge #1

Challenge #1

Challenge #1

Visual and component inconsistencies with lack of hierarchy and scalability across devices.

Challenge #2

Visual and component inconsistencies with lack of hierarchy and scalability across devices.

Challenge #1

Challenge #1

Challenge #1

Engineering needed a better design-to-dev handoff assets and design guideline.

solution statement

Redefining SmartHQ for Appliance Displays

Redefining SmartHQ for Appliance Displays

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

mobile analysis

Interaction & Accessibility Audit

Interaction & Accessibility Audit

To inform the LCD design direction, I conducted an audit of the existing SmartHQ Assistant mobile experience and uncovered key friction points in interaction flow, visual design, and accessibility.

6 Steps = 0 Patience

The interaction requires up to six separate steps for users to receive a response, introducing delays that may disrupt kitchen tasks.

Constant transitions
= Overwhelming users

Frequent major UI changes for each request can contribute to cognitive overload, especially during time-sensitive moments like cooking.

Vibrant? Yes.
Readable? Not for long…

The chat bubble's design lacks accessibility compliance, with a high saturated magenta that can strain readability—particularly for users reading longer responses and time.

solution

From 6 Screens To 1 Unified Interface

interaction mechanism

Visualizing Interaction for Engineering

To support implementation, I created simple wireframe animations to illustrate key interaction flows. These visuals helped engineers clearly understand how the dialog frame responds to user input and transitions across states.

SUPPORTING SWE

Z-Stack Spatial Design Visualization

To support development, I decomposed the UI into clear visual layers—system operations in the foreground, followed by assistant status, chat bubbles, and background elements. This structure aligned with engineering logic, enabling faster understanding and smoother implementation from dev team.

Background


Nav Bar and Operation System

Foreground

Dialog Space

Assistant Status

Z-Stack Depth View

Background


Nav Bar and Operation System

Foreground

Dialog Space

Assistant Status

Z-Stack Depth View

Background


Nav Bar and Operation System

Foreground

Dialog Space

Assistant Status

Z-Stack Depth View

design iterations

Being Agile and Iterate

After presenting my first iteration, team feedback revealed that the design strayed from our core goals—particularly in aligning with SmartHQ’s established branding and interaction patterns. This help me re-focused to the need to stay grounded in scope while also thinking for innovation.

The 2nd iteration focused on aligning with SmartHQ’s global branding, incorporating modern refinements like light frosted chat bubbles and thin borders. While the visuals improved, there remained opportunities to simplify the interaction flow and reduce complexity.

learning

Key Takeaways

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

Understand Scope with PM and Engineers

Working closely with PMs and engineers helped me define a realistic and impactful design scope. By understanding the assistant’s capabilities and technical limitations, I was able to refine my solutions that aligned with both user needs and what was feasible to build—saving time and avoiding rework.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

Iterate with Clear Purpose

I learned that each iteration should have a clear objective tied to the bigger vision. Defining specific goals for each version helped streamline my design process, made team feedback more focused, and ensured each round moved us closer to a meaningful outcome.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

Balance Creativity & Feasibility

This project especially challenged me to balance bold ideas with practical constraints. I learned to prioritize efficiency and clarity over pixel-perfection, adapting creatively within limitations to deliver designs that could be implemented smoothly and still feel thoughtful.