SmartHQ Assistant - Voice-first Experience in the Kitchen

SmartHQ Assistant - Voice-first Experience in the Kitchen

Designing the first MVP experience for GE Appliances’ SmartHQ Assistant on a built-in LCD appliance screen.

MY ROLE

Solo UI/UX and Interaction Design Intern
Interaction System Mapping (Voice + Touch Hybrid)

Visual & Motion Design System Updates for LCD UI

Engineer Collaboration from ideation to handoff

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

team

1 UI/UX Intern (it's me!)

1 Design System Designer

2 Project Managers

1 Contract Engineer

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

tools

Figma

Jitter

After Effects

Token Studios

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

my impact

Shipped end-to-end MVP feature

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

company

GE Appliances by Haier

I’m currently finishing my BFA UX Design @SCAD, after spending a year @GE Appliances as a UI/UX Design Intern.

I bring purposeful delight to digital products and HMI platforms, driven by high standards in clean visual design, interactive prototyping, and new product strategy.

key insight

Hands-Free Interaction
Emerges as a Top User Need

Hands-Free Interaction
Emerges as a Top User Need

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

The Kitchen Hub

GE's 27" touchscreen with Google Assistant

Project scope

Same Assistant with More Opportunities

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

To fully understand the project scope for the MVP, technical constraints, and design system processes, I started the sprint by conducting a series of focused stakeholder interviews.

Project scope

Audio feedbacks? Voice feedbacks? Or chat bubbles?

How do we determine the success of the MVP?
How will the conversation differ between utility tasks vs entertainment task?

How do we determine the success of the MVP?
How will the conversation differ between utility tasks vs entertainment task?

Just like any human-to-human communication,
to be effective is to be clear with the right amount of information,
be open-ended or guided when needed.

Clear communication about its capabilities.

While also help users learn more about them at the same time (MVP).

Lack of resources to acquire conversational API.
Is there a solution?

What if people ask queries, not command?

key challenges

Redefining Interaction
for a New Context

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

SmartHQ Assistant existed solely on mobile. There was no precedent or pattern library for delivering a voice-forward experience on an appliance screen.

Hence for sprint, I need to deliver: a cohesive design system that convey the assistant intelligence, provides contextual awareness, and clear affordances regarding its states.

Challenge #1

Challenge #1

Challenge #1

No prior voice-assistant visuals, UI architecture, and interaction model on appliance screens.

Challenge #1

Challenge #1

Challenge #1

Visual and component inconsistencies with lack of hierarchy and scalability across devices.

Challenge #2

Visual and component inconsistencies with lack of hierarchy and scalability across devices.

Challenge #1

Challenge #1

Challenge #1

Engineering needed a better design-to-dev handoff assets and design guideline.

solution statement

Redefining SmartHQ for Appliance Displays

Redefining SmartHQ for Appliance Displays

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

Designed a voice-first, touch-supported assistant experience for LCD screens—adapting SmartHQ’s brand and mobile patterns while introducing a multimodal interaction model, scalable modern UI components, and contextual feedback.

mobile analysis

Interaction & Accessibility Audit

Interaction & Accessibility Audit

To inform the LCD design direction, I conducted an audit of the existing SmartHQ Assistant mobile experience and uncovered key friction points in interaction flow, visual design, and accessibility.

6 Steps = 0 Patience

The interaction requires up to six separate steps for users to receive a response, introducing delays that may disrupt kitchen tasks.

Constant transitions
= Overwhelming users

Frequent major UI changes for each request can contribute to cognitive overload, especially during time-sensitive moments like cooking.

Vibrant? Yes.
Readable? Not for long…

The chat bubble's design lacks accessibility compliance, with a high saturated magenta that can strain readability—particularly for users reading longer responses and time.

solution

From 6 Screens To 1 Unified Interface

interaction mechanism

Visualizing Interaction for Engineering

To support implementation, I created simple wireframe animations to illustrate key interaction flows. These visuals helped engineers clearly understand how the dialog frame responds to user input and transitions across states.

SUPPORTING SWE

Z-Stack Spatial Design Visualization

To support development, I decomposed the UI into clear visual layers—system operations in the foreground, followed by assistant status, chat bubbles, and background elements. This structure aligned with engineering logic, enabling faster understanding and smoother implementation from dev team.

Z-Stack Depth View

Z-Stack Depth View

Z-Stack Depth View

design iterations

Being Agile and Iterate

After presenting my first iteration, team feedback revealed that the design strayed from our core goals—particularly in aligning with SmartHQ’s established branding and interaction patterns. This help me re-focused to the need to stay grounded in scope while also thinking for innovation.

The 2nd iteration focused on aligning with SmartHQ’s global branding, incorporating modern refinements like light frosted chat bubbles and thin borders. While the visuals improved, there remained opportunities to simplify the interaction flow and reduce complexity.

learning

Key Takeaways