Work

Art

About Me

Work

Art

About Me

Integrating Bosch Sensor Tech into GenAI

Integrating Bosch Sensor Tech into GenAI

Integrating Bosch Sensor Tech into GenAI

Client project with Bosch to leverage machine learning, LLMs, and sensor hardware to design for a new user market
Client project with Bosch to leverage machine learning, LLMs, and sensor hardware to design for a new user market

Client

Bosch

Duration

5 months

Team

6 member client project

Role

Design Lead

Task

Discover new use case for Bosch's machine learning and sensor tech by conducting user research and designing product mockups

Project Overview

I led our team's user research methodologies and based off our findings, I created mockups for the digital and physical product
So what's the impact?

Digital App Mockups and Interaction Flow

New Physical Product Design

Product Market Fit Research Report

Our Task
Our Task

Find new customer markets for Bosch's existing machine learning and sensor technologies

Find new customer markets for Bosch's existing machine learning and sensor technologies

Presenting. . .

The Future of Children's Education

An educational toy that personalizes the learning experience
Leveraging a large language model, our AI toy makes learning fun with English, Reading, and Math activities, conversational interactions, and an app to track progress

Wait . . . Why an Interactive Toy?

Let's rewind to the beginning and I'll guide us through the process.
How do we find the perfect market fit?

Step 1

Brainstorm specific use cases for different customers

Step 2

Group the use cases into corresponding industries

Step 3

Summarize + debrief the ideas to the Bosch team

Over the course of 2 months, we continuously debriefed 85+ ideas to Bosch and received feedback on what industries we were not going to pursue and which ones we should look more into.
The goal of this process was to understand the Bosch’s teams needs and limitations more clearly. After presenting a wide variety of concepts from multiple industries, I can start to pin point what kind of product fits into Bosch’s current branding but is also a new market.
Here are some things we won’t pursue and why.
Here are some things we won’t pursue and why.
Healthcare
Too many challenges with misdiagnosis and federal regulations
Manufacturing + Transportation
Multiple competitors and existing solutions in the field
Smart Home
Bosch is already prominent in this field
From here . . .
From here . . .

Let's Narrow the Scope

From our initial brainstorming, we wind down from 85+ possible ideas to 1 idea.
From our initial brainstorming, we wind down from 85+ possible ideas to 1 idea.
AI and sensor technology provide the ability to personalize learning for diverse users

Education

AI and sensor technology provide the ability to personalize learning for diverse users

Education

AI and sensor technology provide the ability to personalize learning for diverse users

Education

AI and sensor technology provide the ability to personalize learning for diverse users

Education

So why the education industry?
The global market size is $2.5B for AI in education in 2022.
50% of students are behind in at least 1 academic subject.
Children's education can connect with Bosch's existing toy line.
User Research

Now that we know the solution will be for children's education, let's learn more about our users and their pain points to see how Bosch's tech can help.

Now that we know the solution will be for children's education, let's learn more about our users and their pain points to see how Bosch's tech can help.

Research Method 01: Observations
For 2 weeks, I observed 3 pre-kindergarten classrooms for children ages 3-4 and studied firsthand how kids played, spoke to one another, and interacted with adults.
Autonomy of choice and physical movement help kids stay engaged.
To keep children engaged, they need opportunities to make their own decisions.
Rather than fantasy scenarios, children mostly recreated scenarios from real life during play time.
Research Method 02: Teacher Interviews
We conducted 6 interviews with teachers and administrators to learn how they measured academic development, managed classroom engagement, and interactive learning.
Screens are distracting and non-conducive to education
Parents and teachers prefer a low-tech classroom since children often enjoy TV or iPad time at home.
A child's progress is assessed through long-term observation and manual documentation.
Research Method 03: Parent Surveys
Through Survey Monkey, we gathered data from over 100 parents and pre-school teachers about their daily routine involving children and what challenges they face.
Parents and teachers may not have the resources to personalize learning
100% of participants mentioned a need for problem-solving and emotional regulation resources for the children.
50% of participants stated they don’t have the experience to teach children certain academic subjects.
Research Takeaways
What did I learn from my research?
There is a lack of emotional regulation resources for children.
There is a lot of manual and
tedious work in tracking a child’s learning progress.
Adults sometimes feel inexperienced when curating kid-friendly activities.
The Solution

Mittens is an AI powered interactive educational toy that personalizes learning for young children while helping parents and teachers track development.

Mittens is an AI powered interactive educational toy that personalizes learning for young children while helping parents and teachers track development.

All about Mittens

Mittens utilizes an LLM to help children enjoy and understand learning activities.
With its AI sensors, Mittens comes with compatible accessories like building blocks and books to recognize a child's progress in reading and math activities.
Mittens is able to curate the activities to the child's emotional needs and guide them through any confusing instructions.

Tailoring Interactive Learning

Mittens provides the child with activity options and updates its speech based on the child's responses.

Standardizing Development Tracking

Mittens uses a paired mobile app to track a child's progress while also curating personalized lesson plans.

Supporting Multiple Academic Subjects

Mittens provides interactive lesson plans for various subjects to ensure developmental growth.

Things I learned

The solution has to make sense for the client
Our solution needs to break into new industries but also align with Bosch’s image and branding.
It makes a difference to engage users in their own environment
By spending multiple weeks in preschool classrooms, I realized how many details you can learn about the user by observing them in their own space.
If there was more time. . .
I would research school budgets and their technology programs to understand how Bosch can partner with schools to build user adoption.

Things I learned

The solution has to make sense for the client
Our solution needs to break into new industries but also align with Bosch’s image and branding.
It makes a difference to engage users in their own environment
By spending multiple weeks in preschool classrooms, I realized how many details you can learn about the user by observing them in their own space.
If there was more time. . .
I would research school budgets and their technology programs to understand how Bosch can partner with schools to build user adoption.

Things I learned

The solution has to make sense for the client
Our solution needs to break into new industries but also align with Bosch’s image and branding.
It makes a difference to engage users in their own environment
By spending multiple weeks in preschool classrooms, I realized how many details you can learn about the user by observing them in their own space.
If there was more time. . .
I would research school budgets and their technology programs to understand how Bosch can partner with schools to build user adoption.

Things I learned

The solution has to make sense for the client
Our solution needs to break into new industries but also align with Bosch’s image and branding.
It makes a difference to engage users in their own environment
By spending multiple weeks in preschool classrooms, I realized how many details you can learn about the user by observing them in their own space.
If there was more time. . .
I would research school budgets and their technology programs to understand how Bosch can partner with schools to build user adoption.

Check out another case study?

Redesigned a Website + Brand Identity
Inspired Self-Exploration with Class Selection

Check out another case study?

Optimizing an Online Shopping Experience
Bosch Sensor Tech Integration
Check out another case study?
Optimizing an Online Shopping Experience
Bosch Sensor Tech Integration
Index
Problem
Research
Solution