uix design

An enterprise AI solution is designed to address specific business challenges or streamline processes using techniques like natural language processing, machine learning, and computer vision to analyze data, automate tasks, and provide insights.


OVERVIEW


In the rapidly evolving era of AI, our company is actively seeking opportunities to integrate AI across the organization, aiming to achieve cross-service ecosystem applications. This AI initiative has been divided into four major task groups, with our UX team serving as one of them—DevOps – UserOps. The primary responsibility is to focus on user research and definition in the early stages of AI solution, identifying the key objectives for the company's adoption of AI tools.

Key issues :

What strategic goals does the company aim to achieve with AI?

How can we guide cross-departmental teams to define the customer/employee experience after AI implementation under the AI strategy?

As we consider how to specifically respond these questions, it becomes a practical challenge to converge the diverse needs, technical issues, and regulations across the organization. This realization highlights differences from traditional user research methods. Through the interpretation of various articles a by implementing AInd intensive discussions, we are examining the differences between AI-centered product design and traditional design approaches. We are committed to applying the principles, values, and processes of Human-Centered AI within the company’s AI projects, proposing strategic objectives for AI adoption.

UX Team's Goal


This project sharing focuses on how the UX team combines Design Thinking and Human-Centered AI concepts to develop a series of research methods tailored for our company. These methods aim to identify key points for AI integration and, by constructing an AI solution, to refine technical approaches and discover potential business value.


• AI Tools Market Research and Testing

• Understanding Basic Knowledge of AI Technology

• User Research & Synthesis 

• AI Solution to meet business value

• Data definition & Architecture design


AI Solution : Assist various organizations within the group in fully utilizing AI

to achieve reduced working + hoursdecision support + synergistic value.

How to Create a helpful AI Tool ?

The project’s development process is divided into three main phases – Discovery Process , Build Process , LLM Ops Process

How do we plan an efficient approach ?

How do we execute collaboration and division of labour?

Integrating Design Thinking principles into the development process may not be comprehensive enough; it is also essential to consider how AI will acquire the necessary data and continue learning over time. We combined the Design Thinking and Human-Centered AI models, which allowed us to create a structured approach that clearly delineates the primary responsibilities of each team. This fundamentally adjusts the research and analysis framework, enabling us to dive deeper into hardware technology and data requirements.

Team 3 : UX Team’s Research Process

Adopting a human-centered approach, we first explore foundational knowledge of various AI types and data science fields. Throughout this process, we firmly believe that diverse interaction methods are essential to collaboration between humans and AI systems, and thus the value generated by any form of interaction should not be overlooked.

Define : AI – Enabled


Understand the company’s workflow and customer pain points, and identify the data conditions required by various users.

| User AI Tool Usage Background

| Work Challenges, Pain Points, and Needs

| Data Review Across Departments

| Key Points for AI Integration

1. User AI Tool Usage Background : Who needs explainability and for what?

Analyze common user groups and their potential purposes for using AI tools. Considering that different organizations have varied understandings of AI applications, we used a questionnaire to gather information on the current AI tool usage of different users. This data was then analyzed both quantitatively and qualitatively to assess the AI capabilities across the company.

(Valid responses: 57, including employees both domestic and abroad)

2. Work Challenges, Pain Points, and Needs : User expectations ?

Furthermore, we need to conduct user behavior surveys across various departments to gain a practical understanding of the specific impacts AI tools have on work. The Research phase includes conducting focus group interviews, brainstorming, outlining ideas, gathering feedback, and analysis.

The purpose of the focus group interviews is to fully understand users’ perspectives on AI tools and gather their expectations, concerns, and potential obstacles regarding AI implementation. The interview design followed a structured modular approach: "Expectations for AI in supporting the organization; sharing work scenarios; pain points in specific situations; support and concerns post-implementation; and key success factors." An AI engineer was also present to join the discussions, providing explanations and insights as needed. We encouraged participants to freely discuss any AI technologies and ideas, aiming to explore the optimal AI implementation solutions within a controlled design framework for maximum benefit.


Below is the interview plan and preliminary content outline :

Participants: Organization members & managers, AI Engineer, UX Researcher

Research Aspects : Workflow pain points, requirements, input/output scenarios

Technical Aspects: Opportunity evaluation, Data review, technical challenges


  • Each interview lasted for about 60 to 80 mins
  • All the interviews were audio-recorded and later transcribed to episode transcript
  • An Inductive approach was followed for analyzing the data


Interview Script: AI Tools User Behavior Survey

When conducting interviews across different departments, it’s essential to consider that participants may have varying levels of familiarity with AI. We prioritized understanding how users perceive the benefits and advantages that the introduction of AI tools can bring to their work. Members were encouraged to write down their individual expectations, after which users were guided to elaborate on these expectations to reveal more detailed pain points and issues, uncovering additional potential linear topics. This layered discussion process helps the team focus on the applications of AI tools, enabling UX researchers to quickly identify high-demand areas for AI integration.

Interview notes

The image above shows the interview notes, tracking expectations to pain points. We then clustered and summarized the intentions and expectations gathered from each department, aiming to gain a broader perspective on operational and management issues that the company can further improve. Through the analysis of the first phase of interviews, we have identified the core problems of the entire company and the common expectations that need to be met, which can be categorized into five main dimensions: Data Application, Communication Efficiency, Work Efficiency, Professional Assistance, and Information Management.

By understanding the issues users face and having a clear picture of the problem, we expect these to be the goals we aim to achieve step by step in the future. Although not yet refined or validated in any structured way—and some may even go beyond the scope of an AI tool—we still desire to translate these into design goals for AI tools, guided by a user-centered approach. We aim to present phased research outcomes, knowing that this concept can only assist us in continually addressing these topics.

(*Considering confidentiality, only a partial view is presented)

  • Once we have a clear definition of the problem, the next step is to conduct a feasibility assessment of the objectives, considering demand intensity and technical limitations. We aim to apply multiple criteria to filter out ideas that may be challenging for an AI tool to implement. We are in a stage of converging ideas, where considering solutions that effectively address a wide range of user scenarios is crucial.
  • Therefore, here’s the several criteria for evaluation:


• Which issues can be resolved by implementing AI tools ?

• Which can be executed under current departmental conditions?

  • • Which opportunities have the highest potential impact? What is the priority of each key point?



In the preliminary data evaluation phase, we aim to clarify a more defined path for execution.

3. Data Review Across Departments

After reviewing all the research data, the evaluation was ultimately approached from three main aspects:

1) Value Aspect : Which opportunities can maximize company benefits or enhance team collaboration?

2) Technical Aspect : The engineering team provides benchmarks for technology areas—Digitalization, Automation, BI & Predictive AI, and Generative AI. Each opportunity is evaluated to determine which is most suitable for AI tool integration.

  1. 3) Data Aspect : Based on the completeness of data each organization possesses, we narrow down the priority for solution implementation.



First, Value Assessment is conducted to intuitively understand the relative importance levels of key points for each organization. We use the Task Exterprise-AI Performance Matrix, Created by researchers at Carnegie Mellon University’s Human-Computer Interaction (HCI) Institute.

Each organization evaluates key points based on their importance (such as contribution to core business functions, direct benefits, cost savings, work efficiency, competitive advantage, and operational smoothness) and impact (such as the number of people affected, scope of impact, usage frequency, and whether it influences other departments or larger processes). This comprehensive evaluation is followed by discussions among organization managers and members to reach a consensus on an appropriate matrix.


Customizable colors for category differentiation.

Importance assessment from the perspective of the respective department.


Secondly, Technical Aspect Considering that some solutions fall within the Digitalization phase or involve intelligent optimization of existing systems through Automation, we account for these prerequisites. Our focus highlights opportunities in BI & Predictive AI (highlighted in purple) and Generative AI (in orange), marking key needs in these areas. Through quadrant distribution analysis, we gradually identify the critical optimization points each department should prioritize.



各組織之機會點矩陣圖

Finally, Data Validation As priority opportunities become more focused, we conduct a more thorough evaluation of data inputs/outputs. In this phase, we carried out a second round of interviews, focusing on high-priority, actionable opportunities in the first, second, and third quadrants. The interview covered topics such as: the specific context of each key points; intended purpose of use; data sources and retrieval methods; data search actions; and data update frequency, among others. This approach helps us categorize the type of AI system users need and define the scope in system design.



The table below outlines the main items we ask users to briefly describe, including common tasks they might use AI for in their work and questions they might have in completing those tasks. Additionally, it includes sources, formats, and basic maintenance information for the data.

Based on additional data provided by the team, we have identified five key departments as the primary target users. AI engineers simultaneously begin assessing the technical framework, envisioning how the model should perform, learn, and maintain. At the same time, they work closely with us to determine specific outlines for foundational model design and data attributes, driving strategic solutions across multiple use-case scenarios.

(*Considering confidentiality, only a partial view is presented)


In the first phase of the project, AI-Enabled, our exploratory research helped us identify core AI tasks and user needs, gradually filtering out practical and relevant solutions. Through continuously established guidelines and standards, we’ve been guided toward the right ideas, focusing our efforts on new solutions, principles, and success criteria. As the project advances, we are preparing to enter the next phase, Align, which will focus on user data input/output requirements. This phase mainly involves studying users' specific interaction needs and scenarios for data input and output with the tool.




Align : user needs to data inputs


Investigate the data that is currently accessible and investigate possible algorithms. The next step would be determine whether an AI solution is feasible or not.

| Define AI Learning Model

| Dateset management and feasibility

| Data collection

| output trainning


What is the ultimate goal in designing AI tools?

While our understanding may evolve over time, our research is guided by a clear set of objectives. 👋🏻

This provides us with a valuable opportunity to rethink the important role and transformative potential of UX in AI product development.

The team engaged in multiple cross-departmental collaborations and brainstorming sessions, continuously testing open-source GenAI tools available in the market, transforming various design thinking approaches and methods. Throughout this iterative process, the greatest challenge is how UX research can stay aligned with technological changes and technical awareness, further guiding user interactions with AI tools. As new tools rapidly emerge, we are striving to develop solutions adaptable to multiple user application scenarios. With this principle in mind, we aim to identify an effective research approach that can be seamlessly applied to the tool design process, shortening the distance between users and tools and maximizing value impact.