top of page

Dayrio

Collecting valid audio diaries by creating a private, approachable, and engaging study experience for participants.
Mobile | UX/UI | 0-1
Overview

OVERVIEW

I led the app design in a four-member team in this course project. We closely collaborated with the Industry sponsor, AppHatchery, and research clients, lead psychologists at Emory University. Our project is now under development and will be put into use this Spring with a pilot study on real population 🎉
DURATION

08.2022 - 12.2022

(4 months)

ROLE

UX Design

User Research

Competitive Analysis

TEAM

Lina (Research)

Ben Mayo (PM, Design)

Hudson (Research)

TOOLS

Figma

Procreate

Miro

Roland - R-07  High-Resolution Audio Recorder.jpg

BACKGROUND

Clinical psychologists still rely on outdated methods to collect audio diaries

Audio Diary Method is clinical psychologists' preferred method for collecting self-reports of participants, where participants verbally respond to pre-set questions about their daily lives. Audio diaries make it easier for participants to give a stream of consciousness and reduce the overhead of researchers in interviews. However, current methods for collecting audio diaries are quite traditional:

Notebooks vs. Recorders for Journalism.jpg

Participants borrow a recording device from the lab and return after the study

The Human Voice review Ruth Wilson shouldnt have answered the phone.jpg

Participants call an answering machine to verbally respond to audio prompts

wordpress-file-upload-to-dropbox.jpeg

Participants manually upload after recording audio diaries

PROBLEM

Traditional methods are unreliable due to 3 issues:
workload.png
Too Many Steps

Manually fetching the recording device or uploading recordings add workload on both sides.

privacy.png
Privacy Concerns

Participants are worried that others may access their recordings on native recording apps

data validity.png
Poor Data Validity

Issues like forgetting to record, lacking engagement, poor quality of responses, result in poor data validity

SOLUTION

Use a dedicated mobile app to simplify researcher-participant interaction and create better participant experiences to ensure data validity

We designed Dayrio, a dedicated mobile app designed for participants to conveniently record audio diaries, which are privately synced to researchers. To improve the data validity, based on user research, Dayrio creates a more private, approachable, and engaging audio diary study experience for participants.

Final Outcome

CONCEPT 1

Walkthrough with the Virtual Assistant

Familiarize participants with the study procedure, setup, and the app UI with an inviting virtual assistant to reduce researchers' manual labor and ensure study validity from the early stage

CONCEPT 2

Dialogue-Like Diary Recording

Mimic a private conversational experience with the virtual assistant to make audio diary recording more approachable, natural, and less anxious for new users

CONCEPT 3

Take "Memos" to Help Recall

Enable participants to take memos throughout the day that can be reviewed to ease the remembering difficulties in the end-of-day diary recording

CONCEPT 4

Incentive & Progress Tracking

Set short-term incentives and visualize the current progress of the study keep participants motivated and engaged throughout the study period

Final Outcome

Our project was spoken highly by our clients and sponsors. And our design will be put into development and launched by our sponsors, the AppHatchery Team, in early 2023, with pilot study on helping burn out for frontline healthcare workers for clinical psychologists at Emory University.  ​Here are some feedback we got from the researchers at Emory University and the AppHatchery Team:

The AppHatchery Team

You did a phenomenal job running multiple rounds of evaluation and iterations of your prototypes. Lot of creativity was going around and the metaphors you used to simplify and add some fleur to the app were great!

Our Approach
01
RESEARCH

Literature Review

Competitive Analysis

Stakeholder Meetings

User Interviews

Expert Interviews

02
ANALYSIS

Affinity Mapping

Personas

User Journey Maps

Success Criteria

03
DESIGN

Design Ideas

Concept Sketches

Wireframes

Feedback Sessions

Interactive Prototype

04
EVALUATION

Think-aloud User Testing

Quantitative Analysis

Feedback Grouping

Design Iterations

Final Design

RESEARCH

Research
Interviews

We first met sponsors and collaborators to understand the problem space and their initial expectations. Then we interviewed clinical psychologists at Emory University and prior research participants to get first-hand information about their pain points, needs, and expectations for the audio diary recording device / application. 

2

Stakeholder Interviews

with Emory School of Medicine and AppHatchery Team

4

Expert Interviews

with clinical psychologist with audio diary study expertise

6

User Interviews

with participants who prior study experiences

Group 17192 (1) (1).png
Affinity Mapping

To better inform design decisions and derive design implications, we synthesized user quotes and organized them based on their affinities to find the common themes and key findings from the interviews.

affinity mapping - Affinity Mapping (1).jpg
TOP KEY FINDINGS:
key findings (4) (1).jpg
Personas

Considering the diversity of our participants, to better guide a universal design solution and empathize with potential users, we further synthesized the interview results and came up with 2 typical personas for the participants that cover distinctive motivations for participation and levels of tech literacy.

KEY TAKEAWAY

Participants' experience throughout the entire study period plays a key role for the study validity and success.

As shown in the journey map, participants with little experience with audio recording have difficulties talking about their daily experiences into the recording machine in the early stage of the study, while some participants fail to keep recording on time in the later stage due to busy schedules or low motivation later on.

 DESIGN GOAL 

Create a private, approachable and engaging audio diary study experience for participants to better ensure study validity.

IDEATION

Success Criteria

With the end design goal and previous research findings in mind, we then summarized the success criteria we would like to focus on in the next design stage. It considers the needs and expectations of both participants and researchers.

1.

Learnability

Enable participants to easily learn the study procedure and app UI to reduce researchers' workload as well as ensure data validity from an early stage

2.

Privacy

Properly address participants' privacy and security concerns both technically and perceivably to reduce their anxiety around the recording process

3.

Comfortability

Create an approachable and comfortable audio recording experience. Reduce first-time participants' negative feelings, such as nervousness, weirdness, etc

4.

Ease of Recall

Help participants recall their daily activities during end-of-day recording to help collect more complete and accurate self-reports without causing biases

5.

Engagement

Keep participants engaged throughout the study period and motivated to record valid audio diaries in time every day

6.

Accessibility

Within the scope of voice recording, make the app accessible in different contexts for potential participants with varied abilities

Ideation
Brainstorming

To generate as many interesting ideas as possible in the ideation stage, all of us brainstormed solutions together by sketching concepts on paper independently. Then we came together to discuss our ideas, build upon each others' ideas, and clustered them into groups.

FullSizeRender.jpg
Concept Sketches

Two core concepts that best satisfy our design goals emerged in our brainstorming and discussions: 1. Virtual Assistant and 2. Audio Record Case. To quickly evaluate the concepts, I created concept sketches. Then we invited stakeholders to give us feedback based on how well these concepts met the design goals.

CONCEPT COMPARISON
✌️ Virtual Assistant is great for improving the approachability.
✊ But we need more effective strategies to improve long-term engagement.
Frame 17180 (12) (1).png
Core Functions

After deciding the core concept of the virtual assistant, we co-designed with participants and expert psychologists to propose other features that can further makes the audio diary study experience more private, approachable, and engaging for research participants. We then discussed about the feasibility, effectiveness, and novelty, we finally settled on the following core functionalities to satisfy our design goals after brainstorming and co-design sessions:

HOW TO IMPROVE APPROACHABILITY
Core functions_1 (1) (1).png
HOW TO IMPROVE ENGAGEMENT
Core functions_2 (1) (1).png
Wireframes

We then created the wireframes to show and test the core features and the entire user flow.

Wireframes
Wireframe Feedback and Key Iterations

To evaluate the features we proposed, we conducted think aloud interviews with prior participants and researchers to learn the usefulness and possible influence of our concepts. 

Concept 1: Walkthrough with VA
Smile.png
  • Study requirements are more clear with VA guidance.

  • VA makes participants feels more connected with the researcher.

Unhappy.png
  • Still feel uncertain about the real recording process

walkthrough by virtual agent (2).png
Diary Recording with Virtual Agent (1).png
Concept 2: Dialogues-like Recording
Smile.png
  • VA makes the voice recording more approachable, less awkward and less nervous.

  • VA is very neutral and will not influence the recording performance.

Unhappy.png
  • Status in recording responses can be more clear.

Concept 3: Take Sidenotes to help Recall
Smile.png
  • Some participants may find it very useful to help recall.

Unhappy.png
  • The purpose and usage of sidenotes are not clear for new users and thus may feel confused

  • Prefer written-text as an alternative input method when audio recording is not accessible.

Sidenotes (1).png
progress tracking + incentives (4).png
Concept 4: Progress Tracking & Incentives
Smile.png
  • Feel much more motivated seeing incentives

  • Feel clear about the current progress with the calendar view

Unhappy.png
  • Discouraging to see little progress or many data holes over the entire study span on the homescreen visualization

  • Don't know where to track incentives.

01

"Many a little makes a mickle"

Encourage participants to focus on recent, short-term performance to improve the likelihood of completing the entire study 

iteration-tracking (1).png
  • Encourage users to focus on short-term performance instead of the performance over the entire study span

  • Increase users’ motivation by showing the next small challenge and incentive

02

Motivation should be more directly triggered, not found by users

Improve users’ awareness of what has been achieved, what can be achieved, and how to arrive there

iteration-incentive (1).png
  • Enable the users to directly check incentives on the homepage to increase its exposure and thus better improve users' motivation

  • Expose the users to the next challenge and the incentive in the calendar view clearly to keep them engaged in the study

03

"Sidenote" is useful for recall only when users know its purposes and love to use it

Clearly convey the usage of “Sidenote” and improve the UX accessibility of taking notes

iteration-sidenote (1).png
  • Provide user guide to help first-time users grasp the purpose and usage of Sidenotes

  • Enable written-text as an alternative input method to make sidenote taking more accessible

PROTOTYPE

Visual Style Guide
visual reference.png
PRIVATE
CALM | NEUTRAL
INVITING | MOTIVATION
Group 17262 (1).png
Prototype
High-Fidelity Design - Iteration 1
​STUDY WALKTHROUGH
  • Walkthrough the study procedure, setup, the app UI during onboarding with an inviting VA and

  • Provide the training session to ensure study validity from the early stage

Study Intro & Setup

UI User Guide

Pre Recording

Audio Diary Recording

DIALOGUE-LIKE RECORDING
  • Get inviting reminders for diary recording to keep participants engaged in the study

  • Mimic a private conversational experience to make audio diary recording more natural and less nervous

MOMENTARY SIDENOTES
  • Enable the user to record sidenotes throughout the day 

  • Quickly review daily experience using transcripts to reduce remembering difficulties and better ensure data accuracy

Take "Sidenotes"

Review "Sidenotes"

SHORT-TERM INCENTIVES

Provide positive messages and short-term monetary incentives to improve participants’ motivation.

Frame 17131 (1).jpg
PROGRESS TRACKING

Visualize the current progress of the study to encourage self-reflection so as to improve participants’ engagement.

Frame 17132 (2) (1).jpg

Incentive Tracking

Incentive Notification

Updated Incentives

Home - Progress Widget

 Diaries - Calendar View

Diaries - List View

Evaluation

EVALUATION

User Testing

To evaluate if our design meets the overall design goal and the success criteria we set previously, we first moderated user testing with 5 users with different experiences in audio diary studies. We conducted think aloud user testing over Zoom where we set tasks for each concept.

participant.png

5 Participants

Group 242.png

Task-based Think-aloud

Expert Evaluation

Second, we also conducted semi-structured interviews with clinical psychologists who use daily diaries in their research to gain expert feedback.

expert.png

4 Psychologists

Group 223.png

Semi-structured Interview

Group 17265 (1) (1).jpg
Expert Interview.jpg
Measuring Success

To quantitatively evaluate the success of the design, we broke down our design goal into detailed, measurable ones and developed a questionnaire to gather user feedback.

evaluation methods (3) (1).jpg
Quantitative Results

Here's a summary of the ratings in the questionnaire. On average, users rated Moderately Positive (6) for all the questions.

 

User participants' attitudes towards the Sidenote feature varied the most, mainly because users have different levels of remembering difficulties and different habits of taking "sidenotes". 

Quantitative Results (4) (1).jpg
Feedback & Key Iterations

We grouped feedback from the user interviews and expert interviews based on themes and features. I colored different themes based on whether they are positive or negative feedback, or "could be improved".

User Feedback Grouping
STUDY WALKTHROUGH FINDING 1 💡
Easy to get lost in App Walkthrough 

Both users and researchers agreed that the user guide with the virtual agent is very helpful, friendly, and clear. However, 3/5 users thought the app walkthrough is a bit wordy and easy to get lost. It's important to let users remember the key features of the app, and let them know where they are in the entire user guide process.

Iteration1 - user guide1 (2).png
STUDY WALKTHROUGH FINDING 2 💡
Communication with Researchers is still desired

3/5 users and all researchers pointed out the necessity of communication between the participant and the researcher when participants are in trouble despite the availability of the help guide.

Iteration3 - user guide 2 (3).png
AUDIO DIARY RECORDING FINDING 1 💡
Love the avatar! Better if it's customizable?

All interviewees loved the virtual agent and agreed that it was cute, inviting, and made the study more engaging. 3/4 researchers said the virtual agent design was neutral, while 2/4 of them suggested that it would be better if the avatar could be customized according to the nature of the study. 

DESIGN IMPLICATION

Customization of the virtual assistant shall be further considered after we test the current design in a real audio diary study setting

AUDIO DIARY RECORDING FINDING 2 💡
Further Improvement: Better ensure recording quality?

Since recording quality has long been an issue, researchers proposed the idea that we can integrate a microphone test to help participants check the audio recording quality before starting to record audio diaries to better ensure data validity.

AFTER
mockup (1).png
Iteration3 - Sidenotes (3).png
SIDENOTES TAKING FINDING 1 💡
Confused between "Sidenotes" and "Diaries"

2/5 users misunderstood the purpose of the sidenotes at first. They pointed out that the sidenote card looks too similar as the diary entry card, making it more confusing.

SIDENOTES TAKING FINDING 2 💡
Improvement: Review daily experience more efficiently?

Users mentioned that the time cost for reviewing sidenotes can be lowered so they would use it more often. For the sidenote list, 3/5 participants mentioned that the display of title, duration, and time is not very inefficient for catching the content of the sidenote.

Iteration3 - Sidenotes (3).png
INCENTIVE & PROGRESS TRACKING FINDING 1 💡
More diverse incentives! Participants want to feel useful

All participants agreed that seeing the monetary incentives and the challenge for the bonus would greatly improve their motivation and engagement in a longitudinal study. Also, 3/5 participants said they loved to see positive messages related to their contribution to the research or benefits in their personal development.

Iteration4 - incentives (3).png
Final Design

FINAL DESIGN

Here are the prototypes of my final design based on the changes I have made. You can navigate different user flows through the side menu.

Reflection

REFLECTION

🧠 Combine top-down and bottom-up thinking

When understanding user needs and refine our design goals, we conducted user research to generate insights, this is a "top-down" thinking pattern. When designing core features like the Virtual Assistant, Short-term incentives, we referred to some relevant theories related to people's behavioral change, cognitive models, etc. This is a "bottom-up" thinking pattern. I really learned a lot about innovative design thinking by combining these two thinking patterns in my design process.

💁🏻💁🏼‍♀️💁‍♂️ Engage different stakeholders into the design process

The biggest challenge for me was to consider needs of both the researchers and the participants. Here, even though our customers are the researchers, the real users, however, are the participants. Participants' experience in this study plays a key role and should also be carefully considered. Our design should both be approachable and scientifically reliable. By taking different stakeholders into the design process, we are able to have a more well-rounded idea of our design requirements, quickly evaluate our ideas, and make meaningful iterations.

🏃‍♀️ Next Step

We will evaluate the avatar design in a real experiment over a longer time span and may use a between-subject experiment that compares between the group with the virtual assistant in audio recording and another group without it. 

Secondly, we will design the back stage system for researchers to customize their study requirements. We first focused on the design of the user-facing app because in this way, we have a better idea about what features or information is needed, and what should be customized by the researchers.

Lastly, we will further improve the accessibility of our app considering the large audience it may face. For example, when starting to record, we can use the sound effect to help participants with visual impairments ensure that it's started. 

bottom of page