Frisco, Texas Covid Website Reserarch
Welcome to our comprehensive analysis of the Frisco, Texas COVID-19 website. Our focus today is to delve into the heuristic evaluation and usability testing of this crucial online resource. In the face of a global pandemic, accessible and user-friendly digital information is more important than ever. This presentation will uncover how effectively the Frisco COVID-19 website meets these needs.
UX Research, Analytics & Foundation
KEY POINTS
Overview of Heuristic Evaluation: Understanding the principles guiding our analysis.
Usability Testing Insights: Discovering how real users interact with the website.
Strengths & Areas for Improvement: Highlighting what the website does well and where it can be enhanced.
Test Plan
The Frisco, Texas COVID website is a key resource for residents seeking COVID-19 information. However, inconsistent user experiences may hinder access to vital health updates. We're conducting a holistic usability test to establish baseline metrics and identify issues. This will help optimize the site for better access to critical COVID-19 information and services for all users.
Objective
(What do we want to achieve )
-
Effectiveness Assessment
Evaluating how well the Frisco Texas COVID website meets its users' needs
This objective focuses on evaluating the overall effectiveness of the Frisco Texas COVID website for different user types performing common tasks. It aims to understand how well the website serves its intended purpose, particularly in guiding users efficiently to the information or services they seek.
-
Identifying User Obstacles
Discovering and addressing navigational and accessibility challenges on the website
The second objective is to identify any challenges or barriers users encounter while seeking information or services on the site. This includes pinpointing navigational difficulties, content accessibility issues, or any other factors that hinder a seamless user experience.
-
Enhancing User Engagement
Strategies to increase user interaction and deepen content engagement on the site
The third objective seeks to enhance user engagement with the Frisco Texas COVID website. This involves understanding how users interact with various elements of the site, such as infographics, FAQs, and news updates. The goal is to identify strategies to increase user interaction, ensuring that visitors not only find the information they need but also engage with the content more deeply.
Research Questions?
What outcomes were we aiming for?
Navigation and Accessibility
Overall Satisfaction
Resource Identification
User Interaction
Information Seeking
How do users navigate the Frisco Texas COVID website, and what challenges do they encounter?
What is the overall user satisfaction with the website in terms of usability and content availability?
How effectively can users identify and utilize various resources provided on the site?
What patterns emerge in how users interact with different website elements?
What strategies do users employ to find specific COVID-19 related information?
Chosen Heuristics and Severity Scale Framework
Nielsen's 10 Heuristics
We chose Nielsen's 10 heuristics for this project because they are widely recognized and respected in the field of usability testing. Nielsen's principles offer a comprehensive framework for evaluating various aspects of a website's user interface design. They cover critical areas such as error prevention, user control, consistency, and feedback, ensuring a thorough and well-rounded assessment of the website's usability. These heuristics are also flexible and adaptable, making them suitable for a diverse range of web applications, including the specific needs of the Frisco Texas COVID website.
Nielsen's Severity Rating Scale
We chose a 1-5 severity scale for its clarity and precision in evaluating usability issues. This scale effectively differentiates between minor and major problems, aiding in prioritizing fixes based on their impact on user experience. Its simplicity and standardization make it a reliable tool for consistent usability assessment.
According to the Chosen Heuristics and Severity Scale Framework
〰️
According to the Chosen Heuristics and Severity Scale Framework 〰️
We researched the Visibility of System Status, the Match Between the System and the Real World, Consistency and Standards, Global Issues like flexibility, and error prevention Help Users Recognize, Diagnose, and Recover from Errors
Visibility of System Status
Severity Scale - 2
The website could benefit from a more immediate display of the most current COVID-19 data or alerts at the top of the page.
There is a lack of real-time status or prominent updates which might lead to users having to search for the latest information.
The open space on the top of the page not only wastes space, but could be used effectively to deliver important information about COVID-19 alerts and updates.
2. Match Between System and the Real World
Severity Scale - 2
The page uses plain language and appears to follow real-world conventions.
However, the update regarding the discontinuation of the Frisco COVID-19 tracking report might confuse users, as it is dated September 1, 2020, and users might wonder where to find the most current data.
3. Consistency and Standards
The website is generally consistent with other governmental websites, but the lack of a unified and consistent reporting mechanism for COVID-19 data could be confusing.
4. Global Issues
Flexibility and Efficiency of Use
The Frisco Texas COVID website currently lacks efficient navigation tools, particularly for expert users such as public health officials or journalists seeking specific information. This includes the absence of a search function or filtering tools, making it challenging to find current vaccine information or specific orders and notices quickly.
Recognition Rather Than Recall
The Frisco Texas COVID website's main page requires users to recall information from external sources or navigate to other sites for essential data. This approach could be improved by directly integrating critical information on the website itself, providing context and relevance for each link and resource, thus enhancing the user experience by reducing the need for external memory recall.
Error Prevention
External links are used for detailed resources, which could lead to errors if those pages are moved or updated without corresponding updates on this page.
Help Users Recognize, Diagnose, and Recover from Errors
There's no guidance on what users should do if they encounter an error, such as a revoked order or a link to a document that has been superseded by a more recent order.
Severity Scale - 2
1. Testing Method & Test Plan
Remote recorded testing with Zoom
Detailed step by step guide outlining the test: https://shorturl.at/oyACZ
4. Task-Based Evaluation
Participants to perform predefined tasks mimicking common user scenarios to assess website functionality.
Measurable Outcomes
The completion and outcomes of these tasks are quantifiable, allowing us to objectively measure the website's usability. We focus on key performance metrics such as task completion rate, time taken, and error frequency. This data will enable us to make informed decisions about where the website excels and where enhancements are needed to improve the overall user experience.
Methodology
How did we conduct the usability test?
2. Participant demographics
20-30 year olds, proficient with technology across various devices
5. Quantitative Analysis
Tracking key performance indicators like task completion rate and error rates during task navigation.
Task Questions
What did we aim to understand?
How can the tasks help us understand behaviors?
3. Comprehensive Data Gathering
Employing mixed-methods strategy for qualitative and quantitative usability data collection.
6. Qualiative Feedback
Conducting pre- and post-test interviews for insights into participants' website experiences and improvement suggestions.
1. Please navigate to Covid-19 case data for this year in Frisco.
2. Please navigate to find the local Covid-19 testing sites available in Frisco.
3. Please find and access the resources available on the website for small businesses regarding COVID-19 protocol.
4. Please navigate to the section of the website where you can find historical or previous COVID-19 case numbers.
Nature of Task
Diverse Interaction
These tasks encompass a range of interactions with the website, aiming to thoroughly evaluate its various features and capabilities. By including diverse tasks, from simple navigation to more complex information retrieval, we gain insights into different aspects of the site's usability, identifying both strengths and areas for improvement.
Real-life Scenarios
The tasks are crafted to mimic real-life scenarios that users of the Frisco Texas COVID website might face. This approach ensures that our evaluation captures authentic user experiences and interactions with the website, reflecting how users typically seek information and utilize services in actual usage situations.
5. Please find information on Frisco's family services that offer support to families in need of basic necessities.
Understanding Our Participants
Our participant group for the usability test primarily consists of young
adults aged 20-30 years, noted for their high proficiency with technology.
This demographic represents an equal gender split, with half of the
participants being men and the other half women. Their technical adeptness and familiarity with digital interfaces provide valuable insights into the advanced use and navigation of the Frisco Texas COVID website. This group's perspectives are especially crucial in understanding how the site caters to tech-savvy users in efficiently accessing and utilizing COVID-19-related information and resources.
Remote Testing Dynamics
Utilizes Zoom for virtual interaction, enabling participants to access the website in their familiar settings.
Mimics real-world usage, offering a realistic evaluation of the website's usability.
Testing Envirnoment
How did we conduct our tests?
Technical Requirements
Specified necessary equipment like a stable internet connection, computer or mobile device, and Zoom access.
Ensures all participants can effectively engage in the test without technical hindrances.
Ensuring Comfort and Openness
Created a relaxed environment, encouraging honest feedback.
Aims for genuine interactions with the website, vital for authentic usability insights.
Data Analytics
〰️
Data Analytics 〰️
We will focus on
1. Quantitative Data
2. Qualitative Data
1. Quantitative Data
We measure quantitative results using task completion, calculating error rate, measuring time on task, and a perceived level of difficulty (scale of 1-5, 5 being the most difficult).
According to the task requirements, our analysis delved into three main aspects of the data: the time taken for completion, the rate of completion, and an evaluation of the difficulty levels involved.
Task
1. Please navigate to Covid-19 case data for this year in Frisco.
2. Please navigate to find the local Covid-19 testing sites available in Frisco.
3. Please find and access the resources available on the website for small businesses regarding COVID-19 protocol.
4. Please navigate to the section of the website where you can find historical or previous COVID-19 case numbers.
5. Please find information on Frisco's family services that offer support to families in need of basic necessities.
The System Usability Scale (SUS) is a reliable tool widely used to evaluate the usability of a variety of products and services, including hardware, software, mobile applications, websites, and other user interfaces. It consists of a 10-item questionnaire with five response options for respondents, ranging from Strongly Agree to Strongly Disagree.
Excel sheet with 20 users and their responses
5. Average SUS Score: 9.4
By conventional standards, a score of 9.5 is considered to be below average. This score is considered a Grade F. This score may be described as the worst imaginable.
2. Qualitative Data
We measure qualitative results by using the think-aloud technique to track users’ thoughts and feelings. We also did a post-test interview to measure how users felt about the experience of the website, and we additionally had them fill out a System Usability Scale (SUS) test after the test to measure the overall effectiveness of the product.
Qualitative Results
1. How confident are you in the accuracy and reliability of the information provided?
2. Why so much focus on qualitative results?
We knew this website has a plethora of issues, so we decided to focus on how users felt and thought of the website. We predicted they would have a high failure of completion rate therefore wanted to prioritize qualitative data.
4.Qualitative results for System Usability Scale (SUS)
3. Users thoughts
Recommendation
Implement Navigation Tools: Introduce search and filtering options to help users, especially experts, quickly find specific information.
Integrate Critical Information: Embed key content from external sources directly on the website to reduce the need for users to search elsewhere.
Error Handling and Guidance: Provide clear instructions for users on what to do if they encounter errors like broken links or outdated information.
User Engagement: Create interactive elements such as infographics and FAQs to make the content more engaging.
Standardize Content Delivery: Use a consistent reporting system for COVID-19 data to help users easily find the latest updates.
Structured Content Delivery: Organize information into clear sections or categories to make navigation and finding relevant details quicker and easier.
Improve Real-Time Updates: Add a section on the homepage for real-time COVID-19 data and alerts, making it easily visible to users.
What should be changed?
Summary
The Frisco, Texas COVID-19 website can be significantly improved by implementing real-time updates on the homepage, enhancing navigation tools with search and filtering functionalities, and integrating critical information directly from external sources. Providing clear error handling guidance, developing interactive elements like infographics and FAQs, and standardizing content delivery will boost user engagement and comprehension. Additionally, organizing information into well-defined sections will streamline navigation, ensuring users can swiftly and efficiently find the relevant details they need.