The following is a summary of the usability testing that was conducted as part of the Investor Web Portal redesign.
Advisor V3 Usability Testing
​
Purpose:
-
Validation testing conducted prior to the release of the new product. Gather qualitative and quantitative data on product features functionality and visual design.
​
Process:
-
Two rounds of unmoderated remote testing conducted on financial advisors.
-
7 Participants in both rounds.
-
Task section consisting of 6 tasks.
-
Survey section consisting of 3 multiple choice questions, 3 open response questions and the SUS questionnaire.
​
Metrics Used:
-
Success/Failure
-
Time on Task
-
Single Ease Question (SEQ)
-
System Usability Scale (SUS)
​
Findings Summary:
-
Response to the visual design and the layout were overwhelmingly positive.
-
The dashboard reconfiguration tool was intuitive and simple to use.
-
Participants liked the organization of the primary and secondary navigation.
-
SUS Score: Average for both rounds of testing 80.4
Advisor V2 Usability Testing
​
Purpose:
-
Gather benchmark data on our current web platform prior to embarking on a full redesign of the product.
​
Process:
-
One round of unmoderated remote testing conducted on financial investors.
-
7 Participants.
-
Task section consisting of 4 tasks.
-
Survey section consisting of 4 multiple choice and 6 open response questions followed by the SUS questionnaire.
​
Metrics Used:
-
Success/Failure
-
Time on Task
-
Single Ease Question (SEQ)
-
System Usability Scale (SUS)
​
Findings Summary: ​
-
The current web product performed poorly.
-
Users felt that the visual design was outdated looking.
-
There was too much wasted space on the dashboard.
-
Contextual navigation was hidden and confusing to
use leading to an inability to complete tasks and frustration.
-
SUS Score: Average for both rounds of testing 65.5
​
Investor Mobile Usability Testing
​
Purpose:
-
Conduct benchmark testing for comparing future iterations. Gather qualitative and quantitative data. Observe users interacting with our product and giving feedback on various features.
​
Process:
-
One round of remote, unmoderated "think aloud" usability testing.
-
7 participants
-
Task section consisting of 6 tasks.
-
7 survey questions. Conditional questions.
​
Metrics Collected:
-
Net Promoter Score (NPS)
-
System Usability Scale Score
-
Single Ease Question (SEQ)
-
Time on Task
​
Findings Summary:
-
The mobile product performed very well. Users loved its
simplicity, the accessibility of the information, visual
design and layout. It performed
very well on the System Usability Scale.
-
SUS Score: 91
​
Investor V3 Iterative Testing
​
Purpose:
-
Iterative testing on the new design. Seeking general feedback on the organization of the information on the dashboard, primary and contextual navigation, gear menu pages and visual design.
​
Process:
-
One round of remote, unmoderated "think aloud" usability testing.
-
7 participants
-
Task section consisting of 4 tasks.
-
5 survey questions.
​
Metrics Collected:
-
Net Promoter Score (NPS)
-
System Usability Scale Score
-
Single Ease Question (SEQ)
-
Time on Task
​
Findings Summary:
-
Provided extremely valuable data on how our design is progressing.
-
Validation that our new contextual navigation is more intuitive.
-
Valuable feedback on font sizing that led to a full rethinking of how
font is being handled throughout the platform.
-
SUS Score: 77.5
​