Why are we doing this?
To test early native talk page designs via a Figma prototype with new contributors. The participants were asked to:
- Open a topic
- Find a work in the page by using ‘find in page’ action
- Reply to a comment
- Create a new topic
- Open all threads
- Subscribe to a topic
The goal was to test whether participants...
- Understand the content of the page
- Test the basic usability of talk pages
- Give feedback on the UI
Planning document
https://docs.google.com/document/d/1VQ1ParLiQrPZAHtUWEH9pIAyF7c7YHE_lR-CAgEM7js/edit
Testing plan
This test will be for new Wikipedia contributors. At least 5 users will be recruited via usertesting.com where the sessions will be recorded.
The test will be remote, unmoderated, and task-based. Participants will be given 10-15 minutes to complete tasks and make decisions about the designs. They will be provided with a link a Figma prototype where they will be able to view the designs and complete some basic tasks.
Overview of the designs
| Topics page | Open topic | Find in page | Reply to a comment | Create new topic | Open all threads | Subscribe to a topic |
The participants will be able to complete this test either on their on their desktop. There will be 3 screener questions for this group of testers:
- Do you use an iOS device?
- Have you ever used the Wikipedia mobile app before (either on Android or iOS)?
- How often do you use Wikipedia (either on the web or in the app)?
Results
A total of 6 participants completed the test.
😀 100% of the participants understood the use of the speech bubble icon in each topic cell.
😀 100% of the participants found that the topic page was easy to find and understand.
😀 100% of the participants successfully opened a topic, used find in page, replied to a comment, created a new topic and subscribed to a topic.
😕 67% of the participants understood the use of the avatar icon in each topic cell. The other 33% assumed that the avatar icon indicated how many people have seen the comments.
😕 33% of participants thought that the topics were organized by time and date, 16% thought they were organized by the number of participants and the rest of the participants glanced quickly over the question.
😕 33% of the participants were not sure that the three dots would lead to the ‘more menu’ but assumed that it might. Once they were directed to click on it, they said that the task was easy to complete.
😔 50% of participants wished for a greater visual distinction between the different topics.
😔 16% of participants wished for more distinctive UI to indicate who is responding to whom in the comments.
😔 16% of participants expected to find the ‘open all threads’ underneath the header of the page rather than in the ‘more menu’.
Notes
Previous usability testing: