Questions for live-in-app-survey of live-bike-travel-info (Design comparison)
TL;DR: I am creating my own survey questions for a feature comparison. Need feedback on design and if I am missing something important.
I am creating a live-survey for comparing the status quo to the new design of a live-bike-travel-info within the biking app. Users see a map and their progress as well as a list of trip details/milestones (e.g. arrival in 20 min, overall delay of 4 min).
It will be a quasi-experimental design, as the new version will be rolled out with the newest update (no perfect randomization).
The Designer asked to compare and validate the two versions. We want to look into
- Findability of feature in the app
- Overall satisfaction
- Overall ease of use
- Ease of use map
- Ease of use trip details
- Clarity/Trust of information
- Potential future engagement
Personally, I find the standardized questionnaires (e.g. SUS, WAMMI, etc.) to only be mildly applicable (too general) to compare this app feature. There is no need to compare it to other apps or app features.
I came up with the following questions (as did Nielsen Norman Group (Stover, Coyne, & Nielsen, 2002)).
5-point-Likert-Items from Totally disagree to Totally agree:
- The [feature] is easy to find in the app. (Findability)
- Navigating through the [feature] is easy to do.(Overall ease of use)
- Interacting with the map (buttons/zooming in and out) is intuitive.(Map ease of use)
- The information about travel milestones and arrival times is easy to understand.(Milestones ease of use)
- I trust the displayed information in the [feature] the be correct.(Functionality) Overall, I am satisfied with the [feature]. (Satisfaction)
- I can see myself using the [feature] more often. (Engagement)
Goal would be to compare the overall mean scores and if significant, do an item comparison.
I would appreciate any feedback you have. Have you created your own items/scales before? Something to keep in mind (e.g. no. of questions, reversed scale, etc.)?