4/29 Testing

What did we learn from the testing session and how are our discoveries informing our final revisions?

What Did We Test?

During our testing session, we each created two screens that detailed each part of a chapter (the pretest, learning, and application). We then walked our learners through each screen, detailing what they are seeing on the screen, asking them questions such as:

1. Is the information fun to learn, is it digestible and sustainable in interest?
2. Is the pretest annoying, or does it come across as quick and easy?

We also took this time to try out different versions of our UI, considering things like:

1. How organic should we be making these screens? Where is it the most impactful and when does it get too overwhelming?
2. Hamburger menu, would it be helpful to hide or show the guiding navigation content?

Our Testing Screens

Feedback

• For the very beginning and the end of the experience, sketches of a storyboard that details the other parts of the experience that we don’t go into much detail could be impactful —instead of having screens
• The allocation of the funds make sure that happens once the learner has gained some info → don’t reward based on existing knowledge (Can we implement a way to try out options? see the repercussions before actually making a choice — to reward current learning)
• What role are the assets and balance playing in the experience? Make its purpose clear to the user
• Look at hierarchy of text on screen, play with it more
• Separate the visual language for content and nav
• Solidifying the relevance of what they’re doing at each stage and how it relates to the overall topic of financial well-being
• Don’t understand why i’m picking the apartments — tell me why the learner is making these decisions about the apartment, maybe theres another screen (a rhetorical) that reinforces why this is important in the application part. Tell them why they are making these decisions about the apartment.
• Even though we have screens that establish importance earlier on, it’s important to reiterate that same info, to maintain attention. The longer distance you have to activities to relevance, the less likely they are to retain info to reflect on it
• Maybe you insert something that says “hang onto this information, you’ll need it down the road” (quick and easy , if you establish the relevance)
• First screen, drive home the value of the screen beyond the reward, use terminology, things you’ll do as a young adult, what would motivate someone to do it beyond points (intrinsic motivation)
• “Take this test to see the holes in your knowledge if you’re a financial master”
• For the navigation bar, there can be a way to combine the chapters and the sections into one nav. Make it present but not overwhelming.
• For the pretest, is the feedback for each response targeted? Like if you get it wrong, does it explain why that is wrong?
• Really enjoy the micro-interactions of the learning portion — might be good to specify looking for damage rather than just checking? Adding light fixtures too to check is always good
• For leases, you usually don’t get to see it until the end when you’d like to sign — maybe just view the lease for the top 1 property and just view details and ask questions for the top 3?
• For UI, enjoy having a retractable menu and progress bar the most, don’t want to see it all the time, gets overwhelming with content
• Pretest is easy enough to do which is good — would it be more helpful if the lesson or application followed up with what you learned or missed from the pretest? Like a callback
• Application with messaging landlords — make it clearer that it is multiple choice
• UI — enjoys colors with the darker background the most, better contrast, enjoys the menu. “Fun but not too fun” feeling, walks the line well where it doesn’t feel corporate but still is taken seriously
• Imagined photographs instead of illustrations within the grey content boxes — feels more realistic if that is what we want?
• Maybe have a post-test at the end to see how you improve?

Response to Feedback

There were a lot of feedback points brought up during our session that we intend to use as we move forward in refining our screens and our learning experience.

The idea of having sketches, instead of making more screens, for the beginning and end of the experience is something that is very interesting and may allow us to focus on the most important parts of the experience, without getting into the nitty-gritty of creating more screens.

Rewarding based on knowledge learned inside the game, as opposed to knowledge that they are coming in with is a thought that hadn’t occurred to our group, but is one that is so important, as we want to make sure that the learners are truly learning and applying based on our game.

Reiteration of the same information is also something our group is considering as well, as it is important for the learner to be comprehending the importance of what they are doing the entire time. This is another way that we can sustain interest in the learner and make sure to keep their motivation up, by reiterating why what they are doing is important and how things they are doing fit into a bigger picture.

Viewing the lease at the end when the learner would like to sign is a niche thing that matches what happens in real life. This will also help simplify content more.