Usability Testing Log
Sunday, 4/12/2022
Usability Test 4
Time: 4:00pm - 5:00pm
Consultant: Ivona Gorgioski
Logger(s): Austin Sopha, Marie Zgurich
Developer(s): Foenix Szot
Participant 4
Log:
- Not sure what to do or what nodes do
- Is completely lost, even after getting some thing to work (like connecting nodes)
- Would prefer to find the help section
- Gave away where the help section was, might spoil that portion for the next part?
- Is unsure if completed the scenario
- Carefully goes over instructions, mentioning clearing
- Seemed to understand a bit more after reading help (knows how to clear)
- Right click does not clear like planned
- Connects supply nodes to distribution node (road)
- Feels like he is just clicking around
- Not sure how to reset the budget
- “Don’t have enough background knowledge of what I’m doing.”
- Thinks he finished scenario two
- Is still unsure if he completed the task and the simulation
- Still unclear on how to refresh everything/clear connections/’clear budget’
- Has better understanding of creating connections between nodes
- Completed the budget task just fine
- Sees that he has connected everything and the budget is under $2000, but still doesn’t understand why or exactly what he did
Interview Questions: (check the recording)
- What is your first impression of the website?
- Good design, yet since had no or very little experience in supply chain had very little understanding
- Did this impression change over the course of testing the site?
- Became more informed/ understood better how the game worked
- As each scenario went on, understood more of what he was trying to do.
- Is there anything you would change in regards to how the simulator functioned?
- More detail when hovering over the nodes would be nice
- What was the best part of this experience?
- Put a lot of care into it
- What was the more frustrating part of this experience?
- Not understanding what the game was doing
- Do you feel you learned something about supply chain while navigating this application?
- Learned how to manage the budget and connect nodes
- Could you identify the four kinds of nodes?
- Identified road (but sees it is called a truck node and is slightly confused), supply is a tree, demand as a cabin, and other distribution node as railroad
Usability Test 5
Time: 5:00pm - 6:00pm
Consultant: Ivona Gorgioski
Logger(s): Marie Zgurich, Audrey Schmitt
Developer(s): Foenix Szot, Austin Sopha
Participant 5
Log:
- Not sure what he’s supposed to do in the simulation
- Not sure what running the simulation means
- Trying to connect supply nodes to distribution nodes. Not working but he’s not sure why
- Not sure what the end goal is or when to know that he’s done
- Figured out how to disconnect nodes without help section
- After reading help section, still visibly confused as to how the connections work
- Still unsure of what’s going on, even after viewing help. Creating a lot of working chains though
- Saying “I don’t know”
- Didn’t understand the symbols, but thought is was straightforward to control
- Didn’t know what the icons meant
- Doesn’t feel like he learned much about the supply chain
- Four nodes: “supply. . .connecting?... Selling?”
Interview Questions:
- What is your first impression of the website?
- Didn’t know what symbols meant or what they were/supposed to be
- Did this impression change over the course of testing the site?
- Yes, had more of an understanding of what it was
- Is there anything you would change in regards to how the simulator functioned?
- Try to show what each symbol was in a better way, didn’t understand what the game was at first
- What was the best part of this experience?
- Good part was the budget and how to keep it under the goal/trying to reach the goal in the third session.
- What was the more frustrating part of this experience?
- Frustration was trying to figure out what the game was.
- Do you feel you learned something about supply chain while navigating this application?
- In particular, not really
- Could you identify the four kinds of nodes?
- Identified leftmost nodes as supply nodes, train tracks were connecting the chain to other things, rightmost nodes as demand. Trees for lumber, trucks were transporting lumber, tracks were meeting points, other nodes were for selling lumber.
Usability Test 6
Time: 6:00pm - 7:00pm
Consultant: Ivona Gorgioski
Logger(s):Austin Sopha, Audrey Schmitt
Developer(s): none
Participant 6
Log:
- Trying to connect various nodes together
- User is trying to connect nodes in the incorrect order but is not sure why it’s not working
- Not understanding why he can’t get the far right node connected
- User is unclear as to what the end goal is
- Successfully connected all nodes together in first session
- User asks if there is an objective
- Struggling with clearing last nodes
- User figures out how to clear connections without help section
- User thinks some nodes are connected (due to placement of white lines) even though they are not
- Realized he can connect a distribution node to all demand nodes after reading overview and context from previous session
- Was able to finish without any issues
Interview Questions:
- What is your first impression of the website?
- Thinks it was fine. Confused on what he was going for but got a better understanding after the overview.
- Did this impression change over the course of testing the site?
- Is there anything you would change in regards to how the simulator functioned?
- Deleting connections could be better implemented (clicking white line instead)
- What was the best part of this experience?
- Best part was getting to see the total budget and total emissions.
- What was the more frustrating part of this experience?
- Deleting the connections was the most frustrating part.
- Do you feel you learned something about supply chain while navigating this application?
- Could you identify the four kinds of nodes?
- Supply nodes (wood areas, trees). Road node and railroad node. Identified demand nodes, assumed it was a factory/lumber mill