Usability Testing Log
Sunday, 4/14/2022
Usability Test 7
Time: 4:00pm - 5:00pm
Consultant: Ivona Gorgioski
Logger(s): Foenix Szot, Kevin Cornell
Developer(s): None
Participant 7
Log:
- Assumes trees or demand node (unsure which one is which on leftmost and rightmost sides) are supply/demand
- Understands the concepts of nodes
- Is able to connect supply to road right away
- Assumes that nodes are connected via clicking and dragging
- Trying to understand what the nodes are, supply nodes supposed to symbolize trees
- Using connections to try and understand nodes
- Guesses that he completes the task of session one
- The sprites are helping to understand the nodes
- Figures out how to clear nodes, has trouble slightly with demand to road connection, but figures it out
- Connects all the nodes and says the goal is complete
- Is easily able to disconnect nodes
- Assumes ‘Overview’ contains the help section but is at first uncertain
- Quickly is able to connect all nodes
- Quickly reads over the help screen (likely due to prior good understand from session one)
- Tries to connect demand nodes to each other
- Tries to connect a supply node to two different distribution nodes
- Connects all nodes but still trying to connect the same type nodes (i.e. demand to demand)
- Disconnect to redo the chain
- After reconnecting, states they are done
- Still easily disconnects nodes
- Notices that he raised the demand rate
- Tries to connect road to already connected demand node
- Then clears that connection after figuring out it wouldn’t work, to make room for other one
- Achieves assigned goal quickly
- Still seems unclear about things
- Still trying to connect nodes of same type
Interview Questions:
- What is your first impression of the website?
- Without any instructions it was pretty easy to understand.
- Did this impression change over the course of testing the site?
- Not really understanding how to what get the demand rates are asking on the demand nodes (so calculations, what is contributing)
- Is there anything you would change in regards to how the simulator functioned?
- “Maybe a little more information on how the simulation works in general.”
- What was the best part of this experience?
- “The best part would have probably been how easy it was to use.”
- What was the more frustrating part of this experience?
- “Then again the only critique I had was that there wasn’t enough information on the demand rates.”
- Do you feel you learned something about supply chain while navigating this application?
- Kind of, but didn’t learn beyond what they already knew
- Could you identify the four kinds of nodes?
- Identified road and train tracks the best. Mostly by clicking on the other nodes did he figure out the other ones. Demand as building sites (?) and supply nodes as trees.
Usability Test 8
Time: 5:00pm - 6:00pm
Consultant: Ivona Gorgioski
Logger(s): Christian Clemmons, Kevin Cornell
Developer(s): none
Participant 8
Log:
- User is reading the node specific UI to get a better understanding
- Clicks on the distribution node to read it
- User not sure how to start
- User discovers how to connect nodes
- Connects nodes but tries to connect nodes of same type
- User thinks railroad is a warehouse
- Not understanding directionally of connections
- User tries connecting distribution nodes to supply nodes. Can’t do it but is not sure why
- Notices the budget and emissions tracker
- User thinks budget is money he has (incoming budget), not money being spent
- User is not sure what the money/emissions really mean
- “Doesn’t know what the goal is”
- Understands how to disconnect nodes
- User thinks he connected distribution to distribution (but it’s just the lines overlapping)
- “This doesn’t make any sense”
- Thinks goal is to maximize nodes
- Associating the names of nodes to be the order of deliverer
- Sees line drawn over a node to be connecting the nodes
- Uses a truck to determine that the line was drawn on top of the distribution node
- Believes goal is to maximize output relative to input
- User is trying different configurations
- Thinks right click to delete all connections
- User misunderstand the purpose of right click
- Needs clarification in rules to clarify what nodes connect to what
- User is trying to measure the different emissions/costs of trucks and trains
- Associates distance of travel to the budget/emissions
- User thinks that the emissions seem really high
- Wants to minimize the emissions
- User thinks goal is to have highest budget and lowest emissions
- Uses the text box to realize that the node has full connections
- The tem clearing is confusing in the help section
- Give the goal to minimize budget (get under $1250)
- Achieves goal
Interview Questions:
- What is your first impression of the website?
- Did like the look (“thematic”). Was confused how to navigate. Took him a while to figure out what to click and how to connect things. Didn’t think the right click was working, misunderstood what “clearing” meant. Was confused that trucks were coming from train node. Took him a while to figure out that he was delivering somehow. Still unsure what the goal/target is.
- Did this impression change over the course of testing the site?
- Yes. Initially thought budget needed to be maximized but now understand the budget is flexible
- Is there anything you would change in regards to how the simulator functioned?
- What was the best part of this experience?
- Messing around with how the nodes connected and trucks moving
- What was the more frustrating part of this experience?
- Do you feel you learned something about supply chain while navigating this application?
- A little bit, but not really
- Could you identify the four kinds of nodes?
- Trees (supply), warehouse (demand), doesn’t recall the distribution nodes