User test result

The test was conducted to total 34 participants for a week. Among them, more than 20 participants live out of Netherlands. The others live in Netherland, but out of Delft. The following graphs show how many people chose correspondent routes (correspondent route means; route P is correspondent to the map for shopping route, route K is correspondent to the map formuseum route).

• The pie chart 1 shows: the proportion of number of people who noticed any difference between two maps

• The pie chart 2 shows: the proportion of number of people who chose correspondent routes

• The pie chart 3 shows: the proportion of number of people who chose correspondent routes, among who noticed the difference of two maps

• The pie chart 4 shows: the proportion of number of people who chose correspondent routes, when Shopping routes were shown and Museum route were shown

Here are results of analysis:

1. 8 out of 34 participants (30.77%) noticed the difference between two maps.
2. 6 participants among who noticed the difference answered they noticed color saturation of the block on the map.
3. 2 participants picked the difference of icons
4. Only 2 of 8 people (25%) who noticed the difference chose correspondent routes.
5. 18 out of 34 participants (52.94%) chose correspondent routes
6. 9 out of 16 participants(56.25%) chose the routes correctly (chose route P whenShopping routes were shown)
7. 9 out of 18 participants(50%) chose the routes correctly (chose route K when Museum routes were shown)

One of our goal is to know it is possible to affect users' decision with subtle difference or not. Comparing graph 1 with graph 2, it seems natural to conclude our map influenced users' decision unconsciously because more people selected correctly even they could not recognize the difference.

However, only about half of participants (see analysis 5.) chose correspondent routes, so it is hard to conclude our map could affect participants' decision. Also, only 25% (see analysis 4.) chose the routes correctly even they noticed the difference between two maps.

There are several factors that might affect out test, unintentionally.

Flipping effect of test prototype might distract participants' recognition of the difference between two maps, or There might be misunderstanding of the test: some participants said they chose museum routes because they just wanted to visit museums, without understanding the task.