A Comparison of What Is Part of Usability Testing in Three Countries (original) (raw)
The cultural diversity of users of technology challenges our methods for usability evaluation. In this paper we report and compare three ethnographic interview studies of what is a part of a standard (typical) usability test in a company in Mumbai, Beijing and Copenhagen. At each of these three locations, we use structural and contrast questions do a taxonomic and paradigm analysis of a how a company performs a usability test. We find similar parts across the three locations. We also find different results for each location. In Mumbai, most parts of the usability test are not related to the interactive application that is tested, but to differences in user characteristics, test preparation, method, and location. In Copenhagen, considerations about the client´s needs are part of a usability test. In Beijing, the only varying factor is the communication pattern and relation to the user. These results are then contrasted in a cross cultural matrix to identify cultural themes that can help interpret results from existing laboratory research in usability test methods.
Related papers
Researching Culture and Usability — A Conceptual Model of Usability
An experiment conducted to determine the effects of subjective culture on the usability of computerized systems did not provide sufficient evidence that any of the tested cultural dimensions affected the usability of the product. Analysis indicated that the differences in scores could have been attributed to variables other than those tested and controlled for. This indicated a need to build a more detailed conceptual model of usability before empirical research of this nature can be effectively carried out. Additional variables influencing usability and strategies for controlling for these variables under experimental conditions were identified and validated. The valid variables were incorporated into a conceptual model of usability for use in future research endeavours. This paper presents this conceptual model as well as strategies to control the variables.
Cross Cultural Usability Testing
The First All India Human Computer …, 2005
In this paper, we present the results of a pilot study in Denmark of cross cultural effects on Think Aloud usability testing. We provide an overview of previous research on cross cultural usability evaluation with a special focus on the relationship between the evaluator and the test user. This relation was studied in an experiment with usability testing of a localized clipart application in which eight participants from Denmark and India formed pairs of evaluator-test user. The test users were asked to think aloud and the evaluators' role were to facilitate the test users thinking aloud and hereby identify usability problems with the clipart application. Data on the evaluators' and test users' behaviour were recorded and analyzed by coding and summarizing statistics on these behavioural events. The results show that Think Aloud Usability Test of a localized application is most effectively performed, in terms of number of think aloud events and number of usability problems found, when both the evaluators and the test users are local. These results are however limited to the Danish context and need to be investigated in other cultural settings.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.