Meinald T Thielsch | University of Münster (original) (raw)

Papers by Meinald T Thielsch

International Journal of Human-Computer Interaction, 2021

In digital media and on the World Wide Web, content is king. As such, users' subjective perceptio... more In digital media and on the World Wide Web, content is king. As such, users' subjective perceptions of content can influence a variety of their evaluations, thereby altering their attitudes and behavioral outcomes. Thus, users' content perceptions need to be assessed using a valid measure, but this often has to be done while keeping the survey time as short as possible. For these situations, we created a four-item short version of the Web-CLIC questionnaire (Thielsch & Hirschfeld, 2019). We tested this version, called the Web-CLIC-S, in a series of three studies, including 1,414 participants and 33 fully functional websites of different content domains. Confirmatory factor analysis confirms that the Web-CLIC-S reflects an unidimensional g-factor of subjective web content. The Web-CLIC-S also demonstrates high internal consistencies and high short-to mediumterm retest reliabilities. Furthermore, we find strong evidence for construct validity in terms of convergent, divergent, discriminative, concurrent, incremental, and predictive validity. In a fourth study, encompassing 12,568 ratings on 183 websites, we provide benchmarks for 12 different content domains and optimal cut points. Overall, the present research suggests that the Web-CLIC-S can serve as a sound screening tool to assess users' subjective perception of content in research and practice settings.

Mensch und Computer 2019 – Tagungsband, 2019

Aesthetics has become a central construct in Human-Computer Interaction (HCI), and it has clear b... more Aesthetics has become a central construct in Human-Computer Interaction (HCI), and it has clear beneficial effects on users' perceptions and a$itudes. Yet, do a$ractive interfaces actually enhance user performance? In the light of the importance of the construct and the mixed findings in various studies on the ma$er a systematic approach is urgently needed. !us, the present meta-analysis examines in detail the effects of visual interface aesthetics of websites, so%ware and other interactive systems on objective user performance. A systematic literature search yielded 25 eligible studies with 101 observed effects and a total of 3,025 participants. !e conducted meta-analysis revealed a small significant overall effect of interface aesthetics on user performance (g = 0.12), while a high heterogeneity of effects was observed. As potential moderators, we tested the type of used interaction medium, task, goal orientation, measure of performance, measure of aesthetics, and aesthetics manipulation. None showed a significant moderating influence. !us, aesthetics can be considered to have a small but heterogeneous influence on user performance that so far cannot be further resolved by moderating variables reported in eligible studies. !erefore, the discussion sketches avenues for future research and encloses a call to action for the HCI community.

Mensch und Computer 2019 – Tagungsband, 2019

Scores of different evaluation measures resulting from website tests are difficult to interpret w... more Scores of different evaluation measures resulting from website tests are difficult to interpret without comparative data. Benchmarks and optimal cut points provide such interpretation aids. Benchmarks are usually built with test score means based on a tested pool of comparable websites. Optimal cut points are calculated with an external criterion using receiver-operating-characteristic (ROC) based methods applied on website evaluations. Due to relevance and sensitivity of the topic, making the right decision based on evaluation data is of particular importance for creators and owners of websites presenting health-related information. Thus, we combined data of two studies, with a total of n = 2.614 participants, evaluating m=33 health-related websites. Established questionnaires were applied: Web-CLIC (website content), PWU-G and UMUX-Lite (usability), VisAWI-S (aesthetics), and trusting belief scales of McKnight et al. [7]. We calculated overall and specific values for four categories of e-health websites. Benchmarks were quite comparable among categories while optimal cut points differed more. Particularly, cut points were high for charity websites and partly lower for the category "Personal sites & support groups". In general, user requirements for e-health websites appear to be significantly higher than available published benchmarks and cut points for websites in other areas. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI) → Empirical studies in HCI

Technical Communication, 2017

Acknowledgments We would like to thank Prof. Gisela Grosse and her colleagues from the Corporate ... more Acknowledgments We would like to thank Prof. Gisela Grosse and her colleagues from the Corporate Communication Institute Münster for supporting the study.

Studies in Educational Evaluation, 2018

Nowadays, a systematic student evaluation of teaching (SET) is common at many universities. Howev... more Nowadays, a systematic student evaluation of teaching (SET) is common at many universities. However, not all students evaluate all relevant courses and, as a consequence, feedback from a substantial number of students is missing. The current study examines response behavior with respect to demographic, motivational, and situational variables. Based on an online survey, data of N = 640 participants were analyzed. Using regression analysis based on multiple imputation, no significant effects for the reported participation in SET were found for demographic variables or opportunity costs. However, experienced salience of SET, aspects of social exchange, survey mode, and the general willingness to participate in surveys were all identified as significant predictors of SET participation. The results of our study can be helpful for evaluation managers to reduce non-response, especially stressing the importance of feedback and communication in SET. Acknowledgement We thank Philipp Deing for his active help during the planning and investigation phase and Tina Dusend for supporting this study.

PeerJ, 2019

In Human-Computer Interaction research, the positive effect of aesthetics on users' subjective im... more In Human-Computer Interaction research, the positive effect of aesthetics on users' subjective impressions and reactions is well-accepted. However, results regarding the influence of interface aesthetics on a user's individual performance as an objective outcome are very mixed, yet of urgent interest due to the proceeding of digitalization. In this web-based experiment (N = 331), the effect of interface aesthetics on individual performance considering three different types of tasks (search, creative, and transfer tasks) is investigated. The tasks were presented on an either aesthetic or unaesthetic website, which differed significantly in subjective aesthetics. Goal orientation (learning versus performance goals) was included as a possible moderator variable, which was manipulated by using different task instructions. Both aesthetics and goal orientation were a between-subject factor, leading to a 2×2 between subject design. Manipulation checks were highly significant. Yet the results show neither significant main effects of aesthetics and goal orientation on performance regarding both accuracy and response times in each of the three tasks, nor significant interaction effects. Nevertheless, from a practical perspective aesthetics still should be considered due to its positive effects on subjective perceptions of users, even as no substantial effects on user performance occurred in the present experiment.

European Spine Journal, 2018

Background The Quality of Life Profile for Spine Deformities (QLPSD) is a self-reporting question... more Background The Quality of Life Profile for Spine Deformities (QLPSD) is a self-reporting questionnaire designed for studying patients with spinal deformities. Purpose The aim of the present study was to systematically translate the QLPSD into German (G-QLPSD) and to test its reliability and validity. Special emphasis was intended to be given to patients with different Cobb angles and ages. Methods The QLPSD was systematically translated into German and was responded to in a web-based online survey by patients with idiopathic scoliosis and by healthy control individuals in order to carry out a matched-pair analysis. Participants aged 14 years and older were included. All participants answered a battery of validated questionnaires (SRS 22-r, PHQ-9, PANAS, FKS, WHO-5, BFI-S, PTQ). Reliability testing included Cronbach's alpha and test-retest reliability (retest 8 weeks after initial testing). Factorial, convergent, divergent, concurrent, and discriminant validity were calculated. Results A total of 255 scoliosis patients (age 30.0 ± 16.7 years, Cobb angle 43.5 ± 20.9°) and 189 matched healthy control individuals were finally included. Cronbach's alpha for the G-QLPSD total score was 0.93 and the test-retest reliability was 0.84. The G-QLPSD total score correlated with the SRS 22-r total score (r =-0.86). All concurrently applied scores showed strong correlations with the G-QLPSD (e.g., depression score PHQ-9: r = 0.70). The matched-pair analysis of 189 pairs showed strong discriminant validity (Cohen's d = 0.78). Patients with more severe Cobb angles (≥40°) and those ≥ 18 years of age had significantly poorer results than patients with minor curves and younger patients. Conclusion The G-QLPSD proved to be a highly reliable and valid instrument that can be recommended for clinical use in scoliosis patients.

Human-Computer Interaction, 2018

Content is of primary importance in the World Wide Web. In particular, subjective perceptions of ... more Content is of primary importance in the World Wide Web. In particular, subjective perceptions of content are known to influence a variety of user evaluations thereby altering attitudes and behavioral outcomes. Thus, it is essential that individually experienced facets of content can be adequately assessed. In a series of seven studies we create, validate, and benchmark a measure for users' subjective view on web content. In the first six studies, a total of 3,106 participants evaluated a sum of 60 websites. The resulting Web-CLIC questionnaire is a 12-item measure based on prior research on web content. It encloses four main facets of users' content experience: clarity, likeability, informativeness, and credibility-jointly representing a general factor subjective content perception. Very high internal consistencies and high short-to medium-term retest reliabilities are demonstrated. Strong evidence for construct validity in terms of factorial, convergent, divergent, discriminative, concurrent, experimental, and predictive validity is found. In a seventh study, encompassing 7,379 ratings on 120 websites, benchmarks for ten different content domains and optimal cut points are provided. Overall, the present research suggests, that the Web-CLIC is a sound measure of subjective content perception of both practical and theoretical benefit.

Digitalization of work processes is advancing, and this is increasingly supported by complex info... more Digitalization of work processes is advancing, and this is increasingly supported by complex information systems (IS). However, whether such systems are used by employees largely depends on users' trust in these IS. Because there are few systematic studies on this topic, this research provides an initial exploration and validation of preconditions for trust in work-related IS. In Study 1, N = 30 professionals were asked to describe occupational incidents in which they had highly trusted or distrusted an IS. Content analysis of 111 critical incidents described in the in-depth interviews led to 12 predictors of trust and distrust in IS, which partly correspond to the structure of the established IS success model (Delone & McLean, 2003) but also exceed this structure. The resulting integrative model of trust in IS at work was validated in Study 2 using an online questionnaire with N = 179 professionals. Based on regression analyses, reliability (system quality) and credibility (information quality) of IS were identified as the most important predictors for both trust and distrust in IS at work. Contrasting analyses revealed diverging qualities of trust and distrust in IS : whereas well-being and performance were rated higher in trust events, experienced strain was rated higher in distrust events. Together, this study offers a first comprehensive model of trust in IS at work based on systematic empirical research. In addition to implications for theory advancement, we suggest practical implications for how to support trust and to avoid distrust in IS at work.

Background. Depression, as one of the most prevalent mental disorders, is expected to become a le... more Background. Depression, as one of the most prevalent mental disorders, is expected to become a leading cause of disability. While evidence-based treatments are not always easily accessible, Internet-based information and self-help appears as a promising approach to improve the strained supply situation by avoiding barriers of traditional offline treatment. User experience in the domain of mental problems therefore emerges as an important research topic. The aim of our study is to investigate the impact of depressive symptoms on subjective and objective measures of web user experience. Method. In this two-part online study (N total = 721) we investigate the relationship between depressive symptoms of web users and basic website characteristics (i.e., content, subjective and objective usability, aesthetics). Participants completed search and memory tasks on different fully-functional websites. In addition, they were asked to evaluate the given websites with standardized measures and were screened for symptoms of depression using the PHQ-9. We used structural equation modeling (SEM) to determine whether depression severity affects users' perception of and performance in using information websites. Results. We found significant associations between depressive symptoms and subjective user experience, specifically of website content, usability, and aesthetics, as well as an effect of content perception on the overall appraisal of a website in terms of the intention to visit it again. Small yet significant negative effects of depression severity on all named subjective website evaluations were revealed, leading to an indirect negative effect on the intention to revisit a website via impaired content perceptions. However, objective task performance was not influenced by depressiveness of users. Discussion. Depression emerges as capable of altering the subjective perception of a website to some extend with respect to the main features content, usability, and aesthetics. The user experience of a website is crucial, especially as it facilitates revisiting a website and thus might be relevant in avoiding drop-out in online interventions. Thus, the biased impression of persons affected by symptoms of depression and resulting needs of those users should be considered when designing and evaluating E-(Mental)-Health-platforms. The high prevalence of some mental disorders such as depression in the general population stresses the need for further investigations of the found effects.

Ergonomics, 2014

Subjective perceptions of websites can be reliably measured with questionnaires. But it is unclea... more Subjective perceptions of websites can be reliably measured with questionnaires. But it is unclear how such scores should be interpreted in practice, e.g. is an aesthetics score of 4 points on a seven-point-scale satisfactory? The current paper introduces a receiver-operating characteristic (ROC)-based methodology to establish meaningful cut points for the VisAWI (visual aesthetics of websites inventory) and its short form the VisAWI-S. In two studies we use users&amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;amp;#39; global ratings (UGRs) and website rankings as anchors. A total of 972 participants took part in the studies which yielded similar results. First, one-item UGRs correlate highly with the VisAWI. Second, cut points on the VisAWI reliably differentiate between sites that are perceived as attractive versus unattractive. Third, these cut points are variable, but only within a certain range. Together the research presented here establishes a score of 4.5 on the VisAWI which is a reasonable goal for website designers and highlights the utility of the ROC methodology to derive relevant scores for rating scales.

The current study investigates how different types of company website designs influence first imp... more The current study investigates how different types of company website designs influence first impressions, aesthetic evaluations, and memory performance. We implemented an online study with a between-subjects design to examine differences between three design categories identified by ten experts in a pretest: SCOFA (strong colours of one colour family), LAPIC (large pictures), and SAPAT (same amount of pictures and text). The data of 458 participants (52.2% female) reveal that a) after an exposure time of five seconds, response times for website-related attributes differ between the categories, b) LAPIC and SAPAT are perceived as more aesthetic than SCOFA, c) memory performance is best on SAPAT sites. These results underline the importance of first impressions of a site's appearance and provide practical guidance for web designers by showing what users associate with certain designs, which designs they prefer, and which sites are the most memorable. Research highlights: • Already a rough design categorisation of corporate websites based on first impressions yields significant differences on subjective and objective user experience measures. • Users differentially evaluate and remember websites after seeing them for only five seconds. • Considering a number of outcome variables reveals that there is not one superior website design regarding each outcome. This is a pre-copyedited, author-produced PDF of an article accepted for publication in Interacting with Computers following peer review. The version of record Douneva, M., Jaron, R. & Thielsch, M. T. (2016). Effects of different website designs on first impressions, aesthetic judgments, and memory performance after short presentation.

Students' feedback is common in teaching evaluation, but there is no documented instrument enabli... more Students' feedback is common in teaching evaluation, but there is no documented instrument enabling instructors to systematically gather relevant student feedback on written exams in higher education. Three studies are described to develop a valid instrument for evaluating written exams. Study 1 analyzes characteristics of effective written ex ams from the perspective of students and instructors, using qualitative content-analysis. This informs study 2, which analyzes and revises the structure of a questionnaire via exploratory factor analysis. In study 3, confirmatory factor analysis and cross-validation are conducted to confirm the structure found in study 2. Central factors are " Transparency " , " Composition of the exam " and " Students' workload ". Students' feedback as assessed by this questionnaire provides reliable feedback to improve the quality of exams.

Content, usability, and aesthetics are core constructs in users' perception and evaluation of web... more Content, usability, and aesthetics are core constructs in users' perception and evaluation of websites, but little is known about their interplay in different use phases. In a first study web users (N=330) stated content as most relevant, followed by usability and aesthetics. In study 2 tests with four websites were performed (N=300), resulting data were modeled in path analyses. In this model aesthetics had the largest influence on first impressions, while all three constructs had an impact on first and overall impressions. However, only content contributed significantly to the intention to revisit or recommend a website. Using data from a third study (N=512, 42 websites), we were able to replicate this model. As before, perceived usability affected first and overall impressions, while content perception was important for all analyzed website use phases. In addition, aesthetics also had a small but significant impact on the participants' intentions to revisit or recommend.

We investigated whether design experts or laypersons evaluate webpages differently. Twenty partic... more We investigated whether design experts or laypersons evaluate webpages differently. Twenty participants, 10 experts and 10 laypersons, judged the aesthetic value of a webpage in an EEG-experiment. Screenshots of 150 webpages, judged as aesthetic or as unaesthetic by another 136 participants, served as stimulus material. Behaviorally, experts and laypersons evaluated unaesthetic webpages similarly, but they differed in their evaluation of aesthetic ones: experts evaluated aesthetic webpages as unaesthetic more often than laypersons did. The ERP-data show main effects of level of expertise and of aesthetic value only. There was no interaction of expertise and aesthetics. In a time-window of 110–130 ms after stimulus onset, aesthetic webpages elicited a more negative EEG-amplitude than unaesthetic webpages. In the same time window, experts had more negative EEG-amplitudes than laypersons. This patterning of results continued until a time window of 600–800 ms in which group and aesthetic differences diminished. An interaction of perceiver characteristics and object properties that several interactionist theories postulate was absent in the EEG-data. Experts seem to process the stimuli in a more thorough manner than laypersons. The early activation differences between aesthetic and unaesthetic webpages is in contrast with some theories of aesthetic processing and has not been reported before.

Im Rahmen einer Online-Befragung von 199 Personalpraktikern wird deren Weiterbildungsverhalten un... more Im Rahmen einer Online-Befragung von 199 Personalpraktikern wird deren Weiterbildungsverhalten untersucht. Nach eigener Einschätzung greifen die Befragten bei der Lösung von rund einem Viertel ihrer Arbeitsaufgaben auf Wissen zurück, das sie in der Weiterbildung erworben haben. Dabei spielen Print- und Onlinemedien eine herausgehobene Rolle. Personalpraktiker mit Psychologiestudium lesen in signifikant stärkerem Maße (wissenschaftliche) Fachzeitschriften als Vertreter anderer Berufsgruppen, wobei deutschsprachige Publikationen bei allen Berufsgruppen präferiert werden. Für einen leichteren Transfer wissenschaftlicher Erkenntnisse in die Praxis erscheinen auf Basis dieser Studie die folgenden Punkte besonders wichtig: (1) Die wissenschaftlichen Befunde müssen so dargestellt werden, dass ihr Praxisbezug offen zu Tage tritt. (2) Sie müssen aktuelle Themen aufgreifen, (3) deutschsprachig publiziert werden und (4) leicht verfügbar sein.

We examined whether the Big Five personality dimensions and choice of reimbursement (participatin... more We examined whether the Big Five personality dimensions and choice of reimbursement (participating in a lottery for a coupon vs. personality feedback) were related to respondents' motivation to continue filling out an online survey. A total of 3,013 individuals took part in an online study that asked them to rate a number of items separated into different question blocks. Using discrete-time survival analysis (DTSA), we found that Openness, Agreeableness, Conscientiousness, and choosing to receive personality feedback had negative effects on dropout: They were related to a lower probability of quitting the survey. Furthermore, the effects of all four variables were mediated by satisfaction with the questionnaire in the previous question block. Practical implications for online research and implications regarding the role of personality in research participation in general are discussed.

Interacting with Computers, 2015

International Journal of Human-Computer Interaction, 2021

Mensch und Computer 2019 – Tagungsband, 2019

Technical Communication, 2017

Studies in Educational Evaluation, 2018

PeerJ, 2019

European Spine Journal, 2018

Human-Computer Interaction, 2018

Ergonomics, 2014

Interacting with Computers, 2015