Alex Kirlik | University of Illinois at Urbana-Champaign (original) (raw)

Papers by Alex Kirlik

Contents: M.A. Constas, R.J. Sternberg, Preface. Part I: Translation of Research and Theory in Co... more Contents: M.A. Constas, R.J. Sternberg, Preface. Part I: Translation of Research and Theory in Content Areas and Skill Domains. M.A. Constas, R.J. Sternberg, Part I Commentary. A. Schoenfeld, Notes on the Educational Steeplechase: Hurdles and Jumps in the Development of Research-Based Mathematics Instruction. S. Magnussen, A. Palincsar, The Application of Theory to the Design of Innovative Texts Supporting Science Instruction. J.M. Fletcher, B.R. Foorman, C.A. Denton, S. Vaughn, Scaling Research on Beginning Reading: Consensus and Conflict. R.C. Calfee, R.G. Mille, K. Norman, K. Wilson, G. Trainin, Learning to Do Educational Research. Part II: Translation of Theory and Research Into Practice in Large Scale Reform. M.A. Constas, R.J. Sternberg, Part II Commentary. R.E. Slavin, Translating Research Into Widespread Practice: The Case of Success for All. C. Finnan, H. Levin, Accelerated Schools and the Obstacles to School Reform. J. Comer, E. Joyner, Translating Theory and Research Into Practice Through the Yale Child Study Center School Development Program. E. Zigler, M.F. Stevenson, The School of the 21st Century. Part III: Translation of Theory and Research Into Educational Practice to Build Intellectual Capacity. M.A. Constas, R.J. Sternberg, Part III Commentary. R.J. Sternberg, D. Birney, L. Jarvin, A. Kirlik, S. Stemler, E.L. Grigorenko, From Molehill to Mountain: The Process of Scaling Up Educational Interventions (First-Hand Experience Upscaling the Theory of Successful Intelligence). J. Renzulli, Swimming Upstream in a Small River: Changing Conceptions and Practices About the Development of Giftedness. M. Kornhaber, H. Gardner, Multiple Intelligences: Developments in Implementation and Theory. Appendix: List of Contributors.

16th International Symposium on Aviation Psychology, 2011

... and Sheryl L. Miller 5 Supporting Situation Assessment through Attention Guidance and Diagnos... more ... and Sheryl L. Miller 5 Supporting Situation Assessment through Attention Guidance and Diagnostic Aiding: The Benefits and Costs of Display Enhancement on Judgment Skill 55 William J. Horrey, Christopher D. Wickens, Richard Strauss, Alex Kirlik, and Thomas R. Stewart ...

Proceedings of the Annual Meeting of the Cognitive Science Society, 2004

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting, Sep 1, 2012

One potentially useful concept that arises in the elicitation and aggregation of probabilistic fo... more One potentially useful concept that arises in the elicitation and aggregation of probabilistic forecasts is Hammond’s (1996) distinction between coherence and correspondence. A study was conducted to test the commonly held assumption that coherence competency, a judge’s ability to reason correctly according to the prescriptions demanded by the problem, directly yields correspondence competency, a judge’s ability to predict the outcome that actually happens in the external world. The role of a visualization aid in terms of moderating these effects was also examined. Participants who were knowledgeable baseball fans predicted the probability with which their favored team would win the 2011 Major League Baseball World Series, giving a prior probability shortly before the start of the Series, and then sequentially updating their answer as the individual games unfolded over time. Results show that for participants using the visualization, their ability to update probabilities according to the dictates of Bayes’ Theorem was correlated with their ability to predict the winner of the 2011 MLB Series – a desirable property that allows for estimation of judges’ outcome performance based on more readily available process information.

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting, Sep 1, 2004

We present a computational model of closed-loop, pilot-displays-aircraft system designed to evalu... more We present a computational model of closed-loop, pilot-displays-aircraft system designed to evaluate the impact of the addition of a synthetic vision system (SVS) to a commercial airliner cockpit. The NASA-run empirical study revealed that while pilots rarely looked out the window during most phases of approach and landing, they devoted a substantial proportion of their gaze toward the SVS. A model pilot implemented in ACT-R was connected to a commercial flight simulator package in an attempt to model pilots' attention allocation behaviors. Based on metrics such as transitions from one display to another, the model provides a good approximation to pilot behaviors and should allow us to perform virtual experiments on the impact of changes to the SVS.

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting, Sep 1, 2011

ABSTRACT Proper Bayesian reasoning is critical in a variety of domains that require practitioners... more ABSTRACT Proper Bayesian reasoning is critical in a variety of domains that require practitioners to make predictions about the probability of events contingent upon earlier actions or events. However, much research on judgment has shown that people who are unfamiliar with Bayes’ Theorem often reason quite poorly with conditional probabilities due to various cognitive biases. Owing to previous successes of visualization techniques for debiasing judges and improving judgment performance, we created an interactive computer visualization designed to aid Bayes-naïve people in solving conditional probability problems that would not require a training period to use, and would be flexible enough to accommodate many problem types. Results are suggestive that participants using our interactive visualization were able to substantially improve their Bayesian reasoning performance above that of previous debiasing methods. This finding has significant implications for expanding the toolbox of techniques that can be used to more accurately elicit predictions and forecasts from judges whose expertise lies beyond the realm of statistics.

Oxford University Press eBooks, Oct 1, 2009

... described as weak rapprochement, the lat-ter ecological modeling and integration represented ... more ... described as weak rapprochement, the lat-ter ecological modeling and integration represented strong ... conditions of the T-NASA2 experiments were observed to eliminate navigation errors almost ... finding that no errors were observed when the quality of information available to ...

Oxford University Press eBooks, Sep 30, 2010

Oxford University Press eBooks, Feb 12, 2013

said it best in his 1957 classic, Interpreting Our Heritage: "Interpretation addressed to childre... more said it best in his 1957 classic, Interpreting Our Heritage: "Interpretation addressed to children (say, up to the age of twelve) should not be a dilution of the presentation to adults, but should follow a fundamentally different approach. To be at its best it will require a separate program." How can you plan interpretive programs for those young people who will someday inherit the state parks legacy? Experienced interpreters say the first step is to approach life as a child: allow yourself to crawl about the ground on your knees, roll in the cleanliness of tide-washed sand, or examine at length the busy activity of an ant colony as the little creatures scurry back and forth. If you can find joy in these things, you are ready to attempt the second part of the interpretive process: sitting down and designing a Junior Ranger program that will provide both meaning and enjoyment for your young guests and a true sense of satisfaction for you. This handbook is a place to start. A Junior Ranger program can be a staff-led interpretive program, the Adventure Guide, a park-specific self-guided workbook, or webbased activities. Comments from parents and program participants favor the one-on-one interaction children receive during staff-led activities, but self-guided activities are a viable option and can be just as beneficial. Consider what your park has to offer and be creative when you are planning a Junior Ranger program. This guide has been developed as a reference tool for preparing and leading Junior Ranger programs. Almost all of the subject sections presented in the handbook include the following: Interesting Facts These are bits of trivia you can use in your talk to help get the Junior Rangers interested in the subject.

Human speech often contains ambiguity stemming from the use of demonstrative pronouns (DPs), such... more Human speech often contains ambiguity stemming from the use of demonstrative pronouns (DPs), such as “this” and “these.” While we can typically decipher which objects of interest DPs are referring to based on context, modern day voice assistants (VAs – such as Google Assistant and Siri) are yet unable to process queries containing such ambiguity. For instance, to humans, a question such as “how much is this?” can be clarified through visual reference (e.g., a buyer gestures to the seller the object they would like to purchase). To bridge this gap between human and machine cognition, we built and examined a touch + voice multimodal VA prototype that enables users to select key spatial information to embed as context and query the VA. The prototype converts results of mobile, real-time object recognition and optical character recognition models into augmented reality buttons that represent features. Users can interact with and modify the selected features through a word grid. We conducted a study to investigate: 1) how touch performs as an additional modality to resolve ambiguity in queries, 2) how users use DPs when interacting with VAs, and 3) how users perceive a VA that can understand DPs. From this procedure we found that as the query becomes more complex, users prefer the multimodal VA over the standard VA without experiencing elevated cognitive load. Additionally, even though it took some time getting used to, many participants eventually became comfortable with using DPs to interact with the multimodal VA and appreciated the improved human-likeness of human-VA conversations.

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting, Sep 1, 2005

In contrast to many studies revealing biases in the probabilistic judgments of task-naïve partici... more In contrast to many studies revealing biases in the probabilistic judgments of task-naïve participants, a growing body of literature has revealed that over time, professionals are able to gain a reasonably accurate appreciation for the inherent uncertainty that exists in their work environments. The present study assessed how well experienced (working) air traffic controllers are able to predict the probability of the loss of separation between a pair of converging aircraft. Sixteen controllers expressed probabilistically whether or not the depicted pair of aircraft would lose separation. The actual probability of conflict was manipulated by varying the time differential between when each pair of aircraft would reach the point of potential conflict, coupled with uncertainty due to wind perturbations. Results revealed that in instances where perceptual information was available to distinguish between conflicts and non-conflicts, the difference between the actual conflict probability and the mean of the controllers' judged probabilities of conflict was minimal, highlighting the high calibration level of these domain experts at an aggregate level.

Pennsylvania State University where she holds the James F. Will Career Development Professorship.... more Pennsylvania State University where she holds the James F. Will Career Development Professorship. She received her Ph.D. in industrial engineering from the University of Illinois and her M.S. and B.S. in industrial engineering from the University of Nebraska.

Applied Cognitive Psychology, 2001

Cognitive psychology is approaching its fortieth anniversary. In this rela-tively short period, t... more Cognitive psychology is approaching its fortieth anniversary. In this rela-tively short period, the field has seen immense growth, and specialization into various subdomains like research on memory, problem solving, atten-tion, and language acquisition. Moreover, cognitive ...

The Oxford Handbook of Expertise

This chapter provides an introduction to and overview of both foundational and contemporary resea... more This chapter provides an introduction to and overview of both foundational and contemporary research using computational modeling to aid in the scientific understanding of human expertise. The authors note the distinction between computational models constructed within some molar or unified cognitive architecture and models that are more domain or task specific in their psychological assumptions, and present numerous examples of each type. The authors also provide their assessment of this body of research, one that highlights the need for extensive analysis, and even expert-level knowledge of both tasks and the environments in which expert behavior is manifest as a key requirement for successfully modeling high levels of skill or expert performance. Finally, the authors provide their thoughts about promising future directions for research using computational modeling, together with other emerging methodological techniques such as neuroimaging, to provide a comprehensive approach to ...

Crew information processing and decision making in a supervisory control task which is loosely ba... more Crew information processing and decision making in a supervisory control task which is loosely based on the mission of future generation helicopters is measured and represented. Subjects control the motion and activities of their own vehicle and direct the activities of four additional craft. The task involves searching an uncertain environment for cargo and enemies, returning cargo to home base and destroying enemies while attempting to avoid destruction of the scout and the supervised vehicles. A series of experiments with two-person crews and one-person crews were performed. Resulting crew performance was modeled with the objective of describing and understanding the information processing strategies utilized. Of particular interest are problem simplification strategies under time stress and high work load, simplification and compensation in the one-person cases, crew coordination in the two-person cases, and the relationship between strategy and errors in all cases. The results ...

Mechanical Engineering, 2016

This article demonstrates a multidisciplinary approach that proposes to augment future caregiving... more This article demonstrates a multidisciplinary approach that proposes to augment future caregiving by prolonged independence of older adults. The human–robot system allows the elderly to cooperate with small flying robots through an appropriate interface. ASPIRE provides a platform where high-level controllers can be designed to provide a layer of abstraction between the high-level task requests, the perceptual needs of the users, and the physical demands of the robotic platforms. With a robust framework that has the capability to account for human perception and comfort level, one can provide perceived safety for older adults, and further, add expressively that facilitates communication and interaction continuously throughout the stimulation. The proposed framework relies on an iterative process of low-level controllers design through experimental data collected from psychological trials. Future work includes the exploration of multiple carebots to cooperatively assist in caregiving...