Human multi-modal spatial cognition, spatial orientation, and navigation Research Papers (original) (raw)
During the last decades, many cognitive architectures (CAs) have been realized adopting different assumptions about the organization and the representation of their knowledge level. Some of them (e.g. SOAR [35]) adopt a classical symbolic... more
During the last decades, many cognitive architectures (CAs) have been realized adopting different assumptions about the organization and the representation of their knowledge level. Some of them (e.g. SOAR [35]) adopt a classical symbolic approach, some (e.g. LEABRA[48]) are based on a purely con-nectionist model, while others (e.g. CLARION [59]) adopt a hybrid approach combining connectionist and symbolic representational levels. Additionally, some attempts (e.g. biSOAR) trying to extend the representational capacities of CAs by integrating diagrammatical representations and reasoning are also available [34]. In this paper we propose a reflection on the role that Conceptual Spaces, a framework developed by Peter Gärdenfors [24] more than fifteen years ago, can play in the current development of the Knowledge Level in Cognitive Systems and Architectures. In particular, we claim that Conceptual Spaces offer a lingua franca that allows to unify and generalize many aspects of the symbolic, sub-symbolic and diagrammatic approaches (by overcoming some of their typical problems) and to integrate them on a common ground. In doing so we extend and detail some of the arguments explored by Gärdenfors [23] for defending the need of a conceptual, intermediate, representation level between the symbolic and the sub-symbolic one. In particular we focus on the advantages offered by Conceptual Spaces (w.r.t. symbolic and sub-symbolic approaches) in dealing with the problem of compositionality of representations based on typicality traits. Additionally, we argue that Conceptual Spaces could offer a unifying framework for interpreting many kinds of diagrammatic and analogical representations. As a consequence, their adoption could also favor the integration of diagrammatical representation and reasoning in CAs.
Persistence and change are necessary for the stability and development of both the human individual and the human society, since the beginnings of human history. Man needs a static framework, which, related to his self-awareness, defines... more
Persistence and change are necessary for the stability and development of both the human individual and the human society, since the beginnings of human history. Man needs a static framework, which, related to his self-awareness, defines a topocentric system of perception, evaluation, order, and meaning. He also requires a dynamic impetus, which allows exceeding the limits of special world views, shifting of perspectives and transformations of individual as well as social approaches to life. Travelling especially helped to broaden man’s horizon and mind. Accross cultures voyages guided by the skies are linked with practical concepts of exploring and domesticating time and space, but also figuratively with the life’s journey and with other worlds, being expressed by mythic, ritual and later scientific language.
Grammatical aspect is known to shape event understanding. However, little is known about how it interacts with other important temporal information, such as recent and distant past. The current work uses computer-mouse tracking (Spivey et... more
Grammatical aspect is known to shape event understanding. However, little is known about how it interacts with other important temporal information, such as recent and distant past. The current work uses computer-mouse tracking (Spivey et al.,2005) to explore the interaction of aspect and temporal context. Participants in our experiment listened to past motion event descriptions that varied according to aspect (simple past,past progressive) and temporal distance (recent past,distant past) while viewing scenes with paths and implied destinations. Participants used a computer mouse to place characters into the scene to match event descriptions. Our results indicated that aspect and temporal context interact in interesting ways. When aspect placed emphasis on the ongoing details of the event and the temporal context was recent( thus, making fine details available in memory), this match between conditions elicited smoother and faster computer mouse movements than when conditions mismatched. Likewise, when aspect placed emphasis on the less detailed end state of the event and temporal context was in the distant past (thus,making fine details less available), this match between conditions also elicited smoother and faster computer mouse movements.
Try this simple experiment: close your eyes tightly, stand up, and walk to the other side of the room and back.You have just simulated for yourself what it is like to be blind. Well, not quite: there are several importantfactors missing.... more
Try this simple experiment: close your eyes tightly, stand up, and walk to the other side of the room and back.You have just simulated for yourself what it is like to be blind. Well, not quite: there are several importantfactors missing. Firstly, you knew all along that you could open your eyes at any minute if you ran into trouble(e.g., a large hard obstacle). A blind person does not have that option for recovering from a mistake.Secondly, you almost certainly used your visually derived mental 'map' of the room's layout to guide you.Think how much harder it would have been to do the same thing in an unfamiliar room. Thirdly, you drew on aset of spatial concepts and orientation skills developed across your life-span that involved vision as a major unifying sense; the very first time you, as an infant, watched your hand as you reached out for an object, youwere already learning about space through vision.Even this experiment hardly brings you close to the everyday experience of someone who is totally,congenitally blind. Such a person has no visual memories of particular spaces, and has had no direct visual input into the development of their spatial understanding in general. Their experience of space comes fromhearing, touch and movement, and yet they can engage in pretty much all the activities that a sighted personcan. How is this possible when we, as sighted people, place so much importance on visual experience in our lives? Through theories and research in cognitive psychology and behavioural geography, this chapter willexplore the way(s) in which blind people experience and represent space. The first section will trace thehistory of thinking on the subject, the second will assess current work while the third will look to the future.
The development of teaching methods adapted to the new European Higher Education Area requires a review and updating of content and learning methodologies. In this sense, our work addresses the task of studying a learning environment... more
The development of teaching methods adapted to the new European Higher
Education Area requires a review and updating of content and learning methodologies. In
this sense, our work addresses the task of studying a learning environment based on new
Information Technology and Communication in the geographic area: the INSPIRE geoportal
(Infrastructure for Spatial Information in Europe: SDI). The cartography, maps and street plan
are an activity field where spatial orientation abilities are used. The aim of this research ...
This paper reports a study of how familiarity and gender may influence the frames of reference used in memory to represent a real-world regularly shaped environment. Familiar and unfamiliar participants learned the locations of three... more
This paper reports a study of how familiarity and gender may influence the frames of reference used in memory to represent a real-world regularly shaped environment. Familiar and unfamiliar participants learned the locations of three triads of buildings by walking on a path which encircled each triad. Then they were shown with maps reproducing these triads at five different orientations (from 0° to 180°) and had to judge whether each triad represented correctly the relative positions between the buildings. Results showed that unfamiliar participants performed better when the orientation of triads was closer to the learning perspective (0° and 45°) and corresponded to front rather than to back positions. Instead, familiar participants showed a facilitation for triads oriented along orthogonal axes (0°–180°, 90°) and no difference between front and back positions. These findings suggested that locations of unfamiliar buildings were mentally represented in terms of egocentric frames of reference; instead, allocentric frames of reference defined by the environment were used when the environment was familiar. Finally, males were more accurate and faster than females, and this difference was particularly evident in participants unfamiliar with the environment.
The aim of this study was to assess the impact of a wind farm on individuals by means of an audio-visual methodology that tried to simulate biologically plausible individual–environment interactions. To disentangle the effects of auditory... more
The aim of this study was to assess the impact of a wind farm on individuals by means of an audio-visual methodology that tried to simulate biologically plausible individual–environment interactions. To disentangle the effects of auditory and visual components on cognitive performances and subjective evaluations, unimodal (Audio or Video) and bimodal (Audio + Video) approaches were compared. Participants were assigned to three experimental conditions that reproduced a wind farm by means of an immersive virtual reality system: bimodal condition, reproducing scenarios with both acoustic and visual stimuli; unimodal visual condition, with only visual stimuli; unimodal auditory condition, with only auditory stimuli. While immersed in the virtual scenarios, participants performed tasks assessing verbal fluency, short-term verbal memory, backward counting, and distance estimations (egocentric: how far is the turbine from you?; allocentric: how far is the turbine from the target?). Afterwards, participants reported their degree of visual and noise annoyance. The results revealed that the presence of a visual scenario as compared to the only availability of auditory stimuli may exert a negative effect on resource-demanding cognitive tasks but a positive effect on perceived noise annoyance. This supports the idea that humans perceive the environment holistically and that auditory and visual features are processed in close interaction.
There is a substantial and growing interest in immersive virtual spaces as contexts for 21st century skills like problem solving, communication, and collaboration. However, little consideration has been given to the ways in which users... more
There is a substantial and growing interest in immersive virtual spaces as contexts for 21st century skills like problem solving, communication, and collaboration. However, little consideration has been given to the ways in which users become proficient in these environments or what types of target behaviors are associated with 21st century skills. As a result, this exploratory study (n = 16) applied systematic direct observations to examine differences in expert and novice behaviors as they interact within the World of Warcraft (WoW). Trend analyses showed clear differences associated with the user’s level of expertise. In addition, significant differences were found in variables associated with social and spatial attunement to WoW across three points in time. Based on these findings, researchers discuss implications associated with 21st century skills, broader educational applications of these findings, and future avenues for research.
Multimodality studies consider the ways semiotic resources besides language can facilitate “meaning making” in communicative situations. Alison Gibbons and Wolfgang Hallet, among others, adopt multimodality studies as a framework for... more
Multimodality studies consider the ways semiotic resources besides language can facilitate “meaning making” in communicative situations. Alison Gibbons and Wolfgang Hallet, among others, adopt multimodality studies as a framework for literary analysis, calling attention to a growing corpus of novels in which various design features (such as layout) and semiotic systems (such as pictures or maps) offer experiences that are not linguistically shaped. They observe that these additional modal and material resources can strengthen or weaken what readers infer from the written words in the novels. This article, however, traces the cognitive and perceptual processes triggered by the use of handwriting as a form of inscription in J.J. Abrams and Doug Dorst’s novel S. (2013) to highlight how even the presentation of language in multi-modal literature can engender experiences that exceed linguistic comprehension. Thus the article argues that if studies of multimodality in literature intend to subvert “language-based” thinking, they need to move past the preoccupation with meaning making and also recognize those embodied experiences afforded by literary texts that do not seem to significantly modify the linguistic meaning.
Three experiments investigated whether the similarity of relational structures influences the interpretation of spatial representations. Adults were shown diagrams of hand gestures paired with simple statements and asked to judge the... more
Three experiments investigated whether the similarity of relational structures influences the interpretation of spatial representations. Adults were shown diagrams of hand gestures paired with simple statements and asked to judge the meaning of new gestures. In Experiment 1 the gestures were paired with active declarative statements. In Experiment 2, the gestures were paired with conjunctive and disjunctive relations.
The U.S. Census Bureau hires thousands to verify addresses decennially in the United States, an endeavor that stands to benefit from a variety of tools. Software tailored to support location-based tasks constitutes one such tool. In the... more
The U.S. Census Bureau hires thousands to verify addresses decennially in the United States, an endeavor that stands to benefit from a variety of tools. Software tailored to support location-based tasks constitutes one such tool. In the case of the Census Bureau, this software requires workflows to disposition residences and related location-based interests. As a first step in location-based software design, we aim to better understand how users with different cognitive abilities approach location-based tasks. This paper discusses an exploratory study in which college students were given a paper map and asked to verify a set of six residential addresses. This approach, as opposed to using a modern handheld device, allowed us to collect data unconstrained by a specific hardware or software configuration. The study methodology and results are discussed.
Navigation systems are in common use by drivers and typically present information using either audio or visual representations. However, there are many pressures on the driver's cognitive systems in a car and navigational systems can add... more
Navigation systems are in common use by drivers and typically present information using either audio or visual representations. However, there are many pressures on the driver's cognitive systems in a car and navigational systems can add to this complexity. In this paper, we present two studies which investigated how vibro-tactile representations of navigational information, might be presented to the driver via the steering wheel to ameliorate this problem. Our results show that adding tactile information to existing audio, or particularly visual representations, can improve both driving performance and experience.
Survey organizations rely on data that must be collected in the field. In such situations, a field worker makes decisions that are influenced both by their location and the nature of the data they are collecting. As we understand more... more
Survey organizations rely on data that must be collected in the field. In such situations, a field worker makes decisions that are influenced both by their location and the nature of the data they are collecting. As we understand more about how individual differences affect surveyors, we are better able to tailor tools to these differences. Individual differences research has shown that spatial ability is a primary factor of computer user performance. Surveyors such as those deployed by the United States Census Bureau must make decisions that are dependent on geographic position and orientation, further relying on spatial ability. Our prior research has tied survey performance during an address verification task to spatial ability and highlights the differences of approach between participants of high and low spatial ability classifications. The current work examines the impacts of spatial ability with regard to decision-making during an address verification task.
The current study applied a rodent-based Morris water maze (MWM) protocol to an investigation of search performance differences between young and older adult humans. To investigate whether similar age-related decline in search performance... more
The current study applied a rodent-based Morris water maze (MWM) protocol to an investigation of search performance differences between young and older adult humans. To investigate whether similar age-related decline in search performance could be seen in humans based on the rodent-based protocol, we implemented a virtual MWM (vMWM) that has characteristics similar to those of the MWM used in previous studies of spatial learning in mice. Through the use of a proximity to platform measure, robust differences were found between healthy young and older adults in search performance. After dividing older adults into good and poor performers based on a median-split of their corrected cumulative proximity (CCProx) values, the age effects in place learning were found to be largely related to search performance differences between the young and poor-performing older adults. When compared to the young, poor-performing older adults exhibited significantly higher proximity values in 83% of 24 place trials and overall in the probe trials that assessed spatial learning in the absence of the hidden platform. In contrast, good-performing older adults exhibited patterns of search performance that were comparable to that of the younger adults in most place and probe trials. Taken together, our findings suggest that the low search accuracy in poor-performing older adults stemmed from potential differences in strategy selection, differences in assumptions or expectations of task demands, as well as possible underlying functional and/or structural changes in the brain regions involved in vMWM search performance. [To access the paper, click on the URLs]
- by Jimmy Y Zhong, PhD and +2
- •
- Neuroscience, Psychology, Cognitive Psychology, Perception