WISE - CISA Theses Overview 2023-2024 (original) (raw)
Related papers
Using mixed-reality to develop smart environments
Smart homes, smart cars, smart classrooms are now a reality as the world becomes increasingly interconnected by ubiquitous computing technology. The next step is to interconnect such environments; however there are a number of significant barriers to advancing research in this area, most notably the lack of available environments, standards and tools etc. A possible solution is the use of simulated spaces; nevertheless as realistic as strive to make them, they are, at best, only approximations to the real spaces, with important differences such as utilising idealised rather than noisy sensor data. In this respect, an improvement to simulation is emulation, which uses specially adapted physical components to imitate real systems and environments. In this paper we present our work-in-progress towards the creation of a development tool for intelligent environments based on the interconnection of simulated, emulated and real intelligent spaces using a distributed model of mixed reality. To do so, we propose the use of physical/virtual components (xReality objects) able to be combined through a 3D graphical user interface, sharing real-time information. We present three scenarios of interconnected real and emulated spaces, used for education, achieving integration between real and virtual worlds.
The ever evolving range of user centric technology promises new and exciting applications which will permeate society and change the very nature of our social interaction. The increasing demand of collating our physical and digital lives is putting pressure on companies to come up with innovative products. Companies have to plan far ahead into the future, despite lacking the technological infrastructure. In this paper we describe the goal of a research project that, together with Intel, is investigating tools and methodologies which would allow companies to plan into the future by building online virtual prototypes. Real users, from different domains, would use these virtual prototypes to test different aspects and attributes of these potential products to provide relevant user-experience feedback. The feedback would be recorded in an automated and intelligent manner to improve the design. Developing prototypes in such mixed reality environments would enable the involvement of end users from early on. We believe such an approach would allow for better design innovation by providing mechanisms for collaborative research and development across distributed geographical locations. This short work-in-progress-paper will describe the concepts underpinning this research direction.
When Mixed Reality Meets Internet of Things
GetMobile: Mobile Computing and Communications, 2018
From panoramic paintings and stereoscopic photos in the early 19th century, there has been a centurylong effort to realize mixed reality, interweaving real and virtual worlds that interact with each other. Recently, over the past few years, we have witnessed the first wave of "affordable" mixed reality platforms, such as Oculus Rift and Microsoft HoloLens hitting the market. In particular, 2017 was the showcase year of mixed reality technologies: The Academy awarded its first Oscar to virtual reality storytelling1; AAA caliber virtual reality games started to hit the market with impacts2. Furthermore, major mobile operating systems, including Android and iOS, began to support augmented reality at the platform level (e.g., Android ARCore, Apple ARKit). Looking down the road, a recent forecast by Orbis Research projects over $40 billion mixed reality market worldwide by 20203.
2021
The internet-of-things (IoT) refers to the growing number of embedded interconnected devices within everyday ubiquitous objects and environments, especially their networks, edge controllers, data gathering and management, sharing, and contextual analysis capabilities. However, the IoT suffers from inherent limitations in terms of human-computer interaction. In this landscape, there is a need for interfaces that have the potential to translate the IoT more solidly into the foreground of everyday smart environments, where its users are multimodal, multifaceted, and where new forms of presentation, adaptation, and immersion are essential. This work highlights the synergetic opportunities for both IoT and XR to converge toward hybrid XR objects with strong real-world connectivity, and IoT objects with rich XR interfaces. The paper contributes i) an understanding of this multidisciplinary domain XR-IoT (XRI); ii) a theoretical perspective on how to design XRI agents based on the literature; iii) a system design architectural framework for XRI smart environment development; and iv) an early discussion of this process. It is hoped that this research enables future researchers in both communities to better understand and deploy hybrid smart XRI environments.
Imagine Space Fused with Data a Model for Mixed Reality Architecture
2001
The paper presents a conceptual model of a Mixed Reality architecture by the fusion of physical and digital space exemplified with the Murmuring Fields scenario. The concept of spatial perception is supported by perceptive interfaces superimposing different levels of reality. This situation shapes the performers experience of being present in Mixed Reality space by acting. The structure of this Mixed Reality architecture is a notation system describing layers of physical and digital space for a hypermedia storybook. The interconnected space creates a new framework for communication and interaction. To this end, the result is eMUSE, electronic Multi-user stage environment for rapid prototyping of Mixed Reality architectures. 1. Envisioning Mixed Reality Imagine space fused with data. Imagine data representing a tangible situation. The underlying paradigm of Mixed Reality (MR) is that of an information space merging components of physical and digital information. The metaphor we use f...
Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction
There is an increasing interest in the HCI research community to design richer user interactions with the Internet of Things (IoT). This studio will allow exploring the design of tangible interaction with the IoT, what we call Internet of Tangibles. In particular, we aim at investigating the full interaction-attention continuum, with the purpose of designing IoT tangible interfaces that can switch between peripheral interactions that do not disrupt everyday routines, and focused interactions that support user's reflections. This investigation will be conducted through hands-on activities where participants will prototype tangible IoT objects, starting by a paper prototyping phase, supported by design cards, and followed by an Arduino prototype phase. The purpose of the studio is also establishing a community of researchers and practitioners, from both academy and industry, interested in the field of tangible interaction with the Internet of Things.
Towards an Accessible Platform for Multimodal Extended Reality Smart Environments
Information
This article presents the DEMOS prototype platform for creating and exploring multimodal extended-reality smart environments. Modular distributed event-driven applications are created with the help of visual codeless design tools for configuring and linking processing nodes in an oriented dataflow graph. We tested the conceptual logical templates by building two applications that tackle driver arousal state for safety and enhanced museum experiences for cultural purposes, and later by evaluating programmer and nonprogrammer students’ ability to use the design logic. The applications involve formula-based and decision-based processing of data coming from smart sensors, web services, and libraries. Interaction patterns within the distributed event-driven applications use elements of mixed reality and the Internet of Things, creating an intelligent environment based on near-field communication-triggering points. We discuss the platform as a solution to bridging the digital divide, anal...
Mixed Reality Architecture: Concept, Construction, Use, Technical Report
Mixed Reality Architecture (MRA) dynamically links and overlays physical and virtual spaces. This paper investigates the topology of and the relationships between the components of MRA. As a phenomenon, MRA takes its place in a long history of technologies that have influenced conditions for social interaction as well as the environment we build around us. However, by providing a flexible spatial topology spanning physical and virtual environments it presents new opportunities for social interaction across electronic media. An experimental MRA is described that allowed us to study some of the emerging issues in this field. It provided material for the development of a framework describing virtual and physical spaces, the links between those and the types of mixed reality structure that we can envisage it being possible to design using these elements. We propose that by re-introducing a level of spatiality into communication across physical and virtual environments MRA will support everyday social interaction, and may convert digital communication media from being socially conservative to a more generative form familiar from physical space.
Towards a Sustainable Future: Ubiquitous Knowledge Mixed Reality Museum
Procedia Computer Science, 2020
An Intelligent Museum built under the Ubiquitous Computing paradigm, where services follow the user seamlessly across different environments, emerges as a new type of digital institution present beyond its physical limits: the Ubiquitous Museum. Mixed Reality provides the means of harvesting knowledge from memory institutions and smart devices connected to the Internet of Things. At the same time, it enables embedding multimodal contents from the Museum across the Intelligent Environment. We research the user experience of knowledge dissemination through the Ubiquitous Museum. We exemplify how our work aims to help achieve this. We also discuss how using embedded Museum contents helps sustainable development.
Prototyping Distributed Physical User Interfaces in Ambient Intelligence Setups
Distributed, Ambient, and Pervasive Interactions, 2014
Ambient Intelligence systems require the development of highly customized distributed UIs adapted to the user and environment characteristics. They make use of many different devices, from different manufacturers, technologies and modalities. Supporting this wide variety of devices and technologies increases the complexity of a system, affecting its costs and development time. The objective of Dandelion, the solution presented in this paper, is to alleviate this complexity and reduce development costs. Dandelion provides a development framework for distributed physical UIs. It is capable of decoupling the system logic from the characteristics and specifics of the interaction devices, and supports the easy prototyping of different physical realizations of a distributed UI.