Digital Fabrication Using Mixed Reality Technology (original) (raw)
Related papers
A Mixed Reality for Virtual Assembly
26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN2017), 2017
— Mixed reality (MR) is a hybrid reality where real and virtual objects are merged to produce an enriched interactive environment. Virtual Reality (VR) has been used in the simulation of production processes such as the product assembly and the execution of industrial tasks. Augmented reality (AR) has been widely used as an instructional tool to help the user to perform the task in real world conditions. Most of these works were focused on solving technical problems, specific to the type of application but they did not take advantage of the achievements realized in both VR and AR technologies. This paper presents a mixed reality system that integrates virtual assembly environment with augmented reality. This approach is mainly based on the development of a hybrid tacking system for the synchronization of the virtual and the real hand of the user. The evaluation of this Mixed Reality approach showed a statistically significant improvement of the user performance in the assembly task execution, compared to the task realized in virtual environment.
Assembly of the Virtual Model with Real Hands Using Augmented Reality Technology
Lecture Notes in Computer Science, 2014
In the past few years, studying in the field of Augmented Reality (AR) has been expanded from technical aspect such as tracking system, authoring tools and etc. to applications ranging from the fields of education, entertainment, medicine to manufacturing. In manufacturing, which relies on assembly process, AR is used for assisting staffs in the field of maintenance and assembly. Usually, it has been used as a guidance system, for example using graphical instructions for advising the users with the steps in performing the maintenance or assembly operation. In assembly training, especially for small, expensive or harmful devices, interactive technique using real hands may be suitable than the guiding technique. Using tracking algorithm to track both hands in real time, interaction can occurs by the execution of grasp and release gestures. Bare hand tracking technique, which uses gesture recognition to enable interaction with augmented objects are also possible. In this paper, we attempted to use marker based AR technique to assemble 3D virtual objects using natural hand interaction. By applying the markers to fit on fingertip and assigned the corresponding virtual 3D finger that have physical properties such as surface, volume, density, friction and collision detection properties to them, interaction between fingers and objects could be executed. This setup was designed on a PC based system but could be ported to iOS or Android, so that it would work on tablet or mobile phones as well. Unity 3D game engine was used with Vuforia AR platform. In order to grab and move the virtual object by hand, the shape of the virtual finger (Vulforia's target) has been investigated. Appropriate friction coefficient were applied to both virtual fingers and the object and then at least two virtual fingers were force to press on the 3D virtual object in opposite directions so that frictional force is more than gravitational force. To test this method, virtual model of LEGO's mini-figures which composed of five pieces, was used and the assembly could be done in just a short time. Comparing with other popular technique such as "gestures recognition", we have found that our technique could provide more efficient result in term of cost and natural feeling.
Mixed Reality for Mechanical Design and Assembly Planning
Cornell University - arXiv, 2022
Design for Manufacturing and Assembly (DFMA) is a crucial design stage within the heavy vehicle manufacturing process that involves optimising the order and feasibility of the parts assembly process to reduce manufacturing complexity and overall cost. Existing work has focused on conducting DFMA within virtual environments to reduce manufacturing costs, but users are less able to relate and compare physical characteristics of a virtual component with real physical objects. Therefore, a Mixed Reality (MR) application is developed for engineers to visualise and manipulate assembly parts virtually, conduct and plan out an assembly within its intended physical environment. Two pilot evaluations were conducted with both engineering professionals and nonengineers to assess effectiveness of the software for assembly planning. Usability results suggest that the application is overall usable (M=56.1, SD=7.89), and participants felt a sense of involvement in the activity (M=13.1, SD=3.3). Engineering professionals see the application as a useful and cost-effective tool for optimising their mechanical assembly designs.
Augmented Reality in Manual Assembly Processes
2020
Augmented Reality (AR) is a novel technology that projects virtual information on the real world environment. With the increased use of Industry 4.0 technologies in manufacturing, AR has gained momentum across various stages of product life cycle. AR can benefit production operators in many manufacturing tasks such as quality inspection, work instructions for manual assembly, maintenance, and in training. This research presents not only a typical architecture of an AR system but also both its software and hardware functions. The architecture is then applied to display virtual assembly instructions in the form of 3D animations on to the real world environment. The chosen assembly task in this research is to assemble a planetary gearbox system. The assembly instructions are displayed on a mobile device targeting a static tracker placed in the assembly environment
IEEE Access, 2020
This paper presents Interact , a cyber-physical system that enables real-time interaction with real and virtual objects in a mixed reality environment to design 3D models for additive manufacturing. The system has been developed using mixed reality technologies such as HoloLens, for augmenting visual feedback, and haptic gloves, for augmenting haptic force feedback. The efficacy of the system has been demonstrated by generating a 3D model using a novel scanning method to 3D print a customized orthopedic cast for human arm, by estimating spring rates of compression springs, and by simulating interaction with a virtual spring in a mixed reality environment. INDEX TERMS Additive manufacturing, cyber-physical system, haptics, human-computer interaction, mixed reality.
Manual tasks play an important role in social sustainable manufacturing enterprises. Commonly, manual operations are used for low volume productions, but are not limited to. Operational models in manufacturing systems based on “x-to-order” paradigms (e.g. assembly-to-order) may require manual operations to speed-up the ramp-up time of new product configuration assemblies. The implications of manual operations in any production line may imply that any manufacturing or assembly process become more susceptible to human errors and therefore translate into delays, defects and/or poor product quality. In this scenario, virtual and augmented realities can offer significant advantages to support the human operator in manual operations. This research work presents the development of a mixed (virtual and augmented) reality assistance system that permits real-time support in manual operations. A review of mixed reality techniques and technologies was conducted, where it was determined to use a...
2012
Nowadays, the industrial sector and specially manufacturing companies, have a huge challenge trying to train the workforce while maintaining up to date with the technology, machinery and manufacturing techniques involved in the production process. For that reason this sector claims for effective, in time and quality, training methodologies that do not interrupt or interfere with the continuous workflow of the company or its technological evolution.
Use of Augmented Reality in Assembly Process
SAR Journal - Science and Research
Intensive research is currently underway into the concept of intelligent assembly, which integrates production processes, people, hardware and information using both real and virtual methods to achieve significant improvements in productivity, delivery time and combined market turnover. This paper describes the use of augmented reality in the assembly process at the workplace, which by integrating hardware and software equipment will enable an innovative assembly workplace for a manufacturing and development company. The assembly workplace will speed up and facilitate assembly and prevent the creation of failures and restrictions during assembly.
Human–machine collaboration using gesture recognition in mixed reality and robotic fabrication
Architectural intelligence, 2024
This research presents an innovative approach that integrated gesture recognition into a Mixed Reality (MR) interface for human-machine collaboration in the quality control, fabrication, and assembly of the Unlog Tower. MR platforms enable users to interact with three-dimensional holographic instructions during the assembly and fabrication of highly custom and parametric architectural constructions without the necessity of two-dimensional drawings. Previous MR fabrication projects have primarily relied on digital menus and custom buttons within the interface for user interaction between virtual and physical environments. Despite this approach being widely adopted, it is limited in its ability to allow for direct human interaction with physical objects to modify fabrication instructions within the virtual environment. The research integrates user interactions with physical objects through real-time gesture recognition as input to modify, update, or generate new digital information. This integration facilitates reciprocal stimuli between the physical and virtual environments, wherein the digital environment is generative of the user's tactile interaction with physical objects. Thereby providing user with direct, seamless feedback during the fabrication process. Through this method, the research has developed and presents three distinct Gesture-Based Mixed Reality (GBMR) workflows: object localization, object identification, and object calibration. These workflows utilize gesture recognition to enhance the interaction between virtual and physical environments, allowing for precise localization of objects, intuitive identification processes, and accurate calibrations. The results of these methods are demonstrated through a comprehensive case study: the construction of the Unlog Tower, a 36' tall robotically fabricated timber structure.
Augmented reality system for aiding engineering design process of machinery systems
Journal of Systems Science and Systems Engineering, 2011
The paper presents the application of augmented reality for aiding product design and development of machinery systems. Augmented reality technology integrates an interactive computer-generated word with an interactive real word in such a way that they appear as one environment. AR technology can enhance a user's perception of the real world with information that is not actually part of the scene but is relevant to the user's present activity. Presented in the AR system is a mode for changing views of data-especially 3D models-allowing the user to understand the prospective machinery system in a more comprehensive way, thus making the design process more efficient than the one supported by conventional present-day CAD systems. The presented prototype system contains an expert system integrated with AR system and allows the delivering of knowledge to the designer about successive steps of the design process of a mobile robot and practical solutions of realized constructional problems. An approach concerning AR enables the system user to analyze and verify solutions (represented as 3D models) relative to real scenes/objects. This approach is advantageous because the real environment around us often provides a vast amount of information that is difficult to duplicate in a computer. In some cases, the application of an AR system could be an optimal way to verify developed products.