Philipp Klimant - Academia.edu (original) (raw)
Papers by Philipp Klimant
2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2020
Maintenance departments of producing companies in most industrial countries are facing challenges... more Maintenance departments of producing companies in most industrial countries are facing challenges originating from an aging workforce, increasing product variety, and the pressure to increase productivity. We present the concepts and the user interface (UI) designs for two Augmented Reality (AR) applications, which help to tackle these issues. An AR Guidance System will allow new and unexperienced staff to perform medium to highly complex maintenance tasks, which they currently incapable to. The AR Remote Service System enables technicians at the machine to establish a voice/video stream with an internal or external expert. The video stream can be augmented with 3D models and drawings so that problems can be solved remotely and more efficiently. A qualitative assessment with maintenance managers and technicians from three producing companies rated the AR application concept as beneficial and the UI designs as very usable.
2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2021
Access to machine data, e.g. axis positions inside an AR maintenance application can potentially ... more Access to machine data, e.g. axis positions inside an AR maintenance application can potentially increase the usefulness of AR in maintenance. Technicians walking to the machine control for looking up information would be avoided. However, the machine control interface and data are machine manufacturer depended, making it necessary to customize the interface between the machine control and the AR maintenance application. Here, we present a solution integrating machine control access from three different machines using a middleware box. A qualitative assessment with technicians confirms the usefulness direct machine data access from an AR maintenance application.
Procedia CIRP, 2021
The design of cyber physical systems in today’s production and intralogistics is influenced by th... more The design of cyber physical systems in today’s production and intralogistics is influenced by the increasing availability and exchange of data. On the one hand, synergies between connected systems can be used to develop lightweight applications by sharing and reusing data. On the other hand, the possible combinations between these systems increase the complexity and design options. This paper presents a method to structure possible design options systematically and proposes virtual commissioning as solution for their analysis and verification to enable early design decisions. The method is demonstrated using an automated guided vehicle combined with a tactile warning device.
2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), 2017
Connecting third party systems like machine controls and product data management systems with Aug... more Connecting third party systems like machine controls and product data management systems with Augmented Reality (AR) support applications is crucial for their industrial success. We present a marketing use case of a Virtual Press demonstrator where the connection to a machine control was successfully implemented. The realization of this application utilized the AR framework ARViewer that is introduced in this paper. Subsequent, an outlook is given how this framework can be extended using three examples of AR maintenance applications.
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019
The development process of automated guided vehicles (AGV) can be supported by virtual commission... more The development process of automated guided vehicles (AGV) can be supported by virtual commissioning, which comprises the validation of functionality using a simulation of the AGV. In case of collaborating AGVs, testing their functionalities require the simulation to contain not only the AGV but also a human and an interaction device. Therefore, this paper presents a setup, that integrates a human using motion capturing and emulates a smartwatch as interaction device. Furthermore, the simulation is visualized by a head-mounted display and provides additional information for the test case assessment and analysis. Thus, it enables the virtual commissioning of collaborative AGVs.
Durch die zunehmende Verschmelzung zwischen realer Produktionswelt und der virtuellen IT-Welt, ei... more Durch die zunehmende Verschmelzung zwischen realer Produktionswelt und der virtuellen IT-Welt, einhergehend mit den jetzt verfugbaren Moglichkeiten in diesem Bereich, erlebt gerade die produzierende Industrie einen enormen Wandel. Getragen durch politische Rahmenbedingungen sowie neue Anforderungen aus dem Markt, konnen sich kleine bis hin zu grosen Unternehmen diesem Wandel nicht mehr verwehren. Doch was bedeutet dies gerade fur kleinere und mittlere Unternehmen und was bedeutet dies fur die Mitarbeiter und die Anforderungen an diese? Diesen Fragen, unter dem Aspekt von neuen Rahmenbedingungen, erlautert der Beitrag und zeigt Chancen und Risiken auf, die die Digitalisierung, gerade fur produzierende Unternehmen, mit sich bringt. Den Abschluss bildet ein Praxisbeispiel aus dem Maschinenbau. Dabei wird der Wandel der Werkzeugmaschine als Kernkomponente moderner Produktionstechnik dargestellt. Der Fokus liegt dabei auf den Daten, als Enabler fur Werkschopfung und Innovationen durch In...
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
Performing user experience (UX) and usability studies in VR to assess early product prototypes is... more Performing user experience (UX) and usability studies in VR to assess early product prototypes is common in the automotive and other sectors but has not yet been applied for the development of surgical instruments. For the development of an aspiration/irrigation instrument using a shape memory alloy (SMA) tube, we wanted to get an early user feedback of our prototype from medical staff. We conducted a study with 22 participants with a medical background and considered a potential presence bias of the UX and usability ratings. The results confirm the novelty and usefulness of a SMA tube and gave us valuable feedback for optimizing the shapeshifting mechanism.
Augmented Reality (AR) can be used in intra-logistics to optimize packing processes towards shipp... more Augmented Reality (AR) can be used in intra-logistics to optimize packing processes towards shipping less unused space by calculating and visualizing efficient pack schemas. This work describes the prototype of such a system using a Kinect v2. Based on the delivered RGB-D stream detection and tracking algorithm applied particle filters, tracks boxes and articles. Further, the tracking approach can check if an article is placed correctly in the box. A qualitative assessment of the prototype in a warehouse revealed that such a system only useful for unexperienced packers.
The process accuracy when cutting free-form parts using waterjet technology depends on several fa... more The process accuracy when cutting free-form parts using waterjet technology depends on several factors, including various preparatory tasks, such as defining the workpiece coordinate system. Some manual procedures for determining it are already used. Those methods are based on the usage of laser pointers or dial gauges, which are fixed on the machine head. As a computer-aided alternative, measuring probes can be used to define the zero point offset of a workpiece, or to compare its dimensions to the ones predefined in the CAD data. When processing flat parts, optical systems can be used for layout alignment on the blank material. In order to redefine how the workpiece coordinate system is measured on a waterjet cutting machine, a new assistance and control system is being developed. It features an optical system that scans marked clamping and positioning devices whose relative positions to the machined part are precisely defined. By returning data about their location to the control...
We present the first VR training simulator for hip replacement surgeries. We solved the main chal... more We present the first VR training simulator for hip replacement surgeries. We solved the main challenges of this task - high and stable forces during the milling process while simultaneously a very sensitive feedback is required - by using an industrial robot for the force output and the development of a novel massively parallel haptic rendering algorithm with support for material removal.
Scientific Reports
Total hip arthroplasty (THA) is a highly successful surgical procedure, but complications remain,... more Total hip arthroplasty (THA) is a highly successful surgical procedure, but complications remain, including aseptic loosening, early dislocation and misalignment. These may partly be related to lacking training opportunities for novices or those performing THA less frequently. A standardized training setting with realistic haptic feedback for THA does not exist to date. Virtual Reality (VR) may help establish THA training scenarios under standardized settings, morphology and material properties. This work summarizes the development and acquisition of mechanical properties on hip reaming, resulting in a tissue-based material model of the acetabulum for force feedback VR hip reaming simulators. With the given forces and torques occurring during the reaming, Cubic Hermite Spline interpolation seemed the most suitable approach to represent the nonlinear force–displacement behavior of the acetabular tissues over Cubic Splines. Further, Cubic Hermite Splines allowed for a rapid force feed...
Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2020
Procedia Manufacturing
Abstract In modern production environments employees work progressively closer together with auto... more Abstract In modern production environments employees work progressively closer together with autonomous robots and vehicles. Besides the technical specifications, the development of these products focuses on the human-machine interaction. Within the federally funded Project FOLLOWme an automated guided vehicle (AGV) for intralogistics that follows and interacts with the user is developed using virtual reality based prototypes. The benefits in comparison to using only physical prototypes are on the one hand specific user feedback regarding ergonomics and trust. On the other hand the validation of navigation and collision avoidance algorithms and optimization of technical parameters is achieved considering complex environmental conditions. This paper focuses on the latter in detail and deals with the optimization of a fuzzy logic controller using the game engine Unity3D to create the required virtual setup. This approach saves valuable time at early project stages and allows the optimization of a larger number of parameters compared to just physical tests. Furthermore it reduces resources like occupied physical infrastructure and improves the comprehension by using virtual reality.
The International Journal of Advanced Manufacturing Technology
Progress in applied research for sustainable machine tools and forming technologies bases upon in... more Progress in applied research for sustainable machine tools and forming technologies bases upon industrial and environmental requirements for resource efficiency. Relevant technical trends base upon impact studies and applied research projects on the lifecycle resource consumption for manufacturing processes and systems. This paper gives an overview about a unified methodological approach of the evaluation of resource efficiency of machine tools. It answers the scientific question on sustainability: which technological parameters and machine tool characteristics lead to their lowest resource consumption/losses and part manufacturing costs. Therefore, the method allows to consider them as an energy-information model, in which the transformation of any forms and types of energy, material, and information takes place. It is shown that innovative hollow shaft forming technologies become sustainable alternatives to cutting technologies. A smart factory uses digitalization, manufacturing d...
2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Virtual Reality und Augmented Reality in der Digitalen Produktion
2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2020
Maintenance departments of producing companies in most industrial countries are facing challenges... more Maintenance departments of producing companies in most industrial countries are facing challenges originating from an aging workforce, increasing product variety, and the pressure to increase productivity. We present the concepts and the user interface (UI) designs for two Augmented Reality (AR) applications, which help to tackle these issues. An AR Guidance System will allow new and unexperienced staff to perform medium to highly complex maintenance tasks, which they currently incapable to. The AR Remote Service System enables technicians at the machine to establish a voice/video stream with an internal or external expert. The video stream can be augmented with 3D models and drawings so that problems can be solved remotely and more efficiently. A qualitative assessment with maintenance managers and technicians from three producing companies rated the AR application concept as beneficial and the UI designs as very usable.
2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2021
Access to machine data, e.g. axis positions inside an AR maintenance application can potentially ... more Access to machine data, e.g. axis positions inside an AR maintenance application can potentially increase the usefulness of AR in maintenance. Technicians walking to the machine control for looking up information would be avoided. However, the machine control interface and data are machine manufacturer depended, making it necessary to customize the interface between the machine control and the AR maintenance application. Here, we present a solution integrating machine control access from three different machines using a middleware box. A qualitative assessment with technicians confirms the usefulness direct machine data access from an AR maintenance application.
Procedia CIRP, 2021
The design of cyber physical systems in today’s production and intralogistics is influenced by th... more The design of cyber physical systems in today’s production and intralogistics is influenced by the increasing availability and exchange of data. On the one hand, synergies between connected systems can be used to develop lightweight applications by sharing and reusing data. On the other hand, the possible combinations between these systems increase the complexity and design options. This paper presents a method to structure possible design options systematically and proposes virtual commissioning as solution for their analysis and verification to enable early design decisions. The method is demonstrated using an automated guided vehicle combined with a tactile warning device.
2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), 2017
Connecting third party systems like machine controls and product data management systems with Aug... more Connecting third party systems like machine controls and product data management systems with Augmented Reality (AR) support applications is crucial for their industrial success. We present a marketing use case of a Virtual Press demonstrator where the connection to a machine control was successfully implemented. The realization of this application utilized the AR framework ARViewer that is introduced in this paper. Subsequent, an outlook is given how this framework can be extended using three examples of AR maintenance applications.
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019
The development process of automated guided vehicles (AGV) can be supported by virtual commission... more The development process of automated guided vehicles (AGV) can be supported by virtual commissioning, which comprises the validation of functionality using a simulation of the AGV. In case of collaborating AGVs, testing their functionalities require the simulation to contain not only the AGV but also a human and an interaction device. Therefore, this paper presents a setup, that integrates a human using motion capturing and emulates a smartwatch as interaction device. Furthermore, the simulation is visualized by a head-mounted display and provides additional information for the test case assessment and analysis. Thus, it enables the virtual commissioning of collaborative AGVs.
Durch die zunehmende Verschmelzung zwischen realer Produktionswelt und der virtuellen IT-Welt, ei... more Durch die zunehmende Verschmelzung zwischen realer Produktionswelt und der virtuellen IT-Welt, einhergehend mit den jetzt verfugbaren Moglichkeiten in diesem Bereich, erlebt gerade die produzierende Industrie einen enormen Wandel. Getragen durch politische Rahmenbedingungen sowie neue Anforderungen aus dem Markt, konnen sich kleine bis hin zu grosen Unternehmen diesem Wandel nicht mehr verwehren. Doch was bedeutet dies gerade fur kleinere und mittlere Unternehmen und was bedeutet dies fur die Mitarbeiter und die Anforderungen an diese? Diesen Fragen, unter dem Aspekt von neuen Rahmenbedingungen, erlautert der Beitrag und zeigt Chancen und Risiken auf, die die Digitalisierung, gerade fur produzierende Unternehmen, mit sich bringt. Den Abschluss bildet ein Praxisbeispiel aus dem Maschinenbau. Dabei wird der Wandel der Werkzeugmaschine als Kernkomponente moderner Produktionstechnik dargestellt. Der Fokus liegt dabei auf den Daten, als Enabler fur Werkschopfung und Innovationen durch In...
2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
Performing user experience (UX) and usability studies in VR to assess early product prototypes is... more Performing user experience (UX) and usability studies in VR to assess early product prototypes is common in the automotive and other sectors but has not yet been applied for the development of surgical instruments. For the development of an aspiration/irrigation instrument using a shape memory alloy (SMA) tube, we wanted to get an early user feedback of our prototype from medical staff. We conducted a study with 22 participants with a medical background and considered a potential presence bias of the UX and usability ratings. The results confirm the novelty and usefulness of a SMA tube and gave us valuable feedback for optimizing the shapeshifting mechanism.
Augmented Reality (AR) can be used in intra-logistics to optimize packing processes towards shipp... more Augmented Reality (AR) can be used in intra-logistics to optimize packing processes towards shipping less unused space by calculating and visualizing efficient pack schemas. This work describes the prototype of such a system using a Kinect v2. Based on the delivered RGB-D stream detection and tracking algorithm applied particle filters, tracks boxes and articles. Further, the tracking approach can check if an article is placed correctly in the box. A qualitative assessment of the prototype in a warehouse revealed that such a system only useful for unexperienced packers.
The process accuracy when cutting free-form parts using waterjet technology depends on several fa... more The process accuracy when cutting free-form parts using waterjet technology depends on several factors, including various preparatory tasks, such as defining the workpiece coordinate system. Some manual procedures for determining it are already used. Those methods are based on the usage of laser pointers or dial gauges, which are fixed on the machine head. As a computer-aided alternative, measuring probes can be used to define the zero point offset of a workpiece, or to compare its dimensions to the ones predefined in the CAD data. When processing flat parts, optical systems can be used for layout alignment on the blank material. In order to redefine how the workpiece coordinate system is measured on a waterjet cutting machine, a new assistance and control system is being developed. It features an optical system that scans marked clamping and positioning devices whose relative positions to the machined part are precisely defined. By returning data about their location to the control...
We present the first VR training simulator for hip replacement surgeries. We solved the main chal... more We present the first VR training simulator for hip replacement surgeries. We solved the main challenges of this task - high and stable forces during the milling process while simultaneously a very sensitive feedback is required - by using an industrial robot for the force output and the development of a novel massively parallel haptic rendering algorithm with support for material removal.
Scientific Reports
Total hip arthroplasty (THA) is a highly successful surgical procedure, but complications remain,... more Total hip arthroplasty (THA) is a highly successful surgical procedure, but complications remain, including aseptic loosening, early dislocation and misalignment. These may partly be related to lacking training opportunities for novices or those performing THA less frequently. A standardized training setting with realistic haptic feedback for THA does not exist to date. Virtual Reality (VR) may help establish THA training scenarios under standardized settings, morphology and material properties. This work summarizes the development and acquisition of mechanical properties on hip reaming, resulting in a tissue-based material model of the acetabulum for force feedback VR hip reaming simulators. With the given forces and torques occurring during the reaming, Cubic Hermite Spline interpolation seemed the most suitable approach to represent the nonlinear force–displacement behavior of the acetabular tissues over Cubic Splines. Further, Cubic Hermite Splines allowed for a rapid force feed...
Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2020
Procedia Manufacturing
Abstract In modern production environments employees work progressively closer together with auto... more Abstract In modern production environments employees work progressively closer together with autonomous robots and vehicles. Besides the technical specifications, the development of these products focuses on the human-machine interaction. Within the federally funded Project FOLLOWme an automated guided vehicle (AGV) for intralogistics that follows and interacts with the user is developed using virtual reality based prototypes. The benefits in comparison to using only physical prototypes are on the one hand specific user feedback regarding ergonomics and trust. On the other hand the validation of navigation and collision avoidance algorithms and optimization of technical parameters is achieved considering complex environmental conditions. This paper focuses on the latter in detail and deals with the optimization of a fuzzy logic controller using the game engine Unity3D to create the required virtual setup. This approach saves valuable time at early project stages and allows the optimization of a larger number of parameters compared to just physical tests. Furthermore it reduces resources like occupied physical infrastructure and improves the comprehension by using virtual reality.
The International Journal of Advanced Manufacturing Technology
Progress in applied research for sustainable machine tools and forming technologies bases upon in... more Progress in applied research for sustainable machine tools and forming technologies bases upon industrial and environmental requirements for resource efficiency. Relevant technical trends base upon impact studies and applied research projects on the lifecycle resource consumption for manufacturing processes and systems. This paper gives an overview about a unified methodological approach of the evaluation of resource efficiency of machine tools. It answers the scientific question on sustainability: which technological parameters and machine tool characteristics lead to their lowest resource consumption/losses and part manufacturing costs. Therefore, the method allows to consider them as an energy-information model, in which the transformation of any forms and types of energy, material, and information takes place. It is shown that innovative hollow shaft forming technologies become sustainable alternatives to cutting technologies. A smart factory uses digitalization, manufacturing d...
2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)
2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Virtual Reality und Augmented Reality in der Digitalen Produktion
2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)