Alejandro Ramirez-Serrano - Profile on Academia.edu (original) (raw)
Papers by Alejandro Ramirez-Serrano
was a multi-track event covering related topics on theory and practice on systems automation, aut... more was a multi-track event covering related topics on theory and practice on systems automation, autonomous systems and autonomic computing. The main tracks referred to the general concepts of systems automation, and methodologies and techniques for designing, implementing and deploying autonomous systems. The next tracks developed around design and deployment of context-aware networks, services and applications, and the design and management of self-behavioral networks and services. We also considered monitoring, control, and management of autonomous self-aware and context-aware systems and topics dedicated to specific autonomous entities, namely, satellite systems, nomadic code systems, mobile networks, and robots. It has been recognized that modeling (in all forms this activity is known) is the fundamental for autonomous subsystems, as both managed and management entities must communicate and understand each other. Small-scale and large-scale virtualization and model-driven architecture, as well as management challenges in such architectures are considered. Autonomic features and autonomy requires a fundamental theory behind and solid control mechanisms. These topics gave credit to specific advanced practical and theoretical aspects that allow subsystem to expose complex behavior. We aimed to expose specific advancements on theory and tool in supporting advanced autonomous systems. Domain case studies (policy, mobility, survivability, privacy, etc.) and specific technology (wireless, wireline, optical, e-commerce, banking, etc.) case studies were targeted. A special track on mobile environments was indented to cover examples and aspects from mobile systems, networks, codes, and robotics. Pervasive services and mobile computing are emerging as the next computing paradigm in which infrastructure and services are seamlessly available anywhere, anytime, and in any format. This move to a mobile and pervasive environment raises new opportunities and demands on the underlying systems. In particular, they need to be adaptive, self-adaptive, and context-aware. Adaptive and self-management context-aware systems are difficult to create, they must be able to understand context information and dynamically change their behavior at runtime according to the context. Context information can include the user location, his preferences, his activities, the environmental conditions and the availability of computing and communication resources. Dynamic reconfiguration of the context-aware systems can generate inconsistencies as well as integrity problems, and combinatorial explosion of possible variants of these systems with a high degree of variability can introduce great complexity. Traditionally, user interface design is a knowledge-intensive task complying with specific domains, yet being user friendly. Besides operational requirements, design recommendations refer to standards of the application domain or corporate guidelines. Commonly, there is a set of general user interface guidelines; the challenge is due to a need for cross-team expertise. Required knowledge differs from one application domain to another, and the core knowledge is subject to constant changes and to individual perception and skills. Passive approaches allow designers to initiate the search for information in a knowledge-database to make accessible the design information for designers during the design process. Active approaches, e.g., constraints and critics, have been also developed and tested. These mechanisms deliver information (critics) or restrict the design space (constraints) actively, according to the rules and guidelines. Active and passive approaches are usually combined to capture a useful user interface design. We take here the opportunity to warmly thank all the members of the ICAS 2013 Technical Program Committee, as well as the numerous reviewers. The creation of such a high quality conference program would not have been possible without their involvement. We also kindly thank all the authors who dedicated much of their time and efforts to contribute to ICAS 2013. We truly believe that, thanks to all these efforts, the final conference program consisted of top quality contributions. Also, this event could not have been a reality without the support of many individuals, organizations, and sponsors. We are grateful to the members of the ICAS 2013 organizing committee for their help in handling the logistics and for their work to make this professional meeting a success. We hope that ICAS 2013 was a successful international forum for the exchange of ideas and results between academia and industry and for the promotion of progress in the fields of autonomic and autonomous systems. We are convinced that the participants found the event useful and communications very open. We also hope the attendees enjoyed the charm of Lisbon, Portugal.
Robotics
To deploy Unmanned Aerial Vehicles (UAVs) inside heterogeneous GPS-denied confined (potentially u... more To deploy Unmanned Aerial Vehicles (UAVs) inside heterogeneous GPS-denied confined (potentially unknown) spaces, such as those encountered in mining and Urban Search and Rescue (USAR), requires the enhancement of numerous technologies. Of special interest is for UAVs to identify collision-freeSafe Flight Corridors (SFC+) within highly cluttered convex- and non-convex-shaped environments, which requires UAVs to perform advanced flight maneuvers while exploiting their flying capabilities. Within this paper, a novel auxiliary occupancy checking process that augments traditional 3D flight corridor generation is proposed. The 3D flight corridor is established as a topological structure based on a hand-crafted path either derived from a computer-generated environment or provided by the human operator, which captures humans’ preferences and desired flight intentions for the given space. This corridor is formulated as a series of interconnected overlapping convex polyhedra bounded by the pe...
The use of robotics in Urban Search and Rescue (USAR) is growing steadily from their initial ince... more The use of robotics in Urban Search and Rescue (USAR) is growing steadily from their initial inception during the 2001 World Trade Centre incident. Despite years of progress, the core design of robots currently in use for USAR purposes has deviated little, favoring software/control development and optimization of the basic robot template to improve performance instead. Presented here is a novel design description of the Cricket, an advanced robot with a broader range of physical capabilities than traditional USAR robots. By incorporating the tracked structure of earlier robots, appreciated for energy efficiency and robustness, into a multi-limbed walking design, the Cricket enables the use of advanced locomotion techniques. The ability to climb over obstacles many times the height of the robot, ascend vertical shafts without the assistance of a tether, and traverse rough and near vertical terrain improves the Cricket’s capability to successfully locate victims in confined spaces.
Human-Robot Interaction - Perspectives and Applications [Working Title]
This paper presents a practical solution to the problem of multi-legged robot stability moving on... more This paper presents a practical solution to the problem of multi-legged robot stability moving on unstructured 3D terrains using a multi-contact approach. The solution is based on a modified version of the contact wrench set method, which has been reformulated to utilize three arbitrary contact points representing the physics of contact between the robot and the environment. The new formulations are then used to test the stability of a life-size humanoid robot. The proposed method extends available formulations making the CWS tool suitable for a variety of terrains having various physical and geometrical characteristics including heterogenous coplanar (e.g., stairs and sloped terrain) and noncoplanar surfaces (e.g., gravel, sand, compliant terrains, etc.). The results provided by the new formulations are visualized using a graphical visualization tool, showing the adaptability of the proposed formulation in multi-contact locomotion. The results show that the proposed approach effect...
In tilt-rotor UAVs, both the fuselage and tilting rotors contribute to the vehicle's rotation... more In tilt-rotor UAVs, both the fuselage and tilting rotors contribute to the vehicle's rotational motion. Consequently, the system's dynamics rise to a highly-nonlinear system, making it challenging to find feasible and desired control solutions. The common control practices devise a logic-based controller to switch between different flight modes or map the control inputs to the conventional helicopter-type control inputs. However, they fail to provide energy-efficient fast trajectory tracking, especially in the presence of external disturbances. This paper proposes a general-model dynamic formulation and a two-layered constrained Model Predictive Control (MPC) strategy to tackle the trajectory tracking problem for tilt-rotor UAVs. After splitting the vehicle's dynamics into translational and rotational parts, a constrained Linear MPC (LMPC) is designed for the translational dynamic to follow a reference trajectory. We formulate the LMPC as a Quadratically-Constrained Quad...
Multi-contact Stability of Multi-legged Robots Operating in Unstructured Terrains
Advances in Service and Industrial Robotics
Tire force estimation of unmanned ground vehicles on off-road terrains for navigation decisions
2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017
This paper proposes a method of tire force estimation designed for use in navigation decision mak... more This paper proposes a method of tire force estimation designed for use in navigation decision making for Unmanned Ground Vehicles (UGVs) operating on off-road terrains. This method (called the Centroid Method) uses a 3D point cloud representation of the terrain to determine tire-ground interaction, and a linear spring to determine the corresponding tire forces. Simulation results of tire force estimation of the Centroid Method are compared against the experimentally validated MF-Swift model, including on a fractal terrain surface which simulates a rough off-road terrain. The results show that the Centroid Method performs well for longitudinal and vertical tire force estimation especially for lower frequencies up to about 8–21Hz. Although the Centroid Method does not provide the same detail as the advanced tire models such as MF-Swift, it is significantly less complex and simpler to implement for enabling efficient on-board UGV navigation decision making.
Adaptive distributed fetching and retrieval of goods by a swarm-bot
ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005.
AbstractSwarm robotics is a rising paradigm which aims at designing new robot artifacts by extra... more AbstractSwarm robotics is a rising paradigm which aims at designing new robot artifacts by extracting engineering guidelines from Nature. The work presented here shows the use of a particular swarm of robots called swarm-bot for carrying out distributed missions of ...
Robotics
This paper presents an optimized robust trajectory control system for an autonomous tiltrotor bi-... more This paper presents an optimized robust trajectory control system for an autonomous tiltrotor bi-copter based on an incremental nonlinear dynamic inversion (INDI) strategy combined with a set of PID/PD controllers. The methodology includes a lower level, fast attitude control action using an incremental nonlinear dynamic inversion (INDI) strategy, which is driven by a higher level, slow trajectory control action that uses nonlinear dynamic inversion (NDI). The nonlinear dynamic model of the drone is derived, and the basis of the motion and the design of the attitude and position stabilizing controllers are discussed. To develop and test the suggested controller, a circle-shaped flight profile is simulated. The linear control providing inputs to the NDI and INDI controllers is tuned via a novel multi-objective optimization auto-tuning method using the non-dominated sorting genetic algorithm II (NSGA-II). The tracking and disturbance rejection optimization is achieved via the use of t...
Robust RGB-D SLAM for Dynamic Environments Based on YOLOv4
2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), 2020
At present, most of the current Simultaneous Localization and Mapping (SLAM) algorithms are limit... more At present, most of the current Simultaneous Localization and Mapping (SLAM) algorithms are limited to work in static environments. However, the world is not static and dynamic objects are typically present in the environments, leading to the failure of the general SLAM. In this paper, a dynamic object removal method combining semantic detection with depth image segmentation is proposed and applied in the real-time SLAM library for cameras ORB-SLAM2 system to achieve robust RGB-D SLAM for dynamic environments. In the proposed method, the potential dynamic regions are captured via YOLOv4 and K-means image segmentation. Different from the general purposes of processing dynamic regions, the potential dynamic regions are redetected by dynamic outliers rejection, which improves the reliability of dynamic object removal. Experiments using the TUM RGB-D dataset demonstrate that the proposed method performs with increased robustness and accuracy when compared to the original ORB-SLAM2 without dynamic object removal in dynamic environments.
Performance Analysis of Nonlinear Model Predictive Control Applied to Multi-Rotor Unmanned Aerial Vehicles
ABSTRACT This work describes a modified Nonlinear Model Predictive Control (NMPC) to address cont... more ABSTRACT This work describes a modified Nonlinear Model Predictive Control (NMPC) to address control performance issues that arise when NMPC is applied on unmanned aerial vehicles. The proposed NMPC typically identifies lower cost control options within a set optimization time frame thus producing more stable and robust control. We also introduce an alternative performance (stability) analysis methodology suitable for assessing the stochastic behavior of the NMPC. This analysis method can be used to generate a flight envelope within which the NMPC and UAV combination will act reliably.
Humanoid robots (humanoids), at least in theory, can assist humans and work with them in cluttere... more Humanoid robots (humanoids), at least in theory, can assist humans and work with them in cluttered and confined environments. However, further developments are needed to fully enable them to work in close proximity (even in physical interactions) with humans while not risking the safety of themselves and the objects and people around them. Current methods have not been fully successful in preparing humanoids for 100% safe physical Human Robot Interaction (HRI) due partially to the unresolved challenges of detecting the characteristics of the surrounding environment. Furthermore, current humanoids employ expensive and fragile equipment making them costly, thus limiting humanity of using them. This paper presents a novel real-time and hardware inexpensive collision detection methodology that employs signals from the robots’ motor joints and data processing capabilities from the computers running the robot. The approach enables the safe close-proximity HRI for position-controlled human...
Optimal Real-Time Trajectory Control of a Pitch-Hover UAV with a Two Link Manipulator
2018 International Conference on Unmanned Aircraft Systems (ICUAS), 2018
Rotary-wing-based Unmanned Aerial Manipulators (UAM) are gaining attention for their in-place hov... more Rotary-wing-based Unmanned Aerial Manipulators (UAM) are gaining attention for their in-place hovering capability, holonomy in motion, and safe operation due to their redundancy. Task-oriented optimal control strategies can also further improve the flight time by generating energy-optimal coordinated motions. This paper addresses the dynamic modeling, trajectory tracking and control of an UAM that consists of an under-actuated rotary-wing UAV, with a novel pitch-hover-maneuvering capability, and a 2-DOF robotic arm. A decoupled velocity-based Model Predictive Control (MPC) strategy is proposed for tracking a trajectory in the sagittal plane of the UAM while the UAV base pitch hovers in place. Conventional PD controllers were used to generate set-point velocity screws as the inputs to the MPC. A partitioned (but complete) dynamic model of the UAM was developed and used for implementing the proposed control strategy in a simulated environment. The MPC controller takes the force/torque...
IFAC Proceedings Volumes, 2010
This paper addresses the problem of determining the maximum allowable speed (V) of a vehicle trav... more This paper addresses the problem of determining the maximum allowable speed (V) of a vehicle traversing off-road terrains. The calculated maximum speed achieves the fastest navigation without exceeding an allowable range of transmitted force (F all) to the vehicle's frame. The proposed system also enables the vehicle to transit between different terrains safely. The system's input are: i)a 3D range image of the terrain and ii)the vehicle dimensions. The terrain roughness is assessed; then the corresponding maximum allowable speed is calculated. In this paper the novel Roughness Index (RI) is used to represent the terrain roughness. This index is calculated based on the standard deviation of the terrain points (3D range image) elevations. A closed form expression of the maximum allowable vehicle speed is developed (as function of the vehicle's properties, F all , RI, and probability of not exceeding F all). The proposed system can be used as a driver assistant system to enhance the vehicle performance, increase its life time, and reduce the maintenance cost. In addition, it is a key module in Unmanned Ground Vehicles (UGVs) navigation systems. This module provides the navigation system by information necessary for path and speed planning.
Proceedings of the 7th International Conference of Control, Dynamic Systems, and Robotics (CDSR'20), 2020
Collaborative robots (cobots) have emerged as a technological solution for enhanced manipulation ... more Collaborative robots (cobots) have emerged as a technological solution for enhanced manipulation of objects while allowing safe interaction with a human counterpart. Although substantial developments in Human-Robot Collaboration (HRC) systems have taken place in the last decade, no conceptual framework of their composition is available. The literature provides an unclear process of how to integrate human-robot interaction levels and their roles with safety and communication technologies into HRC systems. To design an ergonomic HRC system (in its physical and cognitive dimensions) a clear identification and categorization of its components is required. This paper presents a literature review analysis that identifies the tendencies of HRC in the manufacturing sector. An initial distinction between application by type of industry and task is carried out. Afterward, interaction levels in HRC systems are examined, both individually and collectively, depending on the application area. Work roles of humans and robots, safety settings, and communication interfaces are also analyzed as part of the interaction levels in the primary composition of HRC systems. Their presence and distribution along 50 selected cases are also explored. The analyzed data, results, and observations presented in this paper demonstrate clear tendencies for specific components that were identified as necessary for improving future designs of human-centered HRC systems.
Humanoid robot perception is challenging compared to perception in other robotic systems. The sen... more Humanoid robot perception is challenging compared to perception in other robotic systems. The sensors in a humanoid are in constant state of motion and their pose estimation is affected by the constant motion of the tens of DOFs (Degrees of Freedom) which in turn affect the estimation of the sensed environmental objects. This is especially problematic in highly cluttered dynamic spaces such as indoor office environments. One of the challenges is identifying the presence of all independent moving/dynamic entities such as people walking around the robot. If available, such information would assist humanoids to build better maps and better plan their motions in unstructured confined dynamic environments. This paper presents a moving object detection pipeline based on relative motion and a novel confidence tracking approach that detects point clusters corresponding to independent moving entities around the robot. The detection does not depend on prior knowledge about the target entity. ...
2016 13th Conference on Computer and Robot Vision (CRV), 2016
Design of a vision-based target tracking control strategy for a dual-rotor UAV with tilting rotor... more Design of a vision-based target tracking control strategy for a dual-rotor UAV with tilting rotors is presented. In this research, the under-study UAV is equipped with a sliding mass that can slide over a motorized linear track attached to the UAV's fuselage enabling it to perform sophisticated maneuvers by monitoring its five controllable degrees of freedom. The dynamic model of the system is first derived and then a model-based controller using vision based pose estimation, obtained via an onboard down-looking camera, is designed enabling the UAV to: (1) pitch hover in position, (2) servo towards a target position, and (3) track a moving target. Simulations show the premise of the proposed vision-based control strategy.
Proceedings of the 18th IFAC World Congress, 2011
In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed ... more In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed Lateral Tilting (OLT) control concepts are presented. A complete dynamic model of vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs) having lateral and longitudinal rotor tilting mechanism is developed using a Newton-Euler formulation for double axis OAT mechanism (dOAT). Then, a theoretical analysis of OAT vehicle control response and stability for pitch, roll and yaw motion is described and simulated using the derived dynamic model. The aim of the aspects presented in this paper is to fully enable the highly maneuverable characteristics of UAV possessing dOAT which renders them to navigate in highly confined environments by performing semi-acrobatic maneuvers in hover lateral and forward flight.
World Congress, 2011
In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed ... more In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed Lateral Tilting (OLT) control concepts are presented. A complete dynamic model of vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs) having lateral and longitudinal rotor tilting mechanism is developed using a Newton-Euler formulation for double axis OAT mechanism (dOAT). Then, a theoretical analysis of OAT vehicle control response and stability for pitch, roll and yaw motion is described and simulated using the derived dynamic model. The aim of the aspects presented in this paper is to fully enable the highly maneuverable characteristics of UAV possessing dOAT which renders them to navigate in highly confined environments by performing semi-acrobatic maneuvers in hover lateral and forward flight.
International Conference on Robotics and Automation, 1999
The modeling and control flexible-manufacturing workcells (FMCs) has generally been performed in ... more The modeling and control flexible-manufacturing workcells (FMCs) has generally been performed in a hierarchical structure, where at the highest level they have been modeled as discrete-event systems (DESs). In this paper, a new DES control synthesis technique that combines Moore Automata (MA) and Controlled- Automata theories to synthesize supervisors is presented. The obtained supervisors can monitor multiple pieces of information
was a multi-track event covering related topics on theory and practice on systems automation, aut... more was a multi-track event covering related topics on theory and practice on systems automation, autonomous systems and autonomic computing. The main tracks referred to the general concepts of systems automation, and methodologies and techniques for designing, implementing and deploying autonomous systems. The next tracks developed around design and deployment of context-aware networks, services and applications, and the design and management of self-behavioral networks and services. We also considered monitoring, control, and management of autonomous self-aware and context-aware systems and topics dedicated to specific autonomous entities, namely, satellite systems, nomadic code systems, mobile networks, and robots. It has been recognized that modeling (in all forms this activity is known) is the fundamental for autonomous subsystems, as both managed and management entities must communicate and understand each other. Small-scale and large-scale virtualization and model-driven architecture, as well as management challenges in such architectures are considered. Autonomic features and autonomy requires a fundamental theory behind and solid control mechanisms. These topics gave credit to specific advanced practical and theoretical aspects that allow subsystem to expose complex behavior. We aimed to expose specific advancements on theory and tool in supporting advanced autonomous systems. Domain case studies (policy, mobility, survivability, privacy, etc.) and specific technology (wireless, wireline, optical, e-commerce, banking, etc.) case studies were targeted. A special track on mobile environments was indented to cover examples and aspects from mobile systems, networks, codes, and robotics. Pervasive services and mobile computing are emerging as the next computing paradigm in which infrastructure and services are seamlessly available anywhere, anytime, and in any format. This move to a mobile and pervasive environment raises new opportunities and demands on the underlying systems. In particular, they need to be adaptive, self-adaptive, and context-aware. Adaptive and self-management context-aware systems are difficult to create, they must be able to understand context information and dynamically change their behavior at runtime according to the context. Context information can include the user location, his preferences, his activities, the environmental conditions and the availability of computing and communication resources. Dynamic reconfiguration of the context-aware systems can generate inconsistencies as well as integrity problems, and combinatorial explosion of possible variants of these systems with a high degree of variability can introduce great complexity. Traditionally, user interface design is a knowledge-intensive task complying with specific domains, yet being user friendly. Besides operational requirements, design recommendations refer to standards of the application domain or corporate guidelines. Commonly, there is a set of general user interface guidelines; the challenge is due to a need for cross-team expertise. Required knowledge differs from one application domain to another, and the core knowledge is subject to constant changes and to individual perception and skills. Passive approaches allow designers to initiate the search for information in a knowledge-database to make accessible the design information for designers during the design process. Active approaches, e.g., constraints and critics, have been also developed and tested. These mechanisms deliver information (critics) or restrict the design space (constraints) actively, according to the rules and guidelines. Active and passive approaches are usually combined to capture a useful user interface design. We take here the opportunity to warmly thank all the members of the ICAS 2013 Technical Program Committee, as well as the numerous reviewers. The creation of such a high quality conference program would not have been possible without their involvement. We also kindly thank all the authors who dedicated much of their time and efforts to contribute to ICAS 2013. We truly believe that, thanks to all these efforts, the final conference program consisted of top quality contributions. Also, this event could not have been a reality without the support of many individuals, organizations, and sponsors. We are grateful to the members of the ICAS 2013 organizing committee for their help in handling the logistics and for their work to make this professional meeting a success. We hope that ICAS 2013 was a successful international forum for the exchange of ideas and results between academia and industry and for the promotion of progress in the fields of autonomic and autonomous systems. We are convinced that the participants found the event useful and communications very open. We also hope the attendees enjoyed the charm of Lisbon, Portugal.
Robotics
To deploy Unmanned Aerial Vehicles (UAVs) inside heterogeneous GPS-denied confined (potentially u... more To deploy Unmanned Aerial Vehicles (UAVs) inside heterogeneous GPS-denied confined (potentially unknown) spaces, such as those encountered in mining and Urban Search and Rescue (USAR), requires the enhancement of numerous technologies. Of special interest is for UAVs to identify collision-freeSafe Flight Corridors (SFC+) within highly cluttered convex- and non-convex-shaped environments, which requires UAVs to perform advanced flight maneuvers while exploiting their flying capabilities. Within this paper, a novel auxiliary occupancy checking process that augments traditional 3D flight corridor generation is proposed. The 3D flight corridor is established as a topological structure based on a hand-crafted path either derived from a computer-generated environment or provided by the human operator, which captures humans’ preferences and desired flight intentions for the given space. This corridor is formulated as a series of interconnected overlapping convex polyhedra bounded by the pe...
The use of robotics in Urban Search and Rescue (USAR) is growing steadily from their initial ince... more The use of robotics in Urban Search and Rescue (USAR) is growing steadily from their initial inception during the 2001 World Trade Centre incident. Despite years of progress, the core design of robots currently in use for USAR purposes has deviated little, favoring software/control development and optimization of the basic robot template to improve performance instead. Presented here is a novel design description of the Cricket, an advanced robot with a broader range of physical capabilities than traditional USAR robots. By incorporating the tracked structure of earlier robots, appreciated for energy efficiency and robustness, into a multi-limbed walking design, the Cricket enables the use of advanced locomotion techniques. The ability to climb over obstacles many times the height of the robot, ascend vertical shafts without the assistance of a tether, and traverse rough and near vertical terrain improves the Cricket’s capability to successfully locate victims in confined spaces.
Human-Robot Interaction - Perspectives and Applications [Working Title]
This paper presents a practical solution to the problem of multi-legged robot stability moving on... more This paper presents a practical solution to the problem of multi-legged robot stability moving on unstructured 3D terrains using a multi-contact approach. The solution is based on a modified version of the contact wrench set method, which has been reformulated to utilize three arbitrary contact points representing the physics of contact between the robot and the environment. The new formulations are then used to test the stability of a life-size humanoid robot. The proposed method extends available formulations making the CWS tool suitable for a variety of terrains having various physical and geometrical characteristics including heterogenous coplanar (e.g., stairs and sloped terrain) and noncoplanar surfaces (e.g., gravel, sand, compliant terrains, etc.). The results provided by the new formulations are visualized using a graphical visualization tool, showing the adaptability of the proposed formulation in multi-contact locomotion. The results show that the proposed approach effect...
In tilt-rotor UAVs, both the fuselage and tilting rotors contribute to the vehicle's rotation... more In tilt-rotor UAVs, both the fuselage and tilting rotors contribute to the vehicle's rotational motion. Consequently, the system's dynamics rise to a highly-nonlinear system, making it challenging to find feasible and desired control solutions. The common control practices devise a logic-based controller to switch between different flight modes or map the control inputs to the conventional helicopter-type control inputs. However, they fail to provide energy-efficient fast trajectory tracking, especially in the presence of external disturbances. This paper proposes a general-model dynamic formulation and a two-layered constrained Model Predictive Control (MPC) strategy to tackle the trajectory tracking problem for tilt-rotor UAVs. After splitting the vehicle's dynamics into translational and rotational parts, a constrained Linear MPC (LMPC) is designed for the translational dynamic to follow a reference trajectory. We formulate the LMPC as a Quadratically-Constrained Quad...
Multi-contact Stability of Multi-legged Robots Operating in Unstructured Terrains
Advances in Service and Industrial Robotics
Tire force estimation of unmanned ground vehicles on off-road terrains for navigation decisions
2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017
This paper proposes a method of tire force estimation designed for use in navigation decision mak... more This paper proposes a method of tire force estimation designed for use in navigation decision making for Unmanned Ground Vehicles (UGVs) operating on off-road terrains. This method (called the Centroid Method) uses a 3D point cloud representation of the terrain to determine tire-ground interaction, and a linear spring to determine the corresponding tire forces. Simulation results of tire force estimation of the Centroid Method are compared against the experimentally validated MF-Swift model, including on a fractal terrain surface which simulates a rough off-road terrain. The results show that the Centroid Method performs well for longitudinal and vertical tire force estimation especially for lower frequencies up to about 8–21Hz. Although the Centroid Method does not provide the same detail as the advanced tire models such as MF-Swift, it is significantly less complex and simpler to implement for enabling efficient on-board UGV navigation decision making.
Adaptive distributed fetching and retrieval of goods by a swarm-bot
ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005.
AbstractSwarm robotics is a rising paradigm which aims at designing new robot artifacts by extra... more AbstractSwarm robotics is a rising paradigm which aims at designing new robot artifacts by extracting engineering guidelines from Nature. The work presented here shows the use of a particular swarm of robots called swarm-bot for carrying out distributed missions of ...
Robotics
This paper presents an optimized robust trajectory control system for an autonomous tiltrotor bi-... more This paper presents an optimized robust trajectory control system for an autonomous tiltrotor bi-copter based on an incremental nonlinear dynamic inversion (INDI) strategy combined with a set of PID/PD controllers. The methodology includes a lower level, fast attitude control action using an incremental nonlinear dynamic inversion (INDI) strategy, which is driven by a higher level, slow trajectory control action that uses nonlinear dynamic inversion (NDI). The nonlinear dynamic model of the drone is derived, and the basis of the motion and the design of the attitude and position stabilizing controllers are discussed. To develop and test the suggested controller, a circle-shaped flight profile is simulated. The linear control providing inputs to the NDI and INDI controllers is tuned via a novel multi-objective optimization auto-tuning method using the non-dominated sorting genetic algorithm II (NSGA-II). The tracking and disturbance rejection optimization is achieved via the use of t...
Robust RGB-D SLAM for Dynamic Environments Based on YOLOv4
2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), 2020
At present, most of the current Simultaneous Localization and Mapping (SLAM) algorithms are limit... more At present, most of the current Simultaneous Localization and Mapping (SLAM) algorithms are limited to work in static environments. However, the world is not static and dynamic objects are typically present in the environments, leading to the failure of the general SLAM. In this paper, a dynamic object removal method combining semantic detection with depth image segmentation is proposed and applied in the real-time SLAM library for cameras ORB-SLAM2 system to achieve robust RGB-D SLAM for dynamic environments. In the proposed method, the potential dynamic regions are captured via YOLOv4 and K-means image segmentation. Different from the general purposes of processing dynamic regions, the potential dynamic regions are redetected by dynamic outliers rejection, which improves the reliability of dynamic object removal. Experiments using the TUM RGB-D dataset demonstrate that the proposed method performs with increased robustness and accuracy when compared to the original ORB-SLAM2 without dynamic object removal in dynamic environments.
Performance Analysis of Nonlinear Model Predictive Control Applied to Multi-Rotor Unmanned Aerial Vehicles
ABSTRACT This work describes a modified Nonlinear Model Predictive Control (NMPC) to address cont... more ABSTRACT This work describes a modified Nonlinear Model Predictive Control (NMPC) to address control performance issues that arise when NMPC is applied on unmanned aerial vehicles. The proposed NMPC typically identifies lower cost control options within a set optimization time frame thus producing more stable and robust control. We also introduce an alternative performance (stability) analysis methodology suitable for assessing the stochastic behavior of the NMPC. This analysis method can be used to generate a flight envelope within which the NMPC and UAV combination will act reliably.
Humanoid robots (humanoids), at least in theory, can assist humans and work with them in cluttere... more Humanoid robots (humanoids), at least in theory, can assist humans and work with them in cluttered and confined environments. However, further developments are needed to fully enable them to work in close proximity (even in physical interactions) with humans while not risking the safety of themselves and the objects and people around them. Current methods have not been fully successful in preparing humanoids for 100% safe physical Human Robot Interaction (HRI) due partially to the unresolved challenges of detecting the characteristics of the surrounding environment. Furthermore, current humanoids employ expensive and fragile equipment making them costly, thus limiting humanity of using them. This paper presents a novel real-time and hardware inexpensive collision detection methodology that employs signals from the robots’ motor joints and data processing capabilities from the computers running the robot. The approach enables the safe close-proximity HRI for position-controlled human...
Optimal Real-Time Trajectory Control of a Pitch-Hover UAV with a Two Link Manipulator
2018 International Conference on Unmanned Aircraft Systems (ICUAS), 2018
Rotary-wing-based Unmanned Aerial Manipulators (UAM) are gaining attention for their in-place hov... more Rotary-wing-based Unmanned Aerial Manipulators (UAM) are gaining attention for their in-place hovering capability, holonomy in motion, and safe operation due to their redundancy. Task-oriented optimal control strategies can also further improve the flight time by generating energy-optimal coordinated motions. This paper addresses the dynamic modeling, trajectory tracking and control of an UAM that consists of an under-actuated rotary-wing UAV, with a novel pitch-hover-maneuvering capability, and a 2-DOF robotic arm. A decoupled velocity-based Model Predictive Control (MPC) strategy is proposed for tracking a trajectory in the sagittal plane of the UAM while the UAV base pitch hovers in place. Conventional PD controllers were used to generate set-point velocity screws as the inputs to the MPC. A partitioned (but complete) dynamic model of the UAM was developed and used for implementing the proposed control strategy in a simulated environment. The MPC controller takes the force/torque...
IFAC Proceedings Volumes, 2010
This paper addresses the problem of determining the maximum allowable speed (V) of a vehicle trav... more This paper addresses the problem of determining the maximum allowable speed (V) of a vehicle traversing off-road terrains. The calculated maximum speed achieves the fastest navigation without exceeding an allowable range of transmitted force (F all) to the vehicle's frame. The proposed system also enables the vehicle to transit between different terrains safely. The system's input are: i)a 3D range image of the terrain and ii)the vehicle dimensions. The terrain roughness is assessed; then the corresponding maximum allowable speed is calculated. In this paper the novel Roughness Index (RI) is used to represent the terrain roughness. This index is calculated based on the standard deviation of the terrain points (3D range image) elevations. A closed form expression of the maximum allowable vehicle speed is developed (as function of the vehicle's properties, F all , RI, and probability of not exceeding F all). The proposed system can be used as a driver assistant system to enhance the vehicle performance, increase its life time, and reduce the maintenance cost. In addition, it is a key module in Unmanned Ground Vehicles (UGVs) navigation systems. This module provides the navigation system by information necessary for path and speed planning.
Proceedings of the 7th International Conference of Control, Dynamic Systems, and Robotics (CDSR'20), 2020
Collaborative robots (cobots) have emerged as a technological solution for enhanced manipulation ... more Collaborative robots (cobots) have emerged as a technological solution for enhanced manipulation of objects while allowing safe interaction with a human counterpart. Although substantial developments in Human-Robot Collaboration (HRC) systems have taken place in the last decade, no conceptual framework of their composition is available. The literature provides an unclear process of how to integrate human-robot interaction levels and their roles with safety and communication technologies into HRC systems. To design an ergonomic HRC system (in its physical and cognitive dimensions) a clear identification and categorization of its components is required. This paper presents a literature review analysis that identifies the tendencies of HRC in the manufacturing sector. An initial distinction between application by type of industry and task is carried out. Afterward, interaction levels in HRC systems are examined, both individually and collectively, depending on the application area. Work roles of humans and robots, safety settings, and communication interfaces are also analyzed as part of the interaction levels in the primary composition of HRC systems. Their presence and distribution along 50 selected cases are also explored. The analyzed data, results, and observations presented in this paper demonstrate clear tendencies for specific components that were identified as necessary for improving future designs of human-centered HRC systems.
Humanoid robot perception is challenging compared to perception in other robotic systems. The sen... more Humanoid robot perception is challenging compared to perception in other robotic systems. The sensors in a humanoid are in constant state of motion and their pose estimation is affected by the constant motion of the tens of DOFs (Degrees of Freedom) which in turn affect the estimation of the sensed environmental objects. This is especially problematic in highly cluttered dynamic spaces such as indoor office environments. One of the challenges is identifying the presence of all independent moving/dynamic entities such as people walking around the robot. If available, such information would assist humanoids to build better maps and better plan their motions in unstructured confined dynamic environments. This paper presents a moving object detection pipeline based on relative motion and a novel confidence tracking approach that detects point clusters corresponding to independent moving entities around the robot. The detection does not depend on prior knowledge about the target entity. ...
2016 13th Conference on Computer and Robot Vision (CRV), 2016
Design of a vision-based target tracking control strategy for a dual-rotor UAV with tilting rotor... more Design of a vision-based target tracking control strategy for a dual-rotor UAV with tilting rotors is presented. In this research, the under-study UAV is equipped with a sliding mass that can slide over a motorized linear track attached to the UAV's fuselage enabling it to perform sophisticated maneuvers by monitoring its five controllable degrees of freedom. The dynamic model of the system is first derived and then a model-based controller using vision based pose estimation, obtained via an onboard down-looking camera, is designed enabling the UAV to: (1) pitch hover in position, (2) servo towards a target position, and (3) track a moving target. Simulations show the premise of the proposed vision-based control strategy.
Proceedings of the 18th IFAC World Congress, 2011
In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed ... more In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed Lateral Tilting (OLT) control concepts are presented. A complete dynamic model of vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs) having lateral and longitudinal rotor tilting mechanism is developed using a Newton-Euler formulation for double axis OAT mechanism (dOAT). Then, a theoretical analysis of OAT vehicle control response and stability for pitch, roll and yaw motion is described and simulated using the derived dynamic model. The aim of the aspects presented in this paper is to fully enable the highly maneuverable characteristics of UAV possessing dOAT which renders them to navigate in highly confined environments by performing semi-acrobatic maneuvers in hover lateral and forward flight.
World Congress, 2011
In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed ... more In this paper, first an overview and explanation of the Oblique Active Tilting (OAT) and Opposed Lateral Tilting (OLT) control concepts are presented. A complete dynamic model of vertical takeoff and landing (VTOL) unmanned aerial vehicles (UAVs) having lateral and longitudinal rotor tilting mechanism is developed using a Newton-Euler formulation for double axis OAT mechanism (dOAT). Then, a theoretical analysis of OAT vehicle control response and stability for pitch, roll and yaw motion is described and simulated using the derived dynamic model. The aim of the aspects presented in this paper is to fully enable the highly maneuverable characteristics of UAV possessing dOAT which renders them to navigate in highly confined environments by performing semi-acrobatic maneuvers in hover lateral and forward flight.
International Conference on Robotics and Automation, 1999
The modeling and control flexible-manufacturing workcells (FMCs) has generally been performed in ... more The modeling and control flexible-manufacturing workcells (FMCs) has generally been performed in a hierarchical structure, where at the highest level they have been modeled as discrete-event systems (DESs). In this paper, a new DES control synthesis technique that combines Moore Automata (MA) and Controlled- Automata theories to synthesize supervisors is presented. The obtained supervisors can monitor multiple pieces of information