Santosha Dwivedy - Academia.edu (original) (raw)

Uploads

Papers by Santosha Dwivedy

Research paper thumbnail of Reinforcement Learning via Recurrent Convolutional Neural Networks

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially o... more Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable performance, they often ignore the structure of task. We present a natural representation of to Reinforcement Learning (RL) problems using Recurrent Convolutional Neural Networks (RCNNs), to better exploit this inherent structure. We define 3 such RCNNs, whose forward passes execute an efficient Value Iteration, propagate beliefs of state in partially observable environments, and choose optimal actions respectively. Backpropagating gradients through these RCNNs allows the system to explicitly learn the Transition Model and Reward Function associated with the underlying MDP, serving as an elegant alternative to classical model-based RL. We evaluate the proposed algorithms in simulation, considering a robot planning problem. We demonstrate the capability...

Research paper thumbnail of Transpose Jacobian Control of Flexible Joint Upper Limb Exoskeleton System

Lecture Notes in Mechanical Engineering

Research paper thumbnail of Vibration Analysis of a Cutting Tool with Piezoelectric Bimorph

In this work the health monitoring of the tool is carried out by using bimorph piezoelectric patc... more In this work the health monitoring of the tool is carried out by using bimorph piezoelectric patches on the single point cutting tool in turning process. The patches are mounted on the upper and lower surface of the shank of the tool. The vibration analysis of this system is carried out by modeling the tool as an Euler-Bernoulli cantilever beam subjected to transversal base excitation and periodic axial load. The loading is due to forces exerted by work piece on the tool. Extended Hamilton’s principle is used to obtain the governing equation of motion which has been discretized by using generalized Galerkin’s method to obtain the nonlinear temporal equation of motion. Method of multiple scales is used to investigate nonlinear response, generated voltage due to piezoelectric patches of the system. Two resonance conditions have been studied and it is shown that while the simple resonance condition produces the voltage in the order of micro volt, the principal parametric resonance cond...

Research paper thumbnail of Dynamics and Control of a Pneumatically Actuated Robotic Manipulator

This paper deals with the dynamics and control of a two degree of freedom robot arm actuated by p... more This paper deals with the dynamics and control of a two degree of freedom robot arm actuated by pneumatic artificial muscles (PAMs). The high power-weight ratio of PAMs justifies their use as actuators in robotics. To achieve trajectory tracking performance, controllers are constructed based on a dynamic model of the robot arm. Due to the high non-linear dynamics of the robotic system, fuzzy control is used for trajectory tracking tasks. The results in simulation are shown to achieve sufficiently good tracking performance.

Research paper thumbnail of Biomechanical Study and Prediction of Lower Extremity Joint Movements Using Bayesian Regularization-Based Backpropagation Neural Network

J. Comput. Inf. Sci. Eng., 2021

This work aims to estimate the lower-limb joint angles in the sagittal plane using Microsoft Kine... more This work aims to estimate the lower-limb joint angles in the sagittal plane using Microsoft Kinect-based experimental setup and apply an efficient machine learning technique for predicting the same based on kinematic, spatiotemporal, and biological parameters. Ten healthy participants from 19 to 50 years (33 ± 11.24 years) were asked to walk in front of the Kinect camera. Based on the skeleton image, the biomechanical hip, knee, and ankle joint angles of the lower-limb were measured using ni-labview. Thereafter, two Bayesian regularization-based backpropagation multilayer perceptron neural network models were designed to predict the joint angles in the stance and swing phase. The joint angles of two individuals, as a testing dataset, were predicted and compared with the experimental results. The test correlation coefficient for predicted joint angles has shown a promising effect of the proposed neural network models. Finally, a qualitative comparison was presented between the joint...

Research paper thumbnail of Design and fabrication of a novel three wheel robot with a SLE based lifting mechanism and line tracking capability

The present paper deals with the design and development of a modular three wheel robot capable of... more The present paper deals with the design and development of a modular three wheel robot capable of autonomously navigating a structured environment by means of tracking a curved line on the floor. Furthermore, it is equipped with a deployable scissor lift with an end effecter plate thus providing applicative modularity to the robot. The main application is envisaged to serve as an automatic guided vehicle in industries such as automotive and construction where cost effectiveness is an essential criterion for automation and mobility is a highly desirable functionality. Mechanical design is carried out using stress analysis with the help of the finite element software package ANSYS and velocity response curves are generated for the highly non-linear motion of the scissor lift. Finally an algorithm is developed for high speed line tracking using LED and phototransistor pairs and results are presented in terms of experimental data as well as simulated responses.

Research paper thumbnail of Effect of Blowing Agent CaCO3 Content on the Microstructure and Mechanical Properties of AA 5083 Foam

International Journal of Metalcasting

Research paper thumbnail of Design and Modeling of a Novel Mechanized Injection Platform

Proceedings of the Advances in Robotics 2019

In this work, a novel mechanized medical injection platform is modeled for automated drug deliver... more In this work, a novel mechanized medical injection platform is modeled for automated drug delivery and phlebotomy. The objective is to design a versatile device that can administer injections at various sites on the human body while being either bed-top or desktop. The machine consists of 6 degrees-of-freedom system including an independent end effector. The design is modeled in the SolidWorks software with required specifications. Thereafter, static structural analysis is carried out for the most critical component. Furthermore, the mathematical modeling is done in MATLAB to estimate the actuator torque for the end effector.

Research paper thumbnail of Dynamic analysis of a parametrically excited golden Muga silk embedded pneumatic artificial muscle

MATEC Web of Conferences, 2018

Research paper thumbnail of Nonlinear dynamic analysis of flexible workpiece and tool in turning operation with delay and internal resonance

Journal of Sound and Vibration

Abstract In this work, the nonlinear dynamics of the tool and the thin cylindrical workpiece are ... more Abstract In this work, the nonlinear dynamics of the tool and the thin cylindrical workpiece are studied simultaneously for turning operation. To capture the flexibility of thin workpiece, structural nonlinearity is taken into consideration. Regenerative chatter effect in turning operation is considered in terms of effective chip thickness which is driven by relative motion of the tool and the workpiece during the present cut and the earlier cut. Higher order method of multiple scales (MMS) is used to study the nonlinear responses and stability of tool and workpiece for both internal resonance and primary resonance conditions. The critical values of the cutting parameters like spindle speed, chip width (or depth of cut), cutting force coefficient, workpiece to tool stiffness ratio, and workpiece diameter to thickness ratio etc. are estimated using both time and frequency response curves to have stable chatter free turning operation. The effects of stiffness nonlinearities on the workpiece and the tool responses are also investigated.

Research paper thumbnail of Application of neural-networks and neuro-fuzzy systems for the prediction of short-duration forces acting on the blunt bodies

Soft Computing

Present studies deal with application of finite element method and intelligent soft computing tec... more Present studies deal with application of finite element method and intelligent soft computing techniques viz. neural network (NN) and adaptive neuro-fuzzy inference system (ANFIS) for the prediction of short duration impulse, ramp and hat forces. Two blunt bodies viz. a hemisphere and a blunt cone with cylindrical aft body have been considered in these investigations. Training of the NN and ANFIS has been carried out using one axial acceleration and two normal accelerations obtained from known input forces and a moment. It is shown here that the NN is unable to recover the unknown forces and moment. However, ANFIS-based strategy is found better for prediction of the same forces and moment. Thus, novelty of these studies exists in the assessment and successful implementation of the soft computing techniques like NN and ANFIS for prediction of the unknown short-duration force and moment time histories. These predictions are also cross-checked for the error, and it has been observed that the ANFIS can be used for short-duration force prediction in high-speed aerospace applications.

Research paper thumbnail of Reinforcement Learning via Recurrent Convolutional Neural Networks

2016 23rd International Conference on Pattern Recognition (ICPR), 2016

Research paper thumbnail of Nonlinear Dynamics of Axially Loaded Piezoelectric Energy Harvester

Procedia Engineering, 2016

Research paper thumbnail of Adaptive control for networked uncertain cooperative dual-arm manipulators: an event-triggered approach

Robotica

In this paper, an improved adaptive motion-force control approach is introduced to control the co... more In this paper, an improved adaptive motion-force control approach is introduced to control the cooperative manipulators transporting a shared object under limited communication. The adaptive controller is designed based on the backstepping approach to control the motion of the handled object in the presence of uncertainties and external disturbances. Moreover, the force controller is established to maintain constant internal forces. An event-triggered (ET) mechanism is derived based on the Lyapunov analysis to deal with the bandwidth restrictions and maintain the system stability during the cooperative manipulation. The effectiveness of the proposed control scheme is investigated by comparing it with the existing variations of adaptive backstepping control (i.e., traditional and state augmented schemes). Moreover, the designed triggering mechanism is compared with different triggering conditions presented in the literature. The proposed control approach is further validated in a mor...

Research paper thumbnail of Event-Triggered Adaptive Hybrid Position-Force Control for Robot-Assisted Ultrasonic Examination System

Journal of Intelligent & Robotic Systems

Research paper thumbnail of 3D printed hollow microneedles array using stereolithography for efficient transdermal delivery of rifampicin

International Journal of Pharmaceutics

Research paper thumbnail of Towards Neuro-Fuzzy Compensated PID Control of Lower Extremity Exoskeleton System for Passive Gait Rehabilitation

Research paper thumbnail of Tuning Proportional-Integral-Derivative Gains of a Three-Dimensional RRRP Pick and Place Robot for Asymptotic Trajectory Tracking

Journal of Dynamic Systems, Measurement, and Control

This paper uses the Floquet theory for tuning the feedback gains to stabilize the tracking errors... more This paper uses the Floquet theory for tuning the feedback gains to stabilize the tracking errors of a revolute-revolute-revolute-prismatic (RRRP) robot moving in a three-dimensional (3D) workspace. This robot is driven by a proportional-integral-derivative (PID) control law, tracking a time-varying trajectory in joint space, without knowledge of any bounds of the inertia matrix and/or Jacobian of the gravity vector. The Floquet theory is used to obtain the values of feedback gains for which the asymptotic stability of the tracking errors is obtained. The numerical results obtained by Floquet theory are verified by the tracking error plots and phase portraits. The obtained results will be very useful for the control of any industrial robot, required to perform repetitive tasks like assembly of parts and inspection of products, amongst others.

Research paper thumbnail of Development of Active Lower Limb Robotic-Based Orthosis and Exoskeleton Devices: A Systematic Review

International Journal of Social Robotics

Research paper thumbnail of Nonlinear dynamic response of pneumatic artificial muscle: A theoretical and experimental study

International Journal of Non-Linear Mechanics

Research paper thumbnail of Reinforcement Learning via Recurrent Convolutional Neural Networks

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially o... more Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable performance, they often ignore the structure of task. We present a natural representation of to Reinforcement Learning (RL) problems using Recurrent Convolutional Neural Networks (RCNNs), to better exploit this inherent structure. We define 3 such RCNNs, whose forward passes execute an efficient Value Iteration, propagate beliefs of state in partially observable environments, and choose optimal actions respectively. Backpropagating gradients through these RCNNs allows the system to explicitly learn the Transition Model and Reward Function associated with the underlying MDP, serving as an elegant alternative to classical model-based RL. We evaluate the proposed algorithms in simulation, considering a robot planning problem. We demonstrate the capability...

Research paper thumbnail of Transpose Jacobian Control of Flexible Joint Upper Limb Exoskeleton System

Lecture Notes in Mechanical Engineering

Research paper thumbnail of Vibration Analysis of a Cutting Tool with Piezoelectric Bimorph

In this work the health monitoring of the tool is carried out by using bimorph piezoelectric patc... more In this work the health monitoring of the tool is carried out by using bimorph piezoelectric patches on the single point cutting tool in turning process. The patches are mounted on the upper and lower surface of the shank of the tool. The vibration analysis of this system is carried out by modeling the tool as an Euler-Bernoulli cantilever beam subjected to transversal base excitation and periodic axial load. The loading is due to forces exerted by work piece on the tool. Extended Hamilton’s principle is used to obtain the governing equation of motion which has been discretized by using generalized Galerkin’s method to obtain the nonlinear temporal equation of motion. Method of multiple scales is used to investigate nonlinear response, generated voltage due to piezoelectric patches of the system. Two resonance conditions have been studied and it is shown that while the simple resonance condition produces the voltage in the order of micro volt, the principal parametric resonance cond...

Research paper thumbnail of Dynamics and Control of a Pneumatically Actuated Robotic Manipulator

This paper deals with the dynamics and control of a two degree of freedom robot arm actuated by p... more This paper deals with the dynamics and control of a two degree of freedom robot arm actuated by pneumatic artificial muscles (PAMs). The high power-weight ratio of PAMs justifies their use as actuators in robotics. To achieve trajectory tracking performance, controllers are constructed based on a dynamic model of the robot arm. Due to the high non-linear dynamics of the robotic system, fuzzy control is used for trajectory tracking tasks. The results in simulation are shown to achieve sufficiently good tracking performance.

Research paper thumbnail of Biomechanical Study and Prediction of Lower Extremity Joint Movements Using Bayesian Regularization-Based Backpropagation Neural Network

J. Comput. Inf. Sci. Eng., 2021

This work aims to estimate the lower-limb joint angles in the sagittal plane using Microsoft Kine... more This work aims to estimate the lower-limb joint angles in the sagittal plane using Microsoft Kinect-based experimental setup and apply an efficient machine learning technique for predicting the same based on kinematic, spatiotemporal, and biological parameters. Ten healthy participants from 19 to 50 years (33 ± 11.24 years) were asked to walk in front of the Kinect camera. Based on the skeleton image, the biomechanical hip, knee, and ankle joint angles of the lower-limb were measured using ni-labview. Thereafter, two Bayesian regularization-based backpropagation multilayer perceptron neural network models were designed to predict the joint angles in the stance and swing phase. The joint angles of two individuals, as a testing dataset, were predicted and compared with the experimental results. The test correlation coefficient for predicted joint angles has shown a promising effect of the proposed neural network models. Finally, a qualitative comparison was presented between the joint...

Research paper thumbnail of Design and fabrication of a novel three wheel robot with a SLE based lifting mechanism and line tracking capability

The present paper deals with the design and development of a modular three wheel robot capable of... more The present paper deals with the design and development of a modular three wheel robot capable of autonomously navigating a structured environment by means of tracking a curved line on the floor. Furthermore, it is equipped with a deployable scissor lift with an end effecter plate thus providing applicative modularity to the robot. The main application is envisaged to serve as an automatic guided vehicle in industries such as automotive and construction where cost effectiveness is an essential criterion for automation and mobility is a highly desirable functionality. Mechanical design is carried out using stress analysis with the help of the finite element software package ANSYS and velocity response curves are generated for the highly non-linear motion of the scissor lift. Finally an algorithm is developed for high speed line tracking using LED and phototransistor pairs and results are presented in terms of experimental data as well as simulated responses.

Research paper thumbnail of Effect of Blowing Agent CaCO3 Content on the Microstructure and Mechanical Properties of AA 5083 Foam

International Journal of Metalcasting

Research paper thumbnail of Design and Modeling of a Novel Mechanized Injection Platform

Proceedings of the Advances in Robotics 2019

In this work, a novel mechanized medical injection platform is modeled for automated drug deliver... more In this work, a novel mechanized medical injection platform is modeled for automated drug delivery and phlebotomy. The objective is to design a versatile device that can administer injections at various sites on the human body while being either bed-top or desktop. The machine consists of 6 degrees-of-freedom system including an independent end effector. The design is modeled in the SolidWorks software with required specifications. Thereafter, static structural analysis is carried out for the most critical component. Furthermore, the mathematical modeling is done in MATLAB to estimate the actuator torque for the end effector.

Research paper thumbnail of Dynamic analysis of a parametrically excited golden Muga silk embedded pneumatic artificial muscle

MATEC Web of Conferences, 2018

Research paper thumbnail of Nonlinear dynamic analysis of flexible workpiece and tool in turning operation with delay and internal resonance

Journal of Sound and Vibration

Abstract In this work, the nonlinear dynamics of the tool and the thin cylindrical workpiece are ... more Abstract In this work, the nonlinear dynamics of the tool and the thin cylindrical workpiece are studied simultaneously for turning operation. To capture the flexibility of thin workpiece, structural nonlinearity is taken into consideration. Regenerative chatter effect in turning operation is considered in terms of effective chip thickness which is driven by relative motion of the tool and the workpiece during the present cut and the earlier cut. Higher order method of multiple scales (MMS) is used to study the nonlinear responses and stability of tool and workpiece for both internal resonance and primary resonance conditions. The critical values of the cutting parameters like spindle speed, chip width (or depth of cut), cutting force coefficient, workpiece to tool stiffness ratio, and workpiece diameter to thickness ratio etc. are estimated using both time and frequency response curves to have stable chatter free turning operation. The effects of stiffness nonlinearities on the workpiece and the tool responses are also investigated.

Research paper thumbnail of Application of neural-networks and neuro-fuzzy systems for the prediction of short-duration forces acting on the blunt bodies

Soft Computing

Present studies deal with application of finite element method and intelligent soft computing tec... more Present studies deal with application of finite element method and intelligent soft computing techniques viz. neural network (NN) and adaptive neuro-fuzzy inference system (ANFIS) for the prediction of short duration impulse, ramp and hat forces. Two blunt bodies viz. a hemisphere and a blunt cone with cylindrical aft body have been considered in these investigations. Training of the NN and ANFIS has been carried out using one axial acceleration and two normal accelerations obtained from known input forces and a moment. It is shown here that the NN is unable to recover the unknown forces and moment. However, ANFIS-based strategy is found better for prediction of the same forces and moment. Thus, novelty of these studies exists in the assessment and successful implementation of the soft computing techniques like NN and ANFIS for prediction of the unknown short-duration force and moment time histories. These predictions are also cross-checked for the error, and it has been observed that the ANFIS can be used for short-duration force prediction in high-speed aerospace applications.

Research paper thumbnail of Reinforcement Learning via Recurrent Convolutional Neural Networks

2016 23rd International Conference on Pattern Recognition (ICPR), 2016

Research paper thumbnail of Nonlinear Dynamics of Axially Loaded Piezoelectric Energy Harvester

Procedia Engineering, 2016

Research paper thumbnail of Adaptive control for networked uncertain cooperative dual-arm manipulators: an event-triggered approach

Robotica

In this paper, an improved adaptive motion-force control approach is introduced to control the co... more In this paper, an improved adaptive motion-force control approach is introduced to control the cooperative manipulators transporting a shared object under limited communication. The adaptive controller is designed based on the backstepping approach to control the motion of the handled object in the presence of uncertainties and external disturbances. Moreover, the force controller is established to maintain constant internal forces. An event-triggered (ET) mechanism is derived based on the Lyapunov analysis to deal with the bandwidth restrictions and maintain the system stability during the cooperative manipulation. The effectiveness of the proposed control scheme is investigated by comparing it with the existing variations of adaptive backstepping control (i.e., traditional and state augmented schemes). Moreover, the designed triggering mechanism is compared with different triggering conditions presented in the literature. The proposed control approach is further validated in a mor...

Research paper thumbnail of Event-Triggered Adaptive Hybrid Position-Force Control for Robot-Assisted Ultrasonic Examination System

Journal of Intelligent & Robotic Systems

Research paper thumbnail of 3D printed hollow microneedles array using stereolithography for efficient transdermal delivery of rifampicin

International Journal of Pharmaceutics

Research paper thumbnail of Towards Neuro-Fuzzy Compensated PID Control of Lower Extremity Exoskeleton System for Passive Gait Rehabilitation

Research paper thumbnail of Tuning Proportional-Integral-Derivative Gains of a Three-Dimensional RRRP Pick and Place Robot for Asymptotic Trajectory Tracking

Journal of Dynamic Systems, Measurement, and Control

This paper uses the Floquet theory for tuning the feedback gains to stabilize the tracking errors... more This paper uses the Floquet theory for tuning the feedback gains to stabilize the tracking errors of a revolute-revolute-revolute-prismatic (RRRP) robot moving in a three-dimensional (3D) workspace. This robot is driven by a proportional-integral-derivative (PID) control law, tracking a time-varying trajectory in joint space, without knowledge of any bounds of the inertia matrix and/or Jacobian of the gravity vector. The Floquet theory is used to obtain the values of feedback gains for which the asymptotic stability of the tracking errors is obtained. The numerical results obtained by Floquet theory are verified by the tracking error plots and phase portraits. The obtained results will be very useful for the control of any industrial robot, required to perform repetitive tasks like assembly of parts and inspection of products, amongst others.

Research paper thumbnail of Development of Active Lower Limb Robotic-Based Orthosis and Exoskeleton Devices: A Systematic Review

International Journal of Social Robotics

Research paper thumbnail of Nonlinear dynamic response of pneumatic artificial muscle: A theoretical and experimental study

International Journal of Non-Linear Mechanics