User study of sensorless adaptive haptic assistance for bilateral teleoperation

Jorge Sofrony Esmeral; Tobias Ring

doi:10.17533/udea.redin.20220993

Caso de estudio de una estrategia de asistencia háptico-adaptativa de teleoperación bilateral sin sensores

Autores/as

Jorge Sofrony Esmeral Universidad Nacional de Colombia https://orcid.org/0000-0003-3159-1280
Tobias Ring University of Kassel https://orcid.org/0000-0002-0167-4096

DOI:

https://doi.org/10.17533/udea.redin.20220993

Palabras clave:

Control Bilateral Háptico, Teleoperación, Modelos de Difusión, Control Adaptativo,, Modelos de Toma de Decisiones

Resumen

Este artículo presenta un esquema de asistencia háptica sin sensor para telerobótica controlada compartida bilateral, más específicamente se enfocará en la implementación de un esquema de asistencia adaptativa desarrollado previamente por uno de los autores. Para la aplicación del esquema de asistencia adaptativa, se establece una configuración de teleoperación con un robot esclavo virtual y un robot maestro real (dispositivo de control háptico) utilizando un dispositivo háptico comercial (de bajo costo), a saber, el háptico Novint Falcon dispositivo. Un problema en la configuración de la teleoperación es la falta de sensores para medir la fuerza de contacto entre el operador humano y el dispositivo de control háptico (es decir, solo se mide la posición del robot maestro), que es necesaria para la aplicación de la asistencia adaptativa. Se propone un aumento de estimación de perturbación de un observador de entrada desconocido con una red neuronal, que permite la estimación de la fuerza humana (externa) bajo incertidumbre de la planta y perturbaciones externas. El documento presenta los resultados de implementación de un problema de seguimiento de ruta (conocido) con evitación de obstáculos (desconocidos), y se presenta un análisis estadístico sobre la efectividad de los esquemas.

|Resumen

= 403 veces | PDF (ENGLISH)

= 246 veces| | HTML (ENGLISH)

= 0 veces| | XML (ENGLISH)

= 0 veces|

Descargas

Biografía del autor/a

Jorge Sofrony Esmeral, Universidad Nacional de Colombia

Profesor e Investigador

Tobias Ring, University of Kassel

Investigador con título en Maestría

Citas

N. Glies and M. Hatzel, “Innovative human-robot cooperation in bmw group production,” BMW Group, Sept. 10, 2013.

L. Göbölös, J. Ramahi, A. Obeso, T. Bartel, M. Traina, A. Edris, F. Hasan, and J. Bonatti, “Robot-assisted totally endoscopic coronary bypass surgery,” Indian Journal of Thoracic and Cardiovascular Surgery, vol. 34, no. 2, pp. 94–104, 2018.

G. Niemeyer, C. Preusche, and G. Hirzinger, “Telerobotics,” in Handbook of Robotics, B. Siciliano and O. Khatib, Eds.

Berlin/Heidelberg: Springer, 2008, pp. 741–757.

S. Hayati and S. T. Venkataraman, “Design and implementation of a robot control system with traded and shared control capability,” in Proceedings of the 1989 IEEE International Conference on Robotics and Automation, Scottsdale, Arizona, USA, 1989, pp. 1310–1315.

L. B. Rosenberg, “Virtual fixtures: Perceptual tools for telerobotic manipulation,” in Proceedings of the IEEE Virtual

Reality International Symposium, Seattle, Washinton, USA, 1993, pp. 76–82.

J. A. Corredor Camargo, “Adaptive assistance-based on decision-making models for telerobotics systems,” Ph.D. thesis, Universidad Nacional de Colombia, Bogotá, Colombia, 2016.

C. Passenberg, A. Glaser, and A. Peer, “Exploring the design space of haptic assistants: The assistance policy module,”

IEEE transactions on haptics, vol. 6, no. 4, pp. 440–452, 2013.

J. Smisek, W. Mugge, J. B. J. Smeets, M. M. van Paassen, and A. Schiele, “Adapting haptic guidance authority based on user grip,” in Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, California, USA, 2014, pp. 1516–1521.

A. C. Smith, F. Mobasser, and K. Hashtrudi-Zaad, “Neuralnetwork-based contact force observers for haptic applications,”

IEEE Transactions on Robotics, vol. 22, no. 6, pp. 1163–1175, 2006.

S. Lichiardopol, N. van de Wouw, and H. Nijmeijer, “Boosting human force: A robotic enhancement of a human operator’s force,” in 47th IEEE Conference on Decision and Control, Cancún, Mexico, 2008, pp. 4576–4581.

S. Katsura, Y. Matsumoto, and K. Ohnishi, “Shadow robot for teaching motion,” Robotics and Autonomous Systems,

vol. 58, no. 7, pp. 840–846, 2010.

A. Gupta and M. K. O’Malley, “Disturbance-observer-based force estimation for haptic feedback,” Journal of Dynamic

Systems, Measurement, and Control, vol. 133, no. 1, pp. 014 505–1–014 505–4, 2011.

W.-H. Chen, D. J. Ballance, P. J. Gawthrop, and J. O’Reilly, “A nonlinear disturbance observer for robotic manipulators,” IEEE Transactions on Industrial Electronics, vol. 47, no. 4, pp. 932–938, 2000.

C. Mitsantisuk, S. Stapornchaisit, N. Niramitvasu, and K. Ohishi, “Force sensorless control with 3d workspace analysis

for haptic devices based on delta robot,” in Proceedings of the 41st Annual Conference of the IEEE Industrial Electronics

Society (IECON 2015), Yokohama, Japan, 2015, pp. 1747–1752.

Y. Tian, Z. Chen, T. Jia, A. Wang, and L. Li, “Sensorless collision detection and contact force estimation for collaborative

robots based on torque observer,” in Proceedings of the 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), Quingdao, China, 2016, pp. 946–951.

J. M. Daly and D. W. Wang, “Time-delayed bilateral teleoperation with force estimation for n-dof nonlinear robot

manipulators,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. ), 2010, pp. 3911–3918.

L. Chan, F. Naghdy, D. Stirling, and M. Field, “Nonlinear bilateral teleoperation using extended active observer

for force estimation and disturbance suppression.” Robotica, vol. 33, no. 1, 2015.

S. A. M. Dehghan, H. R. Koofigar, H. Sadeghian, and M. Ekramian, “Observer-based adaptive force–position control

for nonlinear bilateral teleoperation with time delay,” Control Engineering Practice, vol. 107, 2021.

S. Martin and N. Hillier, “Characterisation of the novint falcon haptic device for application as a robot-manipulator,”

in Proceedings of the Australasian Conference on Robotics and Automation 2009, Sydney, Australia, 2009, pp. 177–

R. E. Stamper, “A three degree of freedom parallel manipulator with only translational degrees of freedom,” Ph.D. thesis, University of Maryland, College Park, Maryland, USA, 1997.

K. Waldron and J. Schmiedeler, “Kinematics,” in Handbook of Robotics, B. Siciliano and O. Khatib, Eds.

Berlin/Heidelberg: Springer, 2008, pp. 9–33.

C. S. Dias Carvalheiras, “A parallel manipulator for prostate cancer biopsies: Kinematic optimization, design and control planning,” Master thesis, Universidade de Lisboa, Lisbon, Portugal, 2017.

R. Featherstone and D. E. Orin, “Dynamics,” in Handbook of Robotics, B. Siciliano and O. Khatib, Eds. Berlin/Heidelberg: Springer, 2008, pp. 35–65.

N. Karbasizadeh, A. Aflakiyan, M. Zarei, M. Tale Masouleh, and A. Kalhor, “Dynamic identification of the novint falcon

haptic device,” in The 4th RSI International Conference on Robotics and Mechatronics (ICRoM 2016), Teheran, Iran,

, pp. 518–523.

L. J. Findley, “Classification of tremors,” Journal of Clinical Neurophysiology, vol. 13, no. 2, pp. 122–132, 1996.

A. Mohammadi, M. Tavakoli, H. J. Marquez, and F. Hashemzadeh, “Nonlinear disturbance observer design for robotic manipulators,” Control Engineering Practice, vol. 21, no. 3, pp. 253–267, 2013.

X. Wang, L. Guo, and Y. Jia, “Online sensing of human steering intervention torque for autonomous driving actuation

systems,” IEEE Sensors Journal, vol. 18, no. 8, pp. 3444–3453, 2018.

J. Hu and R. Xiong, “Contact force estimation for robot manipulator using semiparametric model and disturbance

kalman filter,” IEEE Transactions on Industrial Electronics, vol. 65, no. 4, pp. 3365–3375, 2018.

B. Hannaford, Okamura, and Allison M., “Haptics,” in Handbook of Robotics, B. Siciliano and O. Khatib, Eds. Berlin/Heidelberg: Springer, 2008, pp. 719–739.

M. de Pascale and D. Prattichizzo, “The haptik library: A component based architecture for uniform access to haptic

devices,” IEEE Robotics & Automation Magazine, vol. 14, no. 4, pp. 64–75, 2007.

R. K. Groten, “Haptic human-robot collaboration: How to learn from human dyads,” Ph.D. thesis, Technische Universität

München, Munich, Germany, 2011.

Descargas

Publicado

2022-09-19

Cómo citar

Sofrony Esmeral, J., & Ring, T. (2022). Caso de estudio de una estrategia de asistencia háptico-adaptativa de teleoperación bilateral sin sensores. Revista Facultad De Ingeniería Universidad De Antioquia, (108), 81–97. https://doi.org/10.17533/udea.redin.20220993

Descargar cita

Número

Núm. 108 (2023): Revista Facultad de Ingeniería (Jul-Sep 2023)

Sección

Artículo de investigación

Licencia

Derechos de autor 2022 Revista Facultad de Ingeniería Universidad de Antioquia

Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-CompartirIgual 4.0.

Los artículos disponibles en la Revista Facultad de Ingeniería, Universidad de Antioquia están bajo la licencia Creative Commons Attribution BY-NC-SA 4.0.

Eres libre de:

Compartir — copiar y redistribuir el material en cualquier medio o formato

Adaptar : remezclar, transformar y construir sobre el material.

Bajo los siguientes términos:

Reconocimiento : debe otorgar el crédito correspondiente , proporcionar un enlace a la licencia e indicar si se realizaron cambios . Puede hacerlo de cualquier manera razonable, pero no de ninguna manera que sugiera que el licenciante lo respalda a usted o su uso.

No comercial : no puede utilizar el material con fines comerciales .

Compartir igual : si remezcla, transforma o construye a partir del material, debe distribuir sus contribuciones bajo la misma licencia que el original.

El material publicado por la revista puede ser distribuido, copiado y exhibido por terceros si se dan los respectivos créditos a la revista, sin ningún costo. No se puede obtener ningún beneficio comercial y las obras derivadas tienen que estar bajo los mismos términos de licencia que el trabajo original.

Citations

Citation Indexes: 1

Captures

Readers: 4

Mentions

News Mentions: 1

see details

1. Introduction

Telerobotics is a special area of study within the field of human-robot interaction. The general teleoperation setup is composed of a robot (slave robot) that is remotely controlled by a human operator via a control device (master robot). Telerobotics is useful in tasks that present themselves as difficult (oreven impossible) to perform by human operators (e.g., micro-manipulation), or which takes place in dangerous environments (e.g., handling radioactive material). Robots exceed human capacities in terms of precision and force. On the other hand, humans are able to react quickly to new situations and environmental changes. In human-robot interaction (HRI), the physical advantages of the robot are united with the cognitive advantages of the human. This type of cooperation can help in the execution of complex robotic tasks which cannot be automated or demand a high technological effort to be fully automated. Examples of applied HRI can be found in manufacturing [1] and medicine [2].

Telerobotics, as described in [3], is the control of a robot by a human operator located at a remote site.

The human uses a control device (master robot) to send control commands to the remote-controlled robot (slave robot). That robot then executes those commands, while the human operator is monitoring the execution via a visual or audiovisual channel. Figure 1 illustrates a simple teleoperation environment. In bilateral telerobotics, the human operator not only sends commands to the slave robot, but also receives information from it.

Figure 1: Sketch of a teleoperation environment

Such information comprises, for example, the existing contact force between the slave robot and objects in its environment. This information can then be displayed haptically at the operator’s side and may be used to enhance task performance. Depending on the application, the robot can make autonomous decisions (supervisory control) or can be programmed to follow the operator’s commands directly (direct control). A control strategy that is somewhere in between supervisory control and direct control is shared control. In shared control, autonomous trajectories may be modified by the human operator (e.g., to track unmodelled target motions), while trajectories of the operator may also be modified autonomously by the robot (e.g., compliance when the robot comes in contact with unknown obstacles) [4]. Thus, bilateral shared control is used when the human operator needs assistance during a teleoperation task that requires sudden changes within parts of the predefined task i.e., the master and the slave actively change roles.

In many teleoperation tasks, it is helpful for the human operator to be assisted by some teleoperation control system. Assistance can be provided through audio, visual and/or haptic channels. A common assistance method in bilateral shared controlled teleoperation tasks is the use of virtual fixtures. These are virtual elements helping the operator to move the robot along a desired path (guidance virtual fixtures, GVFs) and/or restricting the slaves movements within certain areas (forbidden region virtual fixtures, FRVFs) [5]. Virtual fixtures reduce the mental load of the human operator and improve precision and performance of a teleoperation task and can be modeled as compliant and/or damped surfaces, frictional contacts or potential fields. Virtual fixtures work as follows: if the human operator controls the slave robot away from the desired path, they receive an assistance force

in the haptic control device, which pushes the user back to the desired path. Here, y is the position of the slave robot, y _d is the desired position, k _⊥ the stiffness of the GVF and d _⊥ its damping coefficient. The values for the parameters k _⊥, d _⊥ have to be chosen depending on the teleoperation setup and the task, and have generally been chosen as fixed control gains.

If the environment where the teleoperation task takes place is only partially known or unexpected things happen during the task, constant assistance gains may not be suitable or may even disturb the operator, leading to anadditional mental workload for the user and increasing the risk of not executing the task correctly. In the case of using virtual fixtures for assistance, changing their properties (e.g., the impedance of a spring-damper virtual fixture) due to an adaptation rule could lead to appropriate assistance in unknown situations. Adaptive assistance in telerobotics is a rather young field of research and has been addressed in [6] and the references therein. It has been shown that in contrast to constant (structured) assistance, the operators may benefit from adaptive schemes during unforeseen situations (e.g., unknown obstacles on the desired path).

in the haptic control device, which pushes the user back to the desired path. Here, y is the position of the slave robot, yd is the desired position, k⊥ the stiffness of the GVF and d⊥ its damping coefficient. The values for the parameters k⊥, d⊥ have to be chosen depending on the teleoperation setup and the task, and have generally been chosen as fixed control gains. If the environment where the teleoperation task takes place is only partially known or unexpected things happen during the task, constant assistance gains may not be suitable or may even disturb the operator, leading to an additional mental workload for the user and increasing the risk of not executing the task correctly. In the case of using virtual fixtures for assistance, changing their properties (e.g., the impedance of a spring-damper virtual fixture) due to an adaptation rule could lead to appropriate assistance in unknown situations. Adaptive assistance in telerobotics is a rather young field of research and has been addressed in [6] and the references therein. It has been shown that in contrast to constant (structured) assistance, the operators may benefit from adaptive schemes during unforeseen situations (e.g., unknown obstacles on the desired path).

The main contribution of this paper is two-fold: first, we propose a data-driven observer to estimate the force exerted by the human operator in a novel adaptive assistance scheme; second, we perform a detailed statistical analysis of experimental results, providing evidence of the performance of the assistance scheme. In the former, a regression model is proposed and a Neural Network (NN) is used to estimate the output of the unforced system (nominal dynamics). Our main contribution is the analysis of two different training architectures that seek to increase robustness in the model identification process and hence produce better estimations of the operator’s force induced on the master device. In the later contribution, an experimental setup was implemented using a commercially-off-the-shelf master device and a set of tests were performed. This work caters for a better understanding of bilateral shared control schemes for teleoperation tasks and of what are the effects of not having a direct measurement of the operator’s exerted force. These results, in conjunction with those presented in Corredor et al. [6], permit a fair comparison of the task performance in both cases and allow for “objective” conclusions (the effect of other sources of uncertainty and complexity are removed) to be drawn. This paper allows for a better understanding of how the use of estimators affects the real-life application of advanced, highly immersive, teleoperation schemes. The remainder of this work is organized as follows. Section 2 provides an overview of recent research in adaptive assistance in telerobotics and sensorless human force estimation in HRI and telerobotics. Section 3 presents preliminary work in the field of (nonlinear) estimation of external inputs (Unknown Input Observers - UIO) in the field of robotics; an introduction for basic robot kinematics and dynamics and a Neural Network augmentation is introduced in order to take care of system uncertainties and external disturbances that are not of interest to the haptic feedback. In Section 4, the established teleoperation setup is proposed. It is important to highlight that communication delays are not considered as of yet. Finally, in Section 5, the user study is presented, followed by some concluding remarks on the work and its results.

2. Preliminaries

This section gives an overview of recent research in adaptive assistance in telerobotics and about sensorless human force estimation in HRI. The state-of-the-art in adaptive assistance reveals that the interaction force between the human operator and the master robot provides rich information about human’s behavior in teleoperation tasks. However, force sensors are not the standard for commercially available haptic control devices, especially not for the low-cost devices such as the Novint Falcon. This fact motivates the integration of an estimator for the operator’s force within the HRI context.

2.1 Adaptive haptic assistance in telerobotics

Adaptive haptic assistance in telerobotics still is a rather young field of research. A study with different haptic assistance policies in telerobotics is presented in [7]. In their teleoperation scenarios, a virtual box has to be guided through a maze without and with obstacles that have to be avoided, and GVFs are implemented to support the user. In the study, one constant assistance policy and two adapting policies (switching and linear continuously adapting) are compared according to task performance, disagreement, perceived workload by the users and efficiency. One conclusion of that study is that adaptive assistance policies have the potential to outperform constant assistance when taking into account multiple performance measures. For known environments with obstacles in particular, adapting policies provide more flexibility. However, the authors also conclude that it cannot be said generally that continuously adapting policies are better than switching policies or vice versa according to their evaluation metrics.

The work in [8] also proposes a study to compare constant and adaptive haptic assistance in telerobotics.

The focus of that study is the analysis of how the assistance system behaves when unpredictable disturbances arise. Therefore, scenarios with disturbances forces are established; also, adapting the assistance is developed by changing the stiffness of the GVF linearly with the user grip force measured by force sensors. The authors conclude that adaptive assistance achieves similar performance to high gain (strong guidance) constant assistance. However, adaptive assistance reduces the steering force necessary to overcome situations with unpredictable disturbances.

Corredor et al. [6] developed a nonlinear continuously adapting assistance policy with the intention to make the assistance react more “human-like” in partially known environments. The assistance system is based on the drift-diffusion model (DDM), a decision-making model from cognitive science. The DDM represents a decision-making process as a Two-Alternative Force Choice (TAFC) task depending on past decisions. In [6], the DDM is integrated into the assistance system to adapt the impedance of a spring-damper GVF in order to improve the performance of the teleoperation task with unknown obstacles. The adaptive assistance proposed by Corredor et al. is more complex than systems with linearly adapting policies, which makes it interesting for further investigation. That study concludes that adaptive strategies that preserve the transparency of the interaction present better performance.

2.2 Sensorless human force estimation for HRI

In the field of sensorless external force estimation in robotics, a lot of research has been done, where human force estimation in HRI can be seen as a special case of sensorless external force estimation. In [9], the authors propose a neural network-based contact force observer for haptic applications. They use an MLP neural network to model the inverse dynamics of a 3-DOF Planar Twin-Pantograph haptic device. However, only sensor signals from the joint angles are available, so the velocities and accelerations are obtained using derivative filters. In [10], the problem of estimating human force, while lifting heavy unknown masses with robotic assistance, is tackled. The human force estimation is formulated as a linear control problem where precise knowledge about the robot dynamics is necessary. The work in [11] proposes a twin robot system called shadow robot to estimate human force. The system consists of two robots of the same type, where one robot is constrained by the human, while the other one can move freely. The robots are controlled in position, velocity and acceleration via a control based on a disturbance observer. By subtracting the disturbance torque in the unconstrained robot from the constrained one, the human force is extracted. In [12], the nonlinear disturbance observer proposed by [13] is used for human force estimation in a 1 DOF haptic device. To estimate the human force, a parametric dynamic model (including friction terms) of the device is required. This allows the separation of the observed disturbance torque into a friction term and the applied human force. In [14], a Kalman filter disturbance observer was implemented in order to estimate human force for a delta robot. The disturbance torque is estimated by using measures of the motor currents and the joint angles. That disturbance torque observer is very similar to the one used in [11]. However, this work does not mention how to deal with model uncertainties and unmodeled dynamics in order to separate the torque caused by the operator from those due to disturbances. A sensorless approach to estimate human force for collision detection in HRI is proposed in [15]. A collision torque observer, based on a nominal dynamic model with generalized momentum, is used. The use of the generalized momentum makes acceleration information unnecessary, which is usually not directly measured in robotic systems. Hence, only the joint angles, angular velocities and motor torques are needed for the proposed approach. Model uncertainties and friction parameters are identified using a genetic algorithm.

In [16-18], model-based techniques are proposed in order to estimate external forces under communication time delays. Convergence proofs rely on Lyapunov methods and these works concentrate mostly on enhancing robustness against time-delays of the estimator.

Figure 2: Coordinate frames for the N ovint Falcon kinematics

The approach we follow is somewhat different in the sense that we opt for a data-driven approach, where the model is trained a priori. In this sense, time delays are assumed to be negligible. Although this assumption is strong, we prefer to concentrate on the mechanics of shared control and the effect that the lack of force sensors has on the overall task execution performance.

3. Human interaction force estimation

For the application of the adaptive assistance, it is necessary to have information about the force that the human operator exerts on the master robot. Because the Novint Falcon is not equipped with any force (or velocity) sensors, the so-called human force must be estimated. In this paper, the human force is estimated in a similar fashion to the approach in [12]. First, a simplified rigid body dynamic model is derived for the master robot, namely the nominal model. Then, a nonlinear disturbance observer (NDOB) for robots is proposed and applied for the Novint Falcon. The idea is that the observer estimates the sum of all torques due to external forces, as well as model uncertainties and unmodeled dynamics. Then, in order to separate the torques due to external forces (in our case, the human force) from remaining disturbances, a neural network (NN) based estimator is proposed.

3.1 Nominal master robot dynamics Kinematics

The vector of joint variables is defined as , where n _q is the number of the actuated joints and the robot’s position with respect to a fixed workspace coordinate frame is described by the vector , where np is the number of DOF of the end-effector. The Novint Falcon has three DOF and three actuated joints, thus, n _q = n _p = 3 with parameters as presented in [19].

In [20], the inverse kinematics in the coordinate frames L _i (see Figures 2 and 3 for the position of the coordinate frames) are derived. Because the end-effector’s position is only known with respect to H, the coordinates are transformed to L _i . The position of the coordinate frame H

Figure 3: Labeling of the links and joint angles

with respect to L _i can be described by the homogeneous transformation matrix (see Equation (1)]

with the rotation matrix and the displacement vector The values for the rotation angles and displacements are given in Table 1, [19]. Hence, the coordinates of the end-effector’s position p with respect to L _i can be transformed using (2). From (3), (4) and (5) the equations for the inverse kinematics can be obtained as

from the known end-effector position ^H p. Using trigonometric relations, elements of ^Li p can be expressed as functions of the joint angles θ _ji as

The detailed steps for the derivation of the inverse kinematics can be found in [20]. Due to the constructive design of the Novint Falcon and the restrictions of the joint angles, a unique solution, out of the four theoretical possible solutions, can be obtained (see (6) - (8)], as:

Equation (7) may be used; as an alternative to (8), the following equation may be used instead:

The Jacobian matrix J for the Novint Falcon is derived. With J, velocities and forces can be transformed from the joint space to the workspace and vice versa [21] using the relation in (9).

with f being the force vector at the end-effector and τ being the torques at the actuated joints.

A derivation of J for the Novint Falcon can be found in [22]. The inverse Jacobian matrix is given by:

Dynamics

The rigid body dynamics of a robot are described in the joint space formulation by the differential Equation (10)

with M(q) being the symmetric and positive definite inertia matrix, being the Coriolis and centrifugal matrix and g (q) being the gravity vector [23]. Regarding the Novint Falcon, q is the vector of the three joint angles for the actuated joints θ _1i .

In [20], a simplified rigid body dynamic model for a mechanism such as the Novint Falcon is proposed. With the following simplifications

The mass of each connecting rod, m _b , is evenly distributed and concentrated at the joints B and E.
The masses of the links m _e and m _d are negligible.
The inertia of link a is approximated by the inertia of a thin rod

Define nominal matrices (11) and (12)

with I being the identity matrix and γ being the gravity constant (see Table 2 for further formula symbols).

The parameters for that dynamic model have been experimentally identified by Karbasizadeh et al. [24] and are aγ = −0.0298, m = 0.8653, I_A = 0.0004

3.2 Joint velocity estimation

For the application of the NDOB, information about the joint velocities is necessary. However, those velocities cannot be measured directly and thus, they have to be estimated from the computed joint angles. A simple “dirty” differentiator is used (see Equation (13)], i.e., velocities are obtained by applying the low pass filter

Hence, the estimated joint velocities are declared as filtered velocities The cut-off frequency is chosen as ω _c = 100 rad/s. It is assumed that the Novint Falcon end effector does not move with a higher frequency because it is constrained by the human operator during task execution and the maximum tremor frequency of the human hand can be located at approximately 12 Hz [25]. The advantage of the joint velocity estimation with (13) is its computational simplicity, which leads to a low computational effort and thus, it is useful for real-time applications at the expense of being less precise.

3.3 Nonlinear disturbance observer

In this section, the NDOB for robots proposed in [13,26] is revisited. Define a new variable that sums the gravity, Coriolis and centrifugal terms as in Equation (14)

The nominal model is not exact, hence the robot dynamics (see Equation (15)] consist of the nominal model and model uncertainties:

Furthermore, τ _c are the actuation torques (control torques). Rigid body movements of a robot are usually described by the ordinary differential Equation (10). Besides rigid body movements, no exogenous excitations such as friction are considered in the model. Inserting (14) into (10), inserting (15) into the resulting equation and then adding a friction τ f and external forces τ _ext term, leads to the extended model:

The uncertainties of the extended models are lumped in a disturbance torque (16)

Thus, the extended model has the form

Chen et al. propose in [13] a NDOB for an estimation of the disturbance torque Based on the observer (17)

Where is the observer gain matrix. Alternatively, the auxiliary variable , where is a user-defined function and may be used for estimation.

Taking the time derivative of z as in Equation (18)

and defining (19)

the time derivative (18) may be rewritten as

In contrast to the observer (17), the new observer (20) does not need information about the joint acceleration (see [13]). Mohammadi et al. [26] generalize the observer (20) and the way to obtain an observer gain matrix. They define

with X being a constant, invertible n × n matrix and M_no being symmetric and positive definite. By inserting (21) into (19), it can be shown that The convergence may be established (see [26]) via Lyapunov analysis. The disturbance tracking error converges exponentially to zero if there exists positive definite and symmetric matrix X and positive semi-definite matrix Γ such that Equation (22)

Furthermore, Mohammadi et al. show that the minimum convergence rate of the disturbance tracking error is , where denotes the minimum eigenvalue of a matrix with parameters as in Equation (23)

Using the upper bound on , inequality (22) can then be rewritten as the linear matrix inequality (24) (with a specific choice of parameters (25)]

with Y = X ⁻¹ . An explicit analytical solution of the LMI (24) is obtained for the case

with y and κ being constant scalars. It can be shown that the case (25) leads to with β being the minimum convergence rate of the tracking error. As a trade-off between fast convergence and noise sensitivity, a suitable choice, as in Equation (26) is proposed as

as an analytical solution of the LMI.

Regarding (23), the upper bounds of are necessary. However, the 2-norm of those matrices is hardly feasible in analytical form. Using (11) and the triangle inequality,

where the identity ∥J^T∥₂ = ∥J∥₂ has been used. With (27), a conservative estimation for σ can be obtained. However, the problem of how to obtain max{∥J∥₂} still remains. Due to this, it has been decided to approximate max{∥J∥₂} by computing ∥J∥₂ for a set of 106 uniformly distributed end effector positions. Thus, σ ≤ 0.1116 is computed from (27).

The time derivative of the inertia matrix

can be obtained from the skew-symmetric property of the matrix M˙ (q) − 2C (q, q˙) [23] and by taking (11) for the Coriolis and centrifugal matrix of the nominal model, the 2-norm can be upper bounded by

The bound is obtained by using the identity . Obtaining an approximation of is not as trivial as with because the dimension of the search space for the upper bound increases from three to six dimensions due to the additional independent joint velocities . Hence, the assumption is made which leads to ζ ≤ 0.6024.

Besides information about the upper bounds of M_no (q) and , also a minimum convergence rate must be determined for (26). Wang et al. [27] determined the minimum convergence rate of an observer for an automotive steering wheel according to the maximum input frequency f _max of the system. They analyzed the step response of the observer and chose a convergence rate, so that within a time of the threshold value is reached close enough. Taking ω _c from (13) as the maximum angular frequency input ω _max . Now β is chosen high enough, so that the observer reaches 95 % of the threshold value within seconds. The value for β is found by trial and error via simulation of [20]. With β ≥ 2.8, a sufficiently high convergence rate is found. Finally, with the values for σ, ζ and β the gain matrix Y = 0.6137 I is obtained.

3.4 Neural network-based estimation of model uncertainties and unmodeled dynamics

According to (16), the model uncertainties and unmodeled dynamics of the master robot are

The idea is now to estimate τ u with a NN in order to separate τ ext from the τ d. For the generation of training and test data, the Novint Falcon end-effector tracks a reference position trajectory under closed-loop control, where the end-effector positions and control forces are recorded and transformed into joint space using the already proposed kinematic relations. The joint velocities are then estimated from the joint angles using the filter [13]. It should be mentioned that during the data generation, no human interaction with the robot takes place; thus, τ _ext = 0.

Figure 4: NN training scheme for Method 1

Figure 5: NN training scheme for Method 2

For the training of the NN, two different methods are proposed and compared. The first method is inspired by the work of Hu and Xiong [28]. In this approach, a semiparametric model is proposed to identify the robot dynamics. The training scheme for Method 1 is shown in Figure 4. The nominal model is simulated with the recorded motion data as input. Additionally to the joint angles and velocities, joint accelerations are also necessary, which are estimated from using [13]. The difference between τ _c and τ _no is τ _u, is the training target for a multilayer perceptron (MLP) NN.

The second method assumes that no human interaction with the master robot leads to τ _d = τ _u. That means that the NDOB [20] can be used to produce the target data for the NN. The training scheme for Method 2 is shown in Figure 5.

For both methods, the NN has six inputs: three joint angles θ_1i and their respective joint velocities . The output is the three-dimensional vector The NN itself contains, in each case, one hidden layer with five neurons. Although that configuration is rather simple, no improvements in the estimation with more complex NNs (more hidden layers and/or neurons) were observed. As activation functions, hyperbolic tangent sigmoid functions are used, while the neurons in the output layer have linear activation functions. A set of 10,000 samples is used for training and the NNs are trained with the Levenberg-Marquardt backpropagation algorithm, while 10 % of the training data is used for training validation.

The resulting NN’s do not approximate fast varying disturbances and peaks very well. Peaks in the torques arise on the one hand, due to peaks in joint velocities, on the other hand due to inauspicious combinations of joint positions and velocities in the computation of Due to noticeably lower RMSE and MAE, the NN trained by Method 2 is used in the human force estimation in this work.

4. Teleoperation setup

In this section, the teleoperation setup of this work is presented. The setup, which has been implemented in MATLAB/Simulink, is shown in Figure 6. The general idea is to control a virtual mobile robot as a slave robot with the Novint Falcon as a master robot. The block Human force estimation in Figure 6 contains the nominal model of the Novint Falcon with its kinematics, the joint velocity estimation, the NDOB and the NN. The teleoperation task takes place in a virtual environment and is visualized with a MATLAB plot window (see Figure 7], which is updated with a rate of 25 Hz. The virtual mobile robot is presented as a proxy in the plot window. The obstacle is designed as a red square and the desired path as a solid black line.

4.1 Master robot

The Novint Falcon is a low-cost haptic control device for video games, developed by the former company Novint Technologies, Inc. It is capable to produce forces of up to 2 lbs and its workspace is roughly 4 × 4 × 4 inches. The control torques are updated with a frequency of 1 kHz, which is a typical value for a realistic haptic sensation [29]. In the teleoperation setup, the Novint Falcon communicates with MATLAB/Simulink via the Haptik Library [30].

Figure 7: Visualization of the teleoperation task

Novint Falcon communicates with MATLAB/Simulink via the Haptik Library [30].

4.2 Slave robot control

The virtual mobile robot is simplified to a holonomic point moving in a 2D workspace. The human operator controls the velocity of the slave robot by moving the Novint Falcon end-effector. There, the x-y-elements of Hp are proportional to the velocity vector of the slave robot. By integrating the slave robot’s velocity with respect to time, the actual position of the mobile robot is obtained.

4.3 Adaptive assistance

In this subsection, the adaptive haptic assistance proposed in [6] is revisited. The idea of the adaptive assistance is to schedule the level of assistance depending on the task objective, which can change over time due to uncertain environments. A decision-making model decides between two different objectives: to improve task performance or interaction performance. Depending on the decisions, the properties of the GVF are changed. The GVF in this work is designed as a system that forces the robot to return to the desired path with a control action given by

with fa⊥ being the assistance force perpendicular to the desired path, d⊥ the damping coefficient, k⊥ the stiffness and the deviation of the slave robot from the desired path defined as

The stiffness of the GVF, which is the only parameter varied by the adaptive assistance here, is mapped as a linear homotopy function k_⊥ = αk _low + (1 − α)k _high , with assistance level α ∈ [0; 1[ and upper and the lower bounds for the stiffness k _high and k _low . It can be seen that a low α leads to a more stiff GVF and a high α to a less stiff GVF.

The performance of the teleoperation task is evaluated by two different metrics: Task performance TP and interaction performance IP . TP is based on the position error ϵ and is normalized by

In this work, the position error is only the deviation from the desired path in y-direction and thus, ϵ is a scalar. For mean (|ϵ|), the RMS value is given by (28)

IP is calculated using the internal force fi between the human operator and the assistance. According to [31], the internal force is defined in Equations (29) and (30)

with f_⊥ being the human force and f_a⊥ the assistance force. For the performance metric, f _i is normalized by

The forces perpendicular to the desired path are assumed one-dimensional, hence mean (|f _i |) may be defined as the RMS value. A high internal force indicates a low agreement with the assistance; hence the interaction performance is defined as I_P,n = 1 − f _i,n. The idea of the DDM is that every choice z of the TAFC task is rewarded according to the function,

The rewards depend on the performance measures and are computed by reward functions. As a reward structure, amatching shoulder with the linear reward functions

is used. There, k _I and k _T are the slopes of the reward functions, I _P0 is the minimum reward for interaction performance and T _P0 is the maximum reward for task performance. Reward functions can be designed with or without any preference for task or interaction performance, depending on the teleoperation task. For a neutral reward structure, the intersection point of both reward functions is in the middle of the performance measures, which is 0.5 for normalized performance measures. By moving the intersection point to the right or left half, either preference on interaction or task performance is obtained. An elementary part of the DDM is taking into account the actual and past rewards in order to accumulate evidence for future decisions. The evidence in favor of one decision is computed as

with w _z being the evidence for the actual choice being the evidence for the option which was not chosen z̅, and λ being the learning rate with λ ∈ [0; 1[. If λ is low, past decisions are taken more into account, and vice-versa. With the accumulated evidence, the probability of decision making in order to improve interaction performance p _I is computed using the soft-max model

For a large value for µ, the user might feel sudden changes in the stiffness of the GVF. If pI exceeds a certain value (0.5 in this work), future decisions are made in favor of improving interaction performance (see Equation (31)],

This means that more authority is given to the human operator by increasing α. It is now possible to define the adaptation rule as α(pI ) = pI . Tests with adaptive assistance have shown that some modifications in the task performance measure and the reward structure are necessary. It has been observed that T _P,n increases rapidly for very small path errors, therefore T _P,n is weighted with

In (32), ρ is a design variable that must be determined individually for a teleoperation task. For large ρ, small path errors have less impact on the task performance measure.

Furthermore, it has been observed that reward functions with an intersection point at T _P,n = I _P,n = 0.5 do not practically lead to a neutral reward structure in this teleoperation setup, but lead to a reward structure with preference on task performance. The parameters for that neutral reward structure are defined as k _I = 1, I _P0 = 0, k _T = −0.5, T _P0 = 0.5

Figure 8 shows the DDM response using the parameters of neutral reward structure for a path following task with an obstacle avoidance event. It can be observed that the stiffness is high when following the path and decreases when moving around the obstacle.

Figure 8: DDM response for the reward structure of Neutral Reward Structure. The slightly red-colored area indicates the obstacle avoidance maneuver

Besides the adapting assistance force, which acts in the perpendicular direction of the desired path (y-direction), a virtual fixture for the x and z-direction of the Novint Falcon is also considered. The virtual fixture for the x-direction has a spring model f _a,x = −k _x ^H p _x , _master . For the z-direction, a virtual fixture with the damper model f _a,z = −d _z ^H p˙ _z,master is used. Finally, the assistance force vector f _a, which is the force vector sent to the master robot, consists of f _a = [f _a,x f _a⊥ f _a,z ] ^T .

5. User study

The goal of the study is to address the following questions:

Is adaptive assistance more comfortable for the user than constant assistance when moving around an unknown obstacle?
How does the learning rate λ in the adaptive assistance influence the performance of the teleoperation task?

5.1 Experiment

The teleoperation task is to follow a desired horizontal path from left to right and to avoid the unknown obstacle during task execution (see Figure 7]. The experimental setup does not include communications or any other sources of time delays. As soon as the x-coordinate of the desired end position is reached, the task ends. Five subjects (one female and four male) have participated in the experiment as human operators. Four of them did not have any experience in telerobotics, while one person already had some experience. Each person was allowed to do a trial run without obstacle or assistance in order to get familiar with the control of the virtual slave robot by the Novint Falcon before the experiment started. The users were told to complete the task within 15 seconds, but the task completion time was not considered in the evaluation of the experiment.

The user study is executed in two sessions. In the first session, the users perform the task with four different constant assistance levels (one assistance level per run). These assistance levels are classified as no, low, medium and high assistance. For every assistance level, two runs are performed, but in a random order. As a result, eight runs in total are performed for the first session. The second session is executed with adaptive assistance. There are three different reward structures (no preference, preference on task performance and preference on interaction performance) and two different values for the learning rate λ (high and low). This leads to six different configurations for the adaptive assistance. In addition, in the second session, the users perform the teleoperation task twice for each configuration (in random order). The parameters for each assistance configuration are given in Table 3.

A decision in the DDM is made every 100 ms; a measurement of the path tracking error, as well as an estimation of the human force, is made every 10 ms. The experiment has been executed with MATLAB R2015b (32-bit) on a computer running with Windows 7 Ultimate. The computer is equipped with 12 GB RAM, an Intel Core i5-3330 (4×3 GHz) and an Intel HD Graphics graphic board. The teleoperation task was visualized on a 19-inch screen for the human operator.

5.2 Evaluation metrics

Due to the presence of obstacles that must be avoided during the task execution, the workspace of the slave robot is divided into different evaluation regions. While moving on the path, the mobile robot stays in the on-path region. That obstacle-free region is divided into two segments: one in front of and one behind the obstacle. The area between these two on-path regions is the off-path region, where the obstacle is located. In order to prevent learning effects during the experiment, the obstacle size and position are randomly chosen for every run and thus, the threshold value is determined as 25 % of the obstacle edge length. The obstacle size varies between 20 and 40 length units.

Position tracking error

The position tracking error is only evaluated in the on-path region because no reference tracking for the off-path region exists. As a metric for the position tracking error, the RMS error (28) is used.

Internal force

The internal force is computed according to (29). The mean absolute internal force is used to evaluate separately the on-path and off-path motions.

Physical dominance

In a task where two partners exert forces on the same object, physical dominance is a measure to evaluate which partner is controlling the object’s movement on a higher degree [31]. The individual physical dominance of partner 1 over partner 2 is defined as

where f _ext,1 is the external force of partner 1, f _ext,1 = f ₁ − f _i,1 and f _sum is the sum of the external forces of partner 1 and partner 2, f _sum = f _ext,1 + f _ext,2 = f ₁ + f ₂ with f1 being the total force exerted by partner 1 and f ₂ the total force exerted by partner 2. In the experiment, partner 1 is the human operator and partner 2 the master robot. The individual physical dominance is bounded by P D12 ∈ [0; 1], where a value of unity means that partner 1 is absolutely dominant and for a value of zero absolute non-dominant. For the individual dominance of both partners, the relation P D12+P D21 = 1 is proposed. This means that for a value P D12 > 0.5, partner 1 is more dominant than partner 2. The physical dominance (33) is computed for every sample and mean physical dominance is computed as

separately for the on-path and off-path regions. Besides the physical dominance of partner 1 over partner 2, the dominance difference is analyzed. PD _{dif f} quantifies how much one partner dominates the other one. For a value of zero, no dominant partner exists.

Power-based effort

The power measurement describes the energy flow between an interacting partner and its environment. The power of a partner is defined (for the one dimensional case) as being the force applied by partner (*) and being the velocity of the interaction point. Groten [31] argues that both positive and negative energy flows cause physical effort for the operator and thus, the absolute mean power MAP∗

is taken as a measure of the physical effort. The absolute mean power of the interaction between the two partners (dyadic interaction) is based on the power of each partner and is computed as MAP _d = MAP ₁ + MAP ₂.

5.3 Results

A Kolmogorov-Smirnov test with a significance level of 5 % is applied to the data sets in order to check if the data has a normal distribution. Next, an ANOVA test is made in order to check if the data of at least two assistance configurations differ significantly from each other in a statistical sense.

If the p-value from the ANOVA is lower than 0.05, the null hypothesis (i.e., all assistance configurations are the same) is rejected. If this is the case, Tukey’s HSD test is applied in order to find the assistance configurations which differ from each other.