Immersive Environments with Haptic Technology for the Control of an Industrial Robotic Arm

Authors

  • Wilman Paucar Ingeniería Electrónica, Universidad Politécnica Salesiana
  • Gustavo Caiza Ingeniería Electrónica, Universidad Politécnica Salesiana
  • William Oñate Ingeniería Electrónica, Universidad Politécnica Salesiana
  • Morelva Saeteros Institute of Technology, University of Deusto

Keywords:

Senso Glove, Mitsubishi RV-2AJ Robotics Arm, Internet of Things, Unity

Abstract

The technological advancement of Industry 4.0 and the Internet of Things has brought significant changes and benefits to the industry, allowing observation, control, and decision-making in industrial processes from anywhere in the world and in real-time. This article presents the power of a Mitsubishi RV-2AJ Industrial Robotic Arm using haptic technology "Senso Glove" and real-time 3D visualization, enabling users to interact and control the arm's movements. For the implementation, data is processed in Unity and sent to the "Firebase" cloud, where this data is requested by an embedded system to subsequently be converted into commands for arms control, specifically in the coordinates "X", "Y", "Z," and in the opening or closing of the gripper. The results demonstrated that the arm can be controlled from the gloves, opening various applications. Additionally, an accuracy of 87.8% was achieved in the conducted tests, with an average communication time of 815 milliseconds.

References

Kumar, V., Vrat, P. & Shankar, R. (2022). Factors Influencing the J Implementation of Industry 4.0 for Sustainability in Manufacturing. Glob Flex Syst Manag 23, 453-478. https://bibliotecas.ups.edu.ec:2582/10.1007/s40171-022-00312-1

García, C. A., Caiza, G., Guizado, D., Naranjo, J. E., Ortiz, A., Ayala, P. & Garcia, M. (2023). Visualization of Key Performance Indicators in the Production System in the Context of Industry 4.0. IFAC-PapersOnLine, 56(2), 6582-6587. https://www.sciencedirect.com/science/article/pii/S2405896323006663

Yenorkar, R. & Chaskar, U. (2018). GUI Based Pick and Place Robotic Arm for Multipurpose Industrial Applications. Second International Conference on Intelligent Computing and Control Systems (ICICCS), 200-203.

Barrientos, A., Peñín, L. F., Balaguer, C. & Aracil, R. (2007). Fundamentos de Robótica. Madrid. McGRAW-HILL, 2da. Edición.

Harikrishnan, M., Ghanshsyam, T., Chourasia, G., Das, A., Shrivastava, A. & Bhatt, Z. (2018). Flamen − 7 DOF Robotic Arm to Manipulate a Spanish Fan. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 4152-4157.

Park, J. & Jung, S. (2023). Form-Finding to Fabrication: A Parametric Shell Structure Fabricated Using an Industrial Robotic Arm with a Hot-Wire End-Effector. Nexus Network Journal, 1522-4600.

Eshah, N. S., Osman, K., & Zainuddin N. (2020). 5-Axis of Mitsubishi RV-2AJ Robotics Arm Modelling Using Solidworks. 16th IEEE International Colloquium on Signal Processing & Its Applications (CSPA), 207-212.

Buitrago J. A., Giraldo F. D. & Lamprea J. A. (2011). Remote access lab for Mitsubishi RV-2AJ robot. IX Latin American Robotics Symposium and IEEE Colombian Conference on Automatic Control, 1-7.

Agurto, J., Bonilla, V., Moya Cajas, M., Mosquera, G., Paredes, R. & Litvin, A. (2019). Mitsubishi RV-2AJ Robot Controled by Electromyographic Signals. International Conference on Information Systems and Computer, 77-82.

Weber P., Rueckert E., Calandra R., Peters J. & Beckerle P. (2016). A low-cost sensor glove with vibrotactile feedback and multiple finger joint and hand motion sensing for human-robot interaction. IEEE International Symposium on Robot and Human Interactive Communication, 99-104.

Peralta, J. & Smarsly, K. (2022). An Introduction and Systematic Review on Machine Learning for Smart Environments/Cities: An IoT Approach. Machine Learning for Smart Environments/Cities. Intelligent Systems Reference Library, V 121. https://doi.org/10.1007/978-3-030-97516-6_1

Ghoul, Y. & Naifar, O. (2023). IoT based applications for healthcare and home automation. Multimed Tools Appl, https://bibliotecas.ups.edu.ec:2582/10.1007/s11042-023-16774-z

Cajamarca, J. A. & Portilla, A. D. (2016). Implementación de un controlador para la cinemática inversa del brazo robot Mitsubishi RV-2AJ a través de una tarjeta ARM y Matlab. Universidad Politécnica Salesiana. 17-18.

Ayob, M. A., Zakaria, W. N., & Jalani, J. (2014). Forward kinematics analysis of a 5-axis RV-2AJ robot manipulator. Electrical Power, Electronics, Communications, Control and Informatics Seminar (EECCIS), 87-92.

Crainic, M. & Preitl, S. (2016). Development of a special setup for path tracking of RV-2AJ robot. IEEE 11th International Symposium on Applied Computational Intelligence and Informatics (SACI), 217-220.

Fahmi, F., Nainggolan, F., Siregar, B., Gaweng, S. & Zarlis, M. (2020). User experience study on crane operator erection simulator using senso glove in a virtual reality environment. IOP Conference Series: Materials Science and Engineering, V.851, 012023.

Le, G.T., Tran, N.M., Tran, T.V. (2021). IoT System for Monitoring a Large-Area Environment Sensors and Control Actuators Using Real-Time Firebase Database. Intelligent Human Computer Interaction, Vol 12616. 3-20.

Moroney, L. (2017). The Firebase Realtime Database. In: The Definitive Guide to Firebase, https://doi.org/10.1007/978-1-4842-2943-9_3

Bucsai, S., Kučera, E., Haffner, O. & Drahoš, P. (2020). Control and Monitoring of IoT Devices Using Mixed Reality Developed by Unity

Engine. Cybernetics & Informatics (K&I), 1-8.

Caiza, G., Saeteros, M., Oñate, W. & García M. (2020). Fog computing at industrial level, architecture, latency, energy, and security: A review. Heliyon, V. 6(4).

Caiza, G., Chiliquinga, S., Manzano, S. & García, V. (2020). Software-Defined Network (SDN) Based Internet of Things within the context of low-cost automation. IEEE 18th International Conference on Industrial Informatics (INDIN), 587-591.

Downloads

Published

2024-08-20

How to Cite

Paucar, W., Caiza, G., Oñate, W., & Saeteros, M. (2024). Immersive Environments with Haptic Technology for the Control of an Industrial Robotic Arm. WiPiEC Journal - Works in Progress in Embedded Computing Journal, 10(2). Retrieved from https://wipiec.digitalheritage.me/index.php/wipiecjournal/article/view/63