Intelligent Robots

Planning and Control for Robot-Assisted Feeding System Towards the Disabled

Expand
  • 1. Institute of Medical Robotics; Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China; 2. The Seventh Affiliated Hospital, Sun Yat-sen University, Shenzhen 518107, Guangdong, China

Received date: 2024-03-19

  Accepted date: 2024-06-21

  Online published: 2026-02-12

Abstract

Eating is an essential activity for the disabled with upper limb impairments, and therefore numerous feeding robots are born. However, safety and reliability are two basic elements to build trust in assistive robots. Thus, planning and control methods for a safe and reliable robot-assisted feeding system are developed. Firstly, the feeding task is expanded to include both pre-meal preparation and eating. The feeding task is then divided into five subtasks including door opening, bowl grasping and transferring, utensil fetching, food skewering, and food transferring. Meanwhile, the system is built from five levels, i.e., user interface, task planning, motion planning, control, and perception. Secondly, the feeding task is decomposed into a series of motion primitives based on a motion-centric taxonomy. Then a set of states utilizing those primitives is constructed and then a finite state machine is employed as the task manager which can regulate the workflow during the feeding task. Thirdly, a safety-oriented motion planner, a food item selector, an admittance controller, and a collision detector are depicted. Finally, experiments in the laboratory and further in a rehabilitation hospital with stroke patients are conducted. The experimental results indicate that the system is safe and reliable.

Cite this article

Dai Feifan, Pei Zijun, Wang Pu, Chen Weidong . Planning and Control for Robot-Assisted Feeding System Towards the Disabled[J]. Journal of Shanghai Jiaotong University(Science), 2026 , 31(1) : 71 -81 . DOI: 10.1007/s12204-024-2779-z

References

[1] NAOTUNNA I, PERERA C J, SANDARUWAN C, et al. Meal assistance robots: A review on current status, challenges and future directions [C]//2015 IEEE/SICE International Symposium on System Integration. Nagoya: IEEE, 2015: 211-216.
[2] ZHAO L L, GUO Y. Development of rehabilitation and assistive robots in China: Dilemmas and solutions [J]. Journal of Shanghai Jiao Tong University (Science), 2023, 28(3): 382-390.
[3] PARK D, KIM H, HOSHI Y, et al. A multimodal execution monitor with anomaly classification for robot-assisted feeding [C]//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems. Vancouver: IEEE, 2017: 5406-5413.
[4]   VILA ABAD M, CANAL G, ALENYÀ G. Towards safety in physically assistive robots: Eating assistance [C]// 2018 IROS Workshop on Robots for Assisted Living. Madrid: IROS, 2018: 1-4.
[5] BHATTACHARJEE T, GORDON E K, SCALISE R, et al. Is more autonomy always better? Exploring preferences of users with mobility impairments in robot-assisted feeding [C]// 2020 ACM/IEEE International Conference on Human-Robot Interaction. Cambridge: ACM, 2020: 181-190.
[6] AHN S, YUK S, YU W, et al. A study on standard for safety and performance requirements for care robots [M]// Digital health transformation, smart ageing, and managing disability. Cham: Springer, 2023: 322-329.
[7] MASHRUR T, GHULAM Z, FRENCH G, et al. Assistive feeding robot for upper limb impairment—Testing and validation [J]. International Journal of Advanced Robotic Systems, 2023, 20(4): 17298806231183571.
[8] KIM H K, JEONG H, PARK J, et al. Development of a comprehensive design guideline to evaluate the user experiences of meal-assistance robots considering human-machine social interactions [J]. International Journal of Human–Computer Interaction, 2022, 38(17): 1687-1700.
[9] PASCHER M, BAUMEISTER A, SCHNEEGASS S, et al. Recommendations for the development of a robotic drinking and eating aid - an ethnographic study [M]// Human-Computer Interaction – INTERACT 2021. Cham: Springer, 2021: 331-351.
[10] BULLOCK I M, MA R R, DOLLAR A M. A hand-centric classification of human and robot dexterous manipulation [J]. IEEE Transactions on Haptics, 2013, 6(2): 129-144.
[11] GONZÁLEZ-SANTAMARTA M Á, RODRÍGUEZ-LERA F J, MATELLÁN-OLIVERA V, et al. YASMIN: Yet another state machine [M]// ROBOT2022: Fifth Iberian Robotics Conference. Cham: Springer, 2022: 528-539.
[12] GHZOULI R, BERGER T, JOHNSEN E B, et al. Behavior trees and state machines in robotics applications [J]. IEEE Transactions on Software Engineering, 2023, 49(9): 4243-4267.
[13] HOPCROFT J E, MOTWANI R, ULLMAN J D. Introduction to automata theory, languages, and computation, 2nd edition [J]. ACM SIGACT News, 2001, 32(1): 60-65.
[14] SCHULMAN J, DUAN Y, HO J, et al. Motion planning with sequential convex optimization and convex collision checking [J]. The International Journal of Robotics Research, 2014, 33(9): 1251-1270.
[15] SCHULMAN J, HO J, LEE A, et al. Finding locally optimal, collision-free trajectories with sequential convex optimization [C]//Robotics: Science and Systems IX. Berlin: Robotics and Biology Laboratory, 2013: 1-10.
[16] GALLENBERGER D, BHATTACHARJEE T, KIM Y, et al. Transfer depends on acquisition: Analyzing manipulation strategies for robotic feeding [C]//2019 14th ACM/IEEE International Conference on Human-Robot Interaction. Daegu: IEEE, 2019: 267-276.
[17] HEINS A, SCHOELLIG A P. Keep it upright: Model predictive control for nonprehensile object transportation with obstacle avoidance on a mobile manipulator [J]. IEEE Robotics and Automation Letters, 2023, 8(12): 7986-7993.
[18] KRIM J, BEHRINGER R P. Friction, force chains, and falling fruit [J]. Physics Today, 2009, 62(9): 66-67.
[19] FANG H S, WANG C X, FANG H J, et al. AnyGrasp: Robust and efficient grasp perception in spatial and temporal domains [J]. IEEE Transactions on Robotics, 2023, 39(5): 3929-3945.
[20] HUANG Y T, CHEN W D, SUN Y X. Safety design and realization of an assistive robotic manipulator based on collision detection [J]. Robot, 2011, 33(1): 40-45 (in Chinese).
[21] CARPENTIER J, SAUREL G, BUONDONNO G, et al. The Pinocchio C++ library: A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives [C]//2019 IEEE/SICE International Symposium on System Integration. Paris: IEEE, 2019: 614-619.
[22] HADDADIN S, DE LUCA A, ALBU-SCHÄFFER A. Robot collisions: A survey on detection, isolation, and identification [J]. IEEE Transactions on Robotics, 2017, 33(6): 1292-1312.
[23] CHEN J D, RO P I. A conceptual approach of passive human-intention-orientated variable admittance control using power envelope [C]//2021 IEEE/RSJ International Conference on Intelligent Robots and Systems. Prague: IEEE, 2021: 7300-7306.
[24] LEE D, CHUNG W K, KIM K. Safety-oriented teleoperation framework for contact-rich tasks in hazardous workspaces [C]//2021 IEEE/RSJ International Conference on Intelligent Robots and Systems. Prague: IEEE, 2021: 4268-4275.
[25] SUN Y X, CHEN W D. Operating unknown constrained mechanisms based on motion prediction and impedance control [J]. Robot, 2011, 33(5): 563-569 (in Chinese).

Outlines

/