面向残疾人助餐任务的机械臂规划与控制技术

doi:10.1007/s12204-024-2779-z

摘要/Abstract

摘要： 对于有上肢障碍的残疾人来说，进食是一项必不可少的活动，因此诞生了许多喂养机器人。然而，安全性和可靠性是建立对辅助机器人信任的两个基本要素。因此，开发了一种安全可靠的机器人辅助喂食系统的规划和控制方法。首先，喂养任务扩展到包括餐前准备和进食。然后将喂食任务分为开门，抓取和转移，取餐具，叉取食物，和转移食物五个子任务。同时，系统从用户界面、任务规划、运动规划、控制和感知五个层面进行构建。其次，基于以运动为中心的分类方法，将馈送任务分解为一系列运动原语；然后利用这些原语构造一组状态集，然后使用有限状态机作为任务管理器，在馈送任务中调节工作流程。第三，描述了面向安全的运动规划器、食品选择器、导纳控制器和碰撞检测器。最后，在实验室进行了实验，并进一步在康复医院进行了脑卒中患者的实验。实验结果表明，该系统安全可靠。

关键词: 辅助机器人, 机器人助餐, 导纳控制, 运动规划, 任务规划

Abstract: Eating is an essential activity for the disabled with upper limb impairments, and therefore numerous feeding robots are born. However, safety and reliability are two basic elements to build trust in assistive robots. Thus, planning and control methods for a safe and reliable robot-assisted feeding system are developed. Firstly, the feeding task is expanded to include both pre-meal preparation and eating. The feeding task is then divided into five subtasks including door opening, bowl grasping and transferring, utensil fetching, food skewering, and food transferring. Meanwhile, the system is built from five levels, i.e., user interface, task planning, motion planning, control, and perception. Secondly, the feeding task is decomposed into a series of motion primitives based on a motion-centric taxonomy. Then a set of states utilizing those primitives is constructed and then a finite state machine is employed as the task manager which can regulate the workflow during the feeding task. Thirdly, a safety-oriented motion planner, a food item selector, an admittance controller, and a collision detector are depicted. Finally, experiments in the laboratory and further in a rehabilitation hospital with stroke patients are conducted. The experimental results indicate that the system is safe and reliable.

中图分类号:

TP241
R496

. 面向残疾人助餐任务的机械臂规划与控制技术[J]. J Shanghai Jiaotong Univ Sci, 2026, 31(1): 71-81.

Dai Feifan, Pei Zijun, Wang Pu, Chen Weidong. Planning and Control for Robot-Assisted Feeding System Towards the Disabled[J]. J Shanghai Jiaotong Univ Sci, 2026, 31(1): 71-81.

参考文献

[1] NAOTUNNA I, PERERA C J, SANDARUWAN C, et al. Meal assistance robots: A review on current status, challenges and future directions [C]//2015 IEEE/SICE International Symposium on System Integration. Nagoya: IEEE, 2015: 211-216.

[2] ZHAO L L, GUO Y. Development of rehabilitation and assistive robots in China: Dilemmas and solutions [J]. Journal of Shanghai Jiao Tong University (Science), 2023, 28(3): 382-390.

[3] PARK D, KIM H, HOSHI Y, et al. A multimodal execution monitor with anomaly classification for robot-assisted feeding [C]//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems. Vancouver: IEEE, 2017: 5406-5413.

[4] VILA ABAD M, CANAL G, ALENYÀ G. Towards safety in physically assistive robots: Eating assistance [C]// 2018 IROS Workshop on Robots for Assisted Living. Madrid: IROS, 2018: 1-4.

[5] BHATTACHARJEE T, GORDON E K, SCALISE R, et al. Is more autonomy always better? Exploring preferences of users with mobility impairments in robot-assisted feeding [C]// 2020 ACM/IEEE International Conference on Human-Robot Interaction. Cambridge: ACM, 2020: 181-190.

[6] AHN S, YUK S, YU W, et al. A study on standard for safety and performance requirements for care robots [M]// Digital health transformation, smart ageing, and managing disability. Cham: Springer, 2023: 322-329.

[7] MASHRUR T, GHULAM Z, FRENCH G, et al. Assistive feeding robot for upper limb impairment—Testing and validation [J]. International Journal of Advanced Robotic Systems, 2023, 20(4): 17298806231183571.

[8] KIM H K, JEONG H, PARK J, et al. Development of a comprehensive design guideline to evaluate the user experiences of meal-assistance robots considering human-machine social interactions [J]. International Journal of Human–Computer Interaction, 2022, 38(17): 1687-1700.

[9] PASCHER M, BAUMEISTER A, SCHNEEGASS S, et al. Recommendations for the development of a robotic drinking and eating aid - an ethnographic study [M]// Human-Computer Interaction – INTERACT 2021. Cham: Springer, 2021: 331-351.

[10] BULLOCK I M, MA R R, DOLLAR A M. A hand-centric classification of human and robot dexterous manipulation [J]. IEEE Transactions on Haptics, 2013, 6(2): 129-144.

[11] GONZÁLEZ-SANTAMARTA M Á, RODRÍGUEZ-LERA F J, MATELLÁN-OLIVERA V, et al. YASMIN: Yet another state machine [M]// ROBOT2022: Fifth Iberian Robotics Conference. Cham: Springer, 2022: 528-539.

[12] GHZOULI R, BERGER T, JOHNSEN E B, et al. Behavior trees and state machines in robotics applications [J]. IEEE Transactions on Software Engineering, 2023, 49(9): 4243-4267.

[13] HOPCROFT J E, MOTWANI R, ULLMAN J D. Introduction to automata theory, languages, and computation, 2nd edition [J]. ACM SIGACT News, 2001, 32(1): 60-65.

[14] SCHULMAN J, DUAN Y, HO J, et al. Motion planning with sequential convex optimization and convex collision checking [J]. The International Journal of Robotics Research, 2014, 33(9): 1251-1270.

[15] SCHULMAN J, HO J, LEE A, et al. Finding locally optimal, collision-free trajectories with sequential convex optimization [C]//Robotics: Science and Systems IX. Berlin: Robotics and Biology Laboratory, 2013: 1-10.

[16] GALLENBERGER D, BHATTACHARJEE T, KIM Y, et al. Transfer depends on acquisition: Analyzing manipulation strategies for robotic feeding [C]//2019 14th ACM/IEEE International Conference on Human-Robot Interaction. Daegu: IEEE, 2019: 267-276.

[17] HEINS A, SCHOELLIG A P. Keep it upright: Model predictive control for nonprehensile object transportation with obstacle avoidance on a mobile manipulator [J]. IEEE Robotics and Automation Letters, 2023, 8(12): 7986-7993.

[18] KRIM J, BEHRINGER R P. Friction, force chains, and falling fruit [J]. Physics Today, 2009, 62(9): 66-67.

[19] FANG H S, WANG C X, FANG H J, et al. AnyGrasp: Robust and efficient grasp perception in spatial and temporal domains [J]. IEEE Transactions on Robotics, 2023, 39(5): 3929-3945.

[20] HUANG Y T, CHEN W D, SUN Y X. Safety design and realization of an assistive robotic manipulator based on collision detection [J]. Robot, 2011, 33(1): 40-45 (in Chinese).

[21] CARPENTIER J, SAUREL G, BUONDONNO G, et al. The Pinocchio C++ library: A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives [C]//2019 IEEE/SICE International Symposium on System Integration. Paris: IEEE, 2019: 614-619.

[22] HADDADIN S, DE LUCA A, ALBU-SCHÄFFER A. Robot collisions: A survey on detection, isolation, and identification [J]. IEEE Transactions on Robotics, 2017, 33(6): 1292-1312.

[23] CHEN J D, RO P I. A conceptual approach of passive human-intention-orientated variable admittance control using power envelope [C]//2021 IEEE/RSJ International Conference on Intelligent Robots and Systems. Prague: IEEE, 2021: 7300-7306.

[24] LEE D, CHUNG W K, KIM K. Safety-oriented teleoperation framework for contact-rich tasks in hazardous workspaces [C]//2021 IEEE/RSJ International Conference on Intelligent Robots and Systems. Prague: IEEE, 2021: 4268-4275.

[25] SUN Y X, CHEN W D. Operating unknown constrained mechanisms based on motion prediction and impedance control [J]. Robot, 2011, 33(5): 563-569 (in Chinese).