基于完备抓取构型和多阶段网络的软体手抓取

doi:10.16183/j.cnki.jsjtu.2020.05.008

上海交通大学学报 ›› 2020, Vol. 54 ›› Issue (5): 507-514.doi: 10.16183/j.cnki.jsjtu.2020.05.008

基于完备抓取构型和多阶段网络的软体手抓取

刘文海，胡洁，王伟明

上海交通大学机械与动力工程学院, 上海 200240

发布日期:2020-06-02
通讯作者: 胡洁，男，教授，博士生导师，电话(Tel.): 021-34206552; E-mail：hujie@sjtu.edu.cn.
作者简介:刘文海（1991-），男，河南省辉县市人，博士生，研究方向为深度学习和机器人抓取.
基金资助:
国家自然科学基金项目（51675329，51675342）,机械系统与振动国家重点实验室课题（GZ2016KF001，GKZD020018）,上海交通大学“医工交叉研究基金”（YG2014MS12），特种车辆及其传动系统智能制造国家重点实验室开放课题（GZ2016KF001）

Soft Gripper Grasping Based on Complete Grasp Configuration and Multi-Stage Network

LIU Wenhai,HU Jie,WANG Weiming

School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

Published:2020-06-02

摘要/Abstract

摘要： 视觉引导的软体手抓取依赖视觉输出正确的抓取位置、抓取角度和抓取深度，为此提出了面向多手指软体手的完备抓取构型数学模型和多任务损失函数，设计了基于“锚点”旋转框的两阶段深度学习网络，实现了从图像到软体多手指抓取指令的直接映射.通过公开数据库和自建数据库分析了网络模型的性能表现.研究结果表明：多任务损失函数和基于“锚点”旋转框的两阶段网络模型有效提高了多输出抓取检测的准确率和机器人抓取的成功率.最后，构建了机器人软体手抓取系统，抓取实验结果表明：所提方法对视觉定位误差具有一定的抓取稳健性，可成功抓取不同种类的水果，能够达到96%的抓取成功率，对水果皮的抓取也具有很好的泛化能力.

关键词: 软体手；机器人抓取；深度学习；多任务

Abstract: Visual guided robotic grasping of soft gripper depends on correct grasp position, grasp angle and grasp depth, and therefore a complete grasp configuration model and a multi-task loss function for soft gripper are proposed. A two-stage deep learning network based on anchor and rotating blocks is designed to realize direct map from image to multi-gripper grasping. The performance of the network is analyzed by public cornell grasping dataset and self-built dataset. The results show that the two-stage network based on multi-task loss and anchor with rotated blocks improves the accuracy of multi-output grasp detection and increases the success rate of robotic grasping. Finally, the soft robotic grasping system is constructed and the robotic grasping experiment results show that the proposed method provides a certain robustness to vision error, achieves 96% grasp success rate at different fruits, and exhibits a good generalization ability to grasp fruit peel.

Key words: soft gripper; robotic grasping; deep learning; multi-task

中图分类号:

TP 242

刘文海，胡洁，王伟明. 基于完备抓取构型和多阶段网络的软体手抓取[J]. 上海交通大学学报, 2020, 54(5): 507-514.

LIU Wenhai,HU Jie,WANG Weiming. Soft Gripper Grasping Based on Complete Grasp Configuration and Multi-Stage Network[J]. Journal of Shanghai Jiaotong University, 2020, 54(5): 507-514.

参考文献

［1］张进华, 王韬, 洪军, 等. 软体机械手研究综述［J］. 机械工程学报, 2017, 53(13): 19-28. ZHANG Jinhua, WANG Tao, HONG Jun, et al. Review of soft-bodied manipulator［J］. Journal of Mechanical Engineering, 2017, 53(13): 19-28. ［2］SNDERHAUF N, BROCK O, SCHEIRER W, et al. The limits and potentials of deep learning for robotics［J］. The International Journal of Robotics Research, 2018, 37(4/5): 405-420. ［3］LENZ I, LEE H, SAXENA A. Deep learning for detecting robotic grasps［J］. The International Journal of Robotics Research, 2015, 34(4/5): 705-724. ［4］REDMON J, ANGELOVA A. Real-time grasp detection using convolutional neural networks［C］//2015 IEEE International Conference on Robotics and Automation (ICRA). Seattle, WA, USA: IEEE, 2015: 1316-1322. ［5］KUMRA S, KANAN C. Robotic grasp detection using deep convolutional neural networks［C］//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Vancouver, Canada: IEEE, 2017: 769-776. ［6］LIU W H, PAN Z Y, LIU W J, et al. Deep learning for picking point detection in dense cluster［C］//2017 11th Asian Control Conference (ASCC). Gold Coast, Australia: IEEE, 2017: 1644-1649. ［7］ZENG A, SONG S R, YU K T, et al. Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching［C］//2018 IEEE International Conference on Robotics and Automation (ICRA). Brisbane, Australia: IEEE, 2018: 1-8. ［8］彭艳, 刘勇敢, 杨扬, 等. 软体机械手爪在果蔬采摘中的应用研究进展［J］. 农业工程学报, 2018, 34(9): 11-20. PENG Yan, LIU Yonggan, YANG Yang, et al. Research progress on application of soft robotic gripper in fruit and vegetable picking［J］. Transactions of the Chinese Society of Agricultural Engineering, 2018, 34(9): 11-20. ［9］JIANG Y, MOSESON S, SAXENA A. Efficient grasping from RGBD images: Learning using a new rectangle representation［C］//2011 IEEE International Conference on Robotics and Automation. Shanghai, China: IEEE, 2011: 3304-3311. ［10］MAHLER J, LIANG J, NIYAZ S, et al. Dex-Net 20: Deep learning to plan robust grasps with synthetic point clouds and analytic grasp metrics ［DB/OL］. (2017-08-08) ［2018-12-14］. https://arxiv.org/abs/1703.09312. ［11］REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149. ［12］MAHLER J, POKORNY F T, HOU B, et al. Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards［C］//2016 IEEE International Conference on Robotics and Automation (ICRA). Stockholm, Sweden: IEEE, 2016: 1957-1964. ［13］MORRISON D, LEITNER J, CORKE P. Closing the loop for robotic grasping: A real-time, generative grasp synthesis approach ［DB/OL］. (2018-05-15) ［2018-12-14］. https://arxiv.org/abs/1804.05172.

[1]	温桠妮, 颜国正, 王志武, 姜萍萍, 薛蓉蓉, 王艺芸. 肠道机器人三维接收线圈的设计与优化[J]. 上海交通大学学报, 2020, 54(11): 1117-1123.
[2]	经小龙, 胡源, 郭为忠. 臂载线结构激光手眼矩阵的精确标定——多坐标系转换法[J]. 上海交通大学学报, 2020, 54(6): 607-614.
[3]	张建军, 吴中华, 刘群坡, 王红旗, 刘卫东. 主从机械手遥操作双边自适应阻抗控制策略[J]. 上海交通大学学报, 2020, 54(6): 615-623.
[4]	张铁, 肖蒙, 邹焱飚, 肖佳栋. 基于模糊迭代算法的曲面恒力跟踪[J]. 上海交通大学学报, 2020, 54(4): 344-351.
[5]	高晋阳, 颜国正, 石云波, 刘俊. 肠道微型仿尺蠖式机器人机载供能线圈优化[J]. 上海交通大学学报, 2020, 54(2): 152-159.
[6]	蒲鹏先，颜国正，王志武，韩玎，柯全，汪炜，李达伟. 微型肠道机器人扩张机构与能量接收线圈的设计与实验[J]. 上海交通大学学报, 2019, 53(10): 1143-1150.
[7]	鲁姗，王志武，颜国正，周泽润. 仿生人工肛门括约肌假体的机构设计和实验验证[J]. 上海交通大学学报, 2019, 53(10): 1151-1158.
[8]	张建军，刘卫东，李乐，程瑞锋，郑海峰. 未知环境下水下机械手智能抓取的自适应阻抗控制[J]. 上海交通大学学报（自然版）, 2019, 53(3): 341-347.
[9]	苏程，叶佳楠，李巍，丁旺才，赵志刚. 欠约束多机协调吊运系统动力学工作空间分析[J]. 上海交通大学学报（自然版）, 2019, 53(2): 225-231.
[10]	胡兵,杨明,郭林栋,王春香,王冰. 基于地面快速鲁棒特征的智能车全局定位方法[J]. 上海交通大学学报（自然版）, 2019, 53(2): 203-208.
[11]	武文汉a,b，杨明a,b，王冰a,b，王春香c. 一种基于轮廓匹配的仓储机器人托盘检测方法[J]. 上海交通大学学报（自然版）, 2019, 53(2): 197-202.
[12]	袁伟a,b，杨明a,b，邓琉元a,b，王春香c，王冰a,b. 基于V视差的地形高程栅格图快速构建方法[J]. 上海交通大学学报（自然版）, 2018, 52(1): 1-6.
[13]	王江北，方晔阳，童歆，张帅，费燕琼. 多气囊仿生软体机器人设计及其运动特性分析[J]. 上海交通大学学报（自然版）, 2018, 52(1): 20-25.
[14]	沈悦1，姜志华2，颜国正1，柯全1，王永兵1. 微型胃肠道机器人钳位机构和无线能量接收线圈的优化[J]. 上海交通大学学报（自然版）, 2018, 52(1): 39-44.
[15]	赵国旗a,b，杨明a,b，王冰a,b，王春香c. 基于智能终端的移动机器人室内外无缝定位方法[J]. 上海交通大学学报（自然版）, 2018, 52(1): 13-19.

基于完备抓取构型和多阶段网络的软体手抓取

Soft Gripper Grasping Based on Complete Grasp Configuration and Multi-Stage Network

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价