Visual guided robotic grasping of soft gripper depends on correct grasp position, grasp angle and grasp depth, and therefore a complete grasp configuration model and a multi-task loss function for soft gripper are proposed. A two-stage deep learning network based on anchor and rotating blocks is designed to realize direct map from image to multi-gripper grasping. The performance of the network is analyzed by public cornell grasping dataset and self-built dataset. The results show that the two-stage network based on multi-task loss and anchor with rotated blocks improves the accuracy of multi-output grasp detection and increases the success rate of robotic grasping. Finally, the soft robotic grasping system is constructed and the robotic grasping experiment results show that the proposed method provides a certain robustness to vision error, achieves 96% grasp success rate at different fruits, and exhibits a good generalization ability to grasp fruit peel.
LIU Wenhai,HU Jie,WANG Weiming
. Soft Gripper Grasping Based on Complete Grasp Configuration and
Multi-Stage Network[J]. Journal of Shanghai Jiaotong University, 2020
, 54(5)
: 507
-514
.
DOI: 10.16183/j.cnki.jsjtu.2020.05.008
［1］张进华, 王韬, 洪军, 等. 软体机械手研究综述［J］. 机械工程学报, 2017, 53(13): 19-28.
ZHANG Jinhua, WANG Tao, HONG Jun, et al. Review of soft-bodied manipulator［J］. Journal of Mechanical Engineering, 2017, 53(13): 19-28.
［2］SNDERHAUF N, BROCK O, SCHEIRER W, et al. The limits and potentials of deep learning for robotics［J］. The International Journal of Robotics Research, 2018, 37(4/5): 405-420.
［3］LENZ I, LEE H, SAXENA A. Deep learning for detecting robotic grasps［J］. The International Journal of Robotics Research, 2015, 34(4/5): 705-724.
［4］REDMON J, ANGELOVA A. Real-time grasp detection using convolutional neural networks［C］//2015 IEEE International Conference on Robotics and Automation (ICRA). Seattle, WA, USA: IEEE, 2015: 1316-1322.
［5］KUMRA S, KANAN C. Robotic grasp detection using deep convolutional neural networks［C］//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Vancouver, Canada: IEEE, 2017: 769-776.
［6］LIU W H, PAN Z Y, LIU W J, et al. Deep learning for picking point detection in dense cluster［C］//2017 11th Asian Control Conference (ASCC). Gold Coast, Australia: IEEE, 2017: 1644-1649.
［7］ZENG A, SONG S R, YU K T, et al. Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching［C］//2018 IEEE International Conference on Robotics and Automation (ICRA). Brisbane, Australia: IEEE, 2018: 1-8.
［8］彭艳, 刘勇敢, 杨扬, 等. 软体机械手爪在果蔬采摘中的应用研究进展［J］. 农业工程学报, 2018, 34(9): 11-20.
PENG Yan, LIU Yonggan, YANG Yang, et al. Research progress on application of soft robotic gripper in fruit and vegetable picking［J］. Transactions of the Chinese Society of Agricultural Engineering, 2018, 34(9): 11-20.
［9］JIANG Y, MOSESON S, SAXENA A. Efficient grasping from RGBD images: Learning using a new rectangle representation［C］//2011 IEEE International Conference on Robotics and Automation. Shanghai, China: IEEE, 2011: 3304-3311.
［10］MAHLER J, LIANG J, NIYAZ S, et al. Dex-Net 20: Deep learning to plan robust grasps with synthetic point clouds and analytic grasp metrics ［DB/OL］. (2017-08-08) ［2018-12-14］. https://arxiv.org/abs/1703.09312.
［11］REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
［12］MAHLER J, POKORNY F T, HOU B, et al. Dex-Net 1.0: A cloud-based network of 3D objects for robust grasp planning using a Multi-Armed Bandit model with correlated rewards［C］//2016 IEEE International Conference on Robotics and Automation (ICRA). Stockholm, Sweden: IEEE, 2016: 1957-1964.
［13］MORRISON D, LEITNER J, CORKE P. Closing the loop for robotic grasping: A real-time, generative grasp synthesis approach ［DB/OL］. (2018-05-15) ［2018-12-14］. https://arxiv.org/abs/1804.05172.
