吴蓬勃,张金燕,李莉,孙会泽,王帆.基于多模态的无序堆叠快递包裹机械臂视觉抓取系统[J].包装工程,2022,43(15):68-76.
WU Peng-bo,ZHANG Jin-yan,LI Li,SUN Hui-ze,WANG Fan.Robot Arm Visual Grasping System of Disorderly Stacking ExpressPackage Based on Multimode[J].Packaging Engineering,2022,43(15):68-76. |
| 基于多模态的无序堆叠快递包裹机械臂视觉抓取系统 |
| Robot Arm Visual Grasping System of Disorderly Stacking ExpressPackage Based on Multimode |
| |
| DOI：10.19554/j.cnki.1001-3563.2022.15.008 |
| 中文关键词: 多模态 堆叠 快递包裹 机械臂视觉抓取 |
| 英文关键词: multimodal stacking express package robot arm visual grasping |
| 基金项目:河北省大中学生科技创新能力培育专项(22E50226D);河北省高等学校科学技术研究项目(ZC2021252) |
|
| 摘要点击次数: |
| 全文下载次数: |
| 中文摘要: |
| 目的 为实现快递交叉带分拣机的自动供包，设计一款基于多模态的无序堆叠快递包裹机械臂视觉抓取系统。方法 将堆叠快递包裹RGB图像和深度图多模态信息送入全卷积残差网络模型进行识别，经过模型后处理、抓取策略设计、模型训练与部署，实现快递包裹抓取区域精确识别;结合包裹姿态估计，控制机械臂完成快递包裹的抓取和搬运。结果 实验证明，文中提出的视觉识别方法实现了快递包裹抓取区域的精确识别，测试准确率达到了95.73%。结论 基于该方法构建的快递包裹机械臂视觉抓取系统，可以完成快递交叉带分拣机的自动供包操作。 |
| 英文摘要: |
| The work aims to design a robot arm visual grasping system of disorderly stacked express package based on multimode to realize the automatic package feeding of express cross belt sorter. The multi-modal information of RGB image and depth map of stacked express packages was sent to the residual network model of the full convolution for recognition. After model post-processing, grasping strategy design, model training and deployment, the accurate identification of the grasping area of express packages was realized. Combined with the package attitude estimation, the grasping and handling of express packages were completed through the robot arm. Experiments showed that the visual recognition method proposed in this paper realized the accurate recognition of the grab area of express package, and the test accuracy was 95.73%. The robot arm visual grasping system of express parcel based on this method can complete the automatic package feeding operation of express cross belt sorter. |
|
查看全文
查看/发表评论 下载PDF阅读器 |
| 关闭 |
渝公网安备 50010702501716号