Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,w...Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,we propose Rail-PillarNet,a three-dimensional(3D)LIDAR(Light Detection and Ranging)railway foreign object detection method based on the improvement of PointPillars.Firstly,the parallel attention pillar encoder(PAPE)is designed to fully extract the features of the pillars and alleviate the problem of local fine-grained information loss in PointPillars pillars encoder.Secondly,a fine backbone network is designed to improve the feature extraction capability of the network by combining the coding characteristics of LIDAR point cloud feature and residual structure.Finally,the initial weight parameters of the model were optimised by the transfer learning training method to further improve accuracy.The experimental results on the OSDaR23 dataset show that the average accuracy of Rail-PillarNet reaches 58.51%,which is higher than most mainstream models,and the number of parameters is 5.49 M.Compared with PointPillars,the accuracy of each target is improved by 10.94%,3.53%,16.96%and 19.90%,respectively,and the number of parameters only increases by 0.64M,which achieves a balance between the number of parameters and accuracy.展开更多
The detection of foreign object intrusion is crucial for ensuring the safety of railway operations.To address challenges such as low efficiency,suboptimal detection accuracy,and slow detection speed inherent in conven...The detection of foreign object intrusion is crucial for ensuring the safety of railway operations.To address challenges such as low efficiency,suboptimal detection accuracy,and slow detection speed inherent in conventional comprehensive video monitoring systems for railways,a railway foreign object intrusion recognition and detection system is conceived and implemented using edge computing and deep learning technologies.In a bid to raise detection accuracy,the convolutional block attention module(CBAM),including spatial and channel attention modules,is seamlessly integrated into the YOLOv5 model,giving rise to the CBAM-YOLOv5 model.Furthermore,the distance intersection-over-union_non-maximum suppression(DIo U_NMS)algorithm is employed in lieu of the weighted nonmaximum suppression algorithm,resulting in improved detection performance for intrusive targets.To accelerate detection speed,the model undergoes pruning based on the batch normalization(BN)layer,and Tensor RT inference acceleration techniques are employed,culminating in the successful deployment of the algorithm on edge devices.The CBAM-YOLOv5 model exhibits a notable 2.1%enhancement in detection accuracy when evaluated on a selfconstructed railway dataset,achieving 95.0%for mean average precision(m AP).Furthermore,the inference speed on edge devices attains a commendable 15 frame/s.展开更多
It is difficult to differentiate small,but harmful,shell fragments of Chinese hickory nuts from their kernels since they are very similar in color.Including shell fragments of Chinese hickory nuts by mistake may creat...It is difficult to differentiate small,but harmful,shell fragments of Chinese hickory nuts from their kernels since they are very similar in color.Including shell fragments of Chinese hickory nuts by mistake may create safety hazards for consumers.Therefore,there is a need to develop an effective method to differentiate the shells from the kernels of Chinese hickory nuts.In this study,a deep learning approach based on a two-dimensional convolutional neural network(2D CNN)and long short-term memory(LSTM)integrated with hyperspectral imaging for distinguishing the shells and kernels of Chinese hickory nuts at the pixel level was proposed.Two classical classification methods,principal component analysis-K-nearest neighbors(PCA-KNN)and the support vector machine(SVM),were employed to establish identification models for comparison.The results showed that the 2D CNN-LSTM model achieved the best performance with an overall classification accuracy of 99.0%.Moreover,the shells in mixtures of shells and kernels were detected based on the proposed deep learning method and visualized for subsequent operations for the removal of foreign bodies.展开更多
开发了一种医药在线检测与分拣智能机器人系统(intelligent robot system of pharmaceuticaldetecting and sorting,IRPDS),实现了高速灌装医药生产线上注射型药液内异物的在线检测。该机器人系统采用多工位异物动态视觉扫描检测原理和...开发了一种医药在线检测与分拣智能机器人系统(intelligent robot system of pharmaceuticaldetecting and sorting,IRPDS),实现了高速灌装医药生产线上注射型药液内异物的在线检测。该机器人系统采用多工位异物动态视觉扫描检测原理和多帧图像序列的检测方法及高精度伺服控制等先进技术,能以高灵敏度检测出针剂药液内的微小异物。介绍了该系统的组成结构和工作原理,对系统的机械电气控制设备和软件实现过程进行了说明,并对检测系统的性能进行了测试,测试结果证明,IRPDS能很好地实现医药异物在线自动化检测,对大于50μm的异物具有较高的识别准确率,误检及漏检率小于5%。展开更多
基金supported by a grant from the National Key Research and Development Project(2023YFB4302100)Key Research and Development Project of Jiangxi Province(No.20232ACE01011)Independent Deployment Project of Ganjiang Innovation Research Institute,Chinese Academy of Sciences(E255J001).
文摘Aiming at the limitations of the existing railway foreign object detection methods based on two-dimensional(2D)images,such as short detection distance,strong influence of environment and lack of distance information,we propose Rail-PillarNet,a three-dimensional(3D)LIDAR(Light Detection and Ranging)railway foreign object detection method based on the improvement of PointPillars.Firstly,the parallel attention pillar encoder(PAPE)is designed to fully extract the features of the pillars and alleviate the problem of local fine-grained information loss in PointPillars pillars encoder.Secondly,a fine backbone network is designed to improve the feature extraction capability of the network by combining the coding characteristics of LIDAR point cloud feature and residual structure.Finally,the initial weight parameters of the model were optimised by the transfer learning training method to further improve accuracy.The experimental results on the OSDaR23 dataset show that the average accuracy of Rail-PillarNet reaches 58.51%,which is higher than most mainstream models,and the number of parameters is 5.49 M.Compared with PointPillars,the accuracy of each target is improved by 10.94%,3.53%,16.96%and 19.90%,respectively,and the number of parameters only increases by 0.64M,which achieves a balance between the number of parameters and accuracy.
基金supported in part by the Science and Technology Innovation Project of CHN Energy Shuo Huang Railway Development Company Ltd(No.SHTL-22-28)the Beijing Natural Science Foundation Fengtai Urban Rail Transit Frontier Research Joint Fund(No.L231002)the Major Project of China State Railway Group Co.,Ltd.(No.K2023T003)。
文摘The detection of foreign object intrusion is crucial for ensuring the safety of railway operations.To address challenges such as low efficiency,suboptimal detection accuracy,and slow detection speed inherent in conventional comprehensive video monitoring systems for railways,a railway foreign object intrusion recognition and detection system is conceived and implemented using edge computing and deep learning technologies.In a bid to raise detection accuracy,the convolutional block attention module(CBAM),including spatial and channel attention modules,is seamlessly integrated into the YOLOv5 model,giving rise to the CBAM-YOLOv5 model.Furthermore,the distance intersection-over-union_non-maximum suppression(DIo U_NMS)algorithm is employed in lieu of the weighted nonmaximum suppression algorithm,resulting in improved detection performance for intrusive targets.To accelerate detection speed,the model undergoes pruning based on the batch normalization(BN)layer,and Tensor RT inference acceleration techniques are employed,culminating in the successful deployment of the algorithm on edge devices.The CBAM-YOLOv5 model exhibits a notable 2.1%enhancement in detection accuracy when evaluated on a selfconstructed railway dataset,achieving 95.0%for mean average precision(m AP).Furthermore,the inference speed on edge devices attains a commendable 15 frame/s.
基金The authors gratefully acknowledge the financial support of the National Key Research and Development Program of China(Grant No.2017YFC1600805)the help of Jie Yang in studying convolution neural networks.Trade and manufacturer names are necessary to report factually on the available data。
文摘It is difficult to differentiate small,but harmful,shell fragments of Chinese hickory nuts from their kernels since they are very similar in color.Including shell fragments of Chinese hickory nuts by mistake may create safety hazards for consumers.Therefore,there is a need to develop an effective method to differentiate the shells from the kernels of Chinese hickory nuts.In this study,a deep learning approach based on a two-dimensional convolutional neural network(2D CNN)and long short-term memory(LSTM)integrated with hyperspectral imaging for distinguishing the shells and kernels of Chinese hickory nuts at the pixel level was proposed.Two classical classification methods,principal component analysis-K-nearest neighbors(PCA-KNN)and the support vector machine(SVM),were employed to establish identification models for comparison.The results showed that the 2D CNN-LSTM model achieved the best performance with an overall classification accuracy of 99.0%.Moreover,the shells in mixtures of shells and kernels were detected based on the proposed deep learning method and visualized for subsequent operations for the removal of foreign bodies.
文摘开发了一种医药在线检测与分拣智能机器人系统(intelligent robot system of pharmaceuticaldetecting and sorting,IRPDS),实现了高速灌装医药生产线上注射型药液内异物的在线检测。该机器人系统采用多工位异物动态视觉扫描检测原理和多帧图像序列的检测方法及高精度伺服控制等先进技术,能以高灵敏度检测出针剂药液内的微小异物。介绍了该系统的组成结构和工作原理,对系统的机械电气控制设备和软件实现过程进行了说明,并对检测系统的性能进行了测试,测试结果证明,IRPDS能很好地实现医药异物在线自动化检测,对大于50μm的异物具有较高的识别准确率,误检及漏检率小于5%。
