Invoice document digitization is crucial for efficient management in industries.The scanned invoice image is often noisy due to various reasons.This affects the OCR(optical character recognition)detection accuracy.In ...Invoice document digitization is crucial for efficient management in industries.The scanned invoice image is often noisy due to various reasons.This affects the OCR(optical character recognition)detection accuracy.In this paper,letter data obtained from images of invoices are denoised using a modified autoencoder based deep learning method.A stacked denoising autoencoder(SDAE)is implemented with two hidden layers each in encoder network and decoder network.In order to capture the most salient features of training samples,a undercomplete autoencoder is designed with non-linear encoder and decoder function.This autoencoder is regularized for denoising application using a combined loss function which considers both mean square error and binary cross entropy.A dataset consisting of 59,119 letter images,which contains both English alphabets(upper and lower case)and numbers(0 to 9)is prepared from many scanned invoices images and windows true type(.ttf)files,are used for training the neural network.Performance is analyzed in terms of Signal to Noise Ratio(SNR),Peak Signal to Noise Ratio(PSNR),Structural Similarity Index(SSIM)and Universal Image Quality Index(UQI)and compared with other filtering techniques like Nonlocal Means filter,Anisotropic diffusion filter,Gaussian filters and Mean filters.Denoising performance of proposed SDAE is compared with existing SDAE with single loss function in terms of SNR and PSNR values.Results show the superior performance of proposed SDAE method.展开更多
Wireless sensor networks are increasingly used in sensitive event monitoring.However,various abnormal data generated by sensors greatly decrease the accuracy of the event detection.Although many methods have been prop...Wireless sensor networks are increasingly used in sensitive event monitoring.However,various abnormal data generated by sensors greatly decrease the accuracy of the event detection.Although many methods have been proposed to deal with the abnormal data,they generally detect and/or repair all abnormal data without further differentiate.Actually,besides the abnormal data caused by events,it is well known that sensor nodes prone to generate abnormal data due to factors such as sensor hardware drawbacks and random effects of external sources.Dealing with all abnormal data without differentiate will result in false detection or missed detection of the events.In this paper,we propose a data cleaning approach based on Stacked Denoising Autoencoders(SDAE)and multi-sensor collaborations.We detect all abnormal data by SDAE,then differentiate the abnormal data by multi-sensor collaborations.The abnormal data caused by events are unchanged,while the abnormal data caused by other factors are repaired.Real data based simulations show the efficiency of the proposed approach.展开更多
Accurate fault prediction is essential to ensure the safety and reliability of combine harvester operation.In this study,a combine harvester fault prediction method based on a combination of stacked denoising autoenco...Accurate fault prediction is essential to ensure the safety and reliability of combine harvester operation.In this study,a combine harvester fault prediction method based on a combination of stacked denoising autoencoders(SDAE)and multi-classification support vector machines(SVM)is proposed to predict combine harvester faults by extracting operational features of key combine components.In general,SDAE contains autoencoders and uses a deep network architecture to learn complex non-linear input-output relationships in a hierarchical manner.Selected features are fed into the SDAE network,deep-level features of the input parameters are extracted by SDAE,and an SVM classifier is then added to its top layer to achieve combine harvester fault prediction.The experimental results show that the method can achieve accurate and efficient combine harvester fault prediction.In particular,the experiments used Gaussian noise with a distribution center of 0.05 to corrupt the test data samples obtained by random sampling of the whole population,and the results showed that the prediction accuracy of the method was 95.31%,which has better robustness and generalization ability compared to SVM(77.03%),BP(74.61%),and SAE(90.86%).展开更多
为了提升入侵检测的准确率,鉴于自编码器在学习特征方面的优势以及残差网络在构建深层模型方面的成熟应用,提出一种基于特征降维的改进残差网络入侵检测模型(improved residual network intrusion detection model based on feature dim...为了提升入侵检测的准确率,鉴于自编码器在学习特征方面的优势以及残差网络在构建深层模型方面的成熟应用,提出一种基于特征降维的改进残差网络入侵检测模型(improved residual network intrusion detection model based on feature dimensionality reduction,IRFD),进而缓解传统机器学习入侵检测模型的低准确率问题。IRFD采用堆叠降噪稀疏自编码器策略对数据进行降维,从而提取有效特征。利用卷积注意力机制对残差网络进行改进,构建能提取关键特征的分类网络,并利用两个典型的入侵检测数据集验证IRFD的检测性能。实验结果表明,IRFD在数据集UNSW-NB15和CICIDS 2017上的准确率均达到99%以上,且F1-score分别为99.5%和99.7%。与基线模型相比,提出的IRFD在准确率、精确率和F1-score性能上均有较大提升。展开更多
为了解决联合收割机作业故障的非线性特征信号难以提取的问题,该研究提出了一种基于堆叠去噪自动编码器(Stack Denoising Auto Encoder,SDAE)和BP神经网络(Back Propagation,BP)融合的联合收割机作业故障监测及诊断的方法(SDAE-BP)。以...为了解决联合收割机作业故障的非线性特征信号难以提取的问题,该研究提出了一种基于堆叠去噪自动编码器(Stack Denoising Auto Encoder,SDAE)和BP神经网络(Back Propagation,BP)融合的联合收割机作业故障监测及诊断的方法(SDAE-BP)。以转速传感器采集联合收割机脱粒滚筒转速、籽粒搅龙转速、喂入搅龙转速、杂余搅龙转速、风机转速、输送链耙转速、割刀频率以及逐稿器振动频率,并将采集的数据集作为系统的输入。利用SDAE提取输入信号的深层次特征,并由BP神经网络辨识收割机作业状态,实现联合收割机故障监测。在SDAE-BP模型训练过程中,去噪自动编码器(Denoising Auto Encode,DAE)依次经带有不同分布中心噪声的原始数据进行训练,然后将其堆叠,并通过误差反向传播算法对模型参数进行优化,以提升模型识别故障性能和泛化能力。试验结果表明,对于2018年联合收割机田间试验数据,模型的故障诊断准确率达到99.00%,与SDAE和BP神经网络相比,分别提高了1.5和4.5个百分点。将SDAE-BP故障诊断模型用2019年的试验数据进行更新,并用2018年和2019年试验数据进行测试,结果表明,更新后的模型对2018年试验数据的故障识别准确率为99.25%,对2019年试验数据的故障识别准确率为98.74%,更新后模型在2019试验数据集上的故障识别准确率较未更新模型提高了6.52个百分点。该文所建模型能够准确识别联合收割机的故障类型,且具有较好的鲁棒性,对旋转型机械故障监测及预警具有参考价值。展开更多
文摘Invoice document digitization is crucial for efficient management in industries.The scanned invoice image is often noisy due to various reasons.This affects the OCR(optical character recognition)detection accuracy.In this paper,letter data obtained from images of invoices are denoised using a modified autoencoder based deep learning method.A stacked denoising autoencoder(SDAE)is implemented with two hidden layers each in encoder network and decoder network.In order to capture the most salient features of training samples,a undercomplete autoencoder is designed with non-linear encoder and decoder function.This autoencoder is regularized for denoising application using a combined loss function which considers both mean square error and binary cross entropy.A dataset consisting of 59,119 letter images,which contains both English alphabets(upper and lower case)and numbers(0 to 9)is prepared from many scanned invoices images and windows true type(.ttf)files,are used for training the neural network.Performance is analyzed in terms of Signal to Noise Ratio(SNR),Peak Signal to Noise Ratio(PSNR),Structural Similarity Index(SSIM)and Universal Image Quality Index(UQI)and compared with other filtering techniques like Nonlocal Means filter,Anisotropic diffusion filter,Gaussian filters and Mean filters.Denoising performance of proposed SDAE is compared with existing SDAE with single loss function in terms of SNR and PSNR values.Results show the superior performance of proposed SDAE method.
基金This work is supported by the National Natural Science Foundation of China(Grant No.61672282)the Basic Research Program of Jiangsu Province(Grant No.BK20161491).
文摘Wireless sensor networks are increasingly used in sensitive event monitoring.However,various abnormal data generated by sensors greatly decrease the accuracy of the event detection.Although many methods have been proposed to deal with the abnormal data,they generally detect and/or repair all abnormal data without further differentiate.Actually,besides the abnormal data caused by events,it is well known that sensor nodes prone to generate abnormal data due to factors such as sensor hardware drawbacks and random effects of external sources.Dealing with all abnormal data without differentiate will result in false detection or missed detection of the events.In this paper,we propose a data cleaning approach based on Stacked Denoising Autoencoders(SDAE)and multi-sensor collaborations.We detect all abnormal data by SDAE,then differentiate the abnormal data by multi-sensor collaborations.The abnormal data caused by events are unchanged,while the abnormal data caused by other factors are repaired.Real data based simulations show the efficiency of the proposed approach.
基金The work was sponsored by the Intelligent Manufacturing Comprehensive Standardization Project(No.2018GXZ1101011)the National Key Research and Development Program of China Sub-project(No.2016YFD0701802)the Natural Science Foundation of Henan(No.202300410124).
文摘Accurate fault prediction is essential to ensure the safety and reliability of combine harvester operation.In this study,a combine harvester fault prediction method based on a combination of stacked denoising autoencoders(SDAE)and multi-classification support vector machines(SVM)is proposed to predict combine harvester faults by extracting operational features of key combine components.In general,SDAE contains autoencoders and uses a deep network architecture to learn complex non-linear input-output relationships in a hierarchical manner.Selected features are fed into the SDAE network,deep-level features of the input parameters are extracted by SDAE,and an SVM classifier is then added to its top layer to achieve combine harvester fault prediction.The experimental results show that the method can achieve accurate and efficient combine harvester fault prediction.In particular,the experiments used Gaussian noise with a distribution center of 0.05 to corrupt the test data samples obtained by random sampling of the whole population,and the results showed that the prediction accuracy of the method was 95.31%,which has better robustness and generalization ability compared to SVM(77.03%),BP(74.61%),and SAE(90.86%).
文摘为了提升入侵检测的准确率,鉴于自编码器在学习特征方面的优势以及残差网络在构建深层模型方面的成熟应用,提出一种基于特征降维的改进残差网络入侵检测模型(improved residual network intrusion detection model based on feature dimensionality reduction,IRFD),进而缓解传统机器学习入侵检测模型的低准确率问题。IRFD采用堆叠降噪稀疏自编码器策略对数据进行降维,从而提取有效特征。利用卷积注意力机制对残差网络进行改进,构建能提取关键特征的分类网络,并利用两个典型的入侵检测数据集验证IRFD的检测性能。实验结果表明,IRFD在数据集UNSW-NB15和CICIDS 2017上的准确率均达到99%以上,且F1-score分别为99.5%和99.7%。与基线模型相比,提出的IRFD在准确率、精确率和F1-score性能上均有较大提升。
文摘为了解决联合收割机作业故障的非线性特征信号难以提取的问题,该研究提出了一种基于堆叠去噪自动编码器(Stack Denoising Auto Encoder,SDAE)和BP神经网络(Back Propagation,BP)融合的联合收割机作业故障监测及诊断的方法(SDAE-BP)。以转速传感器采集联合收割机脱粒滚筒转速、籽粒搅龙转速、喂入搅龙转速、杂余搅龙转速、风机转速、输送链耙转速、割刀频率以及逐稿器振动频率,并将采集的数据集作为系统的输入。利用SDAE提取输入信号的深层次特征,并由BP神经网络辨识收割机作业状态,实现联合收割机故障监测。在SDAE-BP模型训练过程中,去噪自动编码器(Denoising Auto Encode,DAE)依次经带有不同分布中心噪声的原始数据进行训练,然后将其堆叠,并通过误差反向传播算法对模型参数进行优化,以提升模型识别故障性能和泛化能力。试验结果表明,对于2018年联合收割机田间试验数据,模型的故障诊断准确率达到99.00%,与SDAE和BP神经网络相比,分别提高了1.5和4.5个百分点。将SDAE-BP故障诊断模型用2019年的试验数据进行更新,并用2018年和2019年试验数据进行测试,结果表明,更新后的模型对2018年试验数据的故障识别准确率为99.25%,对2019年试验数据的故障识别准确率为98.74%,更新后模型在2019试验数据集上的故障识别准确率较未更新模型提高了6.52个百分点。该文所建模型能够准确识别联合收割机的故障类型,且具有较好的鲁棒性,对旋转型机械故障监测及预警具有参考价值。
