Kernel independent component analysis(KICA) is a newly emerging nonlinear process monitoring method,which can extract mutually independent latent variables called independent components(ICs) from process variables. Ho...Kernel independent component analysis(KICA) is a newly emerging nonlinear process monitoring method,which can extract mutually independent latent variables called independent components(ICs) from process variables. However, when more than one IC have Gaussian distribution, it cannot extract the IC feature effectively and thus its monitoring performance will be degraded drastically. To solve such a problem, a kernel time structure independent component analysis(KTSICA) method is proposed for monitoring nonlinear process in this paper. The original process data are mapped into a feature space nonlinearly and then the whitened data are calculated in the feature space by the kernel trick. Subsequently, a time structure independent component analysis algorithm, which has no requirement for the distribution of ICs, is proposed to extract the IC feature.Finally, two monitoring statistics are built to detect process faults. When some fault is detected, a nonlinear fault identification method is developed to identify fault variables based on sensitivity analysis. The proposed monitoring method is applied in the Tennessee Eastman benchmark process. Applications demonstrate the superiority of KTSICA over KICA.展开更多
Dimensionality reduction techniques play an important role in data mining. Kernel entropy component analysis( KECA) is a newly developed method for data transformation and dimensionality reduction. This paper conducte...Dimensionality reduction techniques play an important role in data mining. Kernel entropy component analysis( KECA) is a newly developed method for data transformation and dimensionality reduction. This paper conducted a comparative study of KECA with other five dimensionality reduction methods,principal component analysis( PCA),kernel PCA( KPCA),locally linear embedding( LLE),laplacian eigenmaps( LAE) and diffusion maps( DM). Three quality assessment criteria, local continuity meta-criterion( LCMC),trustworthiness and continuity measure(T&C),and mean relative rank error( MRRE) are applied as direct performance indexes to assess those dimensionality reduction methods. Moreover,the clustering accuracy is used as an indirect performance index to evaluate the quality of the representative data gotten by those methods. The comparisons are performed on six datasets and the results are analyzed by Friedman test with the corresponding post-hoc tests. The results indicate that KECA shows an excellent performance in both quality assessment criteria and clustering accuracy assessing.展开更多
The precision of the kernel independent component analysis( KICA) algorithm depends on the type and parameter values of kernel function. Therefore,it's of great significance to study the choice method of KICA'...The precision of the kernel independent component analysis( KICA) algorithm depends on the type and parameter values of kernel function. Therefore,it's of great significance to study the choice method of KICA's kernel parameters for improving its feature dimension reduction result. In this paper, a fitness function was established by use of the ideal of Fisher discrimination function firstly. Then the global optimal solution of fitness function was searched by particle swarm optimization( PSO) algorithm and a multi-state information dimension reduction algorithm based on PSO-KICA was established. Finally,the validity of this algorithm to enhance the precision of feature dimension reduction has been proven.展开更多
A novel nonlinear combination process monitoring method was proposed based on techniques with memo- ry effect （multivariate exponentially weighted moving average （MEWMA）） and kernel independent component analysis ...A novel nonlinear combination process monitoring method was proposed based on techniques with memo- ry effect （multivariate exponentially weighted moving average （MEWMA）） and kernel independent component analysis （KICA）. The method was developed for dealing with nonlinear issues and detecting small or moderate drifts in one or more process variables with autocorrelation. MEWMA charts use additional information from the past history of the process for keeping the memory effect of the process behavior trend. KICA is a recently devel- oped statistical technique for revealing hidden, nonlinear statistically independent factors that underlie sets of mea- surements and it is a two-phase algorithm., whitened kernel principal component analysis （KPCA） plus indepen- dent component analysis （ICA）. The application to the fluid catalytic cracking unit （FCCU） simulated process in- dicates that the proposed combined method based on MEWMA and KICA can effectively capture the nonlinear rela- tionship and detect small drifts in process variables. Its performance significantly outperforms monitoring method based on ICA, MEWMA-ICA and KICA, especially for lonu-term performance deterioration.展开更多
In order to facilitate the extraction of the default mode network（DMN）, reduce the data complexity of the functional magnetic resonance imaging （fMRI）and overcome the restriction of the linearity of the mixing pro...In order to facilitate the extraction of the default mode network（DMN）, reduce the data complexity of the functional magnetic resonance imaging （fMRI）and overcome the restriction of the linearity of the mixing process encountered with the independent component analysis（ICA）, a framework of dimensionality reduction and nonlinear transformation is proposed. First, the principal component analysis（PCA）is applied to reduce the time dimension 153 594×128 of the fMRI data to 153 594×5 for simplifying complexity computation and obtaining 95% of the information. Secondly, a new kernel-based nonlinear ICA method referred as the kernel ICA（KICA）based on the Gaussian kernel is introduced to analyze the resting-state fMRI data and extract the DMN. Experimental results show that the KICA provides a better performance for the resting-state fMRI data analysis compared with the classical ICA. Furthermore, the DMN is accurately extracted and the noise is reduced.展开更多
Fault detection is beneficial for chiller routine operation management in building automation systems.Considering the limitations of traditional principal component analysis(PCA)algorithm for chiller fault detection,a...Fault detection is beneficial for chiller routine operation management in building automation systems.Considering the limitations of traditional principal component analysis(PCA)algorithm for chiller fault detection,a so-called kernel entropy component analysis(KECA)method has been developed and the development results are reported in this paper.Unlike traditional PCA,in KECA,the feature extraction or dimensionality reduction is implemented in a new space,called kernel feature space.The new space is nonlinearly related to the input space.The data set in the kernel feature space is projected onto a principal component subspace constructed by the feature space principal axes determined by the maximum Rényi entropy rather than the top eigenvalues.The proposed KECA is more suitable to deal with nonlinear process without Gaussian assumption.Using the available experimental data from ASHRAE RP-1043,seven typical chiller faults were tested by the proposed KECA method,and the results were compared to that of PCA.Two statistics,i.e.T2 and squared prediction error(SPE),were employed for fault detection monitoring.The fault detection results showed that the proposed KECA method had a better performance in terms of a higher detection accuracy in comparison to the traditional PCA.For the seven typical faults,the fault detection ratios were over 55%,even at their corresponding least severity level when using the proposed KECA based chiller fault detection method.展开更多
A new algorithm for linear instantaneous independent component analysis is proposed based on maximizing the log-likelihood contrast function which can be changed into a gradient equation.An iterative method is introdu...A new algorithm for linear instantaneous independent component analysis is proposed based on maximizing the log-likelihood contrast function which can be changed into a gradient equation.An iterative method is introduced to solve this equation efficiently.The unknown probability density functions as well as their first and second derivatives in the gradient equation are estimated by kernel density method.Computer simulations on artificially generated signals and gray scale natural scene images confirm the efficiency and accuracy of the proposed algorithm.展开更多
Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly bein...Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly being challenged.To address this challenge,we propose algorithms to detect anomalous data collected from drones to improve drone safety.We deployed a one-class kernel extreme learning machine(OCKELM)to detect anomalies in drone data.By default,OCKELM uses the radial basis(RBF)kernel function as the kernel function of themodel.To improve the performance ofOCKELM,we choose a TriangularGlobalAlignmentKernel(TGAK)instead of anRBF Kernel and introduce the Fast Independent Component Analysis(FastICA)algorithm to reconstruct UAV data.Based on the above improvements,we create a novel anomaly detection strategy FastICA-TGAK-OCELM.The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies(ALFA)dataset.The experimental results show that compared with other methods,the accuracy of this method is improved by more than 30%,and point anomalies are effectively detected.展开更多
目的:为实现从母体腹壁混合信号中提取高信噪比和波形清晰的胎儿心电信号,提出一种融合核主成分分析(kernel principal component analysis,KPCA)、快速独立成分分析(fast independent component analysis,FastICA)及奇异值分解(singula...目的:为实现从母体腹壁混合信号中提取高信噪比和波形清晰的胎儿心电信号,提出一种融合核主成分分析(kernel principal component analysis,KPCA)、快速独立成分分析(fast independent component analysis,FastICA)及奇异值分解(singular value decomposition,SVD)的胎儿心电信号提取算法。方法:首先,采用KPCA对母体心电信号进行降维,再利用改进的基于负熵的FastICA处理降维后的数据,得到独立成分。随后,引入样本熵进行信号通道选择,挑选出包含最多母体信息的信号通道。在选中的母体通道上进行SVD,得到母体心电信号的近似估计,再用腹壁源信号减去该信号得到胎儿心电的初步估计。最后,采用改进的基于负熵的FastICA成功分离出纯净的胎儿心电信号。在腹部和直接胎儿心电图数据库(Abdominal and Direct Fetal Electrocardiogram Database,ADFECGDB)和PhysioNet 2013挑战赛数据库中对提出的算法进行验证。结果:提出的算法在主观视觉效果和客观评价指标上都表现出优越的性能。在ADFECGDB数据库中,胎儿QRS复合波检测的敏感度、阳性预测值和F1值分别为99.74%、98.85%和99.30%;在PhysioNet 2013挑战赛数据库中,胎儿QRS复合波检测的敏感度、阳性预测值和F1值分别为99.10%、97.87%和98.48%。结论:融合KPCA、FastICA及SVD的胎儿心电信号提取算法在提取胎儿心电信号的同时有效处理了附加噪声,为胎儿疾病的早期诊断提供了有力支持。展开更多
基金Supported by the National Natural Science Foundation of China(61273160)the Natural Science Foundation of Shandong Province of China(ZR2011FM014)+1 种基金the Doctoral Fund of Shandong Province(BS2012ZZ011)the Postgraduate Innovation Funds of China University of Petroleum(CX2013060)
文摘Kernel independent component analysis(KICA) is a newly emerging nonlinear process monitoring method,which can extract mutually independent latent variables called independent components(ICs) from process variables. However, when more than one IC have Gaussian distribution, it cannot extract the IC feature effectively and thus its monitoring performance will be degraded drastically. To solve such a problem, a kernel time structure independent component analysis(KTSICA) method is proposed for monitoring nonlinear process in this paper. The original process data are mapped into a feature space nonlinearly and then the whitened data are calculated in the feature space by the kernel trick. Subsequently, a time structure independent component analysis algorithm, which has no requirement for the distribution of ICs, is proposed to extract the IC feature.Finally, two monitoring statistics are built to detect process faults. When some fault is detected, a nonlinear fault identification method is developed to identify fault variables based on sensitivity analysis. The proposed monitoring method is applied in the Tennessee Eastman benchmark process. Applications demonstrate the superiority of KTSICA over KICA.
基金Climbing Peak Discipline Project of Shanghai Dianji University,China(No.15DFXK02)Hi-Tech Research and Development Programs of China(No.2007AA041600)
文摘Dimensionality reduction techniques play an important role in data mining. Kernel entropy component analysis( KECA) is a newly developed method for data transformation and dimensionality reduction. This paper conducted a comparative study of KECA with other five dimensionality reduction methods,principal component analysis( PCA),kernel PCA( KPCA),locally linear embedding( LLE),laplacian eigenmaps( LAE) and diffusion maps( DM). Three quality assessment criteria, local continuity meta-criterion( LCMC),trustworthiness and continuity measure(T&C),and mean relative rank error( MRRE) are applied as direct performance indexes to assess those dimensionality reduction methods. Moreover,the clustering accuracy is used as an indirect performance index to evaluate the quality of the representative data gotten by those methods. The comparisons are performed on six datasets and the results are analyzed by Friedman test with the corresponding post-hoc tests. The results indicate that KECA shows an excellent performance in both quality assessment criteria and clustering accuracy assessing.
文摘The precision of the kernel independent component analysis( KICA) algorithm depends on the type and parameter values of kernel function. Therefore,it's of great significance to study the choice method of KICA's kernel parameters for improving its feature dimension reduction result. In this paper, a fitness function was established by use of the ideal of Fisher discrimination function firstly. Then the global optimal solution of fitness function was searched by particle swarm optimization( PSO) algorithm and a multi-state information dimension reduction algorithm based on PSO-KICA was established. Finally,the validity of this algorithm to enhance the precision of feature dimension reduction has been proven.
基金The National Natural Science Foundation ofChina(No60504033)
文摘A novel nonlinear combination process monitoring method was proposed based on techniques with memo- ry effect （multivariate exponentially weighted moving average （MEWMA）） and kernel independent component analysis （KICA）. The method was developed for dealing with nonlinear issues and detecting small or moderate drifts in one or more process variables with autocorrelation. MEWMA charts use additional information from the past history of the process for keeping the memory effect of the process behavior trend. KICA is a recently devel- oped statistical technique for revealing hidden, nonlinear statistically independent factors that underlie sets of mea- surements and it is a two-phase algorithm., whitened kernel principal component analysis （KPCA） plus indepen- dent component analysis （ICA）. The application to the fluid catalytic cracking unit （FCCU） simulated process in- dicates that the proposed combined method based on MEWMA and KICA can effectively capture the nonlinear rela- tionship and detect small drifts in process variables. Its performance significantly outperforms monitoring method based on ICA, MEWMA-ICA and KICA, especially for lonu-term performance deterioration.
基金Key Academic Discipline during the11th Five-Year Plan Period of Jiangsu Province
文摘In order to facilitate the extraction of the default mode network（DMN）, reduce the data complexity of the functional magnetic resonance imaging （fMRI）and overcome the restriction of the linearity of the mixing process encountered with the independent component analysis（ICA）, a framework of dimensionality reduction and nonlinear transformation is proposed. First, the principal component analysis（PCA）is applied to reduce the time dimension 153 594×128 of the fMRI data to 153 594×5 for simplifying complexity computation and obtaining 95% of the information. Secondly, a new kernel-based nonlinear ICA method referred as the kernel ICA（KICA）based on the Gaussian kernel is introduced to analyze the resting-state fMRI data and extract the DMN. Experimental results show that the KICA provides a better performance for the resting-state fMRI data analysis compared with the classical ICA. Furthermore, the DMN is accurately extracted and the noise is reduced.
基金The financial supports for the Natural Science Foundation of Zhejiang Province(Project No.LQ19E060007)are gratefully acknowledged.
文摘Fault detection is beneficial for chiller routine operation management in building automation systems.Considering the limitations of traditional principal component analysis(PCA)algorithm for chiller fault detection,a so-called kernel entropy component analysis(KECA)method has been developed and the development results are reported in this paper.Unlike traditional PCA,in KECA,the feature extraction or dimensionality reduction is implemented in a new space,called kernel feature space.The new space is nonlinearly related to the input space.The data set in the kernel feature space is projected onto a principal component subspace constructed by the feature space principal axes determined by the maximum Rényi entropy rather than the top eigenvalues.The proposed KECA is more suitable to deal with nonlinear process without Gaussian assumption.Using the available experimental data from ASHRAE RP-1043,seven typical chiller faults were tested by the proposed KECA method,and the results were compared to that of PCA.Two statistics,i.e.T2 and squared prediction error(SPE),were employed for fault detection monitoring.The fault detection results showed that the proposed KECA method had a better performance in terms of a higher detection accuracy in comparison to the traditional PCA.For the seven typical faults,the fault detection ratios were over 55%,even at their corresponding least severity level when using the proposed KECA based chiller fault detection method.
文摘A new algorithm for linear instantaneous independent component analysis is proposed based on maximizing the log-likelihood contrast function which can be changed into a gradient equation.An iterative method is introduced to solve this equation efficiently.The unknown probability density functions as well as their first and second derivatives in the gradient equation are estimated by kernel density method.Computer simulations on artificially generated signals and gray scale natural scene images confirm the efficiency and accuracy of the proposed algorithm.
基金supported by the Natural Science Foundation of The Jiangsu Higher Education Institutions of China(Grant No.19JKB520031).
文摘Unmanned Aerial Vehicles(UAVs)are widely used and meet many demands in military and civilian fields.With the continuous enrichment and extensive expansion of application scenarios,the safety of UAVs is constantly being challenged.To address this challenge,we propose algorithms to detect anomalous data collected from drones to improve drone safety.We deployed a one-class kernel extreme learning machine(OCKELM)to detect anomalies in drone data.By default,OCKELM uses the radial basis(RBF)kernel function as the kernel function of themodel.To improve the performance ofOCKELM,we choose a TriangularGlobalAlignmentKernel(TGAK)instead of anRBF Kernel and introduce the Fast Independent Component Analysis(FastICA)algorithm to reconstruct UAV data.Based on the above improvements,we create a novel anomaly detection strategy FastICA-TGAK-OCELM.The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies(ALFA)dataset.The experimental results show that compared with other methods,the accuracy of this method is improved by more than 30%,and point anomalies are effectively detected.
文摘目的:为实现从母体腹壁混合信号中提取高信噪比和波形清晰的胎儿心电信号,提出一种融合核主成分分析(kernel principal component analysis,KPCA)、快速独立成分分析(fast independent component analysis,FastICA)及奇异值分解(singular value decomposition,SVD)的胎儿心电信号提取算法。方法:首先,采用KPCA对母体心电信号进行降维,再利用改进的基于负熵的FastICA处理降维后的数据,得到独立成分。随后,引入样本熵进行信号通道选择,挑选出包含最多母体信息的信号通道。在选中的母体通道上进行SVD,得到母体心电信号的近似估计,再用腹壁源信号减去该信号得到胎儿心电的初步估计。最后,采用改进的基于负熵的FastICA成功分离出纯净的胎儿心电信号。在腹部和直接胎儿心电图数据库(Abdominal and Direct Fetal Electrocardiogram Database,ADFECGDB)和PhysioNet 2013挑战赛数据库中对提出的算法进行验证。结果:提出的算法在主观视觉效果和客观评价指标上都表现出优越的性能。在ADFECGDB数据库中,胎儿QRS复合波检测的敏感度、阳性预测值和F1值分别为99.74%、98.85%和99.30%;在PhysioNet 2013挑战赛数据库中,胎儿QRS复合波检测的敏感度、阳性预测值和F1值分别为99.10%、97.87%和98.48%。结论:融合KPCA、FastICA及SVD的胎儿心电信号提取算法在提取胎儿心电信号的同时有效处理了附加噪声,为胎儿疾病的早期诊断提供了有力支持。
