The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morph...The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morphological characteristics show significant variations for different patients.A fast patient-specific arrhythmia diagnosis classifier scheme is proposed,in which a wavelet adaptive threshold denoising is combined with quantum genetic algorithm(QAG)based on least squares twin support vector machine(LSTSVM).The wavelet adaptive threshold denoising is employed for noise reduction,and then morphological features combined with the timing interval features are extracted to evaluate the classifier.For each patient,an individual and fast classifier will be trained by common and patient-specific training data.Following the recommendations of the Association for the Advancements of Medical Instrumentation(AAMI),experimental results over the MIT-BIH arrhythmia benchmark database demonstrated that our proposed method achieved the average detection accuracy of 98.22%,99.65%and 99.41%for the abnormal,ventricular ectopic beats(VEBs)and supra-VEBs(SVEBs),respectively.Besides the detection accuracy,sensitivity and specificity,our proposed method consumes the less CPU running time compared with the other representative state of the art methods.It can be ported to Android based embedded system,henceforth suitable for a wearable device.展开更多
A quantitative structure-activity relationships （QSAR） study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calcul...A quantitative structure-activity relationships （QSAR） study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calculate some quantum chemical descriptors including electrostatic potentials and local charges at each atom, HOMO and LUMO energies, etc. Modeling of the solubility of thiazolidine- 4-carboxylic acid derivatives as a function of molecular structures was established by means of the partial least squares （PLS）. The subset of descriptors, which resulted in the low prediction error, was selected by genetic algorithm. This model was applied for the prediction of the solubility of some thiazolidine-4-carboxylic acid derivatives, which were not in the modeling procedure. The relative errors of prediction lower that -4% was obtained by using GA-PLS method. The resulted model showed high prediction ability with RMSEP of 3.8836 and 2.9500 for PLS and GA-PLS models, respectively.展开更多
In order to improve the problem that the filtered-x least mean square(FxLMS)algorithm cannot take into account the convergence speed,steady-state error during active noise control.A piecewise variable step size FxLMS ...In order to improve the problem that the filtered-x least mean square(FxLMS)algorithm cannot take into account the convergence speed,steady-state error during active noise control.A piecewise variable step size FxLMS algorithm based on logarithmic function(PLFxLMS)is proposed,and the genetic algorithm are introduced to optimize the parameters of logarithmic variable step size FxLMS(LFxLMS),improved logarithmic variable step size Films(IFxLMS),and PLFxLMS algorithms.Bandlimited white noise is used as the input signal,FxLMS,LFxLMS,ILFxLMS,and PLFxLMS algorithms are used to conduct active noise control simulation,and the convergence speed and steady-state characteristic of four algorithms are comparatively analyzed.Compared with the other three algorithms,the PLFxLMS algorithm proposed in this paper has the fastest convergence speed,and small steady-state error.The PLFxLMS algorithm can effectively improve the convergence speed and steady-state error of the FxLMS algorithm that cannot be controlled at the same time,and achieve the optimal effect.展开更多
Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid mo...Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid model in combination of least squares support vector machine(LSSVM) model with fruit fly optimization algorithm(FOA) and the seasonal index adjustment is constructed to predict monthly electricity consumption. The monthly electricity consumption demonstrates a nonlinear characteristic and seasonal tendency. The LSSVM has a good fit for nonlinear data, so it has been widely applied to handling nonlinear time series prediction. However, there is no unified selection method for key parameters and no unified method to deal with the effect of seasonal tendency. Therefore, the FOA was hybridized with the LSSVM and the seasonal index adjustment to solve this problem. In order to evaluate the forecasting performance of hybrid model, two samples of monthly electricity consumption of China and the United States were employed, besides several different models were applied to forecast the two empirical time series. The results of the two samples all show that, for seasonal data, the adjusted model with seasonal indexes has better forecasting performance. The forecasting performance is better than the models without seasonal indexes. The fruit fly optimized LSSVM model outperforms other alternative models. In other words, the proposed hybrid model is a feasible method for the electricity consumption forecasting.展开更多
The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical d...The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical deformations and using a rectangular uniform slip model in a homogeneous elastic half space, we first employ genetic algorithms (GA) to infer the approximate global optimal solution, and further use least squares method to get more accurate global optimal solution by taking the approximate solution of GA as the initial parameters of least squares. The inversion results show that the causative fault of Gonghe Ms=7.0 earthquake is a right-lateral reverse fault with strike NW60°, dip SW and dip angle 37°, the coseismic fracture length, width and slip are 37 km, 6 km and 2.7 m respectively. Combination of GA and least squares algorithms is an effective joint inversion method, which could not only escape from local optimum of least squares, but also solve the slow convergence problem of GA after reaching adjacency of global optimal solution.展开更多
Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order ...Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.展开更多
This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obt...This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obtained in T = n(log2m + log2(n - r + 1) + 5) + log2m + 1 steps with P=mn processors when m × 2(n - 1) and with P = 2n(n - 1) processors otherwise.展开更多
The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge...The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.展开更多
With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main devel...With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.展开更多
At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these...At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these strategies have some limitations,e.g.they cannot consider statistical observation error information,redundant observations and so on.This paper applies least squares methods to complex data processing to extend surveying adjustment theory from real to complex number space.We compared the two adjustment criteria for a complex domain in a quantitative way.In order to understand the effectiveness of complex least squares,tree height inversion from PolInSAR data is taken as an example.We firstly established both a complex adjustment function model and a stochastic model for PolInSAR tree height inversion,and then applied the complex least squares method to estimate tree height.Results show that the complex least squares approach is reliable and outperforms other classic tree height retrieval methods;the method is simple and easy to implement.展开更多
This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Le...This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.展开更多
Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and rel...Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and reliable to process the data in building the digital earth with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method was put forward to process data in building the digital earth. A separating solution model and the iterative calculation method were used to solve the generalized nonlinear dynamic least squares problem. In fact, a complex problem can be separated and then solved by converting to two sub problems, each of which has a single variable. Therefore the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations.展开更多
The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant ...The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant dual-beam circumferential scanning laser fuze to distinguish various interference signals and provide more real-time data for the backscatter filtering algorithm.This enhances the algorithm loading capability of the fuze.In order to address the problem of insufficient filtering capacity in existing linear backscatter filtering algorithms,we develop a nonlinear backscattering adaptive filter based on the spline adaptive filter least mean square(SAF-LMS)algorithm.We also designed an algorithm pause module to retain the original trend of the target echo peak,improving the time discrimination accuracy and anti-interference capability of the fuze.Finally,experiments are conducted with varying signal-to-noise ratios of the original underwater target echo signals.The experimental results show that the average signal-to-noise ratio before and after filtering can be improved by more than31 d B,with an increase of up to 76%in extreme detection distance.展开更多
The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive da...The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive damped least square is proposed. This is done by normalizing the measurement vector entering into the identification algorithm. rt is shown that the parametric distance converges to a zero mean random variable. It is also shown that under persistent excitation condition, the condition number of the adaptation gain matrix is bounded, and the variance of the parametric distance is bounded.展开更多
The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in p...The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.展开更多
Data are very important to build the digital mine. Data come from many sources, have different types and temporal states. Relations between one class of data and the other one, or between data and unknown parameters a...Data are very important to build the digital mine. Data come from many sources, have different types and temporal states. Relations between one class of data and the other one, or between data and unknown parameters are more nonlinear. The unknown parameters are non random or random, among which the random parameters often dynamically vary with time. Therefore it is not accurate and reliable to process the data in building the digital mine with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method to process data in building the digital mine is put forward. In the meantime, the corresponding mathematical model is also given. The generalized nonlinear least squares problem is more complex than the common nonlinear least squares problem and its solution is more difficultly obtained because the dimensions of data and parameters in the former are bigger. So a new solution model and the method are put forward to solve the generalized nonlinear dynamic least squares problem. In fact, the problem can be converted to two sub problems, each of which has a single variable. That is to say, a complex problem can be separated and then solved. So the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations. The method lessens the calculating load and opens up a new way to process the data in building the digital mine, which have more sources, different types and more temporal states.展开更多
Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the...Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the rotor vibration in AMBs is to adopt a notch filter or adaptive filter in the AMB controller. However, these methods cannot obtain the precise amplitude and phase of the compensation current. Thus, they are not so effective in terms of suppressing the vibrations of the fundamental and other harmonic orders over the whole speed range. To improve the vibration suppression performance of AMBs,an adaptive filter based on Least Mean Square(LMS) is applied to extract the vibration signals from the rotor displacement signal. An Iterative Search Algorithm(ISA) is proposed in this paper to obtain the corresponding relationship between the compensation current and vibration signals. The ISA is responsible for searching the compensating amplitude and shifting phase online for the LMS filter, enabling the AMB controller to generate the corresponding compensation force for vibration suppression. The results of ISA are recorded to suppress vibration using the Look-Up Table(LUT) in variable speed range. Comprehensive simulations and experimental validations are carried out in fixed and variable speed range, and the results demonstrate that by employing the ISA, vibrations of the fundamental and other harmonic orders are suppressed effectively.展开更多
Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear mode...Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.展开更多
基金Supported by the National Natural Science Foundation of China(61571063)Key Scientific Research Projects of Colleges and Universities in Henan Province(20A510014)Key Scientific and Technological Projects in Henan Province。
文摘The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morphological characteristics show significant variations for different patients.A fast patient-specific arrhythmia diagnosis classifier scheme is proposed,in which a wavelet adaptive threshold denoising is combined with quantum genetic algorithm(QAG)based on least squares twin support vector machine(LSTSVM).The wavelet adaptive threshold denoising is employed for noise reduction,and then morphological features combined with the timing interval features are extracted to evaluate the classifier.For each patient,an individual and fast classifier will be trained by common and patient-specific training data.Following the recommendations of the Association for the Advancements of Medical Instrumentation(AAMI),experimental results over the MIT-BIH arrhythmia benchmark database demonstrated that our proposed method achieved the average detection accuracy of 98.22%,99.65%and 99.41%for the abnormal,ventricular ectopic beats(VEBs)and supra-VEBs(SVEBs),respectively.Besides the detection accuracy,sensitivity and specificity,our proposed method consumes the less CPU running time compared with the other representative state of the art methods.It can be ported to Android based embedded system,henceforth suitable for a wearable device.
文摘A quantitative structure-activity relationships （QSAR） study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calculate some quantum chemical descriptors including electrostatic potentials and local charges at each atom, HOMO and LUMO energies, etc. Modeling of the solubility of thiazolidine- 4-carboxylic acid derivatives as a function of molecular structures was established by means of the partial least squares （PLS）. The subset of descriptors, which resulted in the low prediction error, was selected by genetic algorithm. This model was applied for the prediction of the solubility of some thiazolidine-4-carboxylic acid derivatives, which were not in the modeling procedure. The relative errors of prediction lower that -4% was obtained by using GA-PLS method. The resulted model showed high prediction ability with RMSEP of 3.8836 and 2.9500 for PLS and GA-PLS models, respectively.
文摘In order to improve the problem that the filtered-x least mean square(FxLMS)algorithm cannot take into account the convergence speed,steady-state error during active noise control.A piecewise variable step size FxLMS algorithm based on logarithmic function(PLFxLMS)is proposed,and the genetic algorithm are introduced to optimize the parameters of logarithmic variable step size FxLMS(LFxLMS),improved logarithmic variable step size Films(IFxLMS),and PLFxLMS algorithms.Bandlimited white noise is used as the input signal,FxLMS,LFxLMS,ILFxLMS,and PLFxLMS algorithms are used to conduct active noise control simulation,and the convergence speed and steady-state characteristic of four algorithms are comparatively analyzed.Compared with the other three algorithms,the PLFxLMS algorithm proposed in this paper has the fastest convergence speed,and small steady-state error.The PLFxLMS algorithm can effectively improve the convergence speed and steady-state error of the FxLMS algorithm that cannot be controlled at the same time,and achieve the optimal effect.
基金National Social Science Foundation of China(No.18AGL028)Social Science Foundation of the Higher Education Institutions Jiangsu Province,China(No.2018SJZDI070)Social Science Foundation of the Jiangsu Province,China(Nos.16ZZB004,17ZTB005)
文摘Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid model in combination of least squares support vector machine(LSSVM) model with fruit fly optimization algorithm(FOA) and the seasonal index adjustment is constructed to predict monthly electricity consumption. The monthly electricity consumption demonstrates a nonlinear characteristic and seasonal tendency. The LSSVM has a good fit for nonlinear data, so it has been widely applied to handling nonlinear time series prediction. However, there is no unified selection method for key parameters and no unified method to deal with the effect of seasonal tendency. Therefore, the FOA was hybridized with the LSSVM and the seasonal index adjustment to solve this problem. In order to evaluate the forecasting performance of hybrid model, two samples of monthly electricity consumption of China and the United States were employed, besides several different models were applied to forecast the two empirical time series. The results of the two samples all show that, for seasonal data, the adjusted model with seasonal indexes has better forecasting performance. The forecasting performance is better than the models without seasonal indexes. The fruit fly optimized LSSVM model outperforms other alternative models. In other words, the proposed hybrid model is a feasible method for the electricity consumption forecasting.
文摘The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical deformations and using a rectangular uniform slip model in a homogeneous elastic half space, we first employ genetic algorithms (GA) to infer the approximate global optimal solution, and further use least squares method to get more accurate global optimal solution by taking the approximate solution of GA as the initial parameters of least squares. The inversion results show that the causative fault of Gonghe Ms=7.0 earthquake is a right-lateral reverse fault with strike NW60°, dip SW and dip angle 37°, the coseismic fracture length, width and slip are 37 km, 6 km and 2.7 m respectively. Combination of GA and least squares algorithms is an effective joint inversion method, which could not only escape from local optimum of least squares, but also solve the slow convergence problem of GA after reaching adjacency of global optimal solution.
文摘Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.
基金This project is supported by the National Natural Science Foundation of China
文摘This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obtained in T = n(log2m + log2(n - r + 1) + 5) + log2m + 1 steps with P=mn processors when m × 2(n - 1) and with P = 2n(n - 1) processors otherwise.
文摘The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.
文摘With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.
基金The National Natural Science Foundation of China(41274010,40974007,40901172)National Key Basic Research and Development Program of China(2012AA121301)+2 种基金Hunan Provincial Natural Science Foundation of China(12JJ4035)Postgraduate Autonomous Exploration Project of Central South University(2013zzts055)China Scholarship Council(201406370079).
文摘At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these strategies have some limitations,e.g.they cannot consider statistical observation error information,redundant observations and so on.This paper applies least squares methods to complex data processing to extend surveying adjustment theory from real to complex number space.We compared the two adjustment criteria for a complex domain in a quantitative way.In order to understand the effectiveness of complex least squares,tree height inversion from PolInSAR data is taken as an example.We firstly established both a complex adjustment function model and a stochastic model for PolInSAR tree height inversion,and then applied the complex least squares method to estimate tree height.Results show that the complex least squares approach is reliable and outperforms other classic tree height retrieval methods;the method is simple and easy to implement.
文摘This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.
文摘Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and reliable to process the data in building the digital earth with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method was put forward to process data in building the digital earth. A separating solution model and the iterative calculation method were used to solve the generalized nonlinear dynamic least squares problem. In fact, a complex problem can be separated and then solved by converting to two sub problems, each of which has a single variable. Therefore the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations.
基金supported by the 2021 Open Project Fund of Science and Technology on Electromechanical Dynamic Control Laboratory,grant number 212-C-J-F-QT-2022-0020China Postdoctoral Science Foundation,grant number 2021M701713+1 种基金Postgraduate Research&Practice Innovation Program of Jiangsu Province,grant number KYCX23_0511the Jiangsu Funding Program for Excellent Postdoctoral Talent,grant number 20220ZB245。
文摘The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant dual-beam circumferential scanning laser fuze to distinguish various interference signals and provide more real-time data for the backscatter filtering algorithm.This enhances the algorithm loading capability of the fuze.In order to address the problem of insufficient filtering capacity in existing linear backscatter filtering algorithms,we develop a nonlinear backscattering adaptive filter based on the spline adaptive filter least mean square(SAF-LMS)algorithm.We also designed an algorithm pause module to retain the original trend of the target echo peak,improving the time discrimination accuracy and anti-interference capability of the fuze.Finally,experiments are conducted with varying signal-to-noise ratios of the original underwater target echo signals.The experimental results show that the average signal-to-noise ratio before and after filtering can be improved by more than31 d B,with an increase of up to 76%in extreme detection distance.
文摘The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive damped least square is proposed. This is done by normalizing the measurement vector entering into the identification algorithm. rt is shown that the parametric distance converges to a zero mean random variable. It is also shown that under persistent excitation condition, the condition number of the adaptation gain matrix is bounded, and the variance of the parametric distance is bounded.
基金supported by the National Natural Science Foundation of China(50576033)
文摘The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.
文摘Data are very important to build the digital mine. Data come from many sources, have different types and temporal states. Relations between one class of data and the other one, or between data and unknown parameters are more nonlinear. The unknown parameters are non random or random, among which the random parameters often dynamically vary with time. Therefore it is not accurate and reliable to process the data in building the digital mine with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method to process data in building the digital mine is put forward. In the meantime, the corresponding mathematical model is also given. The generalized nonlinear least squares problem is more complex than the common nonlinear least squares problem and its solution is more difficultly obtained because the dimensions of data and parameters in the former are bigger. So a new solution model and the method are put forward to solve the generalized nonlinear dynamic least squares problem. In fact, the problem can be converted to two sub problems, each of which has a single variable. That is to say, a complex problem can be separated and then solved. So the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations. The method lessens the calculating load and opens up a new way to process the data in building the digital mine, which have more sources, different types and more temporal states.
基金supported by the Natural Science Foundation of China (U22A20214)。
文摘Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the rotor vibration in AMBs is to adopt a notch filter or adaptive filter in the AMB controller. However, these methods cannot obtain the precise amplitude and phase of the compensation current. Thus, they are not so effective in terms of suppressing the vibrations of the fundamental and other harmonic orders over the whole speed range. To improve the vibration suppression performance of AMBs,an adaptive filter based on Least Mean Square(LMS) is applied to extract the vibration signals from the rotor displacement signal. An Iterative Search Algorithm(ISA) is proposed in this paper to obtain the corresponding relationship between the compensation current and vibration signals. The ISA is responsible for searching the compensating amplitude and shifting phase online for the LMS filter, enabling the AMB controller to generate the corresponding compensation force for vibration suppression. The results of ISA are recorded to suppress vibration using the Look-Up Table(LUT) in variable speed range. Comprehensive simulations and experimental validations are carried out in fixed and variable speed range, and the results demonstrate that by employing the ISA, vibrations of the fundamental and other harmonic orders are suppressed effectively.
文摘Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.
