A distributed bearing-only target tracking algorithm based on variational Bayesian inference(VBI)under random measurement anomalies is proposed for the problem of adverse effect of random measurement anomalies on the ...A distributed bearing-only target tracking algorithm based on variational Bayesian inference(VBI)under random measurement anomalies is proposed for the problem of adverse effect of random measurement anomalies on the state estimation accuracy of moving targets in bearing-only tracking scenarios.Firstly,the measurement information of each sensor is complemented by using triangulation under the distributed framework.Secondly,the Student-t distribution is selected to model the measurement likelihood probability density function,and the joint posteriori probability density function of the estimated variables is approximately decoupled by VBI.Finally,the estimation results of each local filter are sent to the fusion center and fed back to each local filter.The simulation results show that the proposed distributed bearing-only target tracking algorithm based on VBI in the presence of abnormal measurement noise comprehensively considers the influence of system nonlinearity and random anomaly of measurement noise,and has higher estimation accuracy and robustness than other existing algorithms in the above scenarios.展开更多
This paper investigates the navigational performance of Global Positioning System(GPS)using the variational Bayesian(VB)based robust filter with interacting multiple model(IMM)adaptation as the navigation processor.Th...This paper investigates the navigational performance of Global Positioning System(GPS)using the variational Bayesian(VB)based robust filter with interacting multiple model(IMM)adaptation as the navigation processor.The performance of the state estimation for GPS navigation processing using the family ofKalman filter(KF)may be degraded due to the fact that in practical situations the statistics of measurement noise might change.In the proposed algorithm,the adaptivity is achieved by estimating the timevarying noise covariance matrices based onVB learning using the probabilistic approach,where in each update step,both the system state and time-varying measurement noise were recognized as random variables to be estimated.The estimation is iterated recursively at each time to approximate the real joint posterior distribution of state using the VB learning.One of the two major classical adaptive Kalman filter(AKF)approaches that have been proposed for tuning the noise covariance matrices is the multiple model adaptive estimate(MMAE).The IMM algorithm uses two or more filters to process in parallel,where each filter corresponds to a different dynamic or measurement model.The robust Huber’s M-estimation-based extended Kalman filter(HEKF)algorithm integrates both merits of the Huber M-estimation methodology and EKF.The robustness is enhanced by modifying the filter update based on Huber’s M-estimation method in the filtering framework.The proposed algorithm,referred to as the interactive multi-model based variational Bayesian HEKF(IMM-VBHEKF),provides an effective way for effectively handling the errors with time-varying and outlying property of non-Gaussian interference errors,such as the multipath effect.Illustrative examples are given to demonstrate the navigation performance enhancement in terms of adaptivity and robustness at the expense of acceptable additional execution time.展开更多
Prediction intervals(PIs)for industrial time series can provide useful guidance for workers.Given that the failure of industrial sensors may cause the missing point in inputs,the existing kernel dynamic Bayesian netwo...Prediction intervals(PIs)for industrial time series can provide useful guidance for workers.Given that the failure of industrial sensors may cause the missing point in inputs,the existing kernel dynamic Bayesian networks(KDBN),serving as an effective method for PIs construction,suffer from high computational load using the stochastic algorithm for inference.This study proposes a variational inference method for the KDBN for the purpose of fast inference,which avoids the timeconsuming stochastic sampling.The proposed algorithm contains two stages.The first stage involves the inference of the missing inputs by using a local linearization based variational inference,and based on the computed posterior distributions over the missing inputs the second stage sees a Gaussian approximation for probability over the nodes in future time slices.To verify the effectiveness of the proposed method,a synthetic dataset and a practical dataset of generation flow of blast furnace gas(BFG)are employed with different ratios of missing inputs.The experimental results indicate that the proposed method can provide reliable PIs for the generation flow of BFG and it exhibits shorter computing time than the stochastic based one.展开更多
This paper is focused on the state estimation problem for nonlinear systems with unknown statistics of measurement noise.Based on the cubature Kalman filter,we propose a new nonlinear filtering algorithm that employs ...This paper is focused on the state estimation problem for nonlinear systems with unknown statistics of measurement noise.Based on the cubature Kalman filter,we propose a new nonlinear filtering algorithm that employs a skew t distribution to characterize the asymmetry of the measurement noise.The system states and the statistics of skew t noise distribution,including the shape matrix,the scale matrix,and the degree of freedom(DOF)are estimated jointly by employing variational Bayesian(VB)inference.The proposed method is validated in a target tracking example.Results of the simulation indicate that the proposed nonlinear filter can perform satisfactorily in the presence of unknown statistics of measurement noise and outperform than the existing state-of-the-art nonlinear filters.展开更多
Aimed at the problem that the state estimation in the measurement update of the simultaneous localization and mapping(SLAM)method is incorrect or even not convergent because of the non-Gaussian measurement noise,outli...Aimed at the problem that the state estimation in the measurement update of the simultaneous localization and mapping(SLAM)method is incorrect or even not convergent because of the non-Gaussian measurement noise,outliers,or unknown and time-varying noise statistical characteristics,a robust SLAM method based on the improved variational Bayesian adaptive Kalman filtering(IVBAKF)is proposed.First,the measurement noise covariance is estimated using the variable Bayesian adaptive filtering algorithm.Then,the estimated covariance matrix is robustly processed through the weight function constructed in the form of a reweighted average.Finally,the system updates are iterated multiple times to further gradually correct the state estimation error.Furthermore,to observe features at different depths,a feature measurement model containing depth parameters is constructed.Experimental results show that when the measurement noise does not obey the Gaussian distribution and there are outliers in the measurement information,compared with the variational Bayesian adaptive SLAM method,the positioning accuracy of the proposed method is improved by 17.23%,20.46%,and 17.76%,which has better applicability and robustness to environmental disturbance.展开更多
An algorithm is presented for image prior combinations based blind deconvolution and applied to astronomical images.Using a hierarchical Bayesian framework, the unknown original image and all required algorithmic para...An algorithm is presented for image prior combinations based blind deconvolution and applied to astronomical images.Using a hierarchical Bayesian framework, the unknown original image and all required algorithmic parameters are estimated simultaneously. Through utilization of variational Bayesian analysis,approximations of the posterior distributions on each unknown are obtained by minimizing the Kullback-Leibler(KL) distance, thus providing uncertainties of the estimates during the restoration process. Experimental results on both synthetic images and real astronomical images demonstrate that the proposed approaches compare favorably to other state-of-the-art reconstruction methods.展开更多
Efficient estimation of line spectral from quantized samples is of significant importance in information theory and signal processing,e.g.,channel estimation in energy efficient massive MIMO systems and direction of a...Efficient estimation of line spectral from quantized samples is of significant importance in information theory and signal processing,e.g.,channel estimation in energy efficient massive MIMO systems and direction of arrival estimation.The goal of this paper is to recover the line spectral as well as its corresponding parameters including the model order,frequencies and amplitudes from heavily quantized samples.To this end,we propose an efficient gridless Bayesian algorithm named VALSE-EP,which is a combination of the high resolution and low complexity gridless variational line spectral estimation(VALSE)and expectation propagation(EP).The basic idea of VALSE-EP is to iteratively approximate the challenging quantized model of line spectral estimation as a sequence of simple pseudo unquantized models,where VALSE is applied.Moreover,to obtain a benchmark of the performance of the proposed algorithm,the Cram′er Rao bound(CRB)is derived.Finally,numerical experiments on both synthetic and real data are performed,demonstrating the near CRB performance of the proposed VALSE-EP for line spectral estimation from quantized samples.展开更多
A novel variational Bayesian inference based on adaptive cubature Kalman filter(VBACKF)algorithm is proposed for the problem of state estimation in a target tracking system with time-varying measurement noise and rand...A novel variational Bayesian inference based on adaptive cubature Kalman filter(VBACKF)algorithm is proposed for the problem of state estimation in a target tracking system with time-varying measurement noise and random measurement losses.Firstly,the Inverse-Wishart(IW)distribution is chosen to model the covariance matrix of time-varying measurement noise in the cubature Kalman filter framework.Secondly,the Bernoulli random variable is introduced as the judgement factor of the measurement losses,and the Beta distribution is selected as the conjugate prior distribution of measurement loss probability to ensure that the posterior distribution and prior distribution have the same function form.Finally,the joint posterior probability density function of the estimated variables is approximately decoupled by the variational Bayesian inference,and the fixed-point iteration approach is used to update the estimated variables.The simulation results show that the proposed VBACKF algorithm considers the comprehensive effects of system nonlinearity,time-varying measurement noise and unknown measurement loss probability,moreover,effectively improves the accuracy of target state estimation in complex scene.展开更多
Aiming at the problem of filtering precision degradation caused by the random outliers of process noise and measurement noise in multi-target tracking(MTT) system,a new Gaussian-Student’s t mixture distribution proba...Aiming at the problem of filtering precision degradation caused by the random outliers of process noise and measurement noise in multi-target tracking(MTT) system,a new Gaussian-Student’s t mixture distribution probability hypothesis density(PHD) robust filtering algorithm based on variational Bayesian inference(GST-vbPHD) is proposed.Firstly,since it can accurately describe the heavy-tailed characteristics of noise with outliers,Gaussian-Student’s t mixture distribution is employed to model process noise and measurement noise respectively.Then Bernoulli random variable is introduced to correct the likelihood distribution of the mixture probability,leading hierarchical Gaussian distribution constructed by the Gaussian-Student’s t mixture distribution suitable to model non-stationary noise.Finally,the approximate solutions including target weights,measurement noise covariance and state estimation error covariance are obtained according to variational Bayesian inference approach.The simulation results show that,in the heavy-tailed noise environment,the proposed algorithm leads to strong improvements over the traditional PHD filter and the Student’s t distribution PHD filter.展开更多
针对测距仪(distance measure equipment,DME)信号严重干扰L频段数字航空通信系统(L-band digital aviation communication system,L-DACS)前向链路接收机的问题,提出基于相关稀疏变分贝叶斯(correlated sparse variational Bayesian,cS...针对测距仪(distance measure equipment,DME)信号严重干扰L频段数字航空通信系统(L-band digital aviation communication system,L-DACS)前向链路接收机的问题,提出基于相关稀疏变分贝叶斯(correlated sparse variational Bayesian,cSVB)算法的DME脉冲干扰抑制方法。所提方法利用L-DACS系统正交频分复用(orthogonal frequency division multiplexing,OFDM)接收机的空子载波信息构建接收信号的压缩感知方程;然后,根据cSVB算法进行三层次贝叶斯信号建模,最后选择了两种变体算法重构DME干扰信号,并将其从时域接收信号中去除。理论分析与仿真结果表明,所提出的干扰抑制方法可以充分利用信号先验信息,进一步降低DME干扰信号估计的归一化均方误差,有效改善L-DACS系统的误码性能,提高传输可靠性。展开更多
Quantile regression is widely used in variable relationship research for statistical learning.Traditional quantile regression model is based on vector-valued covariates and can be efficiently estimated via traditional...Quantile regression is widely used in variable relationship research for statistical learning.Traditional quantile regression model is based on vector-valued covariates and can be efficiently estimated via traditional estimation methods.However,many modern applications involve tensor data with the intrinsic tensor structure.Traditional quantile regression can not deal with tensor regression issues well.To this end,we consider a tensor quantile regression with tensor-valued covariates and develop a novel variational Bayesian estimation approach to make estimation and prediction based on the asymmetric Laplace model and the CANDECOMP/PARAFAC decomposition of tensor coefficients.To incorporate the sparsity of tensor coefficients,we consider the multiway shrinkage priors for marginal factor vectors of tensor coefficients.The key idea of the proposed method is to efficiently combine the prior structural information of tensor and utilize the matricization of tensor decomposition to simplify the complexity of tensor coefficient estimation.The coordinate ascent algorithm is employed to optimize variational lower bound.Simulation studies and a real example show the numerical performances of the proposed method.展开更多
基金Supported by the Science and Technology Key Project of Science and Technology Department of Henan Province(No.252102211041)the Key Research and Development Projects of Henan Province(No.231111212500).
文摘A distributed bearing-only target tracking algorithm based on variational Bayesian inference(VBI)under random measurement anomalies is proposed for the problem of adverse effect of random measurement anomalies on the state estimation accuracy of moving targets in bearing-only tracking scenarios.Firstly,the measurement information of each sensor is complemented by using triangulation under the distributed framework.Secondly,the Student-t distribution is selected to model the measurement likelihood probability density function,and the joint posteriori probability density function of the estimated variables is approximately decoupled by VBI.Finally,the estimation results of each local filter are sent to the fusion center and fed back to each local filter.The simulation results show that the proposed distributed bearing-only target tracking algorithm based on VBI in the presence of abnormal measurement noise comprehensively considers the influence of system nonlinearity and random anomaly of measurement noise,and has higher estimation accuracy and robustness than other existing algorithms in the above scenarios.
基金This work has been partially supported by the Ministry of Science and Technology,Taiwan[Grant Numbers MOST 108-2221-E-019-013 and MOST 109-2221-E-019-010].
文摘This paper investigates the navigational performance of Global Positioning System(GPS)using the variational Bayesian(VB)based robust filter with interacting multiple model(IMM)adaptation as the navigation processor.The performance of the state estimation for GPS navigation processing using the family ofKalman filter(KF)may be degraded due to the fact that in practical situations the statistics of measurement noise might change.In the proposed algorithm,the adaptivity is achieved by estimating the timevarying noise covariance matrices based onVB learning using the probabilistic approach,where in each update step,both the system state and time-varying measurement noise were recognized as random variables to be estimated.The estimation is iterated recursively at each time to approximate the real joint posterior distribution of state using the VB learning.One of the two major classical adaptive Kalman filter(AKF)approaches that have been proposed for tuning the noise covariance matrices is the multiple model adaptive estimate(MMAE).The IMM algorithm uses two or more filters to process in parallel,where each filter corresponds to a different dynamic or measurement model.The robust Huber’s M-estimation-based extended Kalman filter(HEKF)algorithm integrates both merits of the Huber M-estimation methodology and EKF.The robustness is enhanced by modifying the filter update based on Huber’s M-estimation method in the filtering framework.The proposed algorithm,referred to as the interactive multi-model based variational Bayesian HEKF(IMM-VBHEKF),provides an effective way for effectively handling the errors with time-varying and outlying property of non-Gaussian interference errors,such as the multipath effect.Illustrative examples are given to demonstrate the navigation performance enhancement in terms of adaptivity and robustness at the expense of acceptable additional execution time.
基金supported by the National Key Research andDevelopment Program of China(2017YFA0700300)the National Natural Sciences Foundation of China(61533005,61703071,61603069)。
文摘Prediction intervals(PIs)for industrial time series can provide useful guidance for workers.Given that the failure of industrial sensors may cause the missing point in inputs,the existing kernel dynamic Bayesian networks(KDBN),serving as an effective method for PIs construction,suffer from high computational load using the stochastic algorithm for inference.This study proposes a variational inference method for the KDBN for the purpose of fast inference,which avoids the timeconsuming stochastic sampling.The proposed algorithm contains two stages.The first stage involves the inference of the missing inputs by using a local linearization based variational inference,and based on the computed posterior distributions over the missing inputs the second stage sees a Gaussian approximation for probability over the nodes in future time slices.To verify the effectiveness of the proposed method,a synthetic dataset and a practical dataset of generation flow of blast furnace gas(BFG)are employed with different ratios of missing inputs.The experimental results indicate that the proposed method can provide reliable PIs for the generation flow of BFG and it exhibits shorter computing time than the stochastic based one.
基金This work was supported in part by National Natural Science Foundation of China under Grants 62103167 and 61833007in part by the Natural Science Foundation of Jiangsu Province under Grant BK20210451.
文摘This paper is focused on the state estimation problem for nonlinear systems with unknown statistics of measurement noise.Based on the cubature Kalman filter,we propose a new nonlinear filtering algorithm that employs a skew t distribution to characterize the asymmetry of the measurement noise.The system states and the statistics of skew t noise distribution,including the shape matrix,the scale matrix,and the degree of freedom(DOF)are estimated jointly by employing variational Bayesian(VB)inference.The proposed method is validated in a target tracking example.Results of the simulation indicate that the proposed nonlinear filter can perform satisfactorily in the presence of unknown statistics of measurement noise and outperform than the existing state-of-the-art nonlinear filters.
基金Primary Research and Development Plan of Jiangsu Province(No.BE2022389)Jiangsu Province Agricultural Science and Technology Independent Innovation Fund Project(No.CX(22)3091)the National Natural Science Foundation of China(No.61773113)。
文摘Aimed at the problem that the state estimation in the measurement update of the simultaneous localization and mapping(SLAM)method is incorrect or even not convergent because of the non-Gaussian measurement noise,outliers,or unknown and time-varying noise statistical characteristics,a robust SLAM method based on the improved variational Bayesian adaptive Kalman filtering(IVBAKF)is proposed.First,the measurement noise covariance is estimated using the variable Bayesian adaptive filtering algorithm.Then,the estimated covariance matrix is robustly processed through the weight function constructed in the form of a reweighted average.Finally,the system updates are iterated multiple times to further gradually correct the state estimation error.Furthermore,to observe features at different depths,a feature measurement model containing depth parameters is constructed.Experimental results show that when the measurement noise does not obey the Gaussian distribution and there are outliers in the measurement information,compared with the variational Bayesian adaptive SLAM method,the positioning accuracy of the proposed method is improved by 17.23%,20.46%,and 17.76%,which has better applicability and robustness to environmental disturbance.
文摘An algorithm is presented for image prior combinations based blind deconvolution and applied to astronomical images.Using a hierarchical Bayesian framework, the unknown original image and all required algorithmic parameters are estimated simultaneously. Through utilization of variational Bayesian analysis,approximations of the posterior distributions on each unknown are obtained by minimizing the Kullback-Leibler(KL) distance, thus providing uncertainties of the estimates during the restoration process. Experimental results on both synthetic images and real astronomical images demonstrate that the proposed approaches compare favorably to other state-of-the-art reconstruction methods.
基金supported by National Natural Science Foundation of China(No.61901415)。
文摘Efficient estimation of line spectral from quantized samples is of significant importance in information theory and signal processing,e.g.,channel estimation in energy efficient massive MIMO systems and direction of arrival estimation.The goal of this paper is to recover the line spectral as well as its corresponding parameters including the model order,frequencies and amplitudes from heavily quantized samples.To this end,we propose an efficient gridless Bayesian algorithm named VALSE-EP,which is a combination of the high resolution and low complexity gridless variational line spectral estimation(VALSE)and expectation propagation(EP).The basic idea of VALSE-EP is to iteratively approximate the challenging quantized model of line spectral estimation as a sequence of simple pseudo unquantized models,where VALSE is applied.Moreover,to obtain a benchmark of the performance of the proposed algorithm,the Cram′er Rao bound(CRB)is derived.Finally,numerical experiments on both synthetic and real data are performed,demonstrating the near CRB performance of the proposed VALSE-EP for line spectral estimation from quantized samples.
基金Supported by the National Natural Science Foundation of China(No.61976080)the Science and Technology Key Project of Science and TechnologyDepartment of Henan Province(No.212102310298)+1 种基金the Academic Degrees&Graduate Education Reform Project of Henan Province(No.2021SJGLX195Y)the Innovation and Quality Improvement Project for Graduate Education of Henan University(No.SYL20010101)。
文摘A novel variational Bayesian inference based on adaptive cubature Kalman filter(VBACKF)algorithm is proposed for the problem of state estimation in a target tracking system with time-varying measurement noise and random measurement losses.Firstly,the Inverse-Wishart(IW)distribution is chosen to model the covariance matrix of time-varying measurement noise in the cubature Kalman filter framework.Secondly,the Bernoulli random variable is introduced as the judgement factor of the measurement losses,and the Beta distribution is selected as the conjugate prior distribution of measurement loss probability to ensure that the posterior distribution and prior distribution have the same function form.Finally,the joint posterior probability density function of the estimated variables is approximately decoupled by the variational Bayesian inference,and the fixed-point iteration approach is used to update the estimated variables.The simulation results show that the proposed VBACKF algorithm considers the comprehensive effects of system nonlinearity,time-varying measurement noise and unknown measurement loss probability,moreover,effectively improves the accuracy of target state estimation in complex scene.
基金Supported by the National Natural Science Foundation of China(No.61976080)the Science and Technology Key Project of Science and Technology Department of Henan Province(No.212102310298)the Innovation and Quality Improvement Project for Graduate Education of Henan University(No.SYL20010101)。
文摘Aiming at the problem of filtering precision degradation caused by the random outliers of process noise and measurement noise in multi-target tracking(MTT) system,a new Gaussian-Student’s t mixture distribution probability hypothesis density(PHD) robust filtering algorithm based on variational Bayesian inference(GST-vbPHD) is proposed.Firstly,since it can accurately describe the heavy-tailed characteristics of noise with outliers,Gaussian-Student’s t mixture distribution is employed to model process noise and measurement noise respectively.Then Bernoulli random variable is introduced to correct the likelihood distribution of the mixture probability,leading hierarchical Gaussian distribution constructed by the Gaussian-Student’s t mixture distribution suitable to model non-stationary noise.Finally,the approximate solutions including target weights,measurement noise covariance and state estimation error covariance are obtained according to variational Bayesian inference approach.The simulation results show that,in the heavy-tailed noise environment,the proposed algorithm leads to strong improvements over the traditional PHD filter and the Student’s t distribution PHD filter.
文摘针对测距仪(distance measure equipment,DME)信号严重干扰L频段数字航空通信系统(L-band digital aviation communication system,L-DACS)前向链路接收机的问题,提出基于相关稀疏变分贝叶斯(correlated sparse variational Bayesian,cSVB)算法的DME脉冲干扰抑制方法。所提方法利用L-DACS系统正交频分复用(orthogonal frequency division multiplexing,OFDM)接收机的空子载波信息构建接收信号的压缩感知方程;然后,根据cSVB算法进行三层次贝叶斯信号建模,最后选择了两种变体算法重构DME干扰信号,并将其从时域接收信号中去除。理论分析与仿真结果表明,所提出的干扰抑制方法可以充分利用信号先验信息,进一步降低DME干扰信号估计的归一化均方误差,有效改善L-DACS系统的误码性能,提高传输可靠性。
基金Supported by National Key R&D Program of China(Grant No.102022YFA1003701)National Natural Science Foundation of China(Grant No.12271472,12231017,12001479)Natural Science Foundation of Yunnan Province(Grant No.202101AU070073,202201AT070101)。
文摘Quantile regression is widely used in variable relationship research for statistical learning.Traditional quantile regression model is based on vector-valued covariates and can be efficiently estimated via traditional estimation methods.However,many modern applications involve tensor data with the intrinsic tensor structure.Traditional quantile regression can not deal with tensor regression issues well.To this end,we consider a tensor quantile regression with tensor-valued covariates and develop a novel variational Bayesian estimation approach to make estimation and prediction based on the asymmetric Laplace model and the CANDECOMP/PARAFAC decomposition of tensor coefficients.To incorporate the sparsity of tensor coefficients,we consider the multiway shrinkage priors for marginal factor vectors of tensor coefficients.The key idea of the proposed method is to efficiently combine the prior structural information of tensor and utilize the matricization of tensor decomposition to simplify the complexity of tensor coefficient estimation.The coordinate ascent algorithm is employed to optimize variational lower bound.Simulation studies and a real example show the numerical performances of the proposed method.
