期刊文献+
共找到198篇文章
< 1 2 10 >
每页显示 20 50 100
Auxiliary Model Based Multi-innovation Stochastic Gradient Identification Methods for Hammerstein Output-Error System
1
作者 冯启亮 贾立 李峰 《Journal of Donghua University(English Edition)》 EI CAS 2017年第1期53-59,共7页
Special input signals identification method based on the auxiliary model based multi-innovation stochastic gradient algorithm for Hammerstein output-error system was proposed.The special input signals were used to rea... Special input signals identification method based on the auxiliary model based multi-innovation stochastic gradient algorithm for Hammerstein output-error system was proposed.The special input signals were used to realize the identification and separation of the Hammerstein model.As a result,the identification of the dynamic linear part can be separated from the static nonlinear elements without any redundant adjustable parameters.The auxiliary model based multi-innovation stochastic gradient algorithm was applied to identifying the serial link parameters of the Hammerstein model.The auxiliary model based multi-innovation stochastic gradient algorithm can avoid the influence of noise and improve the identification accuracy by changing the innovation length.The simulation results show the efficiency of the proposed method. 展开更多
关键词 Hammerstein output-error system special input signals auxiliary model based multi-innovation stochastic gradient algorithm innovation length
在线阅读 下载PDF
Efficient and High-quality Recommendations via Momentum-incorporated Parallel Stochastic Gradient Descent-Based Learning 被引量:7
2
作者 Xin Luo Wen Qin +2 位作者 Ani Dong Khaled Sedraoui MengChu Zhou 《IEEE/CAA Journal of Automatica Sinica》 SCIE EI CSCD 2021年第2期402-411,共10页
A recommender system(RS)relying on latent factor analysis usually adopts stochastic gradient descent(SGD)as its learning algorithm.However,owing to its serial mechanism,an SGD algorithm suffers from low efficiency and... A recommender system(RS)relying on latent factor analysis usually adopts stochastic gradient descent(SGD)as its learning algorithm.However,owing to its serial mechanism,an SGD algorithm suffers from low efficiency and scalability when handling large-scale industrial problems.Aiming at addressing this issue,this study proposes a momentum-incorporated parallel stochastic gradient descent(MPSGD)algorithm,whose main idea is two-fold:a)implementing parallelization via a novel datasplitting strategy,and b)accelerating convergence rate by integrating momentum effects into its training process.With it,an MPSGD-based latent factor(MLF)model is achieved,which is capable of performing efficient and high-quality recommendations.Experimental results on four high-dimensional and sparse matrices generated by industrial RS indicate that owing to an MPSGD algorithm,an MLF model outperforms the existing state-of-the-art ones in both computational efficiency and scalability. 展开更多
关键词 Big data industrial application industrial data latent factor analysis machine learning parallel algorithm recommender system(RS) stochastic gradient descent(SGD)
在线阅读 下载PDF
CONVERGENCE OF ONLINE GRADIENT METHOD WITH A PENALTY TERM FOR FEEDFORWARD NEURAL NETWORKS WITH STOCHASTIC INPUTS 被引量:3
3
作者 邵红梅 吴微 李峰 《Numerical Mathematics A Journal of Chinese Universities(English Series)》 SCIE 2005年第1期87-96,共10页
Online gradient algorithm has been widely used as a learning algorithm for feedforward neural network training. In this paper, we prove a weak convergence theorem of an online gradient algorithm with a penalty term, a... Online gradient algorithm has been widely used as a learning algorithm for feedforward neural network training. In this paper, we prove a weak convergence theorem of an online gradient algorithm with a penalty term, assuming that the training examples are input in a stochastic way. The monotonicity of the error function in the iteration and the boundedness of the weight are both guaranteed. We also present a numerical experiment to support our results. 展开更多
关键词 前馈神经网络系统 收敛 随机变量 单调性 有界性原理 在线梯度计算法
在线阅读 下载PDF
Adaptive Time Synchronization in Time Sensitive-Wireless Sensor Networks Based on Stochastic Gradient Algorithms Framework
4
作者 Ramadan Abdul-Rashid Mohd Amiruddin Abd Rahman +1 位作者 Kar Tim Chan Arun Kumar Sangaiah 《Computer Modeling in Engineering & Sciences》 2025年第3期2585-2616,共32页
This study proposes a novel time-synchronization protocol inspired by stochastic gradient algorithms.The clock model of each network node in this synchronizer is configured as a generic adaptive filter where different... This study proposes a novel time-synchronization protocol inspired by stochastic gradient algorithms.The clock model of each network node in this synchronizer is configured as a generic adaptive filter where different stochastic gradient algorithms can be adopted for adaptive clock frequency adjustments.The study analyzes the pairwise synchronization behavior of the protocol and proves the generalized convergence of the synchronization error and clock frequency.A novel closed-form expression is also derived for a generalized asymptotic error variance steady state.Steady and convergence analyses are then presented for the synchronization,with frequency adaptations done using least mean square(LMS),the Newton search,the gradient descent(GraDes),the normalized LMS(N-LMS),and the Sign-Data LMS algorithms.Results obtained from real-time experiments showed a better performance of our protocols as compared to the Average Proportional-Integral Synchronization Protocol(AvgPISync)regarding the impact of quantization error on synchronization accuracy,precision,and convergence time.This generalized approach to time synchronization allows flexibility in selecting a suitable protocol for different wireless sensor network applications. 展开更多
关键词 Wireless sensor network time synchronization stochastic gradient algorithm multi-hop
在线阅读 下载PDF
A Hybrid Conjugate Gradient Algorithm for Solving Relative Orientation of Big Rotation Angle Stereo Pair 被引量:4
5
作者 Jiatian LI Congcong WANG +5 位作者 Chenglin JIA Yiru NIU Yu WANG Wenjing ZHANG Huajing WU Jian LI 《Journal of Geodesy and Geoinformation Science》 2020年第2期62-70,共9页
The fast convergence without initial value dependence is the key to solving large angle relative orientation.Therefore,a hybrid conjugate gradient algorithm is proposed in this paper.The concrete process is:①stochast... The fast convergence without initial value dependence is the key to solving large angle relative orientation.Therefore,a hybrid conjugate gradient algorithm is proposed in this paper.The concrete process is:①stochastic hill climbing(SHC)algorithm is used to make a random disturbance to the given initial value of the relative orientation element,and the new value to guarantee the optimization direction is generated.②In local optimization,a super-linear convergent conjugate gradient method is used to replace the steepest descent method in relative orientation to improve its convergence rate.③The global convergence condition is that the calculation error is less than the prescribed limit error.The comparison experiment shows that the method proposed in this paper is independent of the initial value,and has higher accuracy and fewer iterations. 展开更多
关键词 relative orientation big rotation angle global convergence stochastic hill climbing conjugate gradient algorithm
在线阅读 下载PDF
A stochastic gradient-based two-step sparse identification algorithm for multivariate ARX systems
6
作者 Yanxin Fu Wenxiao Zhao 《Control Theory and Technology》 EI CSCD 2024年第2期213-221,共9页
We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (... We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (SG) algorithm is applied to obtain initial estimates of the unknown parameter matrix and in the second step an optimization criterion is introduced for the sparse identification of multivariate ARX systems. Under mild conditions, we prove that by minimizing the criterion function, the zero elements of the unknown parameter matrix can be recovered with a finite number of observations. The performance of the algorithm is testified through a simulation example. 展开更多
关键词 ARX system stochastic gradient algorithm Sparse identification Support recovery Parameter estimation Strong consistency
原文传递
A Primal-Dual SGD Algorithm for Distributed Nonconvex Optimization 被引量:4
7
作者 Xinlei Yi Shengjun Zhang +2 位作者 Tao Yang Tianyou Chai Karl Henrik Johansson 《IEEE/CAA Journal of Automatica Sinica》 SCIE EI CSCD 2022年第5期812-833,共22页
The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of n local cost functions by using local information exchange is considered.This problem is an important component of... The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of n local cost functions by using local information exchange is considered.This problem is an important component of many machine learning techniques with data parallelism,such as deep learning and federated learning.We propose a distributed primal-dual stochastic gradient descent(SGD)algorithm,suitable for arbitrarily connected communication networks and any smooth(possibly nonconvex)cost functions.We show that the proposed algorithm achieves the linear speedup convergence rate O(1/(√nT))for general nonconvex cost functions and the linear speedup convergence rate O(1/(nT)) when the global cost function satisfies the Polyak-Lojasiewicz(P-L)condition,where T is the total number of iterations.We also show that the output of the proposed algorithm with constant parameters linearly converges to a neighborhood of a global optimum.We demonstrate through numerical experiments the efficiency of our algorithm in comparison with the baseline centralized SGD and recently proposed distributed SGD algorithms. 展开更多
关键词 Distributed nonconvex optimization linear speedup Polyak-Lojasiewicz(P-L)condition primal-dual algorithm stochastic gradient descent
在线阅读 下载PDF
A Mini-Batch Proximal Stochastic Recursive Gradient Algorithm with Diagonal Barzilai–Borwein Stepsize 被引量:1
8
作者 Teng-Teng Yu Xin-Wei Liu +1 位作者 Yu-Hong Dai Jie Sun 《Journal of the Operations Research Society of China》 EI CSCD 2023年第2期277-307,共31页
Many machine learning problems can be formulated as minimizing the sum of a function and a non-smooth regularization term.Proximal stochastic gradient methods are popular for solving such composite optimization proble... Many machine learning problems can be formulated as minimizing the sum of a function and a non-smooth regularization term.Proximal stochastic gradient methods are popular for solving such composite optimization problems.We propose a minibatch proximal stochastic recursive gradient algorithm SRG-DBB,which incorporates the diagonal Barzilai–Borwein(DBB)stepsize strategy to capture the local geometry of the problem.The linear convergence and complexity of SRG-DBB are analyzed for strongly convex functions.We further establish the linear convergence of SRGDBB under the non-strong convexity condition.Moreover,it is proved that SRG-DBB converges sublinearly in the convex case.Numerical experiments on standard data sets indicate that the performance of SRG-DBB is better than or comparable to the proximal stochastic recursive gradient algorithm with best-tuned scalar stepsizes or BB stepsizes.Furthermore,SRG-DBB is superior to some advanced mini-batch proximal stochastic gradient methods. 展开更多
关键词 stochastic recursive gradient Proximal gradient algorithm Barzilai-Borwein method Composite optimization
原文传递
Multi-channel blind deconvolution algorithm for multiple-input multiple-output DS/CDMA system
9
作者 Cheng Hao Guo Wei Jiang Yi 《Journal of Systems Engineering and Electronics》 SCIE EI CSCD 2007年第3期454-461,共8页
Direct sequence spread spectrum transmission can be realized at low SNR, and has low probabilityof detection. It is aly problem how to obtain the original users' signal in a non-cooperative context. In practicality, ... Direct sequence spread spectrum transmission can be realized at low SNR, and has low probabilityof detection. It is aly problem how to obtain the original users' signal in a non-cooperative context. In practicality, the DS/CDMA sources received are linear convolute mixing. A more complex multichannel blind deconvolution MBD algorithm is required to achieve better source separation. An improved MBD algorithm for separating linear convolved mixtures of signals in CDMA system is proposed. This algorithm is based on minimizing the average squared cross-output-channel-correlation. The mixture coefficients are totally unknown, while some knowledge about temporal model exists. Results show that the proposed algorithm can bring about the exactness and low computational complexity. 展开更多
关键词 DS/CDMA signal NON-COOPERATIVE MBD stochastic gradient algorithms for MBD.
在线阅读 下载PDF
A distributed stochastic optimization algorithm with gradient-tracking and distributed heavy-ball acceleration
10
作者 Bihao SUN Jinhui HU +1 位作者 Dawen XIA Huaqing LI 《Frontiers of Information Technology & Electronic Engineering》 SCIE EI CSCD 2021年第11期1463-1476,共14页
Distributed optimization has been well developed in recent years due to its wide applications in machine learning and signal processing.In this paper,we focus on investigating distributed optimization to minimize a gl... Distributed optimization has been well developed in recent years due to its wide applications in machine learning and signal processing.In this paper,we focus on investigating distributed optimization to minimize a global objective.The objective is a sum of smooth and strongly convex local cost functions which are distributed over an undirected network of n nodes.In contrast to existing works,we apply a distributed heavy-ball term to improve the convergence performance of the proposed algorithm.To accelerate the convergence of existing distributed stochastic first-order gradient methods,a momentum term is combined with a gradient-tracking technique.It is shown that the proposed algorithm has better acceleration ability than GT-SAGA without increasing the complexity.Extensive experiments on real-world datasets verify the effectiveness and correctness of the proposed algorithm. 展开更多
关键词 Distributed optimization High-performance algorithm Multi-agent system Machine-learning problem stochastic gradient
原文传递
分布式训练系统及其优化算法综述 被引量:8
11
作者 王恩东 闫瑞栋 +1 位作者 郭振华 赵雅倩 《计算机学报》 EI CAS CSCD 北大核心 2024年第1期1-28,共28页
人工智能利用各种优化技术从海量训练样本中学习关键特征或知识以提高解的质量,这对训练方法提出了更高要求.然而,传统单机训练无法满足存储与计算性能等方面的需求.因此,利用多个计算节点协同的分布式训练系统成为热点研究方向之一.本... 人工智能利用各种优化技术从海量训练样本中学习关键特征或知识以提高解的质量,这对训练方法提出了更高要求.然而,传统单机训练无法满足存储与计算性能等方面的需求.因此,利用多个计算节点协同的分布式训练系统成为热点研究方向之一.本文首先阐述了单机训练面临的主要挑战.其次,分析了分布式训练系统亟需解决的三个关键问题.基于上述问题归纳了分布式训练系统的通用框架与四个核心组件.围绕各个组件涉及的技术,梳理了代表性研究成果.在此基础之上,总结了基于并行随机梯度下降算法的中心化与去中心化架构研究分支,并对各研究分支优化算法与应用进行综述.最后,提出了未来可能的研究方向. 展开更多
关键词 分布式训练系统 (去)中心化架构 中心化架构算法 (异)同步算法 并行随机梯度下降 收敛速率
在线阅读 下载PDF
Chimp Optimization Algorithm Based Feature Selection with Machine Learning for Medical Data Classification
12
作者 Firas Abedi Hayder M.A.Ghanimi +6 位作者 Abeer D.Algarni Naglaa F.Soliman Walid El-Shafai Ali Hashim Abbas Zahraa H.Kareem Hussein Muhi Hariz Ahmed Alkhayyat 《Computer Systems Science & Engineering》 SCIE EI 2023年第12期2791-2814,共24页
Datamining plays a crucial role in extractingmeaningful knowledge fromlarge-scale data repositories,such as data warehouses and databases.Association rule mining,a fundamental process in data mining,involves discoveri... Datamining plays a crucial role in extractingmeaningful knowledge fromlarge-scale data repositories,such as data warehouses and databases.Association rule mining,a fundamental process in data mining,involves discovering correlations,patterns,and causal structures within datasets.In the healthcare domain,association rules offer valuable opportunities for building knowledge bases,enabling intelligent diagnoses,and extracting invaluable information rapidly.This paper presents a novel approach called the Machine Learning based Association Rule Mining and Classification for Healthcare Data Management System(MLARMC-HDMS).The MLARMC-HDMS technique integrates classification and association rule mining(ARM)processes.Initially,the chimp optimization algorithm-based feature selection(COAFS)technique is employed within MLARMC-HDMS to select relevant attributes.Inspired by the foraging behavior of chimpanzees,the COA algorithm mimics their search strategy for food.Subsequently,the classification process utilizes stochastic gradient descent with a multilayer perceptron(SGD-MLP)model,while the Apriori algorithm determines attribute relationships.We propose a COA-based feature selection approach for medical data classification using machine learning techniques.This approach involves selecting pertinent features from medical datasets through COA and training machine learning models using the reduced feature set.We evaluate the performance of our approach on various medical datasets employing diverse machine learning classifiers.Experimental results demonstrate that our proposed approach surpasses alternative feature selection methods,achieving higher accuracy and precision rates in medical data classification tasks.The study showcases the effectiveness and efficiency of the COA-based feature selection approach in identifying relevant features,thereby enhancing the diagnosis and treatment of various diseases.To provide further validation,we conduct detailed experiments on a benchmark medical dataset,revealing the superiority of the MLARMCHDMS model over other methods,with a maximum accuracy of 99.75%.Therefore,this research contributes to the advancement of feature selection techniques in medical data classification and highlights the potential for improving healthcare outcomes through accurate and efficient data analysis.The presented MLARMC-HDMS framework and COA-based feature selection approach offer valuable insights for researchers and practitioners working in the field of healthcare data mining and machine learning. 展开更多
关键词 Association rule mining data classification healthcare data machine learning parameter tuning data mining feature selection MLARMC-HDMS COA stochastic gradient descent Apriori algorithm
在线阅读 下载PDF
川东飞仙关组鲕粒滩岩性识别及其分布特征 被引量:1
13
作者 叶榆 程超 +5 位作者 蒋裕强 易娟子 邓虹兵 李曦 谷一凡 陈雁 《沉积学报》 CAS CSCD 北大核心 2024年第3期1032-1046,共15页
【目的】为解决针对川东海槽南段西侧、台内等地区飞仙关组岩性变化不明确等问题。【方法】综合利用岩心、薄片、钻录井等多元地质数据对飞仙关组岩性类型及特征进行研究,提出以机器学习为基础的岩性测井智能识别方法,解决了老区岩性精... 【目的】为解决针对川东海槽南段西侧、台内等地区飞仙关组岩性变化不明确等问题。【方法】综合利用岩心、薄片、钻录井等多元地质数据对飞仙关组岩性类型及特征进行研究,提出以机器学习为基础的岩性测井智能识别方法,解决了老区岩性精细识别的技术难题,揭示了区内飞仙关组鲕粒滩岩性、分布及演化规律。【结论与结果】(1)飞仙关组主要由泥岩、泥晶灰岩、泥质灰岩、鲕粒灰岩、鲕粒云岩、泥晶云岩、膏质云岩、膏岩等岩性组成;(2)对比发现,改进的梯度提升决策树算法即随机梯度提升决策树(SGBDT)构建岩性模型优于其他算法,更适合碳酸盐岩复杂岩性识别;(3)鲕粒灰岩集中发育于开江—梁平海槽以南地区的飞一段—飞三段时期,鲕粒云岩集中发育于飞二段时期且分布分散;(4)区内鲕粒滩分布差异明显,飞一段时期主要发育于台地古地貌高点和台地边缘,飞二段时期多发育台缘鲕粒滩,少量发育台内古地貌高点鲕滩和点滩,飞三段时期主要发育台内点滩。 展开更多
关键词 SGBDT算法 岩性识别 沉积演化 鲕粒滩分布特征 飞仙关组 川东
在线阅读 下载PDF
激光相干合成系统中SPGD算法的分阶段自适应优化
14
作者 郑文慧 祁家琴 +6 位作者 江文隽 谭贵元 胡奇琪 高怀恩 豆嘉真 邸江磊 秦玉文 《红外与激光工程》 EI CSCD 北大核心 2024年第9期303-315,共13页
为改善传统随机并行梯度下降(Stochastic Parallel Gradient Descent,SPGD)算法应用于大规模激光相干合成系统时收敛速度慢且易陷入局部最优解的情况,提出了一种分阶段自适应增益SPGD算法-Staged SPGD算法。该算法根据性能评价函数值,... 为改善传统随机并行梯度下降(Stochastic Parallel Gradient Descent,SPGD)算法应用于大规模激光相干合成系统时收敛速度慢且易陷入局部最优解的情况,提出了一种分阶段自适应增益SPGD算法-Staged SPGD算法。该算法根据性能评价函数值,在不同收敛时期采用不同策略对增益系数进行自适应调整,同时引入含梯度更新因子的控制电压更新策略,在加快收敛速度的同时减少算法陷入局部极值的概率。实验结果表明:在19路激光相干合成系统中,与传统SPGD算法相比,Staged SPGD算法的收敛速度提升了36.84%,针对不同频率和幅度的相位噪声,算法也具有较优的收敛效果,且稳定性得到显著提升。此外,将Staged SPGD算法直接应用于37、61、91路相干合成系统时,Staged SPGD算法相比传统SPGD算法收敛速度分别提升了37.88%、40.85%和41.10%,提升效果随相干合成单元数增加而更加显著,表明该算法在收敛速度、稳定性和扩展性方面均具有一定优势,具备扩展到大规模相干合成系统的潜力。 展开更多
关键词 激光相干合成 相位控制 随机并行梯度下降算法 SPGD算法
在线阅读 下载PDF
一类自适应梯度裁剪的差分隐私随机梯度下降算法 被引量:1
15
作者 张家棋 李觉友 《运筹学学报(中英文)》 CSCD 北大核心 2024年第2期47-57,共11页
梯度裁剪是一种防止梯度爆炸的有效方法,但梯度裁剪参数的选取通常对训练模型的性能有较大的影响。为此,本文针对标准的差分隐私随机梯度下降算法进行改进。首先,提出一种自适应的梯度裁剪方法,即在传统裁剪方法基础上利用分位数和指数... 梯度裁剪是一种防止梯度爆炸的有效方法,但梯度裁剪参数的选取通常对训练模型的性能有较大的影响。为此,本文针对标准的差分隐私随机梯度下降算法进行改进。首先,提出一种自适应的梯度裁剪方法,即在传统裁剪方法基础上利用分位数和指数平均策略对梯度裁剪参数进行自适应动态调整,进而提出一类自适应梯度裁剪的差分隐私随机梯度下降算法。其次,在非凸目标函数的情况下对提出的自适应算法给出收敛性分析和隐私性分析。最后,在MNIST、Fasion-MNIST和IMDB数据集上进行数值仿真。其结果表明,与传统梯度裁剪算法相比,本文提出的自适应梯度裁剪算法显著提高了模型精度。 展开更多
关键词 随机梯度下降算法 差分隐私 梯度裁剪 自适应性
在线阅读 下载PDF
基于改进PDHG算法的波场重构反演
16
作者 李岳峰 罗倩 段中钰 《北京信息科技大学学报(自然科学版)》 2024年第6期62-71,共10页
全波形反演(full waveform inversion,FWI)可实现高分辨率的地震资料成像,但其反演过程易陷入局部极小值。作为FWI的改进方法,波场重构反演(wavefield reconstruction inversion,WRI)能够有效促进模型的准确更新。然而,传统WRI在求解正... 全波形反演(full waveform inversion,FWI)可实现高分辨率的地震资料成像,但其反演过程易陷入局部极小值。作为FWI的改进方法,波场重构反演(wavefield reconstruction inversion,WRI)能够有效促进模型的准确更新。然而,传统WRI在求解正则化项时通常采用原始对偶混合梯度(primal-dual hybrid gradient,PDHG)算法,计算成本高,收敛速度较慢,且复杂模型下无法稳定收敛。为此,提出了一种自适应随机原始对偶混合梯度(adaptive-stochastic PDHG,A-SPDHG)算法,通过引入随机子集更新和自适应步长平衡策略,有效降低了计算开销,并提高了算法的收敛速度和稳定性。对Marmousi模型和盐丘模型的实验结果表明,在噪声干扰、低频缺失及非准确初始模型条件下,基于A-SPDHG的WRI能以更短的迭代时间获得更为精确的反演结果。 展开更多
关键词 全波形反演 波场重构反演 原始对偶混合梯度算法 随机优化 自适应步长
在线阅读 下载PDF
A Novel Optimized Deep Convolutional Neural Network for Efficient Seizure Stage Classification
17
作者 Umapathi Krishnamoorthy Shanmugam Jagan +2 位作者 Mohammed Zakariah Abdulaziz S.Almazyad K.Gurunathan 《Computers, Materials & Continua》 SCIE EI 2024年第12期3903-3926,共24页
Brain signal analysis from electroencephalogram(EEG)recordings is the gold standard for diagnosing various neural disorders especially epileptic seizure.Seizure signals are highly chaotic compared to normal brain sign... Brain signal analysis from electroencephalogram(EEG)recordings is the gold standard for diagnosing various neural disorders especially epileptic seizure.Seizure signals are highly chaotic compared to normal brain signals and thus can be identified from EEG recordings.In the current seizure detection and classification landscape,most models primarily focus on binary classification—distinguishing between seizure and non-seizure states.While effective for basic detection,these models fail to address the nuanced stages of seizures and the intervals between them.Accurate identification of per-seizure or interictal stages and the timing between seizures is crucial for an effective seizure alert system.This granularity is essential for improving patient-specific interventions and developing proactive seizure management strategies.This study addresses this gap by proposing a novel AI-based approach for seizure stage classification using a Deep Convolutional Neural Network(DCNN).The developed model goes beyond traditional binary classification by categorizing EEG recordings into three distinct classes,thus providing a more detailed analysis of seizure stages.To enhance the model’s performance,we have optimized the DCNN using two advanced techniques:the Stochastic Gradient Algorithm(SGA)and the evolutionary Genetic Algorithm(GA).These optimization strategies are designed to fine-tune the model’s accuracy and robustness.Moreover,k-fold cross-validation ensures the model’s reliability and generalizability across different data sets.Trained and validated on the Bonn EEG data sets,the proposed optimized DCNN model achieved a test accuracy of 93.2%,demonstrating its ability to accurately classify EEG signals.In summary,the key advancement of the present research lies in addressing the limitations of existing models by providing a more detailed seizure classification system,thus potentially enhancing the effectiveness of real-time seizure prediction and management systems in clinical settings.With its inherent classification performance,the proposed approach represents a significant step forward in improving patient outcomes through advanced AI techniques. 展开更多
关键词 Bonn EEG dataset cross-validation genetic algorithm batch normalization seizure classification stochastic gradient
在线阅读 下载PDF
基于动态学习率边界的隐私保护算法
18
作者 钱振 《哈尔滨商业大学学报(自然科学版)》 CAS 2024年第2期186-192,共7页
深度学习优化算法在对数据进行训练时容易导致隐私泄露,卷积神经网络在进行隐私计算时会因为计算每个样本的梯度而带来巨大的内存开销,针对以上问题,提出一种结合混合重影剪裁的差分隐私动态学习率边界算法.将AdaBound优化算法与差分隐... 深度学习优化算法在对数据进行训练时容易导致隐私泄露,卷积神经网络在进行隐私计算时会因为计算每个样本的梯度而带来巨大的内存开销,针对以上问题,提出一种结合混合重影剪裁的差分隐私动态学习率边界算法.将AdaBound优化算法与差分隐私相结合,缓解了算法在训练时的极端学习率和不稳定现象,减少了在反向传播过程中因为加入噪声而对模型收敛速度产生的影响.在卷积层上使用混合重影剪裁,简化了更新中对于梯度的直接计算所带来的开销成本,可以有效地训练差分隐私模型.最后,通过仿真实验,与其他经典的差分隐私算法进行对比,实验表明,算法实现了在相同隐私预算下更高的准确率,具有更优的性能,对模型的隐私保护效果更好. 展开更多
关键词 差分隐私 深度学习 随机梯度下降 图像分类 自适应算法 学习率剪裁
在线阅读 下载PDF
加速随机递归梯度下降算法的复杂度分析
19
作者 费经泰 程一元 查星星 《萍乡学院学报》 2024年第3期5-11,共7页
课题组为进一步降低传统随机递归梯度下降算法(SARAH)复杂度,利用内循环数目倍增技术,提出了一种新的算法--Epoch-Doubling-SARAH算法,并通过构造Lyapunov函数证明了Epoch-Doubling-SARAH算法在非强凸条件下具有线性收敛阶,且推导出了... 课题组为进一步降低传统随机递归梯度下降算法(SARAH)复杂度,利用内循环数目倍增技术,提出了一种新的算法--Epoch-Doubling-SARAH算法,并通过构造Lyapunov函数证明了Epoch-Doubling-SARAH算法在非强凸条件下具有线性收敛阶,且推导出了算法的复杂度为O(1/ε+nlog(1/ε)),该结果优于SARAH算法复杂度。再将Epoch-Doubling-SARAH算法与SARAH算法在Mnist和Mushroom两个数据集上进行对比实验,实验结果表明Epoch-Doubling-SARAH算法具有更快的收敛速度,进而说明了本文算法理论分析的正确性。 展开更多
关键词 机器学习 随机递归梯度 下降算法 循环倍增 收敛速率 算法复杂度
在线阅读 下载PDF
随机梯度追踪算法的硬件架构设计
20
作者 陈智颖 《仪表技术》 2024年第6期12-14,54,共4页
压缩感知能够有效降低信号的采样速率,但信号恢复需要大量的复杂计算,这给用于重构的专用电路的面积和功耗带来挑战。以牺牲计算精度和增加计算时长为代价的情况下,随机计算能够大幅度减少算术操作过程中的功耗和硬件成本。这一特性使... 压缩感知能够有效降低信号的采样速率,但信号恢复需要大量的复杂计算,这给用于重构的专用电路的面积和功耗带来挑战。以牺牲计算精度和增加计算时长为代价的情况下,随机计算能够大幅度减少算术操作过程中的功耗和硬件成本。这一特性使得随机计算在计算密集型电路设计中得到广泛应用。基于随机计算范式,设计了一种使用简单逻辑门搭建的向量内积计算电路,进一步构建了随机梯度追踪算法的硬件架构。相较于传统的二进制计算电路,该架构在Slices资源的使用上减少了83%。对信号长度为256、稀疏度为8的信号进行重构测试,结果显示其重构信噪比达到了18.99 dB,充分验证了该方案的有效性和灵活性。 展开更多
关键词 压缩感知 稀疏信号重构 随机计算 随机梯度追踪算法
在线阅读 下载PDF
上一页 1 2 10 下一页 到第
使用帮助 返回顶部