Although modulation classification based on deep neural network can achieve high Modulation Classification(MC)accuracies,catastrophic forgetting will occur when the neural network model continues to learn new tasks.In...Although modulation classification based on deep neural network can achieve high Modulation Classification(MC)accuracies,catastrophic forgetting will occur when the neural network model continues to learn new tasks.In this paper,we simulate the dynamic wireless communication environment and focus on breaking the learning paradigm of isolated automatic MC.We innovate a research algorithm for continuous automatic MC.Firstly,a memory for storing representative old task modulation signals is built,which is employed to limit the gradient update direction of new tasks in the continuous learning stage to ensure that the loss of old tasks is also in a downward trend.Secondly,in order to better simulate the dynamic wireless communication environment,we employ the mini-batch gradient algorithm which is more suitable for continuous learning.Finally,the signal in the memory can be replayed to further strengthen the characteristics of the old task signal in the model.Simulation results verify the effectiveness of the method.展开更多
1|OVERVIEW.Machine learning(ML)has been increasingly used for tackling various diagnostic,therapeutic,and prognostic tasks owing to its capability to learn and reason without explicit programming[1].Most developed ML ...1|OVERVIEW.Machine learning(ML)has been increasingly used for tackling various diagnostic,therapeutic,and prognostic tasks owing to its capability to learn and reason without explicit programming[1].Most developed ML models have had their accuracy proven through internal validation using retrospective data.However,external validation using retrospective data,continual monitoring using prospective data,and randomized controlled trials(RCTs)using prospective data are important for the translation of ML models into real-world clinical practice[2].展开更多
Climate change poses significant challenges to agricultural management,particularly in adapting to extreme weather conditions that impact agricultural production.Existing works with traditional Reinforcement Learning(...Climate change poses significant challenges to agricultural management,particularly in adapting to extreme weather conditions that impact agricultural production.Existing works with traditional Reinforcement Learning(RL)methods often falter under such extreme conditions.To address this challenge,our study introduces a novel approach by integrating Continual Learning(CL)with RL to form Continual Reinforcement Learning(CRL),enhancing the adaptability of agricultural management strategies.Leveraging the Gym-DSSAT simulation environment,our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions.By incorporating CL algorithms,such as Elastic Weight Consolidation(EWC),with established RL techniques like Deep Q-Networks(DQN),we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios.The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies,particularly under extreme weather events like severe droughts.Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods,especially in challenging conditions of reduced rainfall and increased temperatures.This pioneering work,which combines CL with RL to generate adaptive policies for agricultural management,is expected to make significant advancements in precision agriculture in the era of climate change.展开更多
An iterative learning model predictive control （ILMPC） technique is applied to a class of continuous/batch processes. Such processes are characterized by the operations of batch processes generating periodic strong ...An iterative learning model predictive control （ILMPC） technique is applied to a class of continuous/batch processes. Such processes are characterized by the operations of batch processes generating periodic strong disturbances to the continuous processes and traditional regulatory controllers are unable to eliminate these periodic disturbances. ILMPC integrates the feature of iterative learning control （ILC） handling repetitive signal and the flexibility of model predictive control （MPC）. By on-line monitoring the operation status of batch processes, an event-driven iterative learning algorithm for batch repetitive disturbances is initiated and the soft constraints are adjusted timely as the feasible region is away from the desired operating zone. The results of an industrial application show that the proposed ILMPC method is effective for a class of continuous/batch processes.展开更多
Reinforcement Learning is a commonly used technique for learning tasks in robotics, however, traditional algorithms are unable to handle large amounts of data coming from the robot’s sensors, require long training ti...Reinforcement Learning is a commonly used technique for learning tasks in robotics, however, traditional algorithms are unable to handle large amounts of data coming from the robot’s sensors, require long training times, and use dis-crete actions. This work introduces TS-RRLCA, a two stage method to tackle these problems. In the first stage, low-level data coming from the robot’s sensors is transformed into a more natural, relational representation based on rooms, walls, corners, doors and obstacles, significantly reducing the state space. We use this representation along with Behavioural Cloning, i.e., traces provided by the user;to learn, in few iterations, a relational control policy with discrete actions which can be re-used in different environments. In the second stage, we use Locally Weighted Regression to transform the initial policy into a continuous actions policy. We tested our approach in simulation and with a real service robot on different environments for different navigation and following tasks. Results show how the policies can be used on different domains and perform smoother, faster and shorter paths than the original discrete actions policies.展开更多
The predominant method for smart phone accessing is confined to methods directing the authentication by means of Point-of-Entry that heavily depend on physiological biometrics like,fingerprint or face.Implicit continuou...The predominant method for smart phone accessing is confined to methods directing the authentication by means of Point-of-Entry that heavily depend on physiological biometrics like,fingerprint or face.Implicit continuous authentication initiating to be loftier to conventional authentication mechanisms by continuously confirming users’identities on continuing basis and mark the instant at which an illegitimate hacker grasps dominance of the session.However,divergent issues remain unaddressed.This research aims to investigate the power of Deep Reinforcement Learning technique to implicit continuous authentication for mobile devices using a method called,Gaussian Weighted Cauchy Kriging-based Continuous Czekanowski’s(GWCK-CC).First,a Gaussian Weighted Non-local Mean Filter Preprocessing model is applied for reducing the noise pre-sent in the raw input face images.Cauchy Kriging Regression function is employed to reduce the dimensionality.Finally,Continuous Czekanowski’s Clas-sification is utilized for proficient classification between the genuine user and attacker.By this way,the proposed GWCK-CC method achieves accurate authen-tication with minimum error rate and time.Experimental assessment of the pro-posed GWCK-CC method and existing methods are carried out with different factors by using UMDAA-02 Face Dataset.The results confirm that the proposed GWCK-CC method enhances authentication accuracy,by 9%,reduces the authen-tication time,and error rate by 44%,and 43%as compared to the existing methods.展开更多
This study proposed a measurement platform for continuous blood pressure estimation based on dual photoplethysmography(PPG)sensors and a deep learning(DL)that can be used for continuous and rapid measurement of blood ...This study proposed a measurement platform for continuous blood pressure estimation based on dual photoplethysmography(PPG)sensors and a deep learning(DL)that can be used for continuous and rapid measurement of blood pressure and analysis of cardiovascular-related indicators.The proposed platform measured the signal changes in PPG and converted them into physiological indicators,such as pulse transit time(PTT),pulse wave velocity(PWV),perfusion index(PI)and heart rate(HR);these indicators were then fed into the DL to calculate blood pressure.The hardware of the experiment comprised 2 PPG components(i.e.,Raspberry Pi 3 Model B and analog-todigital converter[MCP3008]),which were connected using a serial peripheral interface.The DL algorithm converted the stable dual PPG signals acquired from the strictly standardized experimental process into various physiological indicators as input parameters and finally obtained the systolic blood pressure(SBP),diastolic blood pressure(DBP)and mean arterial pressure(MAP).To increase the robustness of the DL model,this study input data of 100 Asian participants into the training database,including those with and without cardiovascular disease,each with a proportion of approximately 50%.The experimental results revealed that the mean absolute error and standard deviation of SBP was 0.17±0.46 mmHg.The mean absolute error and standard deviation of DBP was 0.27±0.52 mmHg.The mean absolute error and standard deviation of MAP was 0.16±0.40 mmHg.展开更多
The overall research in Reinforcement Learning (RL) concentrates on discrete sets of actions, but for certain real-world problems it is important to have methods which are able to find good strategies using actions dr...The overall research in Reinforcement Learning (RL) concentrates on discrete sets of actions, but for certain real-world problems it is important to have methods which are able to find good strategies using actions drawn from continuous sets. This paper describes a simple control task called direction finder and its known optimal solution for both discrete and continuous actions. It allows for comparison of RL solution methods based on their value functions. In order to solve the control task for continuous actions, a simple idea for generalising them by means of feature vectors is presented. The resulting algorithm is applied using different choices of feature calculations. For comparing their performance a simple measure is展开更多
Continual learning(CL)studies the problem of learning to accumulate knowledge over time from a stream of data.A crucial challenge is that neural networks suffer from performance degradation on previously seen data,kno...Continual learning(CL)studies the problem of learning to accumulate knowledge over time from a stream of data.A crucial challenge is that neural networks suffer from performance degradation on previously seen data,known as catastrophic forgetting,due to allowing parameter sharing.In this work,we consider a more practical online class-incremental CL setting,where the model learns new samples in an online manner and may continuously experience new classes.Moreover,prior knowledge is unavailable during training and evaluation.Existing works usually explore sample usages from a single dimension,which ignores a lot of valuable supervisory information.To better tackle the setting,we propose a novel replay-based CL method,which leverages multi-level representations produced by the intermediate process of training samples for replay and strengthens supervision to consolidate previous knowledge.Specifically,besides the previous raw samples,we store the corresponding logits and features in the memory.Furthermore,to imitate the prediction of the past model,we construct extra constraints by leveraging multi-level information stored in the memory.With the same number of samples for replay,our method can use more past knowledge to prevent interference.We conduct extensive evaluations on several popular CL datasets,and experiments show that our method consistently outperforms state-of-the-art methods with various sizes of episodic memory.We further provide a detailed analysis of these results and demonstrate that our method is more viable in practical scenarios.展开更多
A distance learning Continuing Medical Education （CME） project based on live interactive presentations and a group participatory model demonstrated that important strides can be made in the quality of CME available ...A distance learning Continuing Medical Education （CME） project based on live interactive presentations and a group participatory model demonstrated that important strides can be made in the quality of CME available to health care professionals in African rural settings. Implementers choose a communication model consistent with the fundamental orality of Kenyan and other sub-Saharan African countries. The project involved four hospitals and one training institution in rural Kenya. The testing of learners and focus group discussions with learners, facilitators and presenters indicated that the project＇s methodologies, that strove to be culturally and work place friendly, contributed to gains in knowledge, competencies including case management, the continuity of patient care, team work, staff morale and other issues of expressed importance to the hospital healthcare work force and hospital administrators. The learning system, known as Advancing Continuing Medical Education through Information Technology （ACME-IT）, was implemented by the Kenyan Ministry of Medical Services, EC Associates and the US-funded Aphia2 Western initiative implemented by PATH. The findings of this pilot suggests that the ACME-IT methodology that set up learning centers at the participating institutions is a promising viable alternative to the traditional and relatively expensive workshop training that characterizes much of CME in lower and middle income countries.展开更多
Much in-class education and training for developing countries have focused on how a learner absorbs knowledge and skills efficiently or effectively in the class,but are less interested in how the learners should trans...Much in-class education and training for developing countries have focused on how a learner absorbs knowledge and skills efficiently or effectively in the class,but are less interested in how the learners should transfer the knowledge and skills into their jobs in their workplace.In principle,in-class education and training have a difficulty with applying the learned knowledge and skills to learners’jobs in the workplace in comparison with any other practical-basis training.To overcome this difficulty,many educational stakeholders in the nuclear field have concentrated on how learners can transfer the knowledge and skills absorbed in the class into their jobs in their workplace.The action learning activity for learners can be one of the solutions to apply the knowledge and skills to their job in the workplace.The purpose of this study is to clarify how the transfer of learning has been implemented in the nuclear-related continuing professional educations and training for developing countries in Korea.To accomplish this purpose,this study is implemented as follows.The first is to define the concept of the“transfer of learning”clearly.The second is to clarify the core elements of the transfer of learning.Along with the clarification,the third is to show how the transfer of learning has been implemented in the continuing professional nuclear-related education and training for developing countries in Korea.The fourth is to present core problems in such education and training.As the fifth,this study suggests alternatives to overcome the core problems in the nuclear-related continuing professional education and training.展开更多
In natural language processing(NLP),managing multiple downstream tasks through fine-tuning pre-trained models often requires maintaining separate task-specific models,leading to practical inefficiencies.To address thi...In natural language processing(NLP),managing multiple downstream tasks through fine-tuning pre-trained models often requires maintaining separate task-specific models,leading to practical inefficiencies.To address this challenge,we introduce AdaptForever,a novel approach that enables continuous mastery of NLP tasks through the integration of elastic and mutual learning strategies with a stochastic expert mechanism.Our method freezes the pre-trained model weights while incorporating adapters enhanced with mutual learning capabilities,facilitating effective knowledge transfer from previous tasks to new ones.By combining Elastic Weight Consolidation(EWC)for knowledge preservation with specialized regularization terms,AdaptForever successfully maintains performance on earlier tasks while acquiring new capabilities.Experimental results demonstrate that AdaptForever achieves superior performance across a continuous sequence of NLP tasks compared to existing parameter-efficient methods,while effectively preventing catastrophic forgetting and enabling positive knowledge transfer between tasks.展开更多
This paper reports on a study on the effects of reading-writing integrated tasks on vocabulary learning and explored the differential roles of creative construction and non-creative construction in promoting lexical l...This paper reports on a study on the effects of reading-writing integrated tasks on vocabulary learning and explored the differential roles of creative construction and non-creative construction in promoting lexical learning. Participants were 90 first-year English majors, randomly assigned to two experimental groups(continuation and retelling) and one control group, with 30 students in each group. Results showed that the continuation group generated a substantial amount of creative construction and produced significantly more instances of creative imitation than the retelling group. The continuation group outperformed the retelling group for both receptive and productive vocabulary knowledge gain and retention, but differences were only significant in terms of productive vocabulary retention. Finally, productive vocabulary knowledge retention among the continuation group was significantly and positively correlated with creative imitation(meaning creation coupled with language imitation), but not with linguistic alignment per se. As productive vocabulary knowledge constitutes the learner ’s ability to use lexical knowledge to express ideas in dynamic contexts, the findings afforded evidence that creative imitation could be the answer to the fundamental issue of L2 learning(i.e., mapping static language onto dynamic idea expression). The pedagogical implications as well as future research directions are also discussed.展开更多
This study investigated how the mode in which the reading-writing integrated continuation task was conducted modulates the effects of second language(L2) syntactic alignment, through the English motion event construct...This study investigated how the mode in which the reading-writing integrated continuation task was conducted modulates the effects of second language(L2) syntactic alignment, through the English motion event construction with manner verbs. Ninety Chinese students were assigned to either of the two experimental groups or a control group, and they all experienced a pretest, an alignment phase and a posttest. In the alignment phase, the two experimental groups completed a reading-writing integrated continuation task but in different modes. For the multi-turn mode,participants reconstructed a picture story by continuing the episodes extracted from the story with one episode presented and continued at a time;for the single-turn mode, the first half of the same picture story was presented as a chunk, and then participants read and continued it. Results show that L2 learners aligned with the target structure in completing the story, and the alignment effect was retained in the posttest conducted after a delay of two weeks. Moreover, syntactic alignment was modulated by task mode with the multi-turn group exhibiting stronger immediate and longterm alignment effects. We conclude that the continuation task is a fruitful context for L2 structural alignment, and the magnitude of alignment effect hinges on interactive intensity.展开更多
In a field rapidly evolving over the past few years, the management of inflammatory bowel diseases(IBD), Crohn's disease and ulcerative colitis, is becoming in-creasingly complex, demanding and challenging. In the...In a field rapidly evolving over the past few years, the management of inflammatory bowel diseases(IBD), Crohn's disease and ulcerative colitis, is becoming in-creasingly complex, demanding and challenging. In the recent years, IBD quality measures aiming to improve patients' care have been developed, multiple new medical therapies have been approved, new treatment goals have been set with the "treat--to--target" concept and drug monitoring has been implemented into IBD clinical management. Moreover, patients are increasingly using Internet resources to obtain information about their health conditions. The healthcare professional with an interest in treating IBD patients should deal with all these challenges in everyday practice by establishing, enhancing and maintaining a strong core of knowledge and skills related to IBD. This is an ongoing process and traditionally these needs are covered with additional reading of textbook or journal articles, attendance at meetings or conferences, or at local rounds. Web--based learning resources expand the options for knowledge acquisition and save time and costs as well. In the new era of communications technology, web-based resources can cover the educational needs of both patients and healthcare professionals and can contribute to improvement of disease management and patient care. Healthcare professionals can individually visit and navigate regularly relevant websites and tailor choices for educational activities according to their existing needs. They can also provide their patients with a few certified suitable internet resources. In this review, we explored the Internet using PubMed and Startpage(Google), for web-based IBD--related educational resources aiming to provide a guide for those interested in obtaining certified knowledge in this subject.展开更多
This paper reports distinct spatio-spectral properties of Zen-meditation EEG (electroencephalograph), compared with resting EEG, by implementing unsupervised machine learning scheme in clustering the brain mappings of...This paper reports distinct spatio-spectral properties of Zen-meditation EEG (electroencephalograph), compared with resting EEG, by implementing unsupervised machine learning scheme in clustering the brain mappings of centroid frequency (BMFc). Zen practitioners simultaneously concentrate on the third ventricle, hypothalamus and corpora quadrigemina touniversalize all brain neurons to construct a <i>detached</i> brain and gradually change the normal brain traits, leading to the process of brain-neuroplasticity. During such tri-aperture concentration, EEG exhibits prominent diffuse high-frequency oscillations. Unsupervised self-organizing map (SOM), clusters the dataset of quantitative EEG by matching the input feature vector Fc and the output cluster center through the SOM network weights. Input dataset contains brain mappings of 30 centroid frequencies extracted from CWT (continuous wavelet transform) coefficients. According to SOM clustering results, resting EEG is dominated by global low-frequency (<14 Hz) activities, except channels T7, F7 and TP7 (>14.4 Hz);whereas Zen-meditation EEG exhibits globally high-frequency (>16 Hz) activities throughout the entire record. Beta waves with a wide range of frequencies are often associated with active concentration. Nonetheless, clinic report discloses that benzodiazepines, medication treatment for anxiety, insomnia and panic attacks to relieve mind/body stress, often induce <i>beta buzz</i>. We may hypothesize that Zen-meditation practitioners attain the unique state of mindfulness concentration under optimal body-mind relaxation.展开更多
文摘Although modulation classification based on deep neural network can achieve high Modulation Classification(MC)accuracies,catastrophic forgetting will occur when the neural network model continues to learn new tasks.In this paper,we simulate the dynamic wireless communication environment and focus on breaking the learning paradigm of isolated automatic MC.We innovate a research algorithm for continuous automatic MC.Firstly,a memory for storing representative old task modulation signals is built,which is employed to limit the gradient update direction of new tasks in the continuous learning stage to ensure that the loss of old tasks is also in a downward trend.Secondly,in order to better simulate the dynamic wireless communication environment,we employ the mini-batch gradient algorithm which is more suitable for continuous learning.Finally,the signal in the memory can be replayed to further strengthen the characteristics of the old task signal in the model.Simulation results verify the effectiveness of the method.
文摘1|OVERVIEW.Machine learning(ML)has been increasingly used for tackling various diagnostic,therapeutic,and prognostic tasks owing to its capability to learn and reason without explicit programming[1].Most developed ML models have had their accuracy proven through internal validation using retrospective data.However,external validation using retrospective data,continual monitoring using prospective data,and randomized controlled trials(RCTs)using prospective data are important for the translation of ML models into real-world clinical practice[2].
基金support from the University of Iowa OVPR Interdisciplinary Scholars Program and the US Department of Education(ED#P116S210005)for this study.Kishlay Jha’s work is supported in part by the US National Institute of Health(NIH)and National Science Foundation(NSF)under grants R01LM014012-01A1 and ITE-2333740.
文摘Climate change poses significant challenges to agricultural management,particularly in adapting to extreme weather conditions that impact agricultural production.Existing works with traditional Reinforcement Learning(RL)methods often falter under such extreme conditions.To address this challenge,our study introduces a novel approach by integrating Continual Learning(CL)with RL to form Continual Reinforcement Learning(CRL),enhancing the adaptability of agricultural management strategies.Leveraging the Gym-DSSAT simulation environment,our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions.By incorporating CL algorithms,such as Elastic Weight Consolidation(EWC),with established RL techniques like Deep Q-Networks(DQN),we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios.The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies,particularly under extreme weather events like severe droughts.Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods,especially in challenging conditions of reduced rainfall and increased temperatures.This pioneering work,which combines CL with RL to generate adaptive policies for agricultural management,is expected to make significant advancements in precision agriculture in the era of climate change.
基金Supported by the National Creative Research Groups Science Foundation of China （60721062） and the National High Technology Research and Development Program of China （2007AA04Z162）.
文摘An iterative learning model predictive control （ILMPC） technique is applied to a class of continuous/batch processes. Such processes are characterized by the operations of batch processes generating periodic strong disturbances to the continuous processes and traditional regulatory controllers are unable to eliminate these periodic disturbances. ILMPC integrates the feature of iterative learning control （ILC） handling repetitive signal and the flexibility of model predictive control （MPC）. By on-line monitoring the operation status of batch processes, an event-driven iterative learning algorithm for batch repetitive disturbances is initiated and the soft constraints are adjusted timely as the feasible region is away from the desired operating zone. The results of an industrial application show that the proposed ILMPC method is effective for a class of continuous/batch processes.
文摘Reinforcement Learning is a commonly used technique for learning tasks in robotics, however, traditional algorithms are unable to handle large amounts of data coming from the robot’s sensors, require long training times, and use dis-crete actions. This work introduces TS-RRLCA, a two stage method to tackle these problems. In the first stage, low-level data coming from the robot’s sensors is transformed into a more natural, relational representation based on rooms, walls, corners, doors and obstacles, significantly reducing the state space. We use this representation along with Behavioural Cloning, i.e., traces provided by the user;to learn, in few iterations, a relational control policy with discrete actions which can be re-used in different environments. In the second stage, we use Locally Weighted Regression to transform the initial policy into a continuous actions policy. We tested our approach in simulation and with a real service robot on different environments for different navigation and following tasks. Results show how the policies can be used on different domains and perform smoother, faster and shorter paths than the original discrete actions policies.
文摘The predominant method for smart phone accessing is confined to methods directing the authentication by means of Point-of-Entry that heavily depend on physiological biometrics like,fingerprint or face.Implicit continuous authentication initiating to be loftier to conventional authentication mechanisms by continuously confirming users’identities on continuing basis and mark the instant at which an illegitimate hacker grasps dominance of the session.However,divergent issues remain unaddressed.This research aims to investigate the power of Deep Reinforcement Learning technique to implicit continuous authentication for mobile devices using a method called,Gaussian Weighted Cauchy Kriging-based Continuous Czekanowski’s(GWCK-CC).First,a Gaussian Weighted Non-local Mean Filter Preprocessing model is applied for reducing the noise pre-sent in the raw input face images.Cauchy Kriging Regression function is employed to reduce the dimensionality.Finally,Continuous Czekanowski’s Clas-sification is utilized for proficient classification between the genuine user and attacker.By this way,the proposed GWCK-CC method achieves accurate authen-tication with minimum error rate and time.Experimental assessment of the pro-posed GWCK-CC method and existing methods are carried out with different factors by using UMDAA-02 Face Dataset.The results confirm that the proposed GWCK-CC method enhances authentication accuracy,by 9%,reduces the authen-tication time,and error rate by 44%,and 43%as compared to the existing methods.
基金This study was supported in part by the Ministry of Science and Technology MOST 108-2221-E-150-022-MY3 and Taiwan Ocean University.
文摘This study proposed a measurement platform for continuous blood pressure estimation based on dual photoplethysmography(PPG)sensors and a deep learning(DL)that can be used for continuous and rapid measurement of blood pressure and analysis of cardiovascular-related indicators.The proposed platform measured the signal changes in PPG and converted them into physiological indicators,such as pulse transit time(PTT),pulse wave velocity(PWV),perfusion index(PI)and heart rate(HR);these indicators were then fed into the DL to calculate blood pressure.The hardware of the experiment comprised 2 PPG components(i.e.,Raspberry Pi 3 Model B and analog-todigital converter[MCP3008]),which were connected using a serial peripheral interface.The DL algorithm converted the stable dual PPG signals acquired from the strictly standardized experimental process into various physiological indicators as input parameters and finally obtained the systolic blood pressure(SBP),diastolic blood pressure(DBP)and mean arterial pressure(MAP).To increase the robustness of the DL model,this study input data of 100 Asian participants into the training database,including those with and without cardiovascular disease,each with a proportion of approximately 50%.The experimental results revealed that the mean absolute error and standard deviation of SBP was 0.17±0.46 mmHg.The mean absolute error and standard deviation of DBP was 0.27±0.52 mmHg.The mean absolute error and standard deviation of MAP was 0.16±0.40 mmHg.
文摘The overall research in Reinforcement Learning (RL) concentrates on discrete sets of actions, but for certain real-world problems it is important to have methods which are able to find good strategies using actions drawn from continuous sets. This paper describes a simple control task called direction finder and its known optimal solution for both discrete and continuous actions. It allows for comparison of RL solution methods based on their value functions. In order to solve the control task for continuous actions, a simple idea for generalising them by means of feature vectors is presented. The resulting algorithm is applied using different choices of feature calculations. For comparing their performance a simple measure is
基金supported in part by the National Natura Science Foundation of China(U2013602,61876181,51521003)the Nationa Key R&D Program of China(2020YFB13134)+2 种基金Shenzhen Science and Technology Research and Development Foundation(JCYJ20190813171009236)Beijing Nova Program of Science and Technology(Z191100001119043)the Youth Innovation Promotion Association,Chinese Academy of Sciences。
文摘Continual learning(CL)studies the problem of learning to accumulate knowledge over time from a stream of data.A crucial challenge is that neural networks suffer from performance degradation on previously seen data,known as catastrophic forgetting,due to allowing parameter sharing.In this work,we consider a more practical online class-incremental CL setting,where the model learns new samples in an online manner and may continuously experience new classes.Moreover,prior knowledge is unavailable during training and evaluation.Existing works usually explore sample usages from a single dimension,which ignores a lot of valuable supervisory information.To better tackle the setting,we propose a novel replay-based CL method,which leverages multi-level representations produced by the intermediate process of training samples for replay and strengthens supervision to consolidate previous knowledge.Specifically,besides the previous raw samples,we store the corresponding logits and features in the memory.Furthermore,to imitate the prediction of the past model,we construct extra constraints by leveraging multi-level information stored in the memory.With the same number of samples for replay,our method can use more past knowledge to prevent interference.We conduct extensive evaluations on several popular CL datasets,and experiments show that our method consistently outperforms state-of-the-art methods with various sizes of episodic memory.We further provide a detailed analysis of these results and demonstrate that our method is more viable in practical scenarios.
文摘A distance learning Continuing Medical Education （CME） project based on live interactive presentations and a group participatory model demonstrated that important strides can be made in the quality of CME available to health care professionals in African rural settings. Implementers choose a communication model consistent with the fundamental orality of Kenyan and other sub-Saharan African countries. The project involved four hospitals and one training institution in rural Kenya. The testing of learners and focus group discussions with learners, facilitators and presenters indicated that the project＇s methodologies, that strove to be culturally and work place friendly, contributed to gains in knowledge, competencies including case management, the continuity of patient care, team work, staff morale and other issues of expressed importance to the hospital healthcare work force and hospital administrators. The learning system, known as Advancing Continuing Medical Education through Information Technology （ACME-IT）, was implemented by the Kenyan Ministry of Medical Services, EC Associates and the US-funded Aphia2 Western initiative implemented by PATH. The findings of this pilot suggests that the ACME-IT methodology that set up learning centers at the participating institutions is a promising viable alternative to the traditional and relatively expensive workshop training that characterizes much of CME in lower and middle income countries.
文摘Much in-class education and training for developing countries have focused on how a learner absorbs knowledge and skills efficiently or effectively in the class,but are less interested in how the learners should transfer the knowledge and skills into their jobs in their workplace.In principle,in-class education and training have a difficulty with applying the learned knowledge and skills to learners’jobs in the workplace in comparison with any other practical-basis training.To overcome this difficulty,many educational stakeholders in the nuclear field have concentrated on how learners can transfer the knowledge and skills absorbed in the class into their jobs in their workplace.The action learning activity for learners can be one of the solutions to apply the knowledge and skills to their job in the workplace.The purpose of this study is to clarify how the transfer of learning has been implemented in the nuclear-related continuing professional educations and training for developing countries in Korea.To accomplish this purpose,this study is implemented as follows.The first is to define the concept of the“transfer of learning”clearly.The second is to clarify the core elements of the transfer of learning.Along with the clarification,the third is to show how the transfer of learning has been implemented in the continuing professional nuclear-related education and training for developing countries in Korea.The fourth is to present core problems in such education and training.As the fifth,this study suggests alternatives to overcome the core problems in the nuclear-related continuing professional education and training.
基金supported by the National Key R&D Program of China(No.2023YFB3308601)Sichuan Science and Technology Program(2024NSFJQ0035,2024NSFSC0004)the Talents by Sichuan provincial Party Committee Organization Department.
文摘In natural language processing(NLP),managing multiple downstream tasks through fine-tuning pre-trained models often requires maintaining separate task-specific models,leading to practical inefficiencies.To address this challenge,we introduce AdaptForever,a novel approach that enables continuous mastery of NLP tasks through the integration of elastic and mutual learning strategies with a stochastic expert mechanism.Our method freezes the pre-trained model weights while incorporating adapters enhanced with mutual learning capabilities,facilitating effective knowledge transfer from previous tasks to new ones.By combining Elastic Weight Consolidation(EWC)for knowledge preservation with specialized regularization terms,AdaptForever successfully maintains performance on earlier tasks while acquiring new capabilities.Experimental results demonstrate that AdaptForever achieves superior performance across a continuous sequence of NLP tasks compared to existing parameter-efficient methods,while effectively preventing catastrophic forgetting and enabling positive knowledge transfer between tasks.
文摘This paper reports on a study on the effects of reading-writing integrated tasks on vocabulary learning and explored the differential roles of creative construction and non-creative construction in promoting lexical learning. Participants were 90 first-year English majors, randomly assigned to two experimental groups(continuation and retelling) and one control group, with 30 students in each group. Results showed that the continuation group generated a substantial amount of creative construction and produced significantly more instances of creative imitation than the retelling group. The continuation group outperformed the retelling group for both receptive and productive vocabulary knowledge gain and retention, but differences were only significant in terms of productive vocabulary retention. Finally, productive vocabulary knowledge retention among the continuation group was significantly and positively correlated with creative imitation(meaning creation coupled with language imitation), but not with linguistic alignment per se. As productive vocabulary knowledge constitutes the learner ’s ability to use lexical knowledge to express ideas in dynamic contexts, the findings afforded evidence that creative imitation could be the answer to the fundamental issue of L2 learning(i.e., mapping static language onto dynamic idea expression). The pedagogical implications as well as future research directions are also discussed.
文摘This study investigated how the mode in which the reading-writing integrated continuation task was conducted modulates the effects of second language(L2) syntactic alignment, through the English motion event construction with manner verbs. Ninety Chinese students were assigned to either of the two experimental groups or a control group, and they all experienced a pretest, an alignment phase and a posttest. In the alignment phase, the two experimental groups completed a reading-writing integrated continuation task but in different modes. For the multi-turn mode,participants reconstructed a picture story by continuing the episodes extracted from the story with one episode presented and continued at a time;for the single-turn mode, the first half of the same picture story was presented as a chunk, and then participants read and continued it. Results show that L2 learners aligned with the target structure in completing the story, and the alignment effect was retained in the posttest conducted after a delay of two weeks. Moreover, syntactic alignment was modulated by task mode with the multi-turn group exhibiting stronger immediate and longterm alignment effects. We conclude that the continuation task is a fruitful context for L2 structural alignment, and the magnitude of alignment effect hinges on interactive intensity.
文摘In a field rapidly evolving over the past few years, the management of inflammatory bowel diseases(IBD), Crohn's disease and ulcerative colitis, is becoming in-creasingly complex, demanding and challenging. In the recent years, IBD quality measures aiming to improve patients' care have been developed, multiple new medical therapies have been approved, new treatment goals have been set with the "treat--to--target" concept and drug monitoring has been implemented into IBD clinical management. Moreover, patients are increasingly using Internet resources to obtain information about their health conditions. The healthcare professional with an interest in treating IBD patients should deal with all these challenges in everyday practice by establishing, enhancing and maintaining a strong core of knowledge and skills related to IBD. This is an ongoing process and traditionally these needs are covered with additional reading of textbook or journal articles, attendance at meetings or conferences, or at local rounds. Web--based learning resources expand the options for knowledge acquisition and save time and costs as well. In the new era of communications technology, web-based resources can cover the educational needs of both patients and healthcare professionals and can contribute to improvement of disease management and patient care. Healthcare professionals can individually visit and navigate regularly relevant websites and tailor choices for educational activities according to their existing needs. They can also provide their patients with a few certified suitable internet resources. In this review, we explored the Internet using PubMed and Startpage(Google), for web-based IBD--related educational resources aiming to provide a guide for those interested in obtaining certified knowledge in this subject.
文摘This paper reports distinct spatio-spectral properties of Zen-meditation EEG (electroencephalograph), compared with resting EEG, by implementing unsupervised machine learning scheme in clustering the brain mappings of centroid frequency (BMFc). Zen practitioners simultaneously concentrate on the third ventricle, hypothalamus and corpora quadrigemina touniversalize all brain neurons to construct a <i>detached</i> brain and gradually change the normal brain traits, leading to the process of brain-neuroplasticity. During such tri-aperture concentration, EEG exhibits prominent diffuse high-frequency oscillations. Unsupervised self-organizing map (SOM), clusters the dataset of quantitative EEG by matching the input feature vector Fc and the output cluster center through the SOM network weights. Input dataset contains brain mappings of 30 centroid frequencies extracted from CWT (continuous wavelet transform) coefficients. According to SOM clustering results, resting EEG is dominated by global low-frequency (<14 Hz) activities, except channels T7, F7 and TP7 (>14.4 Hz);whereas Zen-meditation EEG exhibits globally high-frequency (>16 Hz) activities throughout the entire record. Beta waves with a wide range of frequencies are often associated with active concentration. Nonetheless, clinic report discloses that benzodiazepines, medication treatment for anxiety, insomnia and panic attacks to relieve mind/body stress, often induce <i>beta buzz</i>. We may hypothesize that Zen-meditation practitioners attain the unique state of mindfulness concentration under optimal body-mind relaxation.
