Joint Multimodal Aspect-based Sentiment Analysis(JMASA)is a significant task in the research of multimodal fine-grained sentiment analysis,which combines two subtasks:Multimodal Aspect Term Extraction(MATE)and Multimo...Joint Multimodal Aspect-based Sentiment Analysis(JMASA)is a significant task in the research of multimodal fine-grained sentiment analysis,which combines two subtasks:Multimodal Aspect Term Extraction(MATE)and Multimodal Aspect-oriented Sentiment Classification(MASC).Currently,most existing models for JMASA only perform text and image feature encoding from a basic level,but often neglect the in-depth analysis of unimodal intrinsic features,which may lead to the low accuracy of aspect term extraction and the poor ability of sentiment prediction due to the insufficient learning of intra-modal features.Given this problem,we propose a Text-Image Feature Fine-grained Learning(TIFFL)model for JMASA.First,we construct an enhanced adjacency matrix of word dependencies and adopt graph convolutional network to learn the syntactic structure features for text,which addresses the context interference problem of identifying different aspect terms.Then,the adjective-noun pairs extracted from image are introduced to enable the semantic representation of visual features more intuitive,which addresses the ambiguous semantic extraction problem during image feature learning.Thereby,the model performance of aspect term extraction and sentiment polarity prediction can be further optimized and enhanced.Experiments on two Twitter benchmark datasets demonstrate that TIFFL achieves competitive results for JMASA,MATE and MASC,thus validating the effectiveness of our proposed methods.展开更多
Video classification is an important task in video understanding and plays a pivotal role in intelligent monitoring of information content.Most existing methods do not consider the multimodal nature of the video,and t...Video classification is an important task in video understanding and plays a pivotal role in intelligent monitoring of information content.Most existing methods do not consider the multimodal nature of the video,and the modality fusion approach tends to be too simple,often neglecting modality alignment before fusion.This research introduces a novel dual stream multimodal alignment and fusion network named DMAFNet for classifying short videos.The network uses two unimodal encoder modules to extract features within modalities and exploits a multimodal encoder module to learn interaction between modalities.To solve the modality alignment problem,contrastive learning is introduced between two unimodal encoder modules.Additionally,masked language modeling(MLM)and video text matching(VTM)auxiliary tasks are introduced to improve the interaction between video frames and text modalities through backpropagation of loss functions.Diverse experiments prove the efficiency of DMAFNet in multimodal video classification tasks.Compared with other two mainstream baselines,DMAFNet achieves the best results on the 2022 WeChat Big Data Challenge dataset.展开更多
In this paper,the sentiment classification method of multimodal adversarial autoencoder is studied.This paper includes the introduction of the multimodal adversarial autoencoder emotion classification method and the e...In this paper,the sentiment classification method of multimodal adversarial autoencoder is studied.This paper includes the introduction of the multimodal adversarial autoencoder emotion classification method and the experiment of the emotion classification method based on the encoder.The experimental analysis shows that the encoder has higher precision than other encoders in emotion classification.It is hoped that this analysis can provide some reference for the emotion classification under the current intelligent algorithm mode.展开更多
With the rapid development of Teaching Chinese as a Foreign Language(TCFL),improving teaching quality requires integrating advanced pedagogical concepts.Multimodal teaching,which employs various symbolic modes to enga...With the rapid development of Teaching Chinese as a Foreign Language(TCFL),improving teaching quality requires integrating advanced pedagogical concepts.Multimodal teaching,which employs various symbolic modes to engage students’multiple senses,is a highly effective approach.Introducing multimodal theory into TCFL education can enhance teaching efficiency and improve students’communication skills.This paper applies multimodal theory to TCFL,using the elementary Chinese comprehensive course“My Family”as a case study to propose a detailed teaching design,followed by evaluation and reflection.The aim of this teaching design is to deepen the understanding of multimodal theory and provide additional reference for the TCFL.展开更多
BACKGROUND Pancreatic cancer involving the pancreas neck and body often invades the retroperitoneal vessels,making its radical resection challenging.Multimodal treatment strategies,including neoadjuvant therapy,surger...BACKGROUND Pancreatic cancer involving the pancreas neck and body often invades the retroperitoneal vessels,making its radical resection challenging.Multimodal treatment strategies,including neoadjuvant therapy,surgery,and postoperative adjuvant therapy,are contributing to a paradigm shift in the treatment of pancreatic cancer.This strategy is also promising in the treatment of pancreatic neckbody cancer.AIM To evaluate the feasibility and effectiveness of a multimodal strategy for the treatment of borderline/locally advanced pancreatic neck-body cancer.METHODS From January 2019 to December 2021,we reviewed the demographic characteristics,neoadjuvant and adjuvant treatment data,intraoperative and postoperative variables,and follow-up outcomes of patients who underwent multimodal treatment for pancreatic neck-body cancer in a prospectively collected database of our hospital.This investigation was reported in line with the Preferred Reporting of Case Series in Surgery criteria.RESULTS A total of 11 patients with pancreatic neck-body cancer were included in this study,of whom 6 patients were borderline resectable and 5 were locally advanced.Through multidisciplinary team discussion,all patients received neoadjuvant therapy,of whom 8(73%)patients achieved a partial response and 3 patients maintained stable disease.After multidisciplinary team reassessment,all patients underwent laparoscopic subtotal distal pancreatectomy and portal vein reconstruction and achieved R0 resection.Postoperatively,two patients(18%)developed ascites,and two patients(18%)developed pancreatic fistulae.The median length of stay of the patients was 11 days(range:10-15 days).All patients received postoperative adjuvant therapy.During the follow-up,three patients experienced tumor recurrence,with a median disease-free survival time of 13.3 months and a median overall survival time of 20.5 months.CONCLUSION A multimodal treatment strategy combining neoadjuvant therapy,laparoscopic subtotal distal pancreatectomy,and adjuvant therapy is safe and feasible in patients with pancreatic neck-body cancer.展开更多
Thunderstorm wind gusts are small in scale,typically occurring within a range of a few kilometers.It is extremely challenging to monitor and forecast thunderstorm wind gusts using only automatic weather stations.There...Thunderstorm wind gusts are small in scale,typically occurring within a range of a few kilometers.It is extremely challenging to monitor and forecast thunderstorm wind gusts using only automatic weather stations.Therefore,it is necessary to establish thunderstorm wind gust identification techniques based on multisource high-resolution observations.This paper introduces a new algorithm,called thunderstorm wind gust identification network(TGNet).It leverages multimodal feature fusion to fuse the temporal and spatial features of thunderstorm wind gust events.The shapelet transform is first used to extract the temporal features of wind speeds from automatic weather stations,which is aimed at distinguishing thunderstorm wind gusts from those caused by synoptic-scale systems or typhoons.Then,the encoder,structured upon the U-shaped network(U-Net)and incorporating recurrent residual convolutional blocks(R2U-Net),is employed to extract the corresponding spatial convective characteristics of satellite,radar,and lightning observations.Finally,by using the multimodal deep fusion module based on multi-head cross-attention,the temporal features of wind speed at each automatic weather station are incorporated into the spatial features to obtain 10-minutely classification of thunderstorm wind gusts.TGNet products have high accuracy,with a critical success index reaching 0.77.Compared with those of U-Net and R2U-Net,the false alarm rate of TGNet products decreases by 31.28%and 24.15%,respectively.The new algorithm provides grid products of thunderstorm wind gusts with a spatial resolution of 0.01°,updated every 10minutes.The results are finer and more accurate,thereby helping to improve the accuracy of operational warnings for thunderstorm wind gusts.展开更多
With the increasing global demand for Chinese language,the teaching of Chinese for Specific Purposes(CSP)has occupied an increasingly important position in the teaching of Chinese as a foreign language.However,traditi...With the increasing global demand for Chinese language,the teaching of Chinese for Specific Purposes(CSP)has occupied an increasingly important position in the teaching of Chinese as a foreign language.However,traditional teaching methods often neglect the role of non-verbal symbols in language comprehension and communication.The multimodal discourse theory provides a new perspective for CSP teaching,which can effectively enhance students’understanding and mastery of specialized terminology and language application skills by integrating multisensory symbol systems such as language,vision,hearing,and touch.This paper starts from the current situation of teaching CSP and analyzes the adaptability between multimodal discourse and CSP teaching,aiming to provide theoretical support and practical suggestions for the innovation of the teaching mode of CSP.展开更多
With the development of globalization,intercultural communicative competence has become one of the core qualities of modern college students.As an important platform to cultivate students’language skills and cultural...With the development of globalization,intercultural communicative competence has become one of the core qualities of modern college students.As an important platform to cultivate students’language skills and cultural literacy,the innovation of college English teaching mode is essential.Based on this,this paper mainly discusses methods to effectively cultivate students’intercultural communicative competence in college English teaching from the perspective of multimodal interactive teaching mode,hoping to provide references for improving the quality of college English teaching and students’comprehensive quality.展开更多
BACKGROUND Recent advancements in artificial intelligence(AI)have significantly enhanced the capabilities of endoscopic-assisted diagnosis for gastrointestinal diseases.AI has shown great promise in clinical practice,...BACKGROUND Recent advancements in artificial intelligence(AI)have significantly enhanced the capabilities of endoscopic-assisted diagnosis for gastrointestinal diseases.AI has shown great promise in clinical practice,particularly for diagnostic support,offering real-time insights into complex conditions such as esophageal squamous cell carcinoma.CASE SUMMARY In this study,we introduce a multimodal AI system that successfully identified and delineated a small and flat carcinoma during esophagogastroduodenoscopy,highlighting its potential for early detection of malignancies.The lesion was confirmed as high-grade squamous intraepithelial neoplasia,with pathology results supporting the AI system’s accuracy.The multimodal AI system offers an integrated solution that provides real-time,accurate diagnostic information directly within the endoscopic device interface,allowing for single-monitor use without disrupting endoscopist’s workflow.CONCLUSION This work underscores the transformative potential of AI to enhance endoscopic diagnosis by enabling earlier,more accurate interventions.展开更多
BACKGROUND Hepatic artery infusion chemotherapy(HAIC)is a widely used local therapeutic approach for intermediate to advanced-stage hepatocellular carcinoma(HCC),exhibiting considerable efficacy.However,the prevalence...BACKGROUND Hepatic artery infusion chemotherapy(HAIC)is a widely used local therapeutic approach for intermediate to advanced-stage hepatocellular carcinoma(HCC),exhibiting considerable efficacy.However,the prevalence of postoperative pain highlights the importance of pain management.Owing to the limitations inherent in existing pain management strategies,this study investigates and assesses the analgesic effectiveness of a multimodal treatment protocol in mitigating pain after HAIC procedures.AIM To provide patients with a more comprehensive and effective pain management strategy.METHODS A total of 100 patients with primary HCC who underwent HAIC were randomly assigned to a control group(n=50)and a multimodal group(n=50).Baseline characteristics and perioperative data were collected.Upon enrollment,patients in the multimodal group received parecoxib(40 mg)30 minutes before HAIC,followed by 48 hours of patient-controlled analgesia with sufentanil.In contrast,the control group underwent standard preoperative preparation(psychological support)and received dezocine(5 mg)intraoperatively,with intravenous flurbiprofen(100 mg)administered every 12 hours for 48 hours postoperatively.RESULTS Compared to the control group,the multimodal analgesia group exhibited significantly lower resting and movement visual analog scale pain scores at postoperative 0,2,4,6,and 12 hours(P<0.05).Furthermore,the multimodal group experienced a reduced incidence of postoperative nausea and vomiting,as well as a lower overall frequency of adverse events,compared to the control group(P<0.05).Patient satisfaction was also significantly higher in the multimodal group than in the control group(P<0.05).CONCLUSION Our study demonstrates that multimodal analgesia is effective in reducing postoperative pain,minimizing adverse reactions,and improving patient satisfaction in HCC patients undergoing HAIC.This approach provides valuable clinical strategies for optimizing pain management in this patient population.展开更多
Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability...Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability to fully extract fused image information.Therefore,a multimodal medical image fusion method based on mask optimization and parallel attention mechanism was proposed to address the aforementioned issues.Firstly,it converted the entire image into a binary mask,and constructed a contour feature map to maximize the contour feature information of the image and a triple path network for image texture detail feature extraction and optimization.Secondly,a contrast enhancement module and a detail preservation module were proposed to enhance the overall brightness and texture details of the image.Afterwards,a parallel attention mechanism was constructed using channel features and spatial feature changes to fuse images and enhance the salient information of the fused images.Finally,a decoupling network composed of residual networks was set up to optimize the information between the fused image and the source image so as to reduce information loss in the fused image.Compared with nine high-level methods proposed in recent years,the seven objective evaluation indicators of our method have improved by 6%−31%,indicating that this method can obtain fusion results with clearer texture details,higher contrast,and smaller pixel differences between the fused image and the source image.It is superior to other comparison algorithms in both subjective and objective indicators.展开更多
Computer technology-based PPT is usually conceived as a tool for information transmission and presentation rather than as a type of discourse. Much focus of the previous study on PPT is concerned with its development,...Computer technology-based PPT is usually conceived as a tool for information transmission and presentation rather than as a type of discourse. Much focus of the previous study on PPT is concerned with its development, design and application. However, PPT itself may actually be regarded as a multimodal discourse comprising multisemiotics, such as linguistic signs, image, graph, sound, color and their interrelated layouts, etc.. So the article attempts to make a multimodal analysis of College English PPT discourse via the principle of reading images by Kress and van Leeuwen in 1996, aiming to present a different angle of interpreting the meaning of composition anchored in PPT.展开更多
Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, an...Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, and multimodality imaging based on nanoparticles has been receiving extensive attention. This new hybrid imaging technology could provide complementary information from different imaging modalities using only a single injection of contrast agent. In this review, we introduce recent developments in multifunctional nanoparticles and their biomedical applications to multimodal imaging and theragnosis as nanomedicine. Most of the reviewed studies are based on the intrinsic properties of nanoparticles and their application in clinical imaging technology. The imaging techniques include positron emission tomography, single-photon emission computed tomography, computerized tomography, magnetic resonance imaging, optical imaging, and ultrasound imaging.展开更多
After much controversy, multimodality therapy is now accepted worldwide as the gold standard for treatment of resectable bulky localized gastric cancer. There is significant regional variation in the style of multimod...After much controversy, multimodality therapy is now accepted worldwide as the gold standard for treatment of resectable bulky localized gastric cancer. There is significant regional variation in the style of multimodality treatment with adjuvant chemoradiation the North American standard, neoadjuvant chemotherapy preferred in Europe and Australasia, whilst adjuvant chemotherapy is preferred in Asia. With further standardization of surgery and D1+/D2 resections increasingly accepted world wide, and in particular in the West, as the surgical standard of care for potentially curable disease, it is timely to reassess the multimodality regimes being used. The challenge in the use of multimodality therapy is how current outcomes can be standardized and improved further. Recent studies indicate that mere intensification of the regime in time, dosage or addition of further agents does not improve localized gastric cancer outcomes. More novel strategies including early commencement of adjuvant therapies, intra-peritoneal chemotherapy or assessing neoadjuvant response with positron emission tomography scanning may give improvements in outcomes. The introduction of targeted therapies means that the adjuvant use of biological agents needs to be explored. By proper assessment of the patient’s co-morbidities, full tumour staging, and a better understanding of the tumour’s molecular pathology, multimodality therapy for gastric adenocarcinoma may be individualized to optimize the likelihood of cure.展开更多
BACKGROUND Surgical resection is a treatment of choice for gallbladder cancer(GBC)patients but only 10%of patients have a resectable disease at presentation.Even after surgical resection,overall survival(OS)has been p...BACKGROUND Surgical resection is a treatment of choice for gallbladder cancer(GBC)patients but only 10%of patients have a resectable disease at presentation.Even after surgical resection,overall survival(OS)has been poor due to high rates of recurrence.Combination of surgery and systemic therapy can improve outcomes in this aggressive disease.AIM To summarize our single-center experience with multimodality management of resectable GBC patients.METHODS Data of all patients undergoing surgery for suspected GBC from January 2012 to December 2018 was retrieved from a prospectively maintained electronic database.Information extracted included demographics,operative and perioperative details,histopathology,neoadjuvant/adjuvant therapy,follow-up,and recurrence.To know the factors associated with recurrence and OS,univariate and multivariate analysis was done using log rank test and cox proportional hazard analysis for categorical and continuous variables,respectively.Multivariate analysis was done using multiple regression analysis.RESULTS Of 274 patients with GBC taken up for surgical resection,172(62.7%)were female and the median age was 56 years.On exploration,102 patients were found to have a metastatic or unresectable disease(distant metastasis in 66 and locally unresectable in 34).Of 172 patients who finally underwent surgery,93(54%)underwent wedge resection followed by anatomical segment IVb/V resection in 66(38.4%)and modified extended right hepatectomy in 12(7%)patients.The postoperative mortality at 90 d was 4.6%.During a median follow-up period of 20 mo,71(41.2%)patients developed recurrence.Estimated 1-,3-,and 5-years OS rates were 86.5%,56%,and 43.5%,respectively.Estimated 1-and 3-year disease free survival(DFS)rates were 75%and 49.2%,respectively.On multivariate analysis,inferior OS was seen with pT3/T4 tumor(P=0.0001),perineural invasion(P=0.0096),and R+resection(P=0.0125).However,only pT3/T4 tumors were associated with a poor DFS(P<0.0001).CONCLUSION Multimodality treatment significantly improves the 5-year survival rate of patients with GBC up to 43%.R+resection,higher T stage,and perineural invasion adversely affect the outcome and should be considered for systemic therapy in addition to surgery to optimize the outcomes.Multimodality treatment of GBC has potential to improve the survival of GBC patients.展开更多
Triple-negative breast cancer(TNBC)is a subtype of breast cancer in which the estrogen receptor and progesterone receptor are not expressed,and human epidermal growth factor receptor 2 is not amplified or overexpresse...Triple-negative breast cancer(TNBC)is a subtype of breast cancer in which the estrogen receptor and progesterone receptor are not expressed,and human epidermal growth factor receptor 2 is not amplified or overexpressed either,which make the clinical diagnosis and treatment very challenging.Molecular imaging can provide an effective way to diagnose TNBC.Upconversion nanoparticles(UCNPs),are a promising new generation of molecular imaging probes.However,UCNPs still need to be improved for tumor-targeting ability and biocompatibility.This study describes a novel probe based on cancer cell membrane-coated upconversion nanoparticles(CCm-UCNPs),owing to the low immunogenicity and homologous-targeting ability of cancer cell membranes,and modified multifunctional UCNPs.This probe exhibits excellent performance in breast cancer molecular classification and TNBC diagnosis through UCL/MRI/PET tri-modality imaging in vivo.By using this probe,MDA-MB-231 was successfully differentiated between MCF-7 tumor models in vivo.Based on the tumor imaging and molecular classification results,the probe is also expected to be modified for drug delivery in the future,contributing to the treatment of TNBC.The combination of nanoparticles with biomimetic cell membranes has the potential for multiple clinical applications.展开更多
Background: We reported our experience with thymic carcinomas and review their clinical features, treatment strategies, and prognoses. Methods: From April 1998 to November 2012, 11 patients pathologically diagnosed wi...Background: We reported our experience with thymic carcinomas and review their clinical features, treatment strategies, and prognoses. Methods: From April 1998 to November 2012, 11 patients pathologically diagnosed with thymic carcinoma and treated in our hospital were investigated. Results: There were 7 men and 4 women, with a median age of 62 years (range, 35 - 72). According to the Masaoka staging system, 3 patients had stage II, 1 stage III disease, 3 stage IVa disease and 4 stage IVb disease. Ten patients had squamous cell carcinoma, whereas 1 had large cell neuroendocrine carcinoma (LCNEC). We performed surgery or multimodality therapy including surgery as the initial therapy for 8 patients. Of the non-surgical cases, 1 patient received chemoradiotherapy and survived for over 6 years without recurrence, whereas 2 received palliative care. Three of 4 patients who underwent complete resection survived without disease recurrence, whereas only 1 patient with LCNEC survived in the incomplete resection group. Multimodality therapy with cisplatin and docetaxel was provided to 3 patients, and recurrence has not been observed in any of the cases. Conclusions: Favorable outcomes could be achieved in patients with thymic carcinoma who underwent intensive treatment. In particular, surgery combined with cisplatin and docetaxel plus thoracic irradiation may be an attractive approach for thymic carcinoma.展开更多
Despite the aggressive pursuit of diagnostic and treatment modalities for lung cancer, the treatment outcomes are still not satisfactory, and even patients with surgically resectable non-small cell lung cancer (NSCLC)...Despite the aggressive pursuit of diagnostic and treatment modalities for lung cancer, the treatment outcomes are still not satisfactory, and even patients with surgically resectable non-small cell lung cancer (NSCLC) are often at considerable risk of suffering recurrence and/or death from lung cancer. Regarding the treatment of patients with locally advanced, resectable NSCLC, several retrospective and prospective studies have shown the significance of multimodality treatments with preoperative chemoradiotherapy and surgical treatment. However, no definitive treatment strategies for locally advanced NSCLC patients have yet been established. One of the reasons for the lack of established treatment strategies for patients with locally advanced NSCLC is considered to be the heterogeneity of the population, i.e., cT4N0, cT3-4N1 and cT1a-3N2 tumors are included in stage IIIA disease, and superior sulcus tumors (SSTs) are also included in this classification. With regard to SST, two representative prospective phase II trials indicated the efficacy of surgical treatment following concurrent radiation and chemotherapy. In a study conducted by the Southwest Oncology Group, 110 patients with superior sulcus NSCLC were treated with two cycles of cisplatin and etoposide concurrently with 45 gray (Gy) of radiation, followed by surgical treatment and two additional cycles of chemotherapy postoperatively. The response rate (RR) to the preoperative chemoradiotherapy was 86%, and 83 patients (76%) were able to undergo complete resection. A pathological complete response (CR) was observed in 61 patients (56%), and the five-year survival of all patients and those undergoing complete resection was 44% and 54%, respectively. A phase II study conducted by the Japan Clinical Oncology Group examined the safety and efficacy of preoperative concurrent chemoradiotherapy using mitomycin, vinblastin and cisplatin followed by surgical treatment. Seventy-six patients with SST were enrolled in this study, and all received chemotherapy using two cycles of MVP concurrently with 45 Gy of radiation, followed by surgery. Neoadjuvant chemoradiotherapy resulted in a 61% RR, and pathological complete resection was successfully achieved in 51 patients (68%). A pathological CR was observed in 12 patients (16%), and the disease-free and overall survival rates at five years were 45% and 56%, respectively. Both studies showed the efficacy and tolerability of the multimodality treatment for SST, thus suggesting that multimodality treatment with preoperative chemoradiotherapy followed by surgery may therefore be an effective treatment for resectable SST. We herein review the results of retrospective and prospective studies while assessing the treatment outcomes of NSCLC patients with SST.展开更多
Hypertension is currently one of the most prevalent il nesses worldwide,and is the second most common cause of heart failure,only behind ischemic cardiomyopathy.The development of novel multimodality imaging technique...Hypertension is currently one of the most prevalent il nesses worldwide,and is the second most common cause of heart failure,only behind ischemic cardiomyopathy.The development of novel multimodality imaging techniques in recent years has broadened the diagnostic methods,risk stratification and monitoring of treatment of cardiovascular diseases available for clinicians.Cardiovascular magnetic resonance(CMR) has a great capacity to evaluate cardiac dimensions and ventricular function,is extremely useful in ruling-out ischemic cardiomyopathy,the evaluation of the vascular system,in making the differential diagnosis for resistant hypertension and risk stratification for hypertensive cardiomyopathy and constitutes today,the method of choice to evaluate left ventricular systolic function.Computed tomography(CT) is the method of choice for the evaluation of vascular anatomy,including coronary arteries,and is also able to provide both functional and structural information.Finally,nuclear cardiology studies have been traditionally used to evaluate myocardial ischemia,along with offering the capacity to evaluate ventricular,endothelial and cardiac innervation function;information that is key in directing the treatment of the patient.In this narrative review,the most recent contributions of multimodality imaging to the patient with hypertension(CMR,CT and nuclear cardiology) will be reviewed.展开更多
The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard f...The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard for diagnosis of IBD, imaging plays a central role in the assessment of extra mural disease, in disease surveillance and in the assessment of response to medical treatments, which are often expensive. Imaging is also vital in the detection and diagnosis of disease related complications, both acute and chronic. In this review, we will describe, with illustrative images, the imaging features of IBD in adults, with emphasis on upto-date imaging techniques focusing predominantly on cross sectional imaging and new magnetic resonance imaging techniques.展开更多
基金supported by the Science and Technology Project of Henan Province(No.222102210081).
文摘Joint Multimodal Aspect-based Sentiment Analysis(JMASA)is a significant task in the research of multimodal fine-grained sentiment analysis,which combines two subtasks:Multimodal Aspect Term Extraction(MATE)and Multimodal Aspect-oriented Sentiment Classification(MASC).Currently,most existing models for JMASA only perform text and image feature encoding from a basic level,but often neglect the in-depth analysis of unimodal intrinsic features,which may lead to the low accuracy of aspect term extraction and the poor ability of sentiment prediction due to the insufficient learning of intra-modal features.Given this problem,we propose a Text-Image Feature Fine-grained Learning(TIFFL)model for JMASA.First,we construct an enhanced adjacency matrix of word dependencies and adopt graph convolutional network to learn the syntactic structure features for text,which addresses the context interference problem of identifying different aspect terms.Then,the adjective-noun pairs extracted from image are introduced to enable the semantic representation of visual features more intuitive,which addresses the ambiguous semantic extraction problem during image feature learning.Thereby,the model performance of aspect term extraction and sentiment polarity prediction can be further optimized and enhanced.Experiments on two Twitter benchmark datasets demonstrate that TIFFL achieves competitive results for JMASA,MATE and MASC,thus validating the effectiveness of our proposed methods.
基金Fundamental Research Funds for the Central Universities,China(No.2232021A-10)National Natural Science Foundation of China(No.61903078)+1 种基金Shanghai Sailing Program,China(No.22YF1401300)Natural Science Foundation of Shanghai,China(No.20ZR1400400)。
文摘Video classification is an important task in video understanding and plays a pivotal role in intelligent monitoring of information content.Most existing methods do not consider the multimodal nature of the video,and the modality fusion approach tends to be too simple,often neglecting modality alignment before fusion.This research introduces a novel dual stream multimodal alignment and fusion network named DMAFNet for classifying short videos.The network uses two unimodal encoder modules to extract features within modalities and exploits a multimodal encoder module to learn interaction between modalities.To solve the modality alignment problem,contrastive learning is introduced between two unimodal encoder modules.Additionally,masked language modeling(MLM)and video text matching(VTM)auxiliary tasks are introduced to improve the interaction between video frames and text modalities through backpropagation of loss functions.Diverse experiments prove the efficiency of DMAFNet in multimodal video classification tasks.Compared with other two mainstream baselines,DMAFNet achieves the best results on the 2022 WeChat Big Data Challenge dataset.
文摘In this paper,the sentiment classification method of multimodal adversarial autoencoder is studied.This paper includes the introduction of the multimodal adversarial autoencoder emotion classification method and the experiment of the emotion classification method based on the encoder.The experimental analysis shows that the encoder has higher precision than other encoders in emotion classification.It is hoped that this analysis can provide some reference for the emotion classification under the current intelligent algorithm mode.
文摘With the rapid development of Teaching Chinese as a Foreign Language(TCFL),improving teaching quality requires integrating advanced pedagogical concepts.Multimodal teaching,which employs various symbolic modes to engage students’multiple senses,is a highly effective approach.Introducing multimodal theory into TCFL education can enhance teaching efficiency and improve students’communication skills.This paper applies multimodal theory to TCFL,using the elementary Chinese comprehensive course“My Family”as a case study to propose a detailed teaching design,followed by evaluation and reflection.The aim of this teaching design is to deepen the understanding of multimodal theory and provide additional reference for the TCFL.
基金Supported by the Hunan Province Clinical Medical Technology Innovation Guidance Project,No.2020SK50912Annual Scientific Research Plan Project of Hunan Provincial Health Commission,No.C2019057Hunan Provincial Natural Science Foundation of China,No.2023JJ40381.
文摘BACKGROUND Pancreatic cancer involving the pancreas neck and body often invades the retroperitoneal vessels,making its radical resection challenging.Multimodal treatment strategies,including neoadjuvant therapy,surgery,and postoperative adjuvant therapy,are contributing to a paradigm shift in the treatment of pancreatic cancer.This strategy is also promising in the treatment of pancreatic neckbody cancer.AIM To evaluate the feasibility and effectiveness of a multimodal strategy for the treatment of borderline/locally advanced pancreatic neck-body cancer.METHODS From January 2019 to December 2021,we reviewed the demographic characteristics,neoadjuvant and adjuvant treatment data,intraoperative and postoperative variables,and follow-up outcomes of patients who underwent multimodal treatment for pancreatic neck-body cancer in a prospectively collected database of our hospital.This investigation was reported in line with the Preferred Reporting of Case Series in Surgery criteria.RESULTS A total of 11 patients with pancreatic neck-body cancer were included in this study,of whom 6 patients were borderline resectable and 5 were locally advanced.Through multidisciplinary team discussion,all patients received neoadjuvant therapy,of whom 8(73%)patients achieved a partial response and 3 patients maintained stable disease.After multidisciplinary team reassessment,all patients underwent laparoscopic subtotal distal pancreatectomy and portal vein reconstruction and achieved R0 resection.Postoperatively,two patients(18%)developed ascites,and two patients(18%)developed pancreatic fistulae.The median length of stay of the patients was 11 days(range:10-15 days).All patients received postoperative adjuvant therapy.During the follow-up,three patients experienced tumor recurrence,with a median disease-free survival time of 13.3 months and a median overall survival time of 20.5 months.CONCLUSION A multimodal treatment strategy combining neoadjuvant therapy,laparoscopic subtotal distal pancreatectomy,and adjuvant therapy is safe and feasible in patients with pancreatic neck-body cancer.
基金supported by the National Key Research and Development Program of China(Grant No.2022YFC3004104)the National Natural Science Foundation of China(Grant No.U2342204)+4 种基金the Innovation and Development Program of the China Meteorological Administration(Grant No.CXFZ2024J001)the Open Research Project of the Key Open Laboratory of Hydrology and Meteorology of the China Meteorological Administration(Grant No.23SWQXZ010)the Science and Technology Plan Project of Zhejiang Province(Grant No.2022C03150)the Open Research Fund Project of Anyang National Climate Observatory(Grant No.AYNCOF202401)the Open Bidding for Selecting the Best Candidates Program(Grant No.CMAJBGS202318)。
文摘Thunderstorm wind gusts are small in scale,typically occurring within a range of a few kilometers.It is extremely challenging to monitor and forecast thunderstorm wind gusts using only automatic weather stations.Therefore,it is necessary to establish thunderstorm wind gust identification techniques based on multisource high-resolution observations.This paper introduces a new algorithm,called thunderstorm wind gust identification network(TGNet).It leverages multimodal feature fusion to fuse the temporal and spatial features of thunderstorm wind gust events.The shapelet transform is first used to extract the temporal features of wind speeds from automatic weather stations,which is aimed at distinguishing thunderstorm wind gusts from those caused by synoptic-scale systems or typhoons.Then,the encoder,structured upon the U-shaped network(U-Net)and incorporating recurrent residual convolutional blocks(R2U-Net),is employed to extract the corresponding spatial convective characteristics of satellite,radar,and lightning observations.Finally,by using the multimodal deep fusion module based on multi-head cross-attention,the temporal features of wind speed at each automatic weather station are incorporated into the spatial features to obtain 10-minutely classification of thunderstorm wind gusts.TGNet products have high accuracy,with a critical success index reaching 0.77.Compared with those of U-Net and R2U-Net,the false alarm rate of TGNet products decreases by 31.28%and 24.15%,respectively.The new algorithm provides grid products of thunderstorm wind gusts with a spatial resolution of 0.01°,updated every 10minutes.The results are finer and more accurate,thereby helping to improve the accuracy of operational warnings for thunderstorm wind gusts.
文摘With the increasing global demand for Chinese language,the teaching of Chinese for Specific Purposes(CSP)has occupied an increasingly important position in the teaching of Chinese as a foreign language.However,traditional teaching methods often neglect the role of non-verbal symbols in language comprehension and communication.The multimodal discourse theory provides a new perspective for CSP teaching,which can effectively enhance students’understanding and mastery of specialized terminology and language application skills by integrating multisensory symbol systems such as language,vision,hearing,and touch.This paper starts from the current situation of teaching CSP and analyzes the adaptability between multimodal discourse and CSP teaching,aiming to provide theoretical support and practical suggestions for the innovation of the teaching mode of CSP.
文摘With the development of globalization,intercultural communicative competence has become one of the core qualities of modern college students.As an important platform to cultivate students’language skills and cultural literacy,the innovation of college English teaching mode is essential.Based on this,this paper mainly discusses methods to effectively cultivate students’intercultural communicative competence in college English teaching from the perspective of multimodal interactive teaching mode,hoping to provide references for improving the quality of college English teaching and students’comprehensive quality.
基金Supported by the 135 High-end Talent Project of West China Hospital,Sichuan University,No.ZYDG23029.
文摘BACKGROUND Recent advancements in artificial intelligence(AI)have significantly enhanced the capabilities of endoscopic-assisted diagnosis for gastrointestinal diseases.AI has shown great promise in clinical practice,particularly for diagnostic support,offering real-time insights into complex conditions such as esophageal squamous cell carcinoma.CASE SUMMARY In this study,we introduce a multimodal AI system that successfully identified and delineated a small and flat carcinoma during esophagogastroduodenoscopy,highlighting its potential for early detection of malignancies.The lesion was confirmed as high-grade squamous intraepithelial neoplasia,with pathology results supporting the AI system’s accuracy.The multimodal AI system offers an integrated solution that provides real-time,accurate diagnostic information directly within the endoscopic device interface,allowing for single-monitor use without disrupting endoscopist’s workflow.CONCLUSION This work underscores the transformative potential of AI to enhance endoscopic diagnosis by enabling earlier,more accurate interventions.
基金Supported by Beijing Medical Award Foundation of China,No.YXJL-2023-0638-0048.
文摘BACKGROUND Hepatic artery infusion chemotherapy(HAIC)is a widely used local therapeutic approach for intermediate to advanced-stage hepatocellular carcinoma(HCC),exhibiting considerable efficacy.However,the prevalence of postoperative pain highlights the importance of pain management.Owing to the limitations inherent in existing pain management strategies,this study investigates and assesses the analgesic effectiveness of a multimodal treatment protocol in mitigating pain after HAIC procedures.AIM To provide patients with a more comprehensive and effective pain management strategy.METHODS A total of 100 patients with primary HCC who underwent HAIC were randomly assigned to a control group(n=50)and a multimodal group(n=50).Baseline characteristics and perioperative data were collected.Upon enrollment,patients in the multimodal group received parecoxib(40 mg)30 minutes before HAIC,followed by 48 hours of patient-controlled analgesia with sufentanil.In contrast,the control group underwent standard preoperative preparation(psychological support)and received dezocine(5 mg)intraoperatively,with intravenous flurbiprofen(100 mg)administered every 12 hours for 48 hours postoperatively.RESULTS Compared to the control group,the multimodal analgesia group exhibited significantly lower resting and movement visual analog scale pain scores at postoperative 0,2,4,6,and 12 hours(P<0.05).Furthermore,the multimodal group experienced a reduced incidence of postoperative nausea and vomiting,as well as a lower overall frequency of adverse events,compared to the control group(P<0.05).Patient satisfaction was also significantly higher in the multimodal group than in the control group(P<0.05).CONCLUSION Our study demonstrates that multimodal analgesia is effective in reducing postoperative pain,minimizing adverse reactions,and improving patient satisfaction in HCC patients undergoing HAIC.This approach provides valuable clinical strategies for optimizing pain management in this patient population.
基金supported by Gansu Natural Science Foundation Programme(No.24JRRA231)National Natural Science Foundation of China(No.62061023)Gansu Provincial Education,Science and Technology Innovation and Industry(No.2021CYZC-04)。
文摘Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability to fully extract fused image information.Therefore,a multimodal medical image fusion method based on mask optimization and parallel attention mechanism was proposed to address the aforementioned issues.Firstly,it converted the entire image into a binary mask,and constructed a contour feature map to maximize the contour feature information of the image and a triple path network for image texture detail feature extraction and optimization.Secondly,a contrast enhancement module and a detail preservation module were proposed to enhance the overall brightness and texture details of the image.Afterwards,a parallel attention mechanism was constructed using channel features and spatial feature changes to fuse images and enhance the salient information of the fused images.Finally,a decoupling network composed of residual networks was set up to optimize the information between the fused image and the source image so as to reduce information loss in the fused image.Compared with nine high-level methods proposed in recent years,the seven objective evaluation indicators of our method have improved by 6%−31%,indicating that this method can obtain fusion results with clearer texture details,higher contrast,and smaller pixel differences between the fused image and the source image.It is superior to other comparison algorithms in both subjective and objective indicators.
文摘Computer technology-based PPT is usually conceived as a tool for information transmission and presentation rather than as a type of discourse. Much focus of the previous study on PPT is concerned with its development, design and application. However, PPT itself may actually be regarded as a multimodal discourse comprising multisemiotics, such as linguistic signs, image, graph, sound, color and their interrelated layouts, etc.. So the article attempts to make a multimodal analysis of College English PPT discourse via the principle of reading images by Kress and van Leeuwen in 1996, aiming to present a different angle of interpreting the meaning of composition anchored in PPT.
文摘Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, and multimodality imaging based on nanoparticles has been receiving extensive attention. This new hybrid imaging technology could provide complementary information from different imaging modalities using only a single injection of contrast agent. In this review, we introduce recent developments in multifunctional nanoparticles and their biomedical applications to multimodal imaging and theragnosis as nanomedicine. Most of the reviewed studies are based on the intrinsic properties of nanoparticles and their application in clinical imaging technology. The imaging techniques include positron emission tomography, single-photon emission computed tomography, computerized tomography, magnetic resonance imaging, optical imaging, and ultrasound imaging.
文摘After much controversy, multimodality therapy is now accepted worldwide as the gold standard for treatment of resectable bulky localized gastric cancer. There is significant regional variation in the style of multimodality treatment with adjuvant chemoradiation the North American standard, neoadjuvant chemotherapy preferred in Europe and Australasia, whilst adjuvant chemotherapy is preferred in Asia. With further standardization of surgery and D1+/D2 resections increasingly accepted world wide, and in particular in the West, as the surgical standard of care for potentially curable disease, it is timely to reassess the multimodality regimes being used. The challenge in the use of multimodality therapy is how current outcomes can be standardized and improved further. Recent studies indicate that mere intensification of the regime in time, dosage or addition of further agents does not improve localized gastric cancer outcomes. More novel strategies including early commencement of adjuvant therapies, intra-peritoneal chemotherapy or assessing neoadjuvant response with positron emission tomography scanning may give improvements in outcomes. The introduction of targeted therapies means that the adjuvant use of biological agents needs to be explored. By proper assessment of the patient’s co-morbidities, full tumour staging, and a better understanding of the tumour’s molecular pathology, multimodality therapy for gastric adenocarcinoma may be individualized to optimize the likelihood of cure.
文摘BACKGROUND Surgical resection is a treatment of choice for gallbladder cancer(GBC)patients but only 10%of patients have a resectable disease at presentation.Even after surgical resection,overall survival(OS)has been poor due to high rates of recurrence.Combination of surgery and systemic therapy can improve outcomes in this aggressive disease.AIM To summarize our single-center experience with multimodality management of resectable GBC patients.METHODS Data of all patients undergoing surgery for suspected GBC from January 2012 to December 2018 was retrieved from a prospectively maintained electronic database.Information extracted included demographics,operative and perioperative details,histopathology,neoadjuvant/adjuvant therapy,follow-up,and recurrence.To know the factors associated with recurrence and OS,univariate and multivariate analysis was done using log rank test and cox proportional hazard analysis for categorical and continuous variables,respectively.Multivariate analysis was done using multiple regression analysis.RESULTS Of 274 patients with GBC taken up for surgical resection,172(62.7%)were female and the median age was 56 years.On exploration,102 patients were found to have a metastatic or unresectable disease(distant metastasis in 66 and locally unresectable in 34).Of 172 patients who finally underwent surgery,93(54%)underwent wedge resection followed by anatomical segment IVb/V resection in 66(38.4%)and modified extended right hepatectomy in 12(7%)patients.The postoperative mortality at 90 d was 4.6%.During a median follow-up period of 20 mo,71(41.2%)patients developed recurrence.Estimated 1-,3-,and 5-years OS rates were 86.5%,56%,and 43.5%,respectively.Estimated 1-and 3-year disease free survival(DFS)rates were 75%and 49.2%,respectively.On multivariate analysis,inferior OS was seen with pT3/T4 tumor(P=0.0001),perineural invasion(P=0.0096),and R+resection(P=0.0125).However,only pT3/T4 tumors were associated with a poor DFS(P<0.0001).CONCLUSION Multimodality treatment significantly improves the 5-year survival rate of patients with GBC up to 43%.R+resection,higher T stage,and perineural invasion adversely affect the outcome and should be considered for systemic therapy in addition to surgery to optimize the outcomes.Multimodality treatment of GBC has potential to improve the survival of GBC patients.
基金the National Natural Science Foundation of China(Nos.81630049 and 81501532).
文摘Triple-negative breast cancer(TNBC)is a subtype of breast cancer in which the estrogen receptor and progesterone receptor are not expressed,and human epidermal growth factor receptor 2 is not amplified or overexpressed either,which make the clinical diagnosis and treatment very challenging.Molecular imaging can provide an effective way to diagnose TNBC.Upconversion nanoparticles(UCNPs),are a promising new generation of molecular imaging probes.However,UCNPs still need to be improved for tumor-targeting ability and biocompatibility.This study describes a novel probe based on cancer cell membrane-coated upconversion nanoparticles(CCm-UCNPs),owing to the low immunogenicity and homologous-targeting ability of cancer cell membranes,and modified multifunctional UCNPs.This probe exhibits excellent performance in breast cancer molecular classification and TNBC diagnosis through UCL/MRI/PET tri-modality imaging in vivo.By using this probe,MDA-MB-231 was successfully differentiated between MCF-7 tumor models in vivo.Based on the tumor imaging and molecular classification results,the probe is also expected to be modified for drug delivery in the future,contributing to the treatment of TNBC.The combination of nanoparticles with biomimetic cell membranes has the potential for multiple clinical applications.
文摘Background: We reported our experience with thymic carcinomas and review their clinical features, treatment strategies, and prognoses. Methods: From April 1998 to November 2012, 11 patients pathologically diagnosed with thymic carcinoma and treated in our hospital were investigated. Results: There were 7 men and 4 women, with a median age of 62 years (range, 35 - 72). According to the Masaoka staging system, 3 patients had stage II, 1 stage III disease, 3 stage IVa disease and 4 stage IVb disease. Ten patients had squamous cell carcinoma, whereas 1 had large cell neuroendocrine carcinoma (LCNEC). We performed surgery or multimodality therapy including surgery as the initial therapy for 8 patients. Of the non-surgical cases, 1 patient received chemoradiotherapy and survived for over 6 years without recurrence, whereas 2 received palliative care. Three of 4 patients who underwent complete resection survived without disease recurrence, whereas only 1 patient with LCNEC survived in the incomplete resection group. Multimodality therapy with cisplatin and docetaxel was provided to 3 patients, and recurrence has not been observed in any of the cases. Conclusions: Favorable outcomes could be achieved in patients with thymic carcinoma who underwent intensive treatment. In particular, surgery combined with cisplatin and docetaxel plus thoracic irradiation may be an attractive approach for thymic carcinoma.
文摘Despite the aggressive pursuit of diagnostic and treatment modalities for lung cancer, the treatment outcomes are still not satisfactory, and even patients with surgically resectable non-small cell lung cancer (NSCLC) are often at considerable risk of suffering recurrence and/or death from lung cancer. Regarding the treatment of patients with locally advanced, resectable NSCLC, several retrospective and prospective studies have shown the significance of multimodality treatments with preoperative chemoradiotherapy and surgical treatment. However, no definitive treatment strategies for locally advanced NSCLC patients have yet been established. One of the reasons for the lack of established treatment strategies for patients with locally advanced NSCLC is considered to be the heterogeneity of the population, i.e., cT4N0, cT3-4N1 and cT1a-3N2 tumors are included in stage IIIA disease, and superior sulcus tumors (SSTs) are also included in this classification. With regard to SST, two representative prospective phase II trials indicated the efficacy of surgical treatment following concurrent radiation and chemotherapy. In a study conducted by the Southwest Oncology Group, 110 patients with superior sulcus NSCLC were treated with two cycles of cisplatin and etoposide concurrently with 45 gray (Gy) of radiation, followed by surgical treatment and two additional cycles of chemotherapy postoperatively. The response rate (RR) to the preoperative chemoradiotherapy was 86%, and 83 patients (76%) were able to undergo complete resection. A pathological complete response (CR) was observed in 61 patients (56%), and the five-year survival of all patients and those undergoing complete resection was 44% and 54%, respectively. A phase II study conducted by the Japan Clinical Oncology Group examined the safety and efficacy of preoperative concurrent chemoradiotherapy using mitomycin, vinblastin and cisplatin followed by surgical treatment. Seventy-six patients with SST were enrolled in this study, and all received chemotherapy using two cycles of MVP concurrently with 45 Gy of radiation, followed by surgery. Neoadjuvant chemoradiotherapy resulted in a 61% RR, and pathological complete resection was successfully achieved in 51 patients (68%). A pathological CR was observed in 12 patients (16%), and the disease-free and overall survival rates at five years were 45% and 56%, respectively. Both studies showed the efficacy and tolerability of the multimodality treatment for SST, thus suggesting that multimodality treatment with preoperative chemoradiotherapy followed by surgery may therefore be an effective treatment for resectable SST. We herein review the results of retrospective and prospective studies while assessing the treatment outcomes of NSCLC patients with SST.
文摘Hypertension is currently one of the most prevalent il nesses worldwide,and is the second most common cause of heart failure,only behind ischemic cardiomyopathy.The development of novel multimodality imaging techniques in recent years has broadened the diagnostic methods,risk stratification and monitoring of treatment of cardiovascular diseases available for clinicians.Cardiovascular magnetic resonance(CMR) has a great capacity to evaluate cardiac dimensions and ventricular function,is extremely useful in ruling-out ischemic cardiomyopathy,the evaluation of the vascular system,in making the differential diagnosis for resistant hypertension and risk stratification for hypertensive cardiomyopathy and constitutes today,the method of choice to evaluate left ventricular systolic function.Computed tomography(CT) is the method of choice for the evaluation of vascular anatomy,including coronary arteries,and is also able to provide both functional and structural information.Finally,nuclear cardiology studies have been traditionally used to evaluate myocardial ischemia,along with offering the capacity to evaluate ventricular,endothelial and cardiac innervation function;information that is key in directing the treatment of the patient.In this narrative review,the most recent contributions of multimodality imaging to the patient with hypertension(CMR,CT and nuclear cardiology) will be reviewed.
文摘The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard for diagnosis of IBD, imaging plays a central role in the assessment of extra mural disease, in disease surveillance and in the assessment of response to medical treatments, which are often expensive. Imaging is also vital in the detection and diagnosis of disease related complications, both acute and chronic. In this review, we will describe, with illustrative images, the imaging features of IBD in adults, with emphasis on upto-date imaging techniques focusing predominantly on cross sectional imaging and new magnetic resonance imaging techniques.
