Cloud detection from satellite and drone imagery is crucial for applications such as weather forecasting and environmentalmonitoring.Addressing the limitations of conventional convolutional neural networks,we propose ...Cloud detection from satellite and drone imagery is crucial for applications such as weather forecasting and environmentalmonitoring.Addressing the limitations of conventional convolutional neural networks,we propose an innovative transformer-based method.This method leverages transformers,which are adept at processing data sequences,to enhance cloud detection accuracy.Additionally,we introduce a Cyclic Refinement Architecture that improves the resolution and quality of feature extraction,thereby aiding in the retention of critical details often lost during cloud detection.Our extensive experimental validation shows that our approach significantly outperforms established models,excelling in high-resolution feature extraction and precise cloud segmentation.By integrating Positional Visual Transformers(PVT)with this architecture,our method advances high-resolution feature delineation and segmentation accuracy.Ultimately,our research offers a novel perspective for surmounting traditional challenges in cloud detection and contributes to the advancement of precise and dependable image analysis across various domains.展开更多
Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous human...Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.展开更多
Landslide is one of the multitudinous serious geological hazards. The key to its control and reduction lies on dynamic monitoring and early warning. The article points out the insufficiency of traditional measuring me...Landslide is one of the multitudinous serious geological hazards. The key to its control and reduction lies on dynamic monitoring and early warning. The article points out the insufficiency of traditional measuring means applied for large-scale landslide monitoring and proposes the method for extensive landslide displacement field monitoring using high- resolution remote images. Matching of cognominal points is realized by using the invariant features of SIFT algorithm in image translation, rotation, zooming, and affine transformation, and through recognition and comparison of characteristics of high-resolution images in different landsliding periods. Following that, landslide displacement vector field can be made known by measuring the distances and directions between cognominal points. As evidenced by field application of the method for landslide monitoring at West Open Mine in Fushun city of China, the method has the attraction of being able to make areal measurement through satellite observation and capable of obtaining at the same time the information of large- area intensive displacement field, for facilitating automatic delimitation of extent of landslide displacement vector field and sliding mass. This can serve as a basis for making analysis of laws governing occurrence of landslide and adoption of countermeasures.展开更多
The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resoluti...The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.展开更多
It is proposed a high resolution remote sensing image segmentation method which combines static minimum spanning tree(MST)tessellation considering shape information and the RHMRF-FCM algorithm.It solves the problems i...It is proposed a high resolution remote sensing image segmentation method which combines static minimum spanning tree(MST)tessellation considering shape information and the RHMRF-FCM algorithm.It solves the problems in the traditional pixel-based HMRF-FCM algorithm in which poor noise resistance and low precision segmentation in a complex boundary exist.By using the MST model and shape information,the object boundary and geometrical noise can be expressed and reduced respectively.Firstly,the static MST tessellation is employed for dividing the image domain into some sub-regions corresponding to the components of homogeneous regions needed to be segmented.Secondly,based on the tessellation results,the RHMRF model is built,and regulation terms considering the KL information and the information entropy are introduced into the FCM objective function.Finally,the partial differential method and Lagrange function are employed to calculate the parameters of the fuzzy objective function for obtaining the global optimal segmentation results.To verify the robustness and effectiveness of the proposed algorithm,the experiments are carried out with WorldView-3(WV-3)high resolution image.The results from proposed method with different parameters and comparing methods(multi-resolution method and watershed segmentation method in eCognition software)are analyzed qualitatively and quantitatively.展开更多
While executing tasks such as ocean pollution monitoring,maritime rescue,geographic mapping,and automatic navigation utilizing remote sensing images,the coastline feature should be determined.Traditional methods are n...While executing tasks such as ocean pollution monitoring,maritime rescue,geographic mapping,and automatic navigation utilizing remote sensing images,the coastline feature should be determined.Traditional methods are not satisfactory to extract coastline in high-resolution panchromatic remote sensing image.Active contour model,also called snakes,have proven useful for interactive specification of image contours,so it is used as an effective coastlines extraction technique.Firstly,coastlines are detected by water segmentation and boundary tracking,which are considered initial contours to be optimized through active contour model.As better energy functions are developed,the power assist of snakes becomes effective.New internal energy has been done to reduce problems caused by convergence to local minima,and new external energy can greatly enlarge the capture region around features of interest.After normalization processing,energies are iterated using greedy algorithm to accelerate convergence rate.The experimental results encompassed examples in images and demonstrated the capabilities and efficiencies of the improvement.展开更多
While algorithms have been created for land usage in urban settings,there have been few investigations into the extraction of urban footprint(UF).To address this research gap,the study employs several widely used imag...While algorithms have been created for land usage in urban settings,there have been few investigations into the extraction of urban footprint(UF).To address this research gap,the study employs several widely used image classification method classified into three categories to evaluate their segmentation capabilities for extracting UF across eight cities.The results indicate that pixel-based methods only excel in clear urban environments,and their overall accuracy is not consistently high.RF and SVM perform well but lack stability in object-based UF extraction,influenced by feature selection and classifier performance.Deep learning enhances feature extraction but requires powerful computing and faces challenges with complex urban layouts.SAM excels in medium-sized urban areas but falters in intricate layouts.Integrating traditional and deep learning methods optimizes UF extraction,balancing accuracy and processing efficiency.Future research should focus on adapting algorithms for diverse urban landscapes to enhance UF extraction accuracy and applicability.展开更多
This paper introduces a lightweight remote sensing image dehazing network called multidimensional weight regulation network(MDWR-Net), which addresses the high computational cost of existing methods. Previous works, o...This paper introduces a lightweight remote sensing image dehazing network called multidimensional weight regulation network(MDWR-Net), which addresses the high computational cost of existing methods. Previous works, often based on the encoder-decoder structure and utilizing multiple upsampling and downsampling layers, are computationally expensive. To improve efficiency, the paper proposes two modules: the efficient spatial resolution recovery module(ESRR) for upsampling and the efficient depth information augmentation module(EDIA) for downsampling.These modules not only reduce model complexity but also enhance performance. Additionally, the partial feature weight learning module(PFWL) is introduced to reduce the computational burden by applying weight learning across partial dimensions, rather than using full-channel convolution.To overcome the limitations of convolutional neural networks(CNN)-based networks, the haze distribution index transformer(HDIT) is integrated into the decoder. We also propose the physicalbased non-adjacent feature fusion module(PNFF), which leverages the atmospheric scattering model to improve generalization of our MDWR-Net. The MDWR-Net achieves superior dehazing performance with a computational cost of just 2.98×10^(9) multiply-accumulate operations(MACs),which is less than one-tenth of previous methods. Experimental results validate its effectiveness in balancing performance and computational efficiency.展开更多
The secured access is studied in this paper for the network of the image remote sensing.Each sensor in this network encounters the information security when uploading information of the images wirelessly from the sens...The secured access is studied in this paper for the network of the image remote sensing.Each sensor in this network encounters the information security when uploading information of the images wirelessly from the sensor to the central collection point.In order to enhance the sensing quality for the remote uploading,the passive reflection surface technique is employed.If one eavesdropper that exists nearby this sensor is keeping on accessing the same networks,he may receive the same image from this sensor.Our goal in this paper is to improve the SNR of legitimate collection unit while cut down the SNR of the eavesdropper as much as possible by adaptively adjust the uploading power from this sensor to enhance the security of the remote sensing images.In order to achieve this goal,the secured energy efficiency performance is theoretically analyzed with respect to the number of the passive reflection elements by calculating the instantaneous performance over the channel fading coefficients.Based on this theoretical result,the secured access is formulated as a mathematical optimization problem by adjusting the sensor uploading power as the unknown variables with the objective of the energy efficiency maximization while satisfying any required maximum data rate of the eavesdropper sensor.Finally,the analytical expression is theoretically derived for the optimum uploading power.Numerical simulations verify the design approach.展开更多
Recent years have seen a surge in interest in object detection on remote sensing images for applications such as surveillance andmanagement.However,challenges like small object detection,scale variation,and the presen...Recent years have seen a surge in interest in object detection on remote sensing images for applications such as surveillance andmanagement.However,challenges like small object detection,scale variation,and the presence of closely packed objects in these images hinder accurate detection.Additionally,the motion blur effect further complicates the identification of such objects.To address these issues,we propose enhanced YOLOv9 with a transformer head(YOLOv9-TH).The model introduces an additional prediction head for detecting objects of varying sizes and swaps the original prediction heads for transformer heads to leverage self-attention mechanisms.We further improve YOLOv9-TH using several strategies,including data augmentation,multi-scale testing,multi-model integration,and the introduction of an additional classifier.The cross-stage partial(CSP)method and the ghost convolution hierarchical graph(GCHG)are combined to improve detection accuracy by better utilizing feature maps,widening the receptive field,and precisely extracting multi-scale objects.Additionally,we incorporate the E-SimAM attention mechanism to address low-resolution feature loss.Extensive experiments on the VisDrone2021 and DIOR datasets demonstrate the effectiveness of YOLOv9-TH,showing good improvement in mAP compared to the best existing methods.The YOLOv9-TH-e achieved 54.2% of mAP50 on the VisDrone2021 dataset and 92.3% of mAP on the DIOR dataset.The results confirmthemodel’s robustness and suitability for real-world applications,particularly for small object detection in remote sensing images.展开更多
Forest is the largest carbon reservoir and carbon absorber on earth.Thus,mapping forest cover change accurately is of great significance to achieving the global carbon neutrality goal.Accurate forest change informatio...Forest is the largest carbon reservoir and carbon absorber on earth.Thus,mapping forest cover change accurately is of great significance to achieving the global carbon neutrality goal.Accurate forest change information could be acquired by deep learning methods using high-resolution remote sensing images.However,deforestation detection based on deep learning on a large-scale region with high-resolution images required huge computational resources.Therefore,there was an urgent need for a fast and accurate deforestation detection model.In this study,we proposed an interesting but effective re-parameterization deforestation detection model,named RepDDNet.Unlike other existing models designed for deforestation detection,the main feature of RepDDNet was its decoupling feature,which means that it allowed the multi-branch structure in the training stages to be converted into a plain structure in the inference stage,thus the computation efficiency can be significantly improved in the inference stage while maintaining the accuracy unchanged.A large-scale experiment was carried out in Ankang city with 2-meter high-resolution remote sensing images(the total area of it was over 20,000 square kilometers),and the result indicated that the model computation efficiency could be improved by nearly 30%compared with the model without re-parameterization.Additionally,compared with other lightweight models,RepDDNet also displayed a trade-off between accuracy and computation efficiency.展开更多
The optimum segmentation of ground objects in a landscape is essential for interpretation of high-resolution remotely sensed imagery and detection of objects; and it is also a technical foundation to efficiently use s...The optimum segmentation of ground objects in a landscape is essential for interpretation of high-resolution remotely sensed imagery and detection of objects; and it is also a technical foundation to efficiently use spatial information in remote sensing imagery. Landscapes are complex system composed of a large number of heterogeneous components. There are many explicit homogeneous image objects that have similar spectral character and yet differ from surrounding objects in high-resolution remote sensing imagery. Thereby, a new concept of Distinctive Feature of fractal is put forward and used in deriving Distinctive Feature curve of fractal evolution in multiscale segmentation. Through distinguishing the extremum condition of Distinctive Feature curve and the inclusion relationship of fractals in multiscale representation the Scalar Order is built. This can help to determinate the optimum scale in image segmentation for simple-objects, and the potential meaningful image-object fitting the intrinsic scale of the dominant landscape object can be obtained. Based on the application in high-resolution remote sensing imagery in coastal areas, a satisfactory result was acquired.展开更多
The study of urban area is one of the hottest research topics in the field of remote sensing. With the accumulation of high-resolution(HR) remote sensing data and emerging of new satellite sensors, HR observation of u...The study of urban area is one of the hottest research topics in the field of remote sensing. With the accumulation of high-resolution(HR) remote sensing data and emerging of new satellite sensors, HR observation of urban areas has become increasingly possible, which provides us with more elaborate urban information. However, the strong heterogeneity in the spectral and spatial domain of HR imagery brings great challenges to urban remote sensing. In recent years, numerous approaches were proposed to deal with HR image interpretation over complex urban scenes, including a series of features from low level to high level, as well as state-of-the-art methods depicting not only the urban extent, but also the intra-urban variations. In this paper, we aim to summarize the major advances in HR urban remote sensing from the aspects of feature representation and information extraction. Moreover, the future trends are discussed from the perspectives of methodology, urban structure and pattern characterization, big data challenge, and global mapping.展开更多
The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivot...The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivotal components of image preprocessing,fostering an improvement in the quality of remote sensing imagery.This enhancement renders remote sensing data more indispensable,thereby enhancing the accuracy of target iden-tification.Conventional defogging techniques based on simplistic atmospheric degradation models have proven inadequate for mitigating non-uniform haze within remotely sensed images.In response to this challenge,a novel UNet Residual Attention Network(URA-Net)is proposed.This paradigmatic approach materializes as an end-to-end convolutional neural network distinguished by its utilization of multi-scale dense feature fusion clusters and gated jump connections.The essence of our methodology lies in local feature fusion within dense residual clusters,enabling the extraction of pertinent features from both preceding and current local data,depending on contextual demands.The intelligently orchestrated gated structures facilitate the propagation of these features to the decoder,resulting in superior outcomes in haze removal.Empirical validation through a plethora of experiments substantiates the efficacy of URA-Net,demonstrating its superior performance compared to existing methods when applied to established datasets for remote sensing image defogging.On the RICE-1 dataset,URA-Net achieves a Peak Signal-to-Noise Ratio(PSNR)of 29.07 dB,surpassing the Dark Channel Prior(DCP)by 11.17 dB,the All-in-One Network for Dehazing(AOD)by 7.82 dB,the Optimal Transmission Map and Adaptive Atmospheric Light For Dehazing(OTM-AAL)by 5.37 dB,the Unsupervised Single Image Dehazing(USID)by 8.0 dB,and the Superpixel-based Remote Sensing Image Dehazing(SRD)by 8.5 dB.Particularly noteworthy,on the SateHaze1k dataset,URA-Net attains preeminence in overall performance,yielding defogged images characterized by consistent visual quality.This underscores the contribution of the research to the advancement of remote sensing technology,providing a robust and efficient solution for alleviating the adverse effects of haze on image quality.展开更多
Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential....Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential.In this paper,a novel Fibonacci sine exponential map is designed,the hyperchaotic performance of which is particularly suitable for image encryption algorithms.An encryption algorithm tailored for handling the multi-band attributes of remote sensing images is proposed.The algorithm combines a three-dimensional synchronized scrambled diffusion operation with chaos to efficiently encrypt multiple images.Moreover,the keys are processed using an elliptic curve cryptosystem,eliminating the need for an additional channel to transmit the keys,thus enhancing security.Experimental results and algorithm analysis demonstrate that the algorithm offers strong security and high efficiency,making it suitable for remote sensing image encryption tasks.展开更多
Extracting building contours from aerial images is a fundamental task in remote sensing.Current building extraction methods cannot accurately extract building contour information and have errors in extracting small-sc...Extracting building contours from aerial images is a fundamental task in remote sensing.Current building extraction methods cannot accurately extract building contour information and have errors in extracting small-scale buildings.This paper introduces a novel dense feature iterative(DFI)fusion network,denoted as DFINet,for extracting building contours.The network uses a DFI decoder to fuse semantic information at different scales and learns the building contour knowledge,producing the last features through iterative fusion.The dense feature fusion(DFF)module combines features at multiple scales.We employ the contour reconstruction(CR)module to access the final predictions.Extensive experiments validate the effectiveness of the DFINet on two different remote sensing datasets,INRIA aerial image dataset and Wuhan University(WHU)building dataset.On the INRIA aerial image dataset,our method achieves the highest intersection over union(IoU),overall accuracy(OA)and F 1 scores compared to other state-of-the-art methods.展开更多
The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evalu...The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.展开更多
Background China is progressing towards the goal of schistosomiasis elimination,but there are still some problems,such as difficult management of infection source and snail control.This study aimed to develop deep lea...Background China is progressing towards the goal of schistosomiasis elimination,but there are still some problems,such as difficult management of infection source and snail control.This study aimed to develop deep learning models with high-resolution remote sensing images for recognizing and monitoring livestock bovine,which is an intermediate source of Schistosoma japonicum infection,and to evaluate the effectiveness of the models for real-world application.Methods The dataset of livestock bovine’s spatial distribution was collected from the Chinese National Platform for Common Geospatial Information Services.The high-resolution remote sensing images were further divided into training data,test data,and validation data for model development.Two recognition models based on deep learning methods(ENVINet5 and Mask R-CNN)were developed with reference to the training datasets.The performance of the developed models was evaluated by the performance metrics of precision,recall,and F1-score.Results A total of 50 typical image areas were selected,1125 bovine objectives were labeled by the ENVINet5 model and 1277 bovine objectives were labeled by the Mask R-CNN model.For the ENVINet5 model,a total of 1598 records of bovine distribution were recognized.The model precision and recall were 81.9%and 80.2%,respectively.The F1 score was 0.81.For the Mask R-CNN mode,1679 records of bovine objectives were identified.The model precision and recall were 87.3%and 85.2%,respectively.The F1 score was 0.87.When applying the developed models to real-world schistosomiasis-endemic regions,there were 63 bovine objectives in the original image,53 records were extracted using the ENVINet5 model,and 57 records were extracted using the Mask R-CNN model.The successful recognition ratios were 84.1%and 90.5%for the respectively developed models.Conclusion The ENVINet5 model is very feasible when the bovine distribution is low in structure with few samples.The Mask R-CNN model has a good framework design and runs highly efficiently.The livestock recognition models developed using deep learning methods with high-resolution remote sensing images accurately recognize the spatial distribution of livestock,which could enable precise control of schistosomiasis.展开更多
Shadow detection is a crucial task in high-resolution remote-sensing image processing. Various shadow detection methods have been explored during the last decades. These methods did improve the detection accuracy but ...Shadow detection is a crucial task in high-resolution remote-sensing image processing. Various shadow detection methods have been explored during the last decades. These methods did improve the detection accuracy but are still not robust enough to get satisfactory results for failing to extract enough information from the original images. To take full advantage of various features of shadows, a new method combining edges information with the spectral and spatial information is proposed in this paper. As known, edge is one of the most important characteristics in the high-resolution remote-sensing images. Unfortunately, in shadow detection, it is a high-risk strategy to determine whether a pixel is the edge or not strictly because intensity values on shadow boundaries are always between those in shadow and non-shadow areas. Therefore, a soft edge description model is developed to describe the degree of each pixel belonging to the edges or not. Sequentially, the soft edge description is incorporating to a fuzzy clustering procedure based on HMRF (Hidden Markov Random Fields), in which more appropriate spatial contextual information can be used. More concretely, it consists of two components: the soft edge description model and an iterative shadow detection algorithm. Experiments on several remote sensing images have shown that the proposed method can obtain more accurate shadow detection results.展开更多
This study was to estabIish the forest resources management information system for forest farms based on the B/S structural WebGIS with trial forest farm of Hunan Academy of Forestry as the research field, forest reso...This study was to estabIish the forest resources management information system for forest farms based on the B/S structural WebGIS with trial forest farm of Hunan Academy of Forestry as the research field, forest resources field survey da-ta, ETM+ remote sensing data and basic geographical information data as research material through the extraction of forest resource data in the forest farm, require-ment analysis on the system function and the estabIishment of required software and hardware environment, with the alm to realize the management, query, editing, analysis, statistics and other functions of forest resources information to manage the forest resources.展开更多
基金funded by the Chongqing Normal University Startup Foundation for PhD(22XLB021)supported by the Open Research Project of the State Key Laboratory of Industrial Control Technology,Zhejiang University,China(No.ICT2023B40).
文摘Cloud detection from satellite and drone imagery is crucial for applications such as weather forecasting and environmentalmonitoring.Addressing the limitations of conventional convolutional neural networks,we propose an innovative transformer-based method.This method leverages transformers,which are adept at processing data sequences,to enhance cloud detection accuracy.Additionally,we introduce a Cyclic Refinement Architecture that improves the resolution and quality of feature extraction,thereby aiding in the retention of critical details often lost during cloud detection.Our extensive experimental validation shows that our approach significantly outperforms established models,excelling in high-resolution feature extraction and precise cloud segmentation.By integrating Positional Visual Transformers(PVT)with this architecture,our method advances high-resolution feature delineation and segmentation accuracy.Ultimately,our research offers a novel perspective for surmounting traditional challenges in cloud detection and contributes to the advancement of precise and dependable image analysis across various domains.
基金the National Natural Science Foundation of China(42001408,61806097).
文摘Significant advancements have been achieved in road surface extraction based on high-resolution remote sensingimage processing. Most current methods rely on fully supervised learning, which necessitates enormous humaneffort to label the image. Within this field, other research endeavors utilize weakly supervised methods. Theseapproaches aim to reduce the expenses associated with annotation by leveraging sparsely annotated data, such asscribbles. This paper presents a novel technique called a weakly supervised network using scribble-supervised andedge-mask (WSSE-net). This network is a three-branch network architecture, whereby each branch is equippedwith a distinct decoder module dedicated to road extraction tasks. One of the branches is dedicated to generatingedge masks using edge detection algorithms and optimizing road edge details. The other two branches supervise themodel’s training by employing scribble labels and spreading scribble information throughout the image. To addressthe historical flaw that created pseudo-labels that are not updated with network training, we use mixup to blendprediction results dynamically and continually update new pseudo-labels to steer network training. Our solutiondemonstrates efficient operation by simultaneously considering both edge-mask aid and dynamic pseudo-labelsupport. The studies are conducted on three separate road datasets, which consist primarily of high-resolutionremote-sensing satellite photos and drone images. The experimental findings suggest that our methodologyperforms better than advanced scribble-supervised approaches and specific traditional fully supervised methods.
文摘Landslide is one of the multitudinous serious geological hazards. The key to its control and reduction lies on dynamic monitoring and early warning. The article points out the insufficiency of traditional measuring means applied for large-scale landslide monitoring and proposes the method for extensive landslide displacement field monitoring using high- resolution remote images. Matching of cognominal points is realized by using the invariant features of SIFT algorithm in image translation, rotation, zooming, and affine transformation, and through recognition and comparison of characteristics of high-resolution images in different landsliding periods. Following that, landslide displacement vector field can be made known by measuring the distances and directions between cognominal points. As evidenced by field application of the method for landslide monitoring at West Open Mine in Fushun city of China, the method has the attraction of being able to make areal measurement through satellite observation and capable of obtaining at the same time the information of large- area intensive displacement field, for facilitating automatic delimitation of extent of landslide displacement vector field and sliding mass. This can serve as a basis for making analysis of laws governing occurrence of landslide and adoption of countermeasures.
基金National Natural Science Foundation of China(No.41871305)National Key Research and Development Program of China(No.2017YFC0602204)+2 种基金Fundamental Research Funds for the Central Universities,China University of Geosciences(Wuhan)(No.CUGQY1945)Open Fund of Key Laboratory of Geological Survey and Evaluation of Ministry of Education and the Fundamental Research Funds for the Central Universities(No.GLAB2019ZR02)Open Fund of Laboratory of Urban Land Resources Monitoring and Simulation,Ministry of Natural Resources,China(No.KF-2020-05-068)。
文摘The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.
基金National Natural Science Foundation of China(No.41271435)National Natural Science Foundation of China Youth Found(No.41301479)。
文摘It is proposed a high resolution remote sensing image segmentation method which combines static minimum spanning tree(MST)tessellation considering shape information and the RHMRF-FCM algorithm.It solves the problems in the traditional pixel-based HMRF-FCM algorithm in which poor noise resistance and low precision segmentation in a complex boundary exist.By using the MST model and shape information,the object boundary and geometrical noise can be expressed and reduced respectively.Firstly,the static MST tessellation is employed for dividing the image domain into some sub-regions corresponding to the components of homogeneous regions needed to be segmented.Secondly,based on the tessellation results,the RHMRF model is built,and regulation terms considering the KL information and the information entropy are introduced into the FCM objective function.Finally,the partial differential method and Lagrange function are employed to calculate the parameters of the fuzzy objective function for obtaining the global optimal segmentation results.To verify the robustness and effectiveness of the proposed algorithm,the experiments are carried out with WorldView-3(WV-3)high resolution image.The results from proposed method with different parameters and comparing methods(multi-resolution method and watershed segmentation method in eCognition software)are analyzed qualitatively and quantitatively.
基金Sponsoreds by the National Natural Science Foundation of China (Grant No. 60575016)
文摘While executing tasks such as ocean pollution monitoring,maritime rescue,geographic mapping,and automatic navigation utilizing remote sensing images,the coastline feature should be determined.Traditional methods are not satisfactory to extract coastline in high-resolution panchromatic remote sensing image.Active contour model,also called snakes,have proven useful for interactive specification of image contours,so it is used as an effective coastlines extraction technique.Firstly,coastlines are detected by water segmentation and boundary tracking,which are considered initial contours to be optimized through active contour model.As better energy functions are developed,the power assist of snakes becomes effective.New internal energy has been done to reduce problems caused by convergence to local minima,and new external energy can greatly enlarge the capture region around features of interest.After normalization processing,energies are iterated using greedy algorithm to accelerate convergence rate.The experimental results encompassed examples in images and demonstrated the capabilities and efficiencies of the improvement.
文摘While algorithms have been created for land usage in urban settings,there have been few investigations into the extraction of urban footprint(UF).To address this research gap,the study employs several widely used image classification method classified into three categories to evaluate their segmentation capabilities for extracting UF across eight cities.The results indicate that pixel-based methods only excel in clear urban environments,and their overall accuracy is not consistently high.RF and SVM perform well but lack stability in object-based UF extraction,influenced by feature selection and classifier performance.Deep learning enhances feature extraction but requires powerful computing and faces challenges with complex urban layouts.SAM excels in medium-sized urban areas but falters in intricate layouts.Integrating traditional and deep learning methods optimizes UF extraction,balancing accuracy and processing efficiency.Future research should focus on adapting algorithms for diverse urban landscapes to enhance UF extraction accuracy and applicability.
文摘This paper introduces a lightweight remote sensing image dehazing network called multidimensional weight regulation network(MDWR-Net), which addresses the high computational cost of existing methods. Previous works, often based on the encoder-decoder structure and utilizing multiple upsampling and downsampling layers, are computationally expensive. To improve efficiency, the paper proposes two modules: the efficient spatial resolution recovery module(ESRR) for upsampling and the efficient depth information augmentation module(EDIA) for downsampling.These modules not only reduce model complexity but also enhance performance. Additionally, the partial feature weight learning module(PFWL) is introduced to reduce the computational burden by applying weight learning across partial dimensions, rather than using full-channel convolution.To overcome the limitations of convolutional neural networks(CNN)-based networks, the haze distribution index transformer(HDIT) is integrated into the decoder. We also propose the physicalbased non-adjacent feature fusion module(PNFF), which leverages the atmospheric scattering model to improve generalization of our MDWR-Net. The MDWR-Net achieves superior dehazing performance with a computational cost of just 2.98×10^(9) multiply-accumulate operations(MACs),which is less than one-tenth of previous methods. Experimental results validate its effectiveness in balancing performance and computational efficiency.
基金supported in part by Jiangsu Province High Level“333”Program (0401206044)National Natural Science Foundation of China (61801243,62072255)+4 种基金Program for Scientific Research Foundation for Talented Scholars of Jinling Institute of Technology (JIT-B-202031)University Incubator Foundation of Jinling Institute of Technology (JIT-FHXM-202110)Open Project of Fujian Provincial Key Lab.of Network Security and Cryptology (NSCL-KF2021-02)Open Foundation of National Railway Intelligence Transportation System Engineering Tech.Research Center (RITS2021KF02)China Postdoctoral Science Foundation (2019M651914)。
文摘The secured access is studied in this paper for the network of the image remote sensing.Each sensor in this network encounters the information security when uploading information of the images wirelessly from the sensor to the central collection point.In order to enhance the sensing quality for the remote uploading,the passive reflection surface technique is employed.If one eavesdropper that exists nearby this sensor is keeping on accessing the same networks,he may receive the same image from this sensor.Our goal in this paper is to improve the SNR of legitimate collection unit while cut down the SNR of the eavesdropper as much as possible by adaptively adjust the uploading power from this sensor to enhance the security of the remote sensing images.In order to achieve this goal,the secured energy efficiency performance is theoretically analyzed with respect to the number of the passive reflection elements by calculating the instantaneous performance over the channel fading coefficients.Based on this theoretical result,the secured access is formulated as a mathematical optimization problem by adjusting the sensor uploading power as the unknown variables with the objective of the energy efficiency maximization while satisfying any required maximum data rate of the eavesdropper sensor.Finally,the analytical expression is theoretically derived for the optimum uploading power.Numerical simulations verify the design approach.
文摘Recent years have seen a surge in interest in object detection on remote sensing images for applications such as surveillance andmanagement.However,challenges like small object detection,scale variation,and the presence of closely packed objects in these images hinder accurate detection.Additionally,the motion blur effect further complicates the identification of such objects.To address these issues,we propose enhanced YOLOv9 with a transformer head(YOLOv9-TH).The model introduces an additional prediction head for detecting objects of varying sizes and swaps the original prediction heads for transformer heads to leverage self-attention mechanisms.We further improve YOLOv9-TH using several strategies,including data augmentation,multi-scale testing,multi-model integration,and the introduction of an additional classifier.The cross-stage partial(CSP)method and the ghost convolution hierarchical graph(GCHG)are combined to improve detection accuracy by better utilizing feature maps,widening the receptive field,and precisely extracting multi-scale objects.Additionally,we incorporate the E-SimAM attention mechanism to address low-resolution feature loss.Extensive experiments on the VisDrone2021 and DIOR datasets demonstrate the effectiveness of YOLOv9-TH,showing good improvement in mAP compared to the best existing methods.The YOLOv9-TH-e achieved 54.2% of mAP50 on the VisDrone2021 dataset and 92.3% of mAP on the DIOR dataset.The results confirmthemodel’s robustness and suitability for real-world applications,particularly for small object detection in remote sensing images.
基金supported by the Shenzhen Science and Technology Innovation Project(No.ZDSYS20210623091808026)supported in part by the National Natural Science Foundation of China(General Program,No.42071351)+1 种基金the National Key Research and Development Program of China(No.2020YFA0608501)the Chongqing Science and Technology Bureau technology innovation and application development special(cstc2021jscx-gksb0116).
文摘Forest is the largest carbon reservoir and carbon absorber on earth.Thus,mapping forest cover change accurately is of great significance to achieving the global carbon neutrality goal.Accurate forest change information could be acquired by deep learning methods using high-resolution remote sensing images.However,deforestation detection based on deep learning on a large-scale region with high-resolution images required huge computational resources.Therefore,there was an urgent need for a fast and accurate deforestation detection model.In this study,we proposed an interesting but effective re-parameterization deforestation detection model,named RepDDNet.Unlike other existing models designed for deforestation detection,the main feature of RepDDNet was its decoupling feature,which means that it allowed the multi-branch structure in the training stages to be converted into a plain structure in the inference stage,thus the computation efficiency can be significantly improved in the inference stage while maintaining the accuracy unchanged.A large-scale experiment was carried out in Ankang city with 2-meter high-resolution remote sensing images(the total area of it was over 20,000 square kilometers),and the result indicated that the model computation efficiency could be improved by nearly 30%compared with the model without re-parameterization.Additionally,compared with other lightweight models,RepDDNet also displayed a trade-off between accuracy and computation efficiency.
基金This work was supported by the National Special Project-Chinese Offshore Investigation and Assessment(Grant No.908-01-wy03)the Chinese National'863'High Technology Project(Grant No.2003AA783055)the National Natural Science Foundation of China(Grant No.40576080).
文摘The optimum segmentation of ground objects in a landscape is essential for interpretation of high-resolution remotely sensed imagery and detection of objects; and it is also a technical foundation to efficiently use spatial information in remote sensing imagery. Landscapes are complex system composed of a large number of heterogeneous components. There are many explicit homogeneous image objects that have similar spectral character and yet differ from surrounding objects in high-resolution remote sensing imagery. Thereby, a new concept of Distinctive Feature of fractal is put forward and used in deriving Distinctive Feature curve of fractal evolution in multiscale segmentation. Through distinguishing the extremum condition of Distinctive Feature curve and the inclusion relationship of fractals in multiscale representation the Scalar Order is built. This can help to determinate the optimum scale in image segmentation for simple-objects, and the potential meaningful image-object fitting the intrinsic scale of the dominant landscape object can be obtained. Based on the application in high-resolution remote sensing imagery in coastal areas, a satisfactory result was acquired.
基金supported by the National Natural Science Foundation of China(Grant Nos.41771360&41842035)the National Program for Support of Top-notch Young Professionals+2 种基金the Hubei Provincial Natural Science Foundation of China(Grant No.2017CFA029)the National Key Research and Development Program of China(Grant No.2016YFB0501403)the Shenzhen Science and Technology Program(Grant No.JCYJ20180306170645080)。
文摘The study of urban area is one of the hottest research topics in the field of remote sensing. With the accumulation of high-resolution(HR) remote sensing data and emerging of new satellite sensors, HR observation of urban areas has become increasingly possible, which provides us with more elaborate urban information. However, the strong heterogeneity in the spectral and spatial domain of HR imagery brings great challenges to urban remote sensing. In recent years, numerous approaches were proposed to deal with HR image interpretation over complex urban scenes, including a series of features from low level to high level, as well as state-of-the-art methods depicting not only the urban extent, but also the intra-urban variations. In this paper, we aim to summarize the major advances in HR urban remote sensing from the aspects of feature representation and information extraction. Moreover, the future trends are discussed from the perspectives of methodology, urban structure and pattern characterization, big data challenge, and global mapping.
基金This project is supported by the National Natural Science Foundation of China(NSFC)(No.61902158).
文摘The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivotal components of image preprocessing,fostering an improvement in the quality of remote sensing imagery.This enhancement renders remote sensing data more indispensable,thereby enhancing the accuracy of target iden-tification.Conventional defogging techniques based on simplistic atmospheric degradation models have proven inadequate for mitigating non-uniform haze within remotely sensed images.In response to this challenge,a novel UNet Residual Attention Network(URA-Net)is proposed.This paradigmatic approach materializes as an end-to-end convolutional neural network distinguished by its utilization of multi-scale dense feature fusion clusters and gated jump connections.The essence of our methodology lies in local feature fusion within dense residual clusters,enabling the extraction of pertinent features from both preceding and current local data,depending on contextual demands.The intelligently orchestrated gated structures facilitate the propagation of these features to the decoder,resulting in superior outcomes in haze removal.Empirical validation through a plethora of experiments substantiates the efficacy of URA-Net,demonstrating its superior performance compared to existing methods when applied to established datasets for remote sensing image defogging.On the RICE-1 dataset,URA-Net achieves a Peak Signal-to-Noise Ratio(PSNR)of 29.07 dB,surpassing the Dark Channel Prior(DCP)by 11.17 dB,the All-in-One Network for Dehazing(AOD)by 7.82 dB,the Optimal Transmission Map and Adaptive Atmospheric Light For Dehazing(OTM-AAL)by 5.37 dB,the Unsupervised Single Image Dehazing(USID)by 8.0 dB,and the Superpixel-based Remote Sensing Image Dehazing(SRD)by 8.5 dB.Particularly noteworthy,on the SateHaze1k dataset,URA-Net attains preeminence in overall performance,yielding defogged images characterized by consistent visual quality.This underscores the contribution of the research to the advancement of remote sensing technology,providing a robust and efficient solution for alleviating the adverse effects of haze on image quality.
基金supported by the National Natural Science Foundation of China(Grant No.91948303)。
文摘Remote sensing images carry crucial ground information,often involving the spatial distribution and spatiotemporal changes of surface elements.To safeguard this sensitive data,image encryption technology is essential.In this paper,a novel Fibonacci sine exponential map is designed,the hyperchaotic performance of which is particularly suitable for image encryption algorithms.An encryption algorithm tailored for handling the multi-band attributes of remote sensing images is proposed.The algorithm combines a three-dimensional synchronized scrambled diffusion operation with chaos to efficiently encrypt multiple images.Moreover,the keys are processed using an elliptic curve cryptosystem,eliminating the need for an additional channel to transmit the keys,thus enhancing security.Experimental results and algorithm analysis demonstrate that the algorithm offers strong security and high efficiency,making it suitable for remote sensing image encryption tasks.
基金National Natural Science Foundation of China(No.61903078)Fundamental Research Funds for the Central Universities,China(No.2232021A-10)+1 种基金Shanghai Sailing Program,China(No.22YF1401300)Natural Science Foundation of Shanghai,China(No.20ZR1400400)。
文摘Extracting building contours from aerial images is a fundamental task in remote sensing.Current building extraction methods cannot accurately extract building contour information and have errors in extracting small-scale buildings.This paper introduces a novel dense feature iterative(DFI)fusion network,denoted as DFINet,for extracting building contours.The network uses a DFI decoder to fuse semantic information at different scales and learns the building contour knowledge,producing the last features through iterative fusion.The dense feature fusion(DFF)module combines features at multiple scales.We employ the contour reconstruction(CR)module to access the final predictions.Extensive experiments validate the effectiveness of the DFINet on two different remote sensing datasets,INRIA aerial image dataset and Wuhan University(WHU)building dataset.On the INRIA aerial image dataset,our method achieves the highest intersection over union(IoU),overall accuracy(OA)and F 1 scores compared to other state-of-the-art methods.
基金supported by the National Natural Science Foundation of China(Grant Nos.42090054,41931295)the Natural Science Foundation of Hubei Province of China(2022CFA002)。
文摘The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.
基金National Natural Science Foundation of China(No.32161143036,No.82173633,No.81960374)Science and Technology research project of Shanghai Municipal Health Commission(No.20194Y0359)National Key Research and Development Program of China(No.2021YFC2300800,2021YFC2300803)
文摘Background China is progressing towards the goal of schistosomiasis elimination,but there are still some problems,such as difficult management of infection source and snail control.This study aimed to develop deep learning models with high-resolution remote sensing images for recognizing and monitoring livestock bovine,which is an intermediate source of Schistosoma japonicum infection,and to evaluate the effectiveness of the models for real-world application.Methods The dataset of livestock bovine’s spatial distribution was collected from the Chinese National Platform for Common Geospatial Information Services.The high-resolution remote sensing images were further divided into training data,test data,and validation data for model development.Two recognition models based on deep learning methods(ENVINet5 and Mask R-CNN)were developed with reference to the training datasets.The performance of the developed models was evaluated by the performance metrics of precision,recall,and F1-score.Results A total of 50 typical image areas were selected,1125 bovine objectives were labeled by the ENVINet5 model and 1277 bovine objectives were labeled by the Mask R-CNN model.For the ENVINet5 model,a total of 1598 records of bovine distribution were recognized.The model precision and recall were 81.9%and 80.2%,respectively.The F1 score was 0.81.For the Mask R-CNN mode,1679 records of bovine objectives were identified.The model precision and recall were 87.3%and 85.2%,respectively.The F1 score was 0.87.When applying the developed models to real-world schistosomiasis-endemic regions,there were 63 bovine objectives in the original image,53 records were extracted using the ENVINet5 model,and 57 records were extracted using the Mask R-CNN model.The successful recognition ratios were 84.1%and 90.5%for the respectively developed models.Conclusion The ENVINet5 model is very feasible when the bovine distribution is low in structure with few samples.The Mask R-CNN model has a good framework design and runs highly efficiently.The livestock recognition models developed using deep learning methods with high-resolution remote sensing images accurately recognize the spatial distribution of livestock,which could enable precise control of schistosomiasis.
文摘Shadow detection is a crucial task in high-resolution remote-sensing image processing. Various shadow detection methods have been explored during the last decades. These methods did improve the detection accuracy but are still not robust enough to get satisfactory results for failing to extract enough information from the original images. To take full advantage of various features of shadows, a new method combining edges information with the spectral and spatial information is proposed in this paper. As known, edge is one of the most important characteristics in the high-resolution remote-sensing images. Unfortunately, in shadow detection, it is a high-risk strategy to determine whether a pixel is the edge or not strictly because intensity values on shadow boundaries are always between those in shadow and non-shadow areas. Therefore, a soft edge description model is developed to describe the degree of each pixel belonging to the edges or not. Sequentially, the soft edge description is incorporating to a fuzzy clustering procedure based on HMRF (Hidden Markov Random Fields), in which more appropriate spatial contextual information can be used. More concretely, it consists of two components: the soft edge description model and an iterative shadow detection algorithm. Experiments on several remote sensing images have shown that the proposed method can obtain more accurate shadow detection results.
文摘This study was to estabIish the forest resources management information system for forest farms based on the B/S structural WebGIS with trial forest farm of Hunan Academy of Forestry as the research field, forest resources field survey da-ta, ETM+ remote sensing data and basic geographical information data as research material through the extraction of forest resource data in the forest farm, require-ment analysis on the system function and the estabIishment of required software and hardware environment, with the alm to realize the management, query, editing, analysis, statistics and other functions of forest resources information to manage the forest resources.