In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds ...In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds of setups which are able to transform non-visible into visible light imaging,wherein their computing process is replaced by a camera integration mode.The image captured by the camera has a low contrast,so here we present an algorithm that can realize a high quality image in near-infrared to visible cross-waveband imaging.The scheme is verified both by simulation and in actual experiments.The setups demonstrate the great potential for single-pixel imaging and high-speed cross-waveband imaging for future practical applications.展开更多
The rapid development of artificial intelligence(AI)facilitates various applications from all areas but also poses great challenges in its hardware implementation in terms of speed and energy because of the explosive ...The rapid development of artificial intelligence(AI)facilitates various applications from all areas but also poses great challenges in its hardware implementation in terms of speed and energy because of the explosive growth of data.Optical computing provides a distinctive perspective to address this bottleneck by harnessing the unique properties of photons including broad bandwidth,low latency,and high energy efficiency.In this review,we introduce the latest developments of optical computing for different AI models,including feedforward neural networks,reservoir computing,and spiking neural networks(SNNs).Recent progress in integrated photonic devices,combined with the rise of AI,provides a great opportunity for the renaissance of optical computing in practical applications.This effort requires multidisciplinary efforts from a broad community.This review provides an overview of the state-of-the-art accomplishments in recent years,discusses the availability of current technologies,and points out various remaining challenges in different aspects to push the frontier.We anticipate that the era of large-scale integrated photonics processors will soon arrive for practical AI applications in the form of hybrid optoelectronic frameworks.展开更多
Object identification and three-dimensional reconstruction techniques are always attractive research interests in machine vision,virtual reality,augmented reality,and biomedical engineering.Optical computing metasurfa...Object identification and three-dimensional reconstruction techniques are always attractive research interests in machine vision,virtual reality,augmented reality,and biomedical engineering.Optical computing metasurface,as a two-dimensional artificial design component,has displayed the supernormal character of controlling phase,amplitude,polarization,and frequency distributions of the light beam,capable of performing mathematical operations on the input light field.Here,we propose and demonstrate an all-optical object identification technique based on optical computing metasurface,and apply it to 3D reconstruction.Unlike traditional mechanisms,this scheme reduces memory consumption in the processing of the contour surface extraction.The identification and reconstruction of experimental results from high-contrast and low-contrast objects agree well with the real objects.The exploration of the all-optical object identification and 3D reconstruction techniques provides potential applications of high efficiencies,low consumption,and compact systems.展开更多
Orbital angular momentum(OAM),emerging as an inherently high-dimensional property of photons,has boosted information capacity in optical communications.However,the potential of OAM in optical computing remains almost ...Orbital angular momentum(OAM),emerging as an inherently high-dimensional property of photons,has boosted information capacity in optical communications.However,the potential of OAM in optical computing remains almost unexplored.Here,we present a highly efficient optical computing protocol for complex vector convolution with the superposition of high-dimensional OAM eigenmodes.We used two cascaded spatial light modulators to prepare suitable OAM superpositions to encode two complex vectors.Then,a deep-learning strategy is devised to decode the complex OAM spectrum,thus accomplishing the optical convolution task.In our experiment,we succeed in demonstrating 7-,9-,and 11-dimensional complex vector convolutions,in which an average proximity better than 95%and a mean relative error<6%are achieved.Our present scheme can be extended to incorporate other degrees of freedom for a more versatile optical computing in the high-dimensional Hilbert space.展开更多
With the advancement of artificial intelligence,optic in-sensing reservoir computing based on emerging semiconductor devices is high desirable for real-time analog signal processing.Here,we disclose a flexible optomem...With the advancement of artificial intelligence,optic in-sensing reservoir computing based on emerging semiconductor devices is high desirable for real-time analog signal processing.Here,we disclose a flexible optomemristor based on C_(27)H_(30)O_(15)/FeOx heterostructure that presents a highly sensitive to the light stimuli and artificial optic synaptic features such as short-and long-term plasticity(STP and LTP),enabling the developed optomemristor to implement complex analogy signal processing through building a real-physical dynamic-based in-sensing reservoir computing algorithm and yielding an accuracy of 94.88%for speech recognition.The charge trapping and detrapping mediated by the optic active layer of C_(27)H_(30)O_(15) that is extracted from the lotus flower is response for the positive photoconductance memory in the prepared optomemristor.This work provides a feasible organic−inorganic heterostructure as well as an optic in-sensing vision computing for an advanced optic computing system in future complex signal processing.展开更多
Optical directed logic(DL)is a novel logic operation scheme that employs electrical signals as operands to control the working states of optical switches to perform the logic functions.This review first provides an ov...Optical directed logic(DL)is a novel logic operation scheme that employs electrical signals as operands to control the working states of optical switches to perform the logic functions.This review first provides an overview of the concept and working principle of DL.The developing trends of DL computing are then discussed in detail,including the fundamental optical DL gates,combinational optical DL operations,reconfigurable logic computing,low power optical logic computing,and programmable photonic network.The concluding remarks provide an outlook on the DL future development and its impacts in optical computing.展开更多
Optical computing and optical neural network have gained increasing attention in recent years because of their potential advantages of parallel processing at the speed of light and low power consumption by comparison ...Optical computing and optical neural network have gained increasing attention in recent years because of their potential advantages of parallel processing at the speed of light and low power consumption by comparison with electronic computing.The optical implementation of the fundamental building blocks of a digital computer,i.e.logic gates,has been investigated extensively in the past few decades.Optical logic gate computing is an alternative approach to various analogue optical computing architectures.In this paper,the latest development of optical logic gate computing with different kinds of implementations is reviewed.Firstly,the basic concepts of analogue and digital computing with logic gates in the electronic and optical domains are introduced.And then a comprehensive summary of various optical logic gate schemes including spatial encoding of light field,semiconductor optical amplifiers(SOA),highly nonlinear fiber(HNLF),microscale and nanoscale waveguides,and photonic crystal structures is presented.To conclude,the formidable challenges in developing practical all-optical logic gates are analyzed and the prospects of the future are discussed.展开更多
On-chip diffractive optical neural networks(DONNs)bring the advantages of parallel processing and low energy consumption.However,an accurate representation of the optical field’s evolution in the structure cannot be ...On-chip diffractive optical neural networks(DONNs)bring the advantages of parallel processing and low energy consumption.However,an accurate representation of the optical field’s evolution in the structure cannot be provided using the previous diffraction-based analysis method.Moreover,the loss caused by the open boundaries poses challenges to applications.A multimode DONN architecture based on a more precise eigenmode analysis method is proposed.We have constructed a universal library of input,output,and metaline structures utilizing this method,and realized a multimode DONN composed of the structures from the library.On the designed multimode DONNs with only one layer of the metaline,the classification task of an Iris plants dataset is verified with an accuracy of 90%on the blind test dataset,and the performance of the one-bit binary adder task is also validated.Compared to the previous architectures,the multimode DONN exhibits a more compact design and higher energy efficiency.展开更多
The explosive growth of data and information has motivated various emerging non-von Neumann computational approaches in the More-than-Moore era.Photonics neuromorphic computing has attracted lots of attention due to t...The explosive growth of data and information has motivated various emerging non-von Neumann computational approaches in the More-than-Moore era.Photonics neuromorphic computing has attracted lots of attention due to the fascinating advantages such as high speed,wide bandwidth,and massive parallelism.Here,we offer a review on the optical neural computing in our research groups at the device and system levels.The photonics neuron and photonics synapse plasticity are presented.In addition,we introduce several optical neural computing architectures and algorithms including photonic spiking neural network,photonic convolutional neural network,photonic matrix computation,photonic reservoir computing,and photonic reinforcement learning.Finally,we summarize the major challenges faced by photonic neuromorphic computing,and propose promising solutions and perspectives.展开更多
The ultimate goal of artificial intelligence(AI)is to mimic the human brain to perform decision-making and control directly from high-dimensional sensory input.Diffractive optical networks(DONs)provide a promising sol...The ultimate goal of artificial intelligence(AI)is to mimic the human brain to perform decision-making and control directly from high-dimensional sensory input.Diffractive optical networks(DONs)provide a promising solution for implementing AI with high speed and low power-consumption.Most reported DONs focus on tasks that do not involve environmental interaction,such as object recognition and image classification.By contrast,the networks capable of decision-making and control have not been developed.Here,we propose using deep reinforcement learning to implement DONs that imitate human-level decisionmaking and control capability.Such networks,which take advantage of a residual architecture,allow finding optimal control policies through interaction with the environment and can be readily implemented with existing optical devices.The superior performance is verified using three types of classic games:tic-tac-toe,Super Mario Bros.,and Car Racing.Finally,we present an experimental demonstration of playing tic-tac-toe using the network based on a spatial light modulator.Our work represents a solid step forward in advancing DONs,which promises a fundamental shift from simple recognition or classification tasks to the high-level sensory capability of AI.It may find exciting applications in autonomous driving,intelligent robots,and intelligent manufacturing.展开更多
We utilize three parallel reservoir computers using semiconductor lasers with optical feedback and light injection to model radar probe signals with delays.Three radar probe signals are generated by driving lasers con...We utilize three parallel reservoir computers using semiconductor lasers with optical feedback and light injection to model radar probe signals with delays.Three radar probe signals are generated by driving lasers constructed by a threeelement laser array with self-feedback.The response lasers are implemented also by a three-element lase array with both delay-time feedback and optical injection,which are utilized as nonlinear nodes to realize the reservoirs.We show that each delayed radar probe signal can be predicted well and to synchronize with its corresponding trained reservoir,even when parameter mismatches exist between the response laser array and the driving laser array.Based on this,the three synchronous probe signals are utilized for ranging to three targets,respectively,using Hilbert transform.It is demonstrated that the relative errors for ranging can be very small and less than 0.6%.Our findings show that optical reservoir computing provides an effective way for applications of target ranging.展开更多
Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The cu...Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The current ORC employs single-dimensional encoding for computation,which limits input resolution and introduces extraneous information due to interactions between optical dimensions during propagation,thus constraining performance.Here,we propose complex-value encoding-based optoelectronic reservoir computing(CE-ORC),in which the amplitude and phase of the input optical field are both modulated to improve the input resolution and prevent the influence of extraneous information on computation.In addition,scale factors in the amplitude encoding can fine-tune the optical reservoir dynamics for better performance.We built a CE-ORC processing unit with an iteration rate of up to∼1.2 kHz using high-speed communication interfaces and field programmable gate arrays(FPGAs)and demonstrated the excellent performance of CE-ORC in two time series prediction tasks.In comparison with the conventional ORC for the Mackey–Glass task,CE-ORC showed a decrease in normalized mean square error by∼75%.Furthermore,we applied this method in a weather time series analysis and effectively predicted the temperature and humidity within a range of 24 h.展开更多
The next-generation optical network is a service oriented network,which could be delivered by utilizing the generalized multiprotocol label switching(GMPLS) based control plane to realize lots of intelligent features ...The next-generation optical network is a service oriented network,which could be delivered by utilizing the generalized multiprotocol label switching(GMPLS) based control plane to realize lots of intelligent features such as rapid provisioning,automated protection and restoration(P&R),efficient resource allocation,and support for different quality of service(QoS) requirements.In this paper,we propose a novel stateful PCE-cloud(SPC)based architecture of GMPLS optical networks for cloud services.The cloud computing technologies(e.g.virtualization and parallel computing) are applied to the construction of SPC for improving the reliability and maximizing resource utilization.The functions of SPC and GMPLS based control plane are expanded according to the features of cloud services for different QoS requirements.The architecture and detailed description of the components of SPC are provided.Different potential cooperation relationships between public stateful PCE cloud(PSPC) and region stateful PCE cloud(RSPC) are investigated.Moreover,we present the policy-enabled and constraint-based routing scheme base on the cooperation of PSPC and RSPC.Simulation results for verifying the performance of routing and control plane reliability are analyzed.展开更多
Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent com...Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent computing, subverting the imaging mechanism of traditional optical imaging which only relies on orderly information transmission. To meet the high-precision requirements of traditional optical imaging for optical processing and adjustment, as well as to solve its problems of being sensitive to gravity and temperature in use, we establish an optical imaging system model from the perspective of computational optical imaging and studies how to design and solve the imaging consistency problem of optical system under the influence of gravity, thermal effect, stress, and other external environment to build a high robustness optical system. The results show that the high robustness interval of the optical system exists and can effectively reduce the sensitivity of the optical system to the disturbance of each link, thus realizing the high robustness of optical imaging.展开更多
As an optical processor,a diffractive deep neural network(D2NN)utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing,completing its tasks at the speed...As an optical processor,a diffractive deep neural network(D2NN)utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing,completing its tasks at the speed of light propagation through thin optical layers.With sufficient degrees of freedom,D2NNs can perform arbitrary complex-valued linear transformations using spatially coherent light.Similarly,D2NNs can also perform arbitrary linear intensity transformations with spatially incoherent illumination;however,under spatially incoherent light,these transformations are nonnegative,acting on diffraction-limited optical intensity patterns at the input field of view.Here,we expand the use of spatially incoherent D2NNs to complex-valued information processing for executing arbitrary complex-valued linear transformations using spatially incoherent light.Through simulations,we show that as the number of optimized diffractive features increases beyond a threshold dictated by the multiplication of the input and output space-bandwidth products,a spatially incoherent diffractive visual processor can approximate any complex-valued linear transformation and be used for all-optical image encryption using incoherent illumination.The findings are important for the all-optical processing of information under natural light using various forms of diffractive surface-based optical processors.展开更多
Photonic signal processing offers a versatile and promising toolkit for contemporary scenarios ranging from digital optical communication to analog microwave operation.Compared to its electronic counterpart,it elimina...Photonic signal processing offers a versatile and promising toolkit for contemporary scenarios ranging from digital optical communication to analog microwave operation.Compared to its electronic counterpart,it eliminates inherent bandwidth limitations and meanwhile exhibits the potential to provide unparalleled scalability and flexibility,particularly through integrated photonics.However,by far the on-chip solutions for optical signal processing are often tailored to specific tasks,which lacks versatility across diverse applications.Here,we propose a streamlined chip-level signal processing architecture that integrates different active and passive building blocks in silicon-on-insulator(SOI)platform with a compact and efficient manner.Comprehensive and in-depth analyses for the architecture are conducted at levels of device,system,and application.Accompanied by appropriate configuring schemes,the photonic circuitry supports loading and processing both analog and digital signals simultaneously.Three distinct tasks are facilitated with one single chip across several mainstream fields,spanning optical computing,microwave photonics,and optical communications.Notably,it has demonstrated competitive performance in functions like image processing,spectrum filtering,and electro-optical bandwidth equalization.Boasting high universality and a compact form factor,the proposed architecture is poised to be instrumental for next-generation functional fusion systems.展开更多
Optics is an exciting route for the next generation of computing hardware for machine learning,promising several orders of magnitude enhancement in both computational speed and energy efficiency.However, reaching the ...Optics is an exciting route for the next generation of computing hardware for machine learning,promising several orders of magnitude enhancement in both computational speed and energy efficiency.However, reaching the full capacity of an optical neural network(NN) necessitates that the computing be implemented optically not only for inference but also for training. The primary algorithm for network training is backpropagation, in which the calculation is performed in the order opposite to the information flow for inference. Although straightforward in a digital computer, the optical implementation of backpropagation has remained elusive, particularly because of the conflicting requirements for the optical element that implements the nonlinear activation function. We address this challenge for the first time, we believe, with a surprisingly simple scheme, employing saturable absorbers for the role of activation units. Our approach is adaptable to various analog platforms and materials and demonstrates the possibility of constructing NNs entirely reliant on analog optical processes for both training and inference tasks.展开更多
Despite more than 40 years of development,it remains difficult for optical logic computing to support more than four operands because the high parallelism of light has not been fully exploited in current methods that ...Despite more than 40 years of development,it remains difficult for optical logic computing to support more than four operands because the high parallelism of light has not been fully exploited in current methods that are restrained by inefficient optical nonlinearity and redundant input modulation.In this paper,we propose a large-scale optical programmable logic array(PLA)based on parallel spectrum modulation.By fully exploiting the wavelength resource,an eight-input PLA is experimentally demonstrated with 256 wavelength channels.And it is extended to nine-input PLA through the combination of wavelength’s and spatial dimensions.Based on PLA,many advanced logic functions like 8-256 decoder,4-bit comparator,adder and multiplier,and state machines are first realized in optics.We implement the two-dimensional optical cellular automaton(CA)for what we believe is the first time and run Conway’s Game of Life to simulate the complex evolutionary processes(pulsar explosion,glider gun,and breeder).Other CA models,such as the replicator-like evolution and the nonisotropic evolution to generate the Sierpinski triangle are also demonstrated.Our work significantly alleviates the challenge of scalability in optical logic devices and provides a universal optical computing platform for two-dimensional CA.展开更多
The photonic spin Hall effect(SHE)refers to the transverse spin separation of photons with opposite spin angular momentum,after the beam passes through an optical interface or inhomogeneous medium,manifested as the sp...The photonic spin Hall effect(SHE)refers to the transverse spin separation of photons with opposite spin angular momentum,after the beam passes through an optical interface or inhomogeneous medium,manifested as the spin-dependent splitting.It can be considered as an analogue of the SHE in electronic systems:the light’s right-circularly polarized and left-circularly polarized components play the role of the spin-up and spin-down electrons,and the refractive index gradient replaces the electronic potential gradient.Remarkably,the photonic SHE originates from the spin-orbit interaction of the photons and is mainly attributed to two different geometric phases,i.e.,the spin-redirection Rytov-Vlasimirskii-Berry in momentum space and the Pancharatnam-Berry phase in Stokes parameter space.The unique properties of the photonic SHE and its powerful ability to manipulate the photon spin,gradually,make it a useful tool in precision metrology,analog optical computing and quantum imaging,etc.In this review,we provide a brief framework to describe the fundamentals and advances of photonic SHE,and give an overview on the emergent applications of this phenomenon in different scenes.展开更多
文摘In a single-pixel fast imaging setup,the data collected by the single-pixel detector needs to be processed by a computer,but the speed of the latter will affect the image reconstruction time.Here we propose two kinds of setups which are able to transform non-visible into visible light imaging,wherein their computing process is replaced by a camera integration mode.The image captured by the camera has a low contrast,so here we present an algorithm that can realize a high quality image in near-infrared to visible cross-waveband imaging.The scheme is verified both by simulation and in actual experiments.The setups demonstrate the great potential for single-pixel imaging and high-speed cross-waveband imaging for future practical applications.
基金supported by the National Natural Science Foundation of China(61927802,61722209,and 61805145)the Beijing Municipal Science and Technology Commission(Z181100003118014)+3 种基金the National Key Research and Development Program of China(2020AAA0130000)the support from the National Postdoctoral Program for Innovative TalentShuimu Tsinghua Scholar Programthe support from the Hong Kong Research Grants Council(16306220)。
文摘The rapid development of artificial intelligence(AI)facilitates various applications from all areas but also poses great challenges in its hardware implementation in terms of speed and energy because of the explosive growth of data.Optical computing provides a distinctive perspective to address this bottleneck by harnessing the unique properties of photons including broad bandwidth,low latency,and high energy efficiency.In this review,we introduce the latest developments of optical computing for different AI models,including feedforward neural networks,reservoir computing,and spiking neural networks(SNNs).Recent progress in integrated photonic devices,combined with the rise of AI,provides a great opportunity for the renaissance of optical computing in practical applications.This effort requires multidisciplinary efforts from a broad community.This review provides an overview of the state-of-the-art accomplishments in recent years,discusses the availability of current technologies,and points out various remaining challenges in different aspects to push the frontier.We anticipate that the era of large-scale integrated photonics processors will soon arrive for practical AI applications in the form of hybrid optoelectronic frameworks.
基金support from the National Natural Science Foundation of China(Grant Nos.12174097 and 12304321)the Natural Science Foundation of Hunan Province(Grant Nos.2021JJ10008 and 2023JJ40202)the Research Foundation of Education Bureau of Hunan Province(Grant No.22B0871).
文摘Object identification and three-dimensional reconstruction techniques are always attractive research interests in machine vision,virtual reality,augmented reality,and biomedical engineering.Optical computing metasurface,as a two-dimensional artificial design component,has displayed the supernormal character of controlling phase,amplitude,polarization,and frequency distributions of the light beam,capable of performing mathematical operations on the input light field.Here,we propose and demonstrate an all-optical object identification technique based on optical computing metasurface,and apply it to 3D reconstruction.Unlike traditional mechanisms,this scheme reduces memory consumption in the processing of the contour surface extraction.The identification and reconstruction of experimental results from high-contrast and low-contrast objects agree well with the real objects.The exploration of the all-optical object identification and 3D reconstruction techniques provides potential applications of high efficiencies,low consumption,and compact systems.
基金supported by the National Natural Science Foundation of China(Grant Nos.12034016,61975169,and 11904303)the Youth Innovation Fund of Xiamen(Grant No.3502Z20206045)+2 种基金the Fundamental Research Funds for the Central Universities at Xiamen University(Grant Nos.20720200074 and 20720220030)the Natural Science Foundation of Fujian Province of China(Grant No.2021J02002)and for Distinguished Young Scientists(Grant No.2015J06002)the Program for New Century Excellent Talents in University of China(Grant No.NCET-13-0495).
文摘Orbital angular momentum(OAM),emerging as an inherently high-dimensional property of photons,has boosted information capacity in optical communications.However,the potential of OAM in optical computing remains almost unexplored.Here,we present a highly efficient optical computing protocol for complex vector convolution with the superposition of high-dimensional OAM eigenmodes.We used two cascaded spatial light modulators to prepare suitable OAM superpositions to encode two complex vectors.Then,a deep-learning strategy is devised to decode the complex OAM spectrum,thus accomplishing the optical convolution task.In our experiment,we succeed in demonstrating 7-,9-,and 11-dimensional complex vector convolutions,in which an average proximity better than 95%and a mean relative error<6%are achieved.Our present scheme can be extended to incorporate other degrees of freedom for a more versatile optical computing in the high-dimensional Hilbert space.
基金supported by the Key Project of Chongqing Natural Science Foundation Joint Fund[CSTB2023NSCQ-LZX0103,(G.Z.)]Chongqing Natural Science Foundation[CSTB2024NSCQ-MSX0012,(C.L.)]+1 种基金Fundamental Research Funds for the Central Universities[SWUZLPY03,(G.Z.)]Fundamental Research Funds for the Central Universities[Swu020019,(G.Z.):SWU-XDJH202319,(G.Z.)1].
文摘With the advancement of artificial intelligence,optic in-sensing reservoir computing based on emerging semiconductor devices is high desirable for real-time analog signal processing.Here,we disclose a flexible optomemristor based on C_(27)H_(30)O_(15)/FeOx heterostructure that presents a highly sensitive to the light stimuli and artificial optic synaptic features such as short-and long-term plasticity(STP and LTP),enabling the developed optomemristor to implement complex analogy signal processing through building a real-physical dynamic-based in-sensing reservoir computing algorithm and yielding an accuracy of 94.88%for speech recognition.The charge trapping and detrapping mediated by the optic active layer of C_(27)H_(30)O_(15) that is extracted from the lotus flower is response for the positive photoconductance memory in the prepared optomemristor.This work provides a feasible organic−inorganic heterostructure as well as an optic in-sensing vision computing for an advanced optic computing system in future complex signal processing.
基金This work was partially supported by the National Key R&D Program of China(No.2019YFB2205204)the Open Project Program of Wuhan National Laboratory for Optoelectronics(No.2019WNLOKF003)+1 种基金the“Shuguang Program”supported by the Shanghai Education Development Foundation and Shanghai Municipal Education Commission,the Fundamental Research Funds for the Central Universities(No.lzujbky-2021-pd11)the National Natural Science Foundation of China(Grant Nos.61875120 and 62075091).
文摘Optical directed logic(DL)is a novel logic operation scheme that employs electrical signals as operands to control the working states of optical switches to perform the logic functions.This review first provides an overview of the concept and working principle of DL.The developing trends of DL computing are then discussed in detail,including the fundamental optical DL gates,combinational optical DL operations,reconfigurable logic computing,low power optical logic computing,and programmable photonic network.The concluding remarks provide an outlook on the DL future development and its impacts in optical computing.
基金supported by the National Key Research and Development Program of China(Grants No.2021YFA1401500)the National Natural Science Foundation of China(12022416)+3 种基金the Department of Natural Resources of Guangdong Province(No.GDNRC[2022]22)Department of Science and Technology of Guangdong Province(No.2021A0505080002)Intelligent Laser Basic Research Laboratory(No.PCL2021A14-B1)the Hong Kong Research Grants Council(16306220).
文摘Optical computing and optical neural network have gained increasing attention in recent years because of their potential advantages of parallel processing at the speed of light and low power consumption by comparison with electronic computing.The optical implementation of the fundamental building blocks of a digital computer,i.e.logic gates,has been investigated extensively in the past few decades.Optical logic gate computing is an alternative approach to various analogue optical computing architectures.In this paper,the latest development of optical logic gate computing with different kinds of implementations is reviewed.Firstly,the basic concepts of analogue and digital computing with logic gates in the electronic and optical domains are introduced.And then a comprehensive summary of various optical logic gate schemes including spatial encoding of light field,semiconductor optical amplifiers(SOA),highly nonlinear fiber(HNLF),microscale and nanoscale waveguides,and photonic crystal structures is presented.To conclude,the formidable challenges in developing practical all-optical logic gates are analyzed and the prospects of the future are discussed.
基金supported by the National Natural Science Foundation of China (Grant No.62135009)the Beijing Municipal Science and Technology Commission,Administrative Commission of Zhongguancun Science Park (Grant No.Z221100005322010).
文摘On-chip diffractive optical neural networks(DONNs)bring the advantages of parallel processing and low energy consumption.However,an accurate representation of the optical field’s evolution in the structure cannot be provided using the previous diffraction-based analysis method.Moreover,the loss caused by the open boundaries poses challenges to applications.A multimode DONN architecture based on a more precise eigenmode analysis method is proposed.We have constructed a universal library of input,output,and metaline structures utilizing this method,and realized a multimode DONN composed of the structures from the library.On the designed multimode DONNs with only one layer of the metaline,the classification task of an Iris plants dataset is verified with an accuracy of 90%on the blind test dataset,and the performance of the one-bit binary adder task is also validated.Compared to the previous architectures,the multimode DONN exhibits a more compact design and higher energy efficiency.
基金This work was supported in part by the National Outstanding Youth Science Fund Project of National Natural Science Foundation of China(62022062)the National Natural Science Foundation of China(61974177,61674119)the Fundamental Research Funds for the Central Universities.
文摘The explosive growth of data and information has motivated various emerging non-von Neumann computational approaches in the More-than-Moore era.Photonics neuromorphic computing has attracted lots of attention due to the fascinating advantages such as high speed,wide bandwidth,and massive parallelism.Here,we offer a review on the optical neural computing in our research groups at the device and system levels.The photonics neuron and photonics synapse plasticity are presented.In addition,we introduce several optical neural computing architectures and algorithms including photonic spiking neural network,photonic convolutional neural network,photonic matrix computation,photonic reservoir computing,and photonic reinforcement learning.Finally,we summarize the major challenges faced by photonic neuromorphic computing,and propose promising solutions and perspectives.
基金supported by the National Natural Science Foundation of China(Grant Nos.12064025,12264028,12364045,and 12304420)the Natural Science Foundation of Jiangxi Province(Grant Nos.20212ACB202006,20232BAB201040,and 20232BAB211025)+3 种基金the Shanghai Pujiang Program(Grant No.22PJ1402900)the Australian Research Council Discovery Project(Grant No.DP200101353)the Interdisciplinary Innovation Fund of Nanchang University(Grant No.2019-9166-27060003)the China Scholarship Council(Grant No.202008420045).
文摘The ultimate goal of artificial intelligence(AI)is to mimic the human brain to perform decision-making and control directly from high-dimensional sensory input.Diffractive optical networks(DONs)provide a promising solution for implementing AI with high speed and low power-consumption.Most reported DONs focus on tasks that do not involve environmental interaction,such as object recognition and image classification.By contrast,the networks capable of decision-making and control have not been developed.Here,we propose using deep reinforcement learning to implement DONs that imitate human-level decisionmaking and control capability.Such networks,which take advantage of a residual architecture,allow finding optimal control policies through interaction with the environment and can be readily implemented with existing optical devices.The superior performance is verified using three types of classic games:tic-tac-toe,Super Mario Bros.,and Car Racing.Finally,we present an experimental demonstration of playing tic-tac-toe using the network based on a spatial light modulator.Our work represents a solid step forward in advancing DONs,which promises a fundamental shift from simple recognition or classification tasks to the high-level sensory capability of AI.It may find exciting applications in autonomous driving,intelligent robots,and intelligent manufacturing.
基金the National Natural Science Foundation of China(Grant No.62075168)Guang Dong Basic and Applied Basic Research Foundation(Grant No.2020A1515011088)Special Project in Key Fields of Guangdong Provincial Department of Education of China(Grant No.2020ZDZX3052 and 2019KZDZX1025)。
文摘We utilize three parallel reservoir computers using semiconductor lasers with optical feedback and light injection to model radar probe signals with delays.Three radar probe signals are generated by driving lasers constructed by a threeelement laser array with self-feedback.The response lasers are implemented also by a three-element lase array with both delay-time feedback and optical injection,which are utilized as nonlinear nodes to realize the reservoirs.We show that each delayed radar probe signal can be predicted well and to synchronize with its corresponding trained reservoir,even when parameter mismatches exist between the response laser array and the driving laser array.Based on this,the three synchronous probe signals are utilized for ranging to three targets,respectively,using Hilbert transform.It is demonstrated that the relative errors for ranging can be very small and less than 0.6%.Our findings show that optical reservoir computing provides an effective way for applications of target ranging.
基金the National Natural Science Foundation of China(Grant Nos.62375171,62305208,62205189,62105203,and 62405182)the Shanghai Pujiang Program(Grant No.22PJ1407500)+4 种基金the Oceanic Interdisciplinary Program of Shanghai Jiao Tong University(SJTU)(Grant No.SL2022ZD205)the National Key Research and Development Program of China(Grant No.2022YFC2806600)the Science Foundation of Donghai Laboratory(Grant Nos.DH-2022KF01001 and DH-2022KF01005)the Startup Fund for Young Faculty at SJTU(Grant No.24X010500120)the Science and Technology Commission of Shanghai Municipality(Grant No.20DZ2220400).
文摘Optical reservoir computing(ORC)offers advantages,such as high computational speed,low power consumption,and high training speed,so it has become a competitive candidate for time series analysis in recent years.The current ORC employs single-dimensional encoding for computation,which limits input resolution and introduces extraneous information due to interactions between optical dimensions during propagation,thus constraining performance.Here,we propose complex-value encoding-based optoelectronic reservoir computing(CE-ORC),in which the amplitude and phase of the input optical field are both modulated to improve the input resolution and prevent the influence of extraneous information on computation.In addition,scale factors in the amplitude encoding can fine-tune the optical reservoir dynamics for better performance.We built a CE-ORC processing unit with an iteration rate of up to∼1.2 kHz using high-speed communication interfaces and field programmable gate arrays(FPGAs)and demonstrated the excellent performance of CE-ORC in two time series prediction tasks.In comparison with the conventional ORC for the Mackey–Glass task,CE-ORC showed a decrease in normalized mean square error by∼75%.Furthermore,we applied this method in a weather time series analysis and effectively predicted the temperature and humidity within a range of 24 h.
基金supported by National Natural Science Foundation of China(No.61571061)Innovative Research Fund of Beijing University of Posts and Telecommunications (2015RC16)
文摘The next-generation optical network is a service oriented network,which could be delivered by utilizing the generalized multiprotocol label switching(GMPLS) based control plane to realize lots of intelligent features such as rapid provisioning,automated protection and restoration(P&R),efficient resource allocation,and support for different quality of service(QoS) requirements.In this paper,we propose a novel stateful PCE-cloud(SPC)based architecture of GMPLS optical networks for cloud services.The cloud computing technologies(e.g.virtualization and parallel computing) are applied to the construction of SPC for improving the reliability and maximizing resource utilization.The functions of SPC and GMPLS based control plane are expanded according to the features of cloud services for different QoS requirements.The architecture and detailed description of the components of SPC are provided.Different potential cooperation relationships between public stateful PCE cloud(PSPC) and region stateful PCE cloud(RSPC) are investigated.Moreover,we present the policy-enabled and constraint-based routing scheme base on the cooperation of PSPC and RSPC.Simulation results for verifying the performance of routing and control plane reliability are analyzed.
文摘Computational optical imaging is an interdisciplinary subject integrating optics, mathematics, and information technology. It introduces information processing into optical imaging and combines it with intelligent computing, subverting the imaging mechanism of traditional optical imaging which only relies on orderly information transmission. To meet the high-precision requirements of traditional optical imaging for optical processing and adjustment, as well as to solve its problems of being sensitive to gravity and temperature in use, we establish an optical imaging system model from the perspective of computational optical imaging and studies how to design and solve the imaging consistency problem of optical system under the influence of gravity, thermal effect, stress, and other external environment to build a high robustness optical system. The results show that the high robustness interval of the optical system exists and can effectively reduce the sensitivity of the optical system to the disturbance of each link, thus realizing the high robustness of optical imaging.
基金support of the U.S.Department of Energy (DOE),Office of Basic Energy Sciences,Division of Materials Sciences and Engineering under Award#DE-SC0023088.
文摘As an optical processor,a diffractive deep neural network(D2NN)utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing,completing its tasks at the speed of light propagation through thin optical layers.With sufficient degrees of freedom,D2NNs can perform arbitrary complex-valued linear transformations using spatially coherent light.Similarly,D2NNs can also perform arbitrary linear intensity transformations with spatially incoherent illumination;however,under spatially incoherent light,these transformations are nonnegative,acting on diffraction-limited optical intensity patterns at the input field of view.Here,we expand the use of spatially incoherent D2NNs to complex-valued information processing for executing arbitrary complex-valued linear transformations using spatially incoherent light.Through simulations,we show that as the number of optimized diffractive features increases beyond a threshold dictated by the multiplication of the input and output space-bandwidth products,a spatially incoherent diffractive visual processor can approximate any complex-valued linear transformation and be used for all-optical image encryption using incoherent illumination.The findings are important for the all-optical processing of information under natural light using various forms of diffractive surface-based optical processors.
基金supported by the National Key Research and Development Program of China(2022YFB2803700)the National Natural Science Foundation of China(62235002,62322501,12204021,62105008,62235003,and 62105260)+5 种基金Beijing Municipal Science and Technology Commission(Z221100006722003)Beijing Municipal Natural Science Foundation(Z210004)China Postdoctoral Science Foundation(2021T140004)Major Key Project of PCL,the Natural Science Basic Research Program of Shaanxi Province(2022 JQ-638)Young Talent fund of University Association for Science and Technology in Shaanxi,China(20220135)Young Talent fund of Xi'an Association for science and technology(095920221308).
文摘Photonic signal processing offers a versatile and promising toolkit for contemporary scenarios ranging from digital optical communication to analog microwave operation.Compared to its electronic counterpart,it eliminates inherent bandwidth limitations and meanwhile exhibits the potential to provide unparalleled scalability and flexibility,particularly through integrated photonics.However,by far the on-chip solutions for optical signal processing are often tailored to specific tasks,which lacks versatility across diverse applications.Here,we propose a streamlined chip-level signal processing architecture that integrates different active and passive building blocks in silicon-on-insulator(SOI)platform with a compact and efficient manner.Comprehensive and in-depth analyses for the architecture are conducted at levels of device,system,and application.Accompanied by appropriate configuring schemes,the photonic circuitry supports loading and processing both analog and digital signals simultaneously.Three distinct tasks are facilitated with one single chip across several mainstream fields,spanning optical computing,microwave photonics,and optical communications.Notably,it has demonstrated competitive performance in functions like image processing,spectrum filtering,and electro-optical bandwidth equalization.Boasting high universality and a compact form factor,the proposed architecture is poised to be instrumental for next-generation functional fusion systems.
基金supported by the Innovate UK Smart (Grant No. 10043476)support from the Royal Commission for the Exhibition of 1851 Research Fellowship。
文摘Optics is an exciting route for the next generation of computing hardware for machine learning,promising several orders of magnitude enhancement in both computational speed and energy efficiency.However, reaching the full capacity of an optical neural network(NN) necessitates that the computing be implemented optically not only for inference but also for training. The primary algorithm for network training is backpropagation, in which the calculation is performed in the order opposite to the information flow for inference. Although straightforward in a digital computer, the optical implementation of backpropagation has remained elusive, particularly because of the conflicting requirements for the optical element that implements the nonlinear activation function. We address this challenge for the first time, we believe, with a surprisingly simple scheme, employing saturable absorbers for the role of activation units. Our approach is adaptable to various analog platforms and materials and demonstrates the possibility of constructing NNs entirely reliant on analog optical processes for both training and inference tasks.
基金supported in part by the National Key Research and Development Program of China(Grant No.2022YFB2804203)the National Natural Science Foundation of China(Grant Nos.62075075,62275088)the Knowledge Innovation Program of Wuhan-Basic Research(Grant No.2023010201010049).
文摘Despite more than 40 years of development,it remains difficult for optical logic computing to support more than four operands because the high parallelism of light has not been fully exploited in current methods that are restrained by inefficient optical nonlinearity and redundant input modulation.In this paper,we propose a large-scale optical programmable logic array(PLA)based on parallel spectrum modulation.By fully exploiting the wavelength resource,an eight-input PLA is experimentally demonstrated with 256 wavelength channels.And it is extended to nine-input PLA through the combination of wavelength’s and spatial dimensions.Based on PLA,many advanced logic functions like 8-256 decoder,4-bit comparator,adder and multiplier,and state machines are first realized in optics.We implement the two-dimensional optical cellular automaton(CA)for what we believe is the first time and run Conway’s Game of Life to simulate the complex evolutionary processes(pulsar explosion,glider gun,and breeder).Other CA models,such as the replicator-like evolution and the nonisotropic evolution to generate the Sierpinski triangle are also demonstrated.Our work significantly alleviates the challenge of scalability in optical logic devices and provides a universal optical computing platform for two-dimensional CA.
基金supports from the National Natural Science Foundation of China(Grant No.12174097)the Natural Science Foundation of Hunan Province(Grant No.2021JJ10008).
文摘The photonic spin Hall effect(SHE)refers to the transverse spin separation of photons with opposite spin angular momentum,after the beam passes through an optical interface or inhomogeneous medium,manifested as the spin-dependent splitting.It can be considered as an analogue of the SHE in electronic systems:the light’s right-circularly polarized and left-circularly polarized components play the role of the spin-up and spin-down electrons,and the refractive index gradient replaces the electronic potential gradient.Remarkably,the photonic SHE originates from the spin-orbit interaction of the photons and is mainly attributed to two different geometric phases,i.e.,the spin-redirection Rytov-Vlasimirskii-Berry in momentum space and the Pancharatnam-Berry phase in Stokes parameter space.The unique properties of the photonic SHE and its powerful ability to manipulate the photon spin,gradually,make it a useful tool in precision metrology,analog optical computing and quantum imaging,etc.In this review,we provide a brief framework to describe the fundamentals and advances of photonic SHE,and give an overview on the emergent applications of this phenomenon in different scenes.