Researchers demonstrate all-optical neural network for deep learning

image: Researchers demonstrated the first two-layer, all-optical artificial neural network with nonlinear activation functions. These types of functions are required to perform complex tasks such as pattern recognition.

Image: 
Olivia Wang, Peng Cheng Laboratory

WASHINGTON -- Even the most powerful computers are still no match for the human brain when it comes to pattern recognition, risk management, and other similarly complex tasks. Recent advances in optical neural networks, however, are closing that gap by simulating the way neurons respond in the human brain.

In a key step toward making large-scale optical neural networks practical, researchers have demonstrated a first-of-its-kind multilayer all-optical artificial neural network. Generally, this type of artificial intelligence can tackle complex problems that are impossible with traditional computational approaches, but current designs require extensive computational resources that are both time-consuming and energy intensive. For this reason, there is great interest developing practical optical artificial neural networks, which are faster and consume less power than those based on traditional computers.

In Optica, The Optical Society's journal for high-impact research, researchers from The Hong Kong University of Science and Technology, Hong Kong detail their two-layer all-optical neural network and successfully apply it to a complex classification task.

"Our all-optical scheme could enable a neural network that performs optical parallel computation at the speed of light while consuming little energy," said Junwei Liu, a member of the research team. "Large-scale, all-optical neural networks could be used for applications ranging from image recognition to scientific research."

Building an all-optical network

In conventional hybrid optical neural networks, optical components are typically used for linear operations while nonlinear activation functions--the functions that simulate the way neurons in the human brain respond--are usually implemented electronically because nonlinear optics typically require high-power lasers that are difficult to implement in an optical neural network.

To overcome this challenge, the researchers used cold atoms with electromagnetically induced transparency to perform nonlinear functions. "This light-induced effect can be achieved with very weak laser power," said Shengwang Du, a member of the research team. "Because this effect is based on nonlinear quantum interference, it might be possible to extend our system into a quantum neural network that could solve problems intractable by classical methods."

To confirm the capability and feasibility of the new approach, the researchers constructed a two-layer fully-connected all optical neural network with 16 inputs and two outputs. The researchers used their all-optical network to classify the order and disorder phases of the Ising model, a statistical model of magnetism. The results showed that the all-optical neural network was as accurate as a well-trained computer-based neural network.

Optical neural networks at larger scales

The researchers plan to expand the all-optical approach to large-scale all-optical deep neural networks with complex architectures designed for specific practical applications such as image recognition. This will help demonstrate that the scheme works at larger scales.

"Although our work is a proof-of-principle demonstration, it shows that it may become possible in the future to develop optical versions of artificial intelligence," said Du. "The next generation of artificial intelligence hardware will be intrinsically much faster and exhibit lower power consumption compared to today's computer-based artificial intelligence," added Liu.

Credit: 
Optica