Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Convergence of backward-error-propagation learning in photorefractive crystals

Not Accessible

Your library or personal account may give you access

Abstract

We analytically determine that the backward-error-propagation learning algorithm has a well-defined region of convergence in neural learning-parameter space for two classes of photorefractive-based optical neural-network architectures. The first class uses electric-field amplitude encoding of signals and weights in a fully coherent system, whereas the second class uses intensity encoding of signals and weights in an incoherent/coherent system. Under typical assumptions on the grating formation in photorefractive materials used in adaptive optical interconnections, we compute weight updates for both classes of architectures. Using these weight updates, we derive a set of conditions that are sufficient for such a network to operate within the region of convergence. The results are verified empirically by simulations of the XOR sample problem. The computed weight updates for both classes of architectures contain two neural learning parameters: a learning-rate coefficient and a weight-decay coefficient. We show that these learning parameters are directly related to two important design parameters: system gain and exposure energy. The system gain determines the ratio of the learning-rate parameter to decay-rate parameter, and the exposure energy determines the size of the decay-rate parameter. We conclude that convergence is guaranteed (assuming no spurious local minima in the error function) by using a sufficiently high gain and a sufficiently low exposure energy per weight update.

© 1996 Optical Society of America

Full Article  |  PDF Article
More Like This
Dynamic digital photorefractive memory for optoelectronic neural network learning modules

Hironori Sasaki, Nicolas Mauduit, Jian Ma, Yeshaiahu Fainman, Sing H. Lee, and Michael S. Gray
Appl. Opt. 35(23) 4641-4654 (1996)

Generalized perceptron learning rule and its implications for photorefractive neural networks

Chau-Jern Cheng, Pochi Yeh, and Ken Yuh Hsu
J. Opt. Soc. Am. B 11(9) 1619-1624 (1994)

Adaptive optical networks using photorefractive crystals

Demetri Psaltis, David Brady, and Kelvin Wagner
Appl. Opt. 27(9) 1752-1759 (1988)

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (14)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (71)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved