## Abstract

We model the impact of atmospheric turbulence-induced phase and amplitude fluctuations on free-space optical links using synchronous detection. We derive exact expressions for the probability density function of the signal-to-noise ratio in the presence of turbulence. We consider the effects of log-normal amplitude fluctuations and Gaussian phase fluctuations, in addition to local oscillator shot noise, for both passive receivers and those employing active modal compensation of wave-front phase distortion. We compute error probabilities for M-ary phase-shift keying, and evaluate the impact of various parameters, including the ratio of receiver aperture diameter to the wave-front coherence diameter, and the number of modes compensated.

© 2008 Optical Society of America

## 1. Introduction

Evaluating the performance of a heterodyne or homodyne receiver in the presence of atmospheric turbulence is generally difficult because of the complex ways turbulence affects the coherence of the received signal that is to be mixed with the local oscillator. The downconverted heterodyne or homodyne power is maximized when the spatial field of the received signal matches that of the local oscillator. Any mismatch of the amplitudes and phases of the two fields will result in a loss in downconverted power. Adaptive compensation of atmospheric wave-front phase distortion to improve the performance of atmospheric systems has been an important field of study for many years. In particular, modal compensation method involves correction of several modes of an expansion of the total phase distortion in a set of basis functions.

Here, we study in a unified framework the effects of both wavefront distortion and amplitude scintillation on the performance of synchronous (coherent) receivers utilizing wavefront compensation. The effects ascribed to turbulence are random and subsequently must be described in a statistical sense. Early works quantified turbulence-induced fading through its mean and variance [1,2], although these are not adequate to fully characterize system performance. Later analyses have attempted to overcome these limitations and fully characterize the statistics of heterodyne optical systems by assuming a highly simplified model of atmospheric effects [3,4]. An alternate approach, aimed at overcoming the limitations of previous work, is based on numerical simulation of heterodyne optical systems [5,6]. Unfortunately, none of these prior works have resulted in an accurate statistical description of the performance of phase-compensated homodyne or heterodyne systems. Recently, a full-wave simulation of beam propagation has been used to examine the uncertainty inherent to the process of optical power measurement with a practical heterodyne receiver because of the presence of refractive turbulence [7].

The remainder of this paper is organized as follows. In Section 2, we define a mathematical model for the received signal after propagation through the atmosphere. By noting that the downconverted signal current can be characterized as the sum of many contributions from different coherent regions within the aperture, we show that the probability density function (PDF) of this current can be well-approximated by a modified Rice distribution. In our model, the parameters describing the PDF depend on the turbulence conditions and the degree of modal compensation applied in the receiver. In Section 3, we compute the error probability for QPSK modulation in the presence of multiplicative noise from atmospheric turbulence and additive white Gaussian noise (AWGN). We provide analytical expressions for the error probability of synchronous communication systems, and use them to study the effect of various parameters on performance, including turbulence level, signal strength, receive aperture size, and the extent of wavefront compensation.

## 2. First-order statistics in optical homodyne or heterodyne detection

When a received signal experiences atmospheric turbulence during transmission, both its envelope and its phase fluctuate over time. In the case of coherent modulation, phase fluctuations can severely degrade performance unless measures are taken to compensate for them at the receiver. Here, we assume that after homodyne or heterodyne downconversion is used to obtain an electrical signal, the receiver is able to track any phase fluctuations caused by turbulence (as well as those caused by laser phase noise), performing ideal coherent (synchronous) demodulation. Under this assumption, analyzing the receiver performance requires knowledge of only the envelope statistics of the downconverted electrical signal.

In a coherent receiver, downconversion from the optical domain to the electrical domain can be achieved using either heterodyne or homodyne methods [8]. The performance comparison between homodyne and heterodyne depends on the modulation scheme being considered. This paper analyzes QPSK modulation with synchronous homodyne or heterodyne detection, assuming the dominant noise is local oscillator shot noise. For concreteness, equations are given for the heterodyne case, but the signal-to-noise ratio (SNR) and error-rate performance are the same for the homodyne case. We assume the heterodyne downconverter uses a 50-50 beamsplitter and a pair of photodetectors, comprising a balanced receiver. (Using BPSK modulation, it is possible to employ a single-quadrature downconverter for homodyne but not heterodyne. Hence, for BPSK, homodyne can achieve a given error rate at a 3-dB lower signal power than heterodyne in the shot-noise-limited regime.)

In order to assess the impact of turbulence, both log-amplitude and phase fluctuations should be considered. As a consequence, the field in the pupil plane is expressed as

where *A _{s}* is the amplitude without the effect of turbulence, and

*χ*(

*r*) and

*ϕ*(

*r*) represent the logamplitude fluctuations (scintillation) and phase variations (aberrations), respectively, introduced by atmospheric turbulence. In the heterodyne downconverter, the information-carrying photocurrent

*i*at the output of the balanced receiver is:

_{s}where *η* is the quantum efficiency of the photodetector, *A*
_{0} is the amplitude of the local oscillator, and Δ*f* and Δ*ϕ* are, respectively, the differences between the frequencies and phases of the signal and local oscillator. The circular receiving aperture of diameter *D* is defined by the aperture function *W*(*r*), which equals unity for |*r*|≤*D*/2, and equals zero for |*r*|>*D*/2. We can rewrite the cosine using cos(*u*-*v*)=cos*u* cos*v*+sin *u*sin *v*, obtaining

$$+\mathrm{sin}\left[2\pi \mathrm{\Delta}ft+\mathrm{\Delta}\varphi \right]\int d\mathit{r}W\left(\mathit{r}\right)\mathrm{exp}\left[\chi \left(\mathit{r}\right)\right]\mathrm{sin}\left[\varphi \left(\mathit{r}\right)\right]\}.$$

Taking the time average of the beat frequency Δ*f* oscillations of Eq. (3), the average detected signal power $\overline{{i}_{S}^{2}}$ may be written as

where *α _{r}* and

*α*are normalized versions of the integrals in Eq. (3):

_{i}$${\alpha}_{i}={\left(\frac{\pi}{4}{D}^{2}\right)}^{-1}\int d\mathit{r}W\left(\mathit{r}\right)\mathrm{exp}\left[\chi \right(\mathit{r}\left)\right]\mathrm{sin}\left[\varphi \left(\mathit{r}\right)\right].$$

In this last step, the trigonometric and exponential terms have been considered time-independent, as the time average is taken over a period that is short compared with the coherence time associated with atmospheric turbulence. It is important to note that *α _{r}* and

*α*represent integrals over the collecting aperture of the real and imaginary parts, respectively, of the normalized optical field reaching the receiver. These real and imaginary parts can be considered as the components of a complex random phasor.

_{i}If the noise is dominated by local oscillator shot noise, the average noise power per unit bandwidth is $\overline{{i}_{N}^{2}}=e\eta \frac{\pi}{4}{D}^{2}{{A}_{0}}^{2},$ where *e* is the electronic charge. The SNR per unit bandwidth $\gamma =\frac{\overline{{i}_{S}^{2}}}{\overline{{i}_{N}^{2}}}$ can be expressed using Eq. (4) as

Note that the SNR in the presence of turbulence, γ, is proportional to the SNR in the absence of turbulence, ${\gamma}_{0}=\frac{1}{2}\left(\frac{\eta}{e}\right)\frac{\pi}{4}{D}^{2}{{A}_{S}}^{2}$:

The constant of proportionality is *α*
^{2}=*α*
^{2}
* _{r}*+

*α*

^{2}

*, a random scale factor representing the effect of both the amplitude and phase fluctuations of the optical field. The statistical properties of the random variable*

_{i}*α*

^{2}, with mean $\overline{{\alpha}^{2}}$ and PDF

*p*

*α*

^{2}(

*α*

^{2}), provide a statistical characterization of the SNR γ. Using the average SNR $\overline{\gamma}={\gamma}_{0}\overline{{\alpha}^{2}}$ and the Jacobian of the transformation ${\alpha}^{2}=\frac{\gamma}{{\gamma}_{0}}=\gamma \frac{\overline{{\alpha}^{2}}}{\overline{\gamma}}$, we obtain the PDF of the SNR:

Turning attention to *α*
^{2}, we study how amplitude and phase fluctuations of the optical field define the statistics of the fading intensity *α*
^{2}=*α*
^{2}
* _{r}*+

*α*

^{2}

*. We note that the two random magnitudes*

_{i}*α*

*and*

_{r}*α*

*are expressed in Eq. (5) as integrals over the aperture and, hence, are the sums of contributions from each point in the aperture. In order to proceed with the analysis, we consider a statistical model in which these continuous integrals are expressed as finite sums over*

_{i}*N*statistically independent cells in the aperture:

$${\alpha}_{i}\cong \frac{1}{N}\sum _{k=1}^{N}\mathrm{exp}{\chi}_{k}\mathrm{cos}{\varphi}_{k},$$

where *χk* is the log-amplitude and *ϕ _{k}* is the phase of the kth statistically independent cell. A similar approach has been used to analyze the statistics of the Strehl ratio [9]. The mean log-amplitude can be extracted out of the sums, yielding

$${\alpha}_{i}\cong \frac{1}{N}\mathrm{exp}\stackrel{-}{\chi}\sum _{k=1}^{N}\mathrm{exp}\left({\chi}_{k}-\stackrel{-}{\chi}\right)\mathrm{sin}{\varphi}_{k.}$$

Under the assumption that *N*, the number of independent cells, is large enough, we can consider that *α _{r}* and

*α*asymptotically approach jointly normal random variables:

_{i}where *α*̄* _{r}*,

*α*̄

*and*

_{i}*σ*

^{2}

*,*

_{r}*σ*

^{2}

*are the means and variances of*

_{i}*α*

*,*

_{r}*α*

*, which are required to evaluate the joint PDF. To estimate these means and variances, we recall that*

_{i}*α*

*and*

_{r}*α*

*can be considered as the real and imaginary parts of a random phasor. Hence, it is possible to evaluate the means and variances of*

_{i}*α*

*and*

_{r}*α*

*by using the classical statistical model for speckle with a non-uniform distribution of phases [10]. After some algebraic manipulation, mean values can be obtained as*

_{i}$${\overline{\alpha}}_{i}=-\frac{j}{2}\mathrm{exp}\overline{\chi}\overline{\mathrm{exp}\left({\chi}_{k}-\overline{\chi}\right)}\left[{M}_{\varphi}\left(1\right)-{M}_{\varphi}\left(-1\right)\right],$$

and the variances are given by

$$-\frac{\mathrm{exp}2\stackrel{-}{\chi}{\left[\overline{\mathrm{exp}\left({\chi}_{k}-\overline{\chi}\right)}\right]}^{2}}{4N}\left[2{M}_{\varphi}\left(1\right){M}_{\varphi}\left(-1\right)+{M}_{\varphi}^{2}\left(1\right)+{M}_{\varphi}^{2}\left(-1\right)\right],$$

$${\sigma}_{i}^{2}=\frac{\mathrm{exp}2\stackrel{-}{\chi}\overline{\mathrm{exp}2\left({\chi}_{k}-\overline{\chi}\right)}}{4N}[2-{M}_{\varphi}\left(2\right)-{M}_{\varphi}\left(-2\right)]$$

$$-\frac{\mathrm{exp}2\stackrel{-}{\chi}{\left[\overline{\mathrm{exp}\left({\chi}_{k}-\overline{\chi}\right)}\right]}^{2}}{4N}[2{M}_{\varphi}\left(1\right){M}_{\varphi}(-1)-{M}_{\varphi}^{2}\left(1\right)-{M}_{\varphi}^{2}(-1)].$$

*M*
* _{ϕ}*(

*ω*) is the characteristic function of the phase, i.e., the Fourier transform of its PDF. We point out that because

*α*,

_{r}*α*result from atmospheric turbulence, we can consider phases

_{i}*ϕ*that obey zero-mean Gaussian statistics: ${p}_{\varphi}\left(\varphi \right)=\frac{1}{\sqrt{2\pi {\sigma}_{\varphi}}}\mathrm{exp}\left(\frac{-{\varphi}^{2}}{2{\sigma}_{\varphi}^{2}}\right)$. In this case, the characteristic function of the phase is:

_{k}In [11], the statistics of phase aberrations caused by atmospheric turbulence were characterized, considering a Kolmogorov spectrum of turbulence. In that analysis, classical results for the phase variance *σ*
^{2}
* _{ϕ}* were extended to consider modal compensation of atmospheric phase distortion. In such modal compensation, Zernike polynomials are widely used as basis functions because of their simple analytical expressions and their correspondence to classical aberrations [12]. It is known that the residual phase variance after modal compensation of

*J*Zernike terms is given by

where the aperture diameter *D* is normalized by the wavefront coherence diameter *r*
_{0}, which describes the spatial correlation of phase fluctuations in the receiver plane [1]. In (15), the coefficient *C _{J}* depends on

*J*[11]. For example, aberrations up to tilt, astigmatism, coma and fifth-order correspond to

*J*=3, 6, 10 and 20, respectively. Ideally, it is desirable to choose

*J*large enough that the residual variance Eq. (15) becomes negligible.

If it is also assumed that the log-amplitudes *χ _{k}* are normal random variables [13], we can use energy conservation, and the expressions for the mean of exponential functions of Gaussian variables, to obtain classical results for the log-amplitude and amplitude means:

$$\overline{\mathrm{exp}\left({\chi}_{k}-\overline{\chi}\right)}=\mathrm{exp}\left(\frac{1}{2}{\sigma}_{\chi}^{2}\right).$$

The irradiance *β*≡exp^{2}(*χ _{k}*-

*χ*̄) has a mean given by exp(2

*σ*

^{2}

*). The log-amplitude variance σ2χ is often expressed as a scintillation index*

_{χ}*σ*

^{2}

*=exp(4σ*

_{β}^{2}

*)-1.*

_{χ}Substitution of Eq. (14) and Eq. (16) into Eq. (12) and Eq. (13) yields

$$\overline{{\alpha}_{i}}=0$$

$${\sigma}_{r}^{2}=\frac{1}{2N}\left[1+\mathrm{exp}\right(-{2\sigma}_{\varphi}^{2})-2\mathrm{exp}(-{\sigma}_{\chi}^{2}\left)\mathrm{exp}\right(-{\sigma}_{\varphi}^{2}\left)\right]$$

$${\sigma}_{i}^{2}=\frac{1}{2N}[1-\mathrm{exp}(-2{\sigma}_{\varphi}^{2}\left)\right].$$

At this point, we still need to determine the number of statistically independent patches or cells *N* present in the aperture. An analytical expression to estimate *N* can be defined by

where *W*(*r*) again characterizes the collecting aperture with area *S*=(π/4)*D*
^{2}. Here, *C*(*r*) is the coherence function describing the wavefront distortion introduced by atmospheric turbulence [1]

Physical insight into Eq. (18) may be obtained by considering the limiting case in which the receiver aperture is much greater than the coherence diameter *r*
_{0}, i.e., *D*»*r*
_{0}. In this case,

The integral can be solved in a closed form to obtain *N*=[1.007 (*r*
_{0}/*D*)^{2}]^{-1}. To a good approximation, the aperture can be considered to consist of (*D*/*r*
_{0})^{2} independent cells, each of diameter *r*
_{0}. In the opposite extreme of an aperture much smaller than the coherence diameter, *D*«*r*
_{0}, we have C(*r*)≈1 and *N*=1. This result indicates that as the aperture gets smaller, the number of cells approaches unity. Values of *N*<1 are not possible. An analytical expression for *N* valid for all aperture diameters is given by

which can easily be integrated to yield

Here, Γ(*a*,*x*) is the lower incomplete gamma function. Equation (22) will be used to estimate the value of *N* needed to evaluate Eq. (17).

Turning again to the distribution function of interest, a joint PDF of intensity *α*
^{2} and phase *θ* can be found by substituting ${a}_{r}=\sqrt{{\alpha}^{2}}\mathrm{cos}\theta $, ${a}_{i}=\sqrt{{\alpha}^{2}}\mathrm{sin}\theta $ into Eq. (11), and multiplying the resulting expression by the Jacobian of the transformation, 1/2. To obtain the marginal PDF of the fading intensity *α*
^{2}, we integrate with respect to *θ*:

Unfortunately, the integral in Eq. (23) cannot be performed in closed form. Since *α*
* _{r}* and

*α*

*are jointly normal random variables, it is possible to obtain the mean and variance of the intensity fading as $\overline{{\alpha}^{2}}={\sigma}_{r}^{2}+{\sigma}_{i}^{2}+{\overline{\alpha}}_{r}^{2}$ and ${\sigma}_{{\alpha}^{2}}^{2}=2\left({\sigma}_{r}^{4}+{\sigma}_{i}^{4}\right)+4{\sigma}_{r}^{2}{\overline{\alpha}}_{r}^{2}$. It is instructive to consider the weak-turbulence, near-field regime, where values of*

_{i}*σ*

^{2}

*and*

_{ϕ}*σ*

^{2}

*are small but the log-amplitude variance*

_{χ}*σ*

^{2}

*can be neglected in comparison to the effect of phase aberrations. From Eq. (17), we obtain*

_{χ}*σ*

^{2}

*=0, α*

_{r}*̄*

*=1-*

_{r}*σ*

^{2}

*/2, and*

_{ϕ}*σ*

^{2}

*=*

_{i}*σ*

^{2}

*/*

_{ϕ}*N*. In this case, the fading intensity

*α*

^{2}is defined as the sum of a constant (coherent) term

*α*

*with amplitude*

_{r}*α*̄

*and a random (incoherent) term*

_{r}*α*

*with zero mean and variance*

_{i}*σ*

^{2}

*. Such a random variable, defined as the sum of a known dominant phasor plus a random phasor sum, is characterized by a Rice PDF [10]:*

_{i}where ${a}^{2}={{\overline{\alpha}}_{r}}^{2}$ and 2*σ*
^{2}=*σ*
^{2}
* _{i}*. The parameter

*a*

^{2}represents the coherent intensity that dominates over the fluctuating residual halo, whose intensity is represented by 2

*σ*

^{2}. It is convenient to express the basic Rice PDF (24) in terms of the mean $\overline{{\alpha}^{2}}=2{\sigma}^{2}+{a}^{2}$ and the contrast parameter 1/

*r*≡2

*σ*

^{2}/

*a*

^{2}, a measure of the strength of the residual halo to the coherent component:

which is often referred to as the modified Rician PDF. The variance of the intensity fading ${\sigma}_{{\alpha}^{2}}^{2}$ can be expressed in terms of mean value $\overline{{\alpha}^{2}}$ and the parameter *r* as ${\sigma}_{{\alpha}^{2}}^{2}=\frac{\overline{{\alpha}^{2}}\left(2r+1\right)}{{\left(1+r\right)}^{2}}$.

It is possible to extend this convenient Rice distribution to stronger turbulence regimes, in which both the phase aberrations *σ*
^{2}
* _{ϕ}* and the log-amplitude variance

*σ*

^{2}

*need to be considered. We can expect the general marginal PDF Eq. (23) to behave like the Rice PDF Eq. (25) provided that we can find a set of equivalent Rice parameters ($\overline{{\alpha}^{2}}$ and*

_{χ}*r*) that makes Eq. (17) and Eq. (19) have identical mean and variance. Comparing the means and variances of the two distributions, the required values of $\overline{{\alpha}^{2}}$ and

*r*can be computed as functions of

*α*̄

*,*

_{r}*σ*

^{2}

*, and*

_{r}*σ*

^{2}

*through the relations*

_{i}$$\overline{{\alpha}^{2}}\left(2r+1\right)/{\left(1+r\right)}^{2}=2\left({{\sigma}_{r}}^{4}+{{\sigma}_{i}}^{4}\right)+4{{\sigma}_{r}}^{2}{{\overline{\alpha}}_{r}}^{2}.$$

After some algebra, the contrast parameter 1/*r* can be obtained from Eq. (26) as

where the mean *α*̄* _{r}* and variances

*σ*

^{2}

*,*

_{r}*σ*

^{2}

*are obtained with the help of Eq. (17).*

_{r}We have just redefined the Rician model so the dominant component can be a phasor sum of two or more dominant waves, and can be subject to amplitude fluctuations (scintillation). The parameter *r* ranges between 0 and ∞. It can be shown that when the dominant term is very weak (*r*→0), intensity fading *α*
^{2} becomes negative-exponential-distributed, just as in a speckle pattern. Likewise, when the dominant term is very strong (*r*→∞), the density function becomes highly peaked around the mean value $\overline{{\alpha}^{2}}$, and there is no fading to be considered. When *r* is large, it can be shown that the PDF of *α*
^{2} is, except for a skewness factor *α*, approximately Gaussian with mean $\overline{{\alpha}^{2}}$. Consequently, the Rice distribution can describe the entire range of fading that needs to be considered in our analysis.

Using Eq. (25) to express the PDF of the fading intensity *α*
^{2}, and applying Eq. (8), we find that the SNR γ is described by a noncentral chi-square distribution with two degrees of freedom:

where the mean SNR $\overline{\gamma}={\gamma}_{0}\overline{{\alpha}^{2}}$ depends on turbulence-free SNR *γ*
_{0} and the parameter $\overline{{\alpha}^{2}}$ describing turbulence effects.

While we have a plausible model leading to the Rice and noncentral chi-square distributions, the choice of the beta distribution in [6] is based on a resemblance of the observed curves in some numerical simulations, and not on any statistical reasoning. It is not clear how the parameters of the beta distribution must be (heuristically) fitted. Also, it result difficult to extent those results to coherent optical receivers using atmospheric compensation techniques. The framework of our approach is mathematically more robust and leads to results easily extendable to systems employing active modal compensation.

## 3. Performance of coherent receivers

In the presence of turbulence, the received power is scaled by the fading intensity *α*
^{2}, a random variable with PDF
${p}_{{\alpha}^{2}}\left({\alpha}^{2}\right)$, which depends on atmospheric propagation. At the receiver, the signal is perturbed by AWGN, which is statistically independent of the fading intensity *α*
^{2}. Hence, the instantaneous SNR γ is proportional to *α*
^{2}. The symbol-error probability (SEP) *p _{s}*(

*E*) of an ideal coherent receiver is obtained by averaging the SEP conditioned on the SNR γ over the PDF of the instantaneous SNR,

*p*

*(*

_{γ}*γ*):

Although our model can accommodate various modulation/detection schemes, in this paper, we consider *M*-ary phase-shift keying (*M*-PSK) with ideal coherent detection based on maximum-likelihood principles. In this case, the SEP conditioned on the instantaneous SNR is given by [14]

Using Eqs. (30) and (28) in Eq. (29), after some algebra, we obtain

Although this integral cannot be put in a closed form, we are able to carry out the integration in Eq. (31) using a simple 30-point Gaussian-Legendre quadrature formula, which yields high accuracy. It is useful to have a simple closed-form upper bound on the error probability, which can be obtained by simply noting that sin^{2} θ≤1. The integral in Eq. (30) is reduced to

By using this upper bound along with the PDF of the instantaneous SNR Eq. (28) in the symbol error probability Eq. (29), after some algebra, we obtain an upper bound for the SEP in an *M*-PSK receiver:

Comparison with the exact result Eq. (31) shows that the upper bound Eq. (33) estimates the SEP with sufficient accuracy to be useful in many practical situations.

Figures 1-3 show the effect of atmospheric turbulence on QPSK with coherent detection using modal-compensated heterodyne or homodyne receivers. We study the SEP Eq. (31) as a function of several parameters: the average turbulence-free SNR γ_{0} per symbol, the receiver aperture diameter *D*, the number of spatial modes *J* removed by the compensation system, and the strength of atmospheric turbulence. Turbulence is quantified by two parameters: the phase coherence length *r*
_{0} and the scintillation index *σ*
^{2}
_{β}. We consider two nonzero values of the scintillation index. The value *σ*
^{2}
* _{β}*=0.3 corresponds to relatively low scintillation levels, while

*σ*

^{2}

*=1 corresponds to strong scintillation, but still below the saturation regime. When the turbulence reaches the saturation regime, wavefront distortion becomes so severe that it would be unrealistic to consider phase compensation. In most practical free-space links, amplitude fluctuations are not saturated [15].*

_{β}Figure 1 presents the SEP vs. turbulence-free SNR γ_{0}. Figure 1(a) shows the performance for different values of the normalized aperture diameter *D*/*r*
_{0}, while Fig. 1(b) shows the performance for different values of *J*, the number of modes compensated. We assume no scintillation, *σ*
^{2}
* _{β}*=0, so the effect of turbulence is simply to reduce the coherence length

*r*

_{0}. For a fixed aperture diameter

*D*, as

*r*

_{0}is reduced, the normalized aperture diameter

*D*/

*r*

_{0}increases, and turbulence reduces the heterodyne or homodyne downconversion efficiency. Even using a relatively small normalized aperture diameter

*D*/

*r*

_{0}=1, turbulence introduces more than a 15-dB performance penalty at 10

^{-3}SEP. When phase correction is used, as in Fig. 1(b), in most situations, compensation of just a few modes yields a substantial performance improvement. Compensation of

*J*=20 modes yields significant improvement for even the largest normalized apertures considered. For example, for a normalized aperture

*D*/

*r*

_{0}=10, at a SEP=10

^{-3}, the SNR penalty is just over 5 dB. This value should be contrasted with the 15-dB penalty observed in Fig. 1(a) for

*D*/

*r*

_{0}=1 when

*J*=0, i.e., no modes are compensated.

Figure 2 shows the SEP vs. the phase coherence diameter *r*
_{0}. Figure 2(a) shows the performance for different values of the scintillation index *σ*
^{2}
_{β}, while Fig. 2(b) shows the performance for different values of *J*, the number of modes compensated. In all cases presented, the turbulence-free SNR has a value γ_{0}=10 dB. The aperture diameter is fixed in every plot to *D*=10 cm. As we observe in Fig. 2(a), for strong turbulence, corresponding to small values of *r*
_{0}, the SEP is substantially independent of the scintillation index *σ*
^{2}
_{β}. In this regime, phase distortions have a large impact, and high-order phase corrections may be required. We note that in this regime of strong turbulence, the coherent part of *α*
^{2} is very weak, *r*→0, and intensity fading becomes negative-exponential distributed, i.e. *p _{r}*(

*γ*)=1/

*γ*̄exp(-

*γ*/

*γ*̄). In this case, SEP Eq. (31) reduces to

For the strongest turbulence (i.e., smallest *r*
_{0}) considered, *γ*̄→0 and the SEP Eq. (34) asymptotes to a maximum value (*M*-1)/*M*. In the plots shown, where *M*=4, we have *p _{s}*(

*E*)→3/4.

Figure 3 considers the effect of aperture diameter on performance. It presents the SEP as a function of the normalized aperture diameter *D*/*r*
_{0} for a constant phase coherence length *r*
_{0} and constant scintillation index *σ*
^{2}
_{β}. For the smallest aperture diameter considered, the turbulence-free SNR has a value γ_{0}=10 dB. For any other aperture diameter, the value of γ_{0} is proportional to *D*
^{2}. Figure 3 illustrates the concept of an optimal aperture diameter in coherent free-space links. This optimal aperture diameter, which minimizes the SEP, exhibits two different regimes in our studies. For relatively small apertures, amplitude scintillation is dominant, and performance is virtually unaffected by wavefront phase correction. When the aperture is larger, phase distortion becomes dominant, and high-order phase correction may be needed to improve performance to acceptable levels. In [7], the simulation of beam propagation was used to examine the uncertainty inherent to the process of optical power measurement with a practical heterodyne receiver because of the presence of refractive turbulence. Phase-compensated heterodyne receivers were also considered for overcoming the limitations imposed by the atmosphere by the partial correction of turbulence-induced wavefront phase aberrations. As in the current analysis, simulations indicated that the optimal aperture diameters, those minimizing the relative error, separate two different regimes in our simulations. The regime dominated by amplitude scintillation was defined for relatively small apertures and it was virtually unaffected by phase-front corrections. When larger apertures were considered, phase distortion was the relevant effect of turbulence, amplitude fluctuations were of little influence, and we needed high-order phase corrections to decrease the uncertainty to acceptable levels.

In Fig. 3(a), no phase compensation is employed (*J*=0), and the performance is shown for different values of the scintillation index *σ*
^{2}
_{β}. Here, the optimal normalized aperture diameter is close to *D*/*r*
_{0}=0.3, and increases slightly with increasing scintillation index. In any case, when *σ*
^{2}
_{β} becomes too large, the optimization is of little practical significance. In Fig. 3(b), we consider strong scintillation, *σ*
^{2}
_{β}=1, and show the performance for different values of *J*, the number of modes compensated. As we increase *J*, the optimized value of *D*/*r*
_{0} increases, and the optimized SEP improves substantially. Even for such strong scintillation, with compensation of *J*=20 modes and optimized *D*/*r*
_{0}, excellent SEP performance is obtained. In this case, the optimized *D*/*r*
_{0} is rather large (close to 4). For the larger values of *D*/*r*
_{0} considered in these plots, the coherent part of *α*
^{2} is very weak (*r*→0) and fading intensity becomes negative-exponential-distributed, such that the SEP is described by Eq. (34). In Fig. 3(a), when large normalized apertures *D*/*r*
_{0} are considered, the SEP becomes independent of the scintillation index *σ*
^{2}
_{β}, and tends toward an asymptotic value that is independent of normalized aperture diameter *D*/*r*
_{0}. In Fig. 3(b), at large values of *D*/*r*
_{0}, the SEPs also tend toward asymptotic values, independent of normalized aperture diameter *D*/*r*
_{0}, which depend only weakly on the scintillation index *σ*
^{2}
_{β}.

## 4. Conclusions

We have studied the impact of atmospheric turbulence-induced scintillation and phase aberrations on the performance of free-space optical links in which the receiver uses modal wavefront compensation and synchronous homodyne or heterodyne detection. We have defined a mathematical model for the signal received after propagation through the atmosphere and after modal compensation. By noting that the down converted electrical signal current can be characterized as the sum of many contributions from different coherent regions within the aperture, we showed that the PDF of this signal can be described by a modified Rice distribution. The parameters describing the PDF depend on the turbulence conditions and the number of modes compensated at the receiver. We have provided analytical expressions for the symbol error probability (SEP) for synchronous detection of *M*-PSK with additive white Gaussian noise, and have used them to study the effect of various parameters on performance, including signal level, aperture diameter, turbulence strength, and the number of modes compensated. We have separately quantified the effects of amplitude fluctuations and wavefront phase distortion on system performance, and have identified two different regimes of turbulence, depending on the receiver aperture diameter normalized to the coherence diameter of the wavefront phase. When the normalized aperture diameter is relatively small, amplitude scintillation dominates and, as phase fluctuations have little impact, performance is virtually independent of the number of modes compensated. When the normalized aperture is larger, amplitude fluctuations become negligible, and phase fluctuations become dominant, so that high-order phase compensation may be needed to improve performance to acceptable levels. We have found that for most typical link designs, wavefront phase fluctuations are the dominant impairment, and compensation of a modest number of modes can reduce performance penalties by several decibels.

## Acknowledgment

The research of Aniceto Belmonte was supported by a Spain MEC Secretary of State for Universities and Research Grant Fellowship. He is on leave from the Technical University of Catalonia. The research of Joseph M. Kahn was supported, in part, by Naval Research Laboratory award N00173-06-1-G035.

## References and links

**1. **D. L. Fried, “Optical heterodyne detection of an atmospherically distorted signal wave front,” Proc. IEEE **55**, 57–67 (1967). [CrossRef]

**2. **D. L. Fried, “Atmospheric modulation noise in an optical heterodyne receiver,” IEEE J. Quantum Electron. **QE-3**, 213–221 (1967). [CrossRef]

**3. **J. H. Churnside and C. M. McIntyre, “Signal current probability distribution for optical heterodyne receivers in the turbulent atmosphere. 1: Theory,” Appl. Opt. **17**, 2141–2147 (1978). [CrossRef] [PubMed]

**4. **J. H. Churnside and C. M. McIntyre, “Heterodyne receivers for atmospheric optical communications,” Appl. Opt. **19**, 582–590 (1980). [CrossRef] [PubMed]

**5. **K. A. Winick, “Atmospheric turbulence-induced signal fades on optical heterodyne communication links,” Appl. Opt. **25**, 1817–1825 (1986). [CrossRef] [PubMed]

**6. **N. Perlot, “Turbulence-induced fading probability in coherent optical communication through the atmosphere,” Appl. Opt. **46**, 7218–7226 (2007). [CrossRef] [PubMed]

**7. **A. Belmonte, “Influence of atmospheric phase compensation on optical heterodyne power measurements,” Opt. Express **16**, 6756–6767 (2008). [CrossRef] [PubMed]

**8. **E. Ip, A. P. T. Lau, D. J. F. Barros, and J. M. Kahn, “Coherent detection in optical fiber systems,” Opt. Express **16**, 753–791 (2008). [CrossRef] [PubMed]

**9. **M. P. Cagigal and V. F. Canales, “Speckle statistics in partially corrected wave fronts,” Opt. Lett. **23**, 1072–1074 (1998). [CrossRef]

**10. **J. W. Goodman, *Speckle Phenomena in Optics. Theory and Applications* (Ben Roberts & Company, 2007).

**11. **R. J. Noll, “Zernike polynomials and atmospheric turbulence,” J. Opt. Soc. Am. **66**, 207–211 (1976). [CrossRef]

**12. **M. Born and E. Wolf, *Principles of Optics* (Cambridge University Press, 1999)

**13. **J. W. Strohbehn, T. Wang, and J. P. Speck, “On the probability distribution of line-of-sight fluctuations of optical signals,” Radio Science **10**, 59–70 (1975). [CrossRef]

**14. **R. F. Pawula, S. O. Rice, and J. H. Roberts, “Distribution of the phase angle between two vectors perturbed by Gaussian noise,” IEEE Trans. Commun. **COM-30**, 1828–1841 (1982). [CrossRef]

**15. **L. C. Andrews, R. L. Phillips, and C. Y. Hopen, *Laser Beam Scintillation with Applications* (SPIE Press, 2001). [CrossRef]