Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Single-exposure optical focusing inside scattering media using binarized time-reversed adapted perturbation

Open Access Open Access

Abstract

Light scattering inhibits high-resolution optical imaging, manipulation, and therapy deep inside biological tissue by preventing focusing. To form deep foci, wavefront-shaping techniques that break the optical diffusion limit have been developed. For in vivo applications, such focusing must provide a high gain, high speed, and a high focal peak-to-background ratio. However, none of the previous techniques meet these requirements simultaneously. Here, we overcome this challenge by rapidly measuring the perturbed optical field within a single camera exposure followed by adaptively time-reversing the phase-binarized perturbation. Consequently, a phase-conjugated wavefront is synthesized within a millisecond, two orders of magnitude shorter than the digitally achieved record. We demonstrate real-time focusing in dynamic scattering media and extend laser speckle contrast imaging to new depths. The unprecedented combination of a fast response, high gain, and high focusing contrast makes this work a major stride toward in vivo deep-tissue optical imaging, manipulation, and therapy.

© 2015 Optical Society of America

1. INTRODUCTION

Visible and near-infrared photons occupy a unique portion of the electromagnetic spectrum: Through noncarcinogenic molecular interactions with biological tissue and exogenous agents, they provide rich structural and physiological information [1] and noninvasive solutions for manipulation [2], control [3], and therapy [4]. However, these photons undergo severe scattering in tissue, rendering traditional control over their propagation completely ineffective beyond the optical diffusion limit—about 1 mm in biological tissue [5,6]. Such scattering shuts the door to important diagnostic and therapeutic applications at depths.

In recent years, the optical diffusion limit has been conquered by two categories of wavefront-shaping (WFS) techniques: iterative WFS and optical time reversal. In iterative WFS [713], a subset of the transmission matrix [14] of the scattering medium is measured iteratively. Subsequently, the phase of the light is controlled spatially to compensate for the inhomogeneous delays due to random scattering, generating a focus through constructive interference. In optical time reversal, the optical wavefront from a real [1517] or virtual guide star [1820] is detected, and its phase-conjugated copy is converged back to the origin. A feasible approach to achieving time reversal is through optical phase conjugation (OPC) [2123].

Due to the highly dynamic and scattering nature of living tissue, it is important that the focusing be sufficiently fast (ideally with a response time of 1ms [24,25]) and have high quality [i.e., having a large number of independent control elements for a high focal peak-to-background ratio (PBR) [14]]. Consequently, an important figure of merit is the average mode time (i.e., the average operation time per spatial mode [7,8,14]), which should ideally approach 1ps/mode (for a 1 ms response time with a billion modes).

However, the average mode times achieved by existing techniques are orders of magnitude greater than 1ps/mode, preventing any practical applications in biological tissue. For example, iterative WFS achieved an average mode time of 145μs/mode (37 ms for 256 spatial modes [12]) in the fastest implementation of this technique. Ultimately, when data transfer and processing times are assumed to be negligible, iterative WFS can achieve an average mode time of 18μs/mode by employing a digital micromirror device (DMD) for wavefront control [8,12,13]. In contrast, because OPC measures the desired wavefront at once, it is potentially faster. Analog OPC [18,21,22,25] approaches based on nonlinear optical crystals demonstrated a short average mode time (100ps/mode, a 10 ms response time for 107 modes [25]), but suffered from an energy gain (defined as the ratio of the focal light energy in the reading phase to that in the probing phase) well below unity, which is a drawback detrimental to widespread applications. In comparison, digital OPC (DOPC) [15,19,20] provides inherently large gains and reasonably fast responses, with 2μs/mode being realized recently for focusing inside scattering media [26] (a 100 ms response time with 50,000 spatial modes). The lowest possible average mode time (60ns/mode) for previous DOPC techniques is dictated by the phase modulation speed (assuming a 30 ms settling time and 5×105 spatial modes), and it is still four orders of magnitude longer than the goal of 1ps/mode. To break through this limit, the slow phase modulation must be replaced by a faster binary amplitude or phase modulation [27], which could potentially reach 36ps/mode using a DMD (assuming an 18 μs settling time [13] and 5×105 spatial modes). To date, none of the existing DOPC technologies for focusing inside scattering media have been demonstrated using binary modulation.

Here we address this challenge by demonstrating light focusing inside scattering media using binary phase modulation. The technology, named binarized time-reversed adapted-perturbation optical focusing (b-TRAP), has achieved the shortest average mode time to date (300ns/mode) among all methods developed for focusing inside scattering media with high energy gains. Compared with the binary-amplitude WFS technology [13], which finds and utilizes the same binary mask, our technology uses an adaptive mask, enhances the speed by 105 times, and doubles the focusing quality at no additional cost. More strikingly, we show that by using b-TRAP, the formation time of the binary mask is determined only by the laser pulse interval, which is highly tunable and can be less than 1 μs. These features not only facilitate fast light focusing, but also enable us to acquire detailed information about tissue dynamics (such as blood flow speed). The capabilities demonstrated pave the way toward in vivo deep-tissue biophotonics.

2. METHODS

A. Basic Principle

Time reversal by analysis of changing wavefronts from kinetic targets (TRACK) and TRAP optical focusing [26,28] employ intrinsic tissue dynamics as guide stars for completely noninvasive and noncontact light focusing inside scattering media. In short, if the scattered fields at two instants are recorded in the presence of internal dynamic perturbations (e.g., absorption or refractive index changes), subtracting the two fields generates a differential field whose conjugate copy enables focusing at the perturbed sites by canceling the scattering contribution originating from the static portion of the medium.

The original TRAP focusing [28] relied on phase-shifting holography [29] to record the complex amplitude of the scattered electromagnetic fields, which took multiple intensity measurements to accomplish and was impractically slow for many applications. In comparison, b-TRAP measures each field indirectly within the time duration of a single laser pulse. As shown in Fig. 1(a), at instant t1, a short laser pulse probes the scattering medium in which the permittivity of the target (i.e., the guide star) is ε(t1). The exterior scattered light field, termed the “sample beam,” whose complex amplitude is expressed as Es(t1), is combined with a planar reference beam ER on an amplitude-only spatial light modulator (SLM). The SLM surface is imaged onto a scientific complementary metal oxide semiconductor camera (sCMOS) to generate a time-averaged intensity pattern

I(t1)=|ES(t1)|2+|ER|2+ES*(t1)ER+ES(t1)ER*.

 figure: Fig. 1.

Fig. 1. Principle and schematic of b-TRAP focusing. (a)–(c) Principle of b-TRAP focusing (for details see text). (d) Schematic of the focusing method. The green (solid) arrows represent the light path in the probing process; the blue (slim) arrows show the light path in the time-reversal process. AOM, acousto-optic modulator; BS, beam splitter; CL, camera lens; L, lens; M, mirror; OS, optical shutter; sCMOS, scientific complementary metal oxide semiconductor camera; SF, spatial filter (zero-order block); SLM, spatial light modulator.

Download Full Size | PDF

As shown in Fig. 1(b), at a later instant t2, the above process is repeated, at which time the target permittivity has changed to ε(t2) from either a naturally occurring event, such as movement, or from an externally induced perturbation. The result is a different intensity pattern

I(t2)=|ES(t2)|2+|ER|2+ES*(t2)ER+ES(t2)ER*.

Subtracting the two patterns [Eqs. (1) and (2)] generates multiple terms:

ΔI=I(t2)I(t1)=Δ|ES|2+ΔES*ER+ΔESER*,
where Δ|ES|2=|ES(t2)|2|ES(t1)|2 and ΔES=ES(t2)ES(t1). The second term on the right-hand side in Eq. (3) encodes the TRAP field ΔES*, which can be reconstructed upon reading an amplitude hologram ΔI with a conjugate reference (reading) beam ER* [Fig. 1(c)]. It should be noted that b-TRAP focusing dramatically simplifies the complicated task of complex amplitude measurement and allows indirect, single-laser-shot electric field recording. The advantages of the new technology will be discussed in detail in the next section.

The above focusing procedure can be implemented using the schematic shown in Fig. 1(d). The system employs a Mach–Zehnder interferometric structure where the scattering medium resides in one arm and the planar reference/reading beam is generated in the other. Intensity patterns I(t1) and I(t2) are recorded via an sCMOS camera. The SLM, along with the camera, forms a DOPC system [23]. Adjusting the driving frequencies (f1 and f2) of the two acousto-optic modulators (AOMs) allows the system to work under different operation modes, as detailed in the next section. For a more detailed description of the system setup, see Supplement 1, Method A.

B. Operation Modes

TRAP relies on embedded novelties [30] to guide light focusing, meaning that the target’s permittivity must be time-variant. Accordingly, the light field scattered by the target continuously decorrelates over time [31]. In real practice, the background medium (e.g., biological tissue) also generates time-variant scattering, resulting in a continuously decorrelating background field. The focusing quality sensitively hinges on the background field decorrelation during the entire time-reversal process [25,32]. Hence, TRAP focusing is valid only if the field from the target decorrelates faster than the field from the surrounding medium. The time interval between the field measurements must be chosen properly to allow detectable target decorrelation yet a highly correlated background. The above condition is illustrated in Figs. 2(a)2(c). The curves drawn on the upper rows depict distinct correlation decays derived from the target’s and background’s scatterings. During the process, the difference between the two field measurements exposes the target decorrelation against a relatively stable background. For example, the correlation time of flowing blood is of the order of milliseconds, whereas that of the surrounding tissue varies, but is at least 10 times slower [22,25,33] with proper stabilization.

 figure: Fig. 2.

Fig. 2. Influence of field sampling scheme on the focusing quality under both target and medium decorrelations. (a)–(c) Time-dependent correlation coefficients of the scattered electromagnetic fields due to the target and the background (upper rows), and the field sampling schemes (lower rows). (a) Full-field (amplitude and phase) sampling using a phase-shifting scheme. (b) Amplitude-only sampling with double camera exposures and digital subtraction. (c) Amplitude-only sampling with single camera exposure and automatic analog subtraction. (d)–(f) Simulated focal light intensity distributions corresponding to the sampling schemes in (a)–(c), normalized by the peak intensity in (f).

Download Full Size | PDF

Note that the duration of each field measurement must be shorter than the target decorrelation time to avoid significant reduction of the focal PBR. As shown in Fig. 2(a), the original TRAP focusing scheme relied on digital phase-shifting holography, which required at least four laser shots synchronized with four camera exposures to complete a single field measurement. The speed of the method was primarily restricted by the camera frame rate. For example, if the camera ran at 50 Hz, the minimum duration of four exposures was 60ms. Consequently, the target needed to be stable within 60 ms, which is impractically long for many applications. Moreover, the second field measurement had to be delayed significantly (e.g., to after 1 s) due to the slow target decorrelation, making the method applicable only to a nearly stable background.

To remove such limitations, the field measurement time must be shortened. As shown in Fig. 2(b), b-TRAP records each of the two fields with a single laser shot, which is accomplished on a time scale defined by the laser pulse width. By using a laser with a 6 ns pulse width, the original constraint on the target correlation time is relaxed by seven orders of magnitude (from 60 ms to 6 ns [28]). Such a fast field measurement makes b-TRAP applicable to almost any biological targets. The phase differences between the reference beam and the static portion of the sample beam are kept constant for the two measurements, and thus, digitally subtracting the two intensity patterns directly generates the TRAP field [Eq. (3)]. The response speed of the scheme is limited only by the camera frame rate and the SLM refresh time. Because it requires two camera exposures, the scheme is named double-exposure b-TRAP focusing.

b-TRAP focusing has been made even more powerful by the single camera-exposure scheme described below (referred to as single-exposure b-TRAP hereafter), which can reduce the hologram formation time by two orders of magnitude in comparison with the state of the art [26]. As shown in Fig. 2(c), in this mode, one camera exposure records two consecutive laser shots, with a π phase shift introduced between the sample and reference beams in the second shot. The intensities of the first and second light pulses are I1=|ES(t1)|2+|ER|2+ES*(t1)ER+ES(t1)ER* and I2=|ES(t2)|2+|ER|2ES*(t2)ERES(t2)ER*, respectively. In a single exposure, the two intensities are added automatically by the camera sensor, resulting in a total intensity of

I=|ES|2+2|ER|2ΔES*ERΔESER*,
where |ES|2=|ES(t1)|2+|ES(t2)|2, and the TRAP field is encoded in the third term. By reading the hologram using a planar reading beam, the TRAP field ΔES* is reconstructed. In this focusing mode, the time interval between the two field measurements is determined by the laser repetition rate, making the procedure independent of the camera frame rate. Thus, a hologram can be formed within less than 1 μs for operation at a >1MHz laser repetition rate (e.g., by using a mode-locked laser). The ultimate speed is determined only by the image transfer and SLM refresh rates.

The advantage of b-TRAP focusing is demonstrated by the simulation results shown in Figs. 2(d)2(f). In these simulations, a point target moves (downward) inside a dynamic scattering medium. The original TRAP scheme [Fig. 2(a)] fails to focus [Fig. 2(d)] due to its low speed. In vivid contrast, b-TRAP focusing successfully captures the target movement and focuses into the time-variant scattering media with double exposures [Fig. 2(e)] and a single exposure [Fig. 2(f)]. However, single-exposure b-TRAP shows the strongest background suppression [Fig. 2(f)], thanks to its higher speed and greater tolerance to medium decorrelation: For TRAP to work, the medium should be stable when ES(t1) and ES(t2) are measured—a requirement most easily fulfilled by the single-exposure scheme. In the simulation, the single-exposure approach yields the highest PBR since the background decorrelates 10 times less than that in double-exposure b-TRAP and 70 times less than that in traditional TRAP focusing. See in Supplement 1, Method B, for the detailed simulation method.

In the experiment, for double-exposure b-TRAP focusing, the modulation frequencies of AOM1 and AOM2 are set to f1=50MHz (50 MHz is the central frequency of the device) and f2=f1+Δf. The frequency difference is Δf=NfC, where fC is the frame rate of the camera and N is a non-negative integer. The laser repetition rate is fL=MfC, where M is a positive integer. In the single-exposure scheme, the sign of the beat between the sample and reference beams flips from shot to shot, requiring Δf=(N+1/2)fL, where N is a non-negative integer. Laser shots are synchronized with camera exposures, with fL=MfC(M>2) and 1/fL<texp<2/fL, where texp is the camera exposure time.

C. Hologram Binarization

SLMs with binary modulation, such as DMDs, provide much faster actuation in comparison with their grayscale-modulation counterparts. As such, the intensity holograms shown in Eqs. (3) and (4) are binarized to facilitate the implementation of b-TRAP focusing on such devices. The binarization process is straightforward: The mean intensity of the hologram is used as a threshold. Pixel values exceeding the threshold are set to unity; otherwise, they are set to 0. We used a zero-order block to double the focal PBR by converting binary amplitude to binary phase modulation [27].

The binarization process is subject to contamination from the speckle background (Δ|ES|2 in Eq. (3) and |ES|2 in Eq. (4)], which causes error in the hologram and consequently reduces the focal PBR. In order for the binarization to work properly, the reference beam intensity should be sufficiently large, so that the TRAP term [ΔES*ER in Eqs. (3) and (4)] dominates. A theoretical model is provided in Supplement 1, Discussion C, to show the relationship between the beam ratio IS/IR and the focal PBR. Computer simulations were performed to verify the theory. Simulation and analytical results are coplotted in Fig. 3 for both the double- and single-exposure sampling schemes. As evident from the figure, the PBRs undergo continuous reduction when the beam ratio increases.

 figure: Fig. 3.

Fig. 3. Influence of beam ratio IS/IR on the PBR of b-TRAP focusing. Discrete points are from numerical simulations, whereas lines are from the analytical model. The total number of controls is 100.

Download Full Size | PDF

In b-TRAP focusing, we used an on-axis spatial sampling scheme. It is also possible to use an off-axis sampling scheme for both double- and single-exposure TRAP hologram measurements [26]. The advantage of using an off-axis scheme is apparent: by using a sufficiently high carrier spatial frequency, the TRAP term can be separated from the speckle background in the spatial frequency domain. However, this comes at the expense of a reduced spatial bandwidth, resulting in 16 times fewer number of controls in the off-axis scheme compared with that in the on-axis scheme at the same spatial sampling capacity (i.e., camera pixel count; see Supplement 1, Discussion A, for a detailed analysis). Equivalently, the focal PBR will be 16 times lower. According to Fig. 3, as long as the beam ratio is below 6% for single exposure and 10 for double-exposure schemes, the on-axis schemes yields higher PBRs than their off-axis counterparts. Moreover, to calculate the binary hologram, the off-axis scheme has much higher computational complexity in comparison with the on-axis scheme (see, e.g., Ref. [32]), giving rise to a much slower response. Considering all the above factors, we used on-axis sampling scheme, in conjunction with hologram binarization for the subsequent experiments.

3. RESULTS

A. Moving-Object Tracking

Real-time tracking of moving objects has extensive applications [34,35] and TRAP (and TRACK) focusing is the only known optical method that tracks moving objects inside scattering media. A robust tracking system must meet two criteria. First, the time it spends on field measurements must be sufficiently short. Since there is no external control over the objects’ movement speeds, it is essential that the field measurement be accomplished sufficiently fast to accommodate potentially fast field decorrelations. Second, the entire focusing procedure, including the measurement, calculation, and display of the hologram, must be finished within a short time span so as to minimize the spatial lag of the focus and to robustly adapt to any potential host medium decorrelation.

In a demonstration of the original TRAP focusing, the target moved slowly, with an estimated decorrelation time of 6s. With the new b-TRAP focusing system, we shortened the field measurement time from 60 ms down to 6 ns and reduced the repetition period from 2s to 140 ms. These speed improvements allowed us to optically track fast-moving objects inside scattering media. A simplified experimental setting is depicted in Fig. 4(a), where a black human hair target (50μm in diameter), positioned vertically between two optical diffusers (DG10-600, Thorlabs, USA), was mounted onto a motorized stage. The target was moved back and forth in the x direction at a speed of 0.78mm/s (with an estimated decorrelation time of <60ms), while b-TRAP focusing was performed at a repetition rate of 7 Hz. A detailed explanation of the timing of the focusing procedure, including key steps and their execution times, are provided in Supplement 1, Method C. The focal light intensity distribution was sampled using a beam splitter onto the detection plane of a CMOS camera (Firefly MV, Point Gray, Canada) to monitor the focusing process in real time. The two-dimensional (2D) light intensity distribution was then averaged along y, condensed into a 1D intensity map, and stacked in time to form an intensity distribution time trace, as shown in Fig. 4(b). The movement of the target was clearly revealed by the tracking focus. Most of the focusing patterns comprised two foci, typical of TRAP focusing patterns induced by a moving object [28]. As shown in the inset in Fig. 4(b), the twin foci were contributed by the old and new target positions.

 figure: Fig. 4.

Fig. 4. Tracking a moving target inside scattering media. (a) Experimental scheme. The hair target between two scattering media moves back and forth on a motorized stage. (b) Measured time trace of the focal light intensity distribution. Each row depicts the light intensity distribution (integrated along y) at a fixed time point. Each column shows the temporal evolution of the intensity at a fixed position. Process repetition rate, 7 Hz. Inset: intensity profile along the dashed line.

Download Full Size | PDF

B. Tissue-Mimicking Phantom Experiment

One unique feature of TRAP focusing is its ability to concentrate light onto endogenous contrast agents, such as moving red blood cells (RBCs). As RBCs are exclusively confined within blood vessels, TRAP focusing selectively deposits time-reversed photons onto the vasculature. This feature is potentially useful in applications such as photoacoustic tomography of blood vessels [36] and treatment of port-wine stains [37]. It is important to note that living tissue is associated with two distinct correlation times: a fast decorrelation due to blood flow and a slow one from the relatively stationary background [25,32]. The TRAP focusing procedure must be able to capture the fast-changing information and adapt to the slow background evolution.

We demonstrated the above capability in the tissue-mimicking phantom experiment shown in Fig. 5(a). The phantom was composed of two ground-glass diffusers (DG10-600, Thorlabs, USA) as scattering media with a tube (300 μm inner diameter, silicone) containing flowing blood placed vertically in between. The mimic blood vessel was completely invisible outside the ground glass. To mimic tissue decorrelation with a controlled correlation time, the scattering layers were mounted onto a motorized stage with adjustable movement speed. The speckle correlation time [25] of the scattered light was measured as a function of the media’s movement speed and was subsequently fitted according to

tC[s]=1.2[μm]×{v[μm/s]}1,
as shown in Fig. 5(c). From Eq. (5), we were able to pre-set the tissue correlation time by controlling the media’s movement speeds. During the focusing demonstration, diluted bovine blood [1 (blood):8 (phosphate-buffered saline solution) by volume] was pumped through the silicone tube at a constant flow rate. The moving RBCs perturbed the scattered field, forming targets for time-reversed focusing of the entire vessel. While the focusing procedure was performed at a repetition rate of 7 Hz, the scattering media were translated at various speeds to set the background correlation time to +, 0.81, 0.41, and 0.28 s; the corresponding 2D focal light intensity distributions and 1D cross-sectional intensity profile along x are plotted in Figs. 5(b) and 5(d) in subplots (i)–(iv), respectively. Despite an intensity drop, the focus was well preserved, even when the background medium decorrelated within as short as 0.28 s. Such demonstrated capabilities take a quantum leap from an earlier demonstration [28], where the slow response of the system forced us to temporarily stop the blood flow to facilitate field measurements, and required absolutely stationary background media.

 figure: Fig. 5.

Fig. 5. Tissue-mimicking phantom experiment. (a) Experimental arrangement. RBC, red blood cell; BS, beam splitter. (b) Focal light intensity distribution, each averaged over 100 speckle realizations, measured at different movement speeds of the media. (c) Medium’s correlation time as a function of its movement speed. The open triangles are measured data, whereas the solid line is the fitted curve. (d) Evolution of the focal intensity profile with increasing media decorrelation rate. Indices (i) through (iv) in (b)–(d) show different media’s correlation times as shown in (c). Scale bar, 500 μm.

Download Full Size | PDF

C. Deep-Flow Measurement

As shown in the preceding section, blood flow perturbs the scattered light field, which enables time-reversed focusing: The field decorrelation associated with the RBC movement is captured externally and is converted to a differential field, the conjugate copy of which ultimately leads to the time-reversed focusing. Two consecutive laser pulses “see” two sets of spatially shifted RBC positions, as illustrated in Fig. 6(a). The displacement d=v×Δt, where v is the flow speed and Δt is the pulse interval. A larger displacement results in a greater decorrelation [Fig. 6(d)], creating a stronger differential field [Fig. 6(b)] and a brighter focus [Fig. 6(c)]. The focusing power (PTRAP) is a function of the RBC displacement:

PTRAP=Pmax{1{ξsinξ}/π},
where ξ=2cos1(dD); D is the average diameter of the moving particle and Pmax is the maximum power (see Supplement 1, Method D, for a detailed analysis).

 figure: Fig. 6.

Fig. 6. Deep-flow measurement with single-exposure b-TRAP focusing. (a) Simplified schematic. d, displacement; D, size of the moving particle. (b, c) Intensity maps of the exterior differential field (upper row, simulation) and interior focal field (lower row, experimental) at various target displacements. (d) Correlation of the scattered fields at different target displacements. Filled stars, simulation; dashed curve, theory. (e) Flow measurement results showing focal PBR as a function of flow speed, obtained at 500 and 800 Hz laser repetition rates. Discrete points are experimental data, whereas curves are theoretical fittings. Scale bar, 500 μm.

Download Full Size | PDF

At fixed Δt, d was adjusted by varying v, giving rise to dramatically different focal PBRs. Blood flow speed was controlled by a motorized syringe pump during the measurement. We used a hybrid scheme to generate the digital hologram for the best focal PBR. Two laser repetition rates were employed during the test: fL=500Hz and fL=800Hz. For fL=500Hz, fC=12.5Hz, Δf=250Hz, and texp=3ms. For fL=800Hz, fC=12.5Hz, Δf=400Hz, and texp=2ms. At a fixed flow speed, 51 single-exposure b-TRAP holograms were recorded and the hybrid holograms were calculated using HH,i=HSE,i+1HSE,i (i=1,,50), where HH,i represents the ith hybrid hologram and HSE,i denotes the ith single-exposure hologram. The focal PBR was then characterized using a CMOS camera (Firefly MV, Point Gray, Canada) by averaging over the 50 corresponding focal light patterns. Repeating the above procedure at various flow speeds produced the experimental results shown in Fig. 6(e). To finalize the characterization process, the results were then fitted using a nonlinear least-square model to Eq. (6), with Pmax and D as unknown parameters. Experimental results are compared with theoretical ones for Δt=2ms (500 Hz laser repetition rate) and Δt=1.25ms (800 Hz laser repetition rate) in Fig. 6(e). The theoretical curves were plotted based on Eq. (6), with Pmax and D fitted to the experimental data. The effective RBC diameters were found to be 3.4 and 3.2 μm for Δt=2 and 1.25 ms, respectively; the difference is attributed to measurement noise. For flow measurement, the laser repetition rate can be swept to scan d, and v can then be obtained readily by fitting. The focal PBR and location can be acquired photoacoustically [38].

In the experiment, the interval between the two field measurements must be precisely adjustable and can be squeezed below the target decorrelation time. Among all technologies developed to date, only single-exposure b-TRAP focusing has this unique capability. It is important to note that in such a working mode, the time to generate a hologram is entirely dependent on the laser pulse interval (as opposed to the camera frame rate), which is short and highly adjustable. Consequently, the finely and broadly tunable Δt makes the method extremely appealing due to its large dynamic range: it can measure both slow [39] and fast [40] flow, and extends the laser speckle contrast imaging of blood flow [31] into the diffusive regime.

4. DISCUSSION AND CONCLUSION

We discovered that the b-TRAP mask is equivalent to the hologram generated by the binary amplitude iterative WFS technique [13], but we doubled the PBR by employing a zero-order block for binary phase modulation [27] (see Supplement 1, Discussion C, for details). Using a DMD, the binary amplitude iterative WFS technique took several minutes to find the mask with 3228 degrees of freedom (DOFs; i.e., number of controlled spatial modes); the limited speed was attributed to the iterative algorithm and data transfer between a personal computer and the DMD. In comparison, b-TRAP focuses in 143 ms with a DOF of 5×105, equivalently 105 faster than the iterative WFS approach on a per mode basis.

In OPC, two types of systems were developed. The analog systems perform OPC using nonlinear crystals. The response of such systems can be fast, ranging from milliseconds [25] to microseconds [41]. The DOFs of the analog systems are large [25] and can exceed 107. Nevertheless, the gains of the systems are low. Despite a large power gain demonstrated recently using a pulsed hologram readout [42], the achievable energy gain is still well below unity. Without large energy gains, many applications are still infeasible.

In digital systems, OPC is accomplished by digital SLMs, which can provide high gains [20]. However, the low camera frame rates significantly limit the field measurement times and the overall speeds. A single-shot off-axis holographic scheme has been employed to reduce the field measurement time and accelerate focusing [32]. However, the speed improvement compromises spatial resolution and reduces the total number of DOFs significantly (see Supplement 1, Discussion A). In contrast, b-TRAP focusing achieves a similar field measurement time (enabled by single-shot holographic recording) while preserving the number of DOFs; thus, the technology has the shortest average mode time among all digital systems developed to date. (We have demonstrated an average mode time of 0.3μs/mode, using a focusing repetition rate of 7 Hz and 5×105 spatial modes.) Moreover, for double-exposure b-TRAP focusing, the computational load is significantly reduced compared with that in other digital approaches. It took 30ms on a computer with a 3.6 GHz quad-core i7 CPU (Intel, USA) and 1600 MHz memory frequency for Matlab to generate a binary mask with 1920×1080 resolution. The single-exposure scheme further improves the focusing speed by automatically forming the TRAP hologram within one camera exposure, thereby decoupling the speed from the camera frame rate and hologram computation time, leaving the ultimate speed defined by the rates of data transfer and SLM actuation. In deep-flow measurements, we have achieved a hologram formation time of 1.25 ms, which is nearly two orders of magnitude shorter than that of the state-of-the-art technique [26]. By using a pulsed laser with a >1MHz repetition rate, the hologram formation time can be further reduced to below 1 μs, sufficiently fast for most biological applications. Moreover, this unique capability allows us to not only detect but also quantify target decorrelation during time reversal (which is the key to deep-flow measurement).

The demonstrated binary modulation makes b-TRAP focusing implementable on DMDs with minimal system modification, which can potentially further improve light focusing speed and make in vivo applications possible. Currently, besides low speed, the number of DOFs supported by a liquid-crystal-based SLM is insufficient for most real applications, since the resultant low focal PBR in deep tissue is unsuitable for applications such as imaging, therapy, or control. On the other hand, the DMD has recently emerged as an attractive solution for optical time reversal, thanks to its high speed [8,12,13,27,4348], and its relatively low price makes the use of multiple devices in parallel affordable, which can potentially increase the total number of DOFs dramatically. The method invented here can be integrated with other time-reversal-based approaches, such as ultrasonically encoded focusing [time-reversed ultrasonically encoded (TRUE)] [1820], to improve their speeds and efficiencies.

Single-exposure b-TRAP focusing has a smaller diffraction efficiency than the double-exposure approach because the ratio of the TRAP component in the hologram is lower. As dictated by the nature of amplitude modulation, b-TRAP schemes have weaker diffractions compared with focusing methods implementing phase modulations; the focusing efficiency is about 10 times lower (see Supplement 1, Discussion B). It is important to note that a lower diffraction efficiency does not necessarily lead to lower PBRs (which determines the focusing quality). The light reflected as the zero-order component can be effectively blocked by a spatial filter, leading to binary phase modulation with a focal PBR of 40% of that attainable using a phase-only approach (see Supplement 1, Discussion C). To compensate for the lower reflectivity, stronger input light can be used as long as damage to the SLM is avoided. Multiple DMDs can work in parallel to further enhance the energy gain.

In sum, optical time-reversal techniques promise to revolutionize biomedical optics by dramatically extending the depth of optical focusing inside tissue. However, several key factors, including gain, speed, and focal PBR, must be simultaneously improved to implement these techniques in vivo. b-TRAP focusing has shown great potential in fulfilling all these criteria and in bridging the gap between laboratory explorations and real-world applications of deep-tissue biophotonics. The technology has anticipated applications in deep-tissue molecular imaging [49], flow measurement and cytometry [26], photodynamic therapy [50], optogenetics [51], microsurgery [4], and more.

Funding

National Institutes of Health (NIH) (DP1 EB016986, R01 CA186567).

Acknowledgment

We thank Song Hu for discussions about the flow measurement experiment and James Ballard for editing the manuscript.

 

See Supplement 1 for supporting content.

REFERENCES

1. L. V. Wang and H.-i. Wu, Biomedical Optics: Principles and Imaging (Wiley, 2012).

2. D. G. Grier, “A revolution in optical manipulation,” Nature 424, 810–816 (2003). [CrossRef]  

3. E. S. Boyden, F. Zhang, E. Bamberg, G. Nagel, and K. Deisseroth, “Millisecond-timescale, genetically targeted optical control of neural activity,” Nat. Neurosci. 8, 1263–1268 (2005). [CrossRef]  

4. M. F. Yanik, H. Cinar, H. N. Cinar, A. D. Chisholm, Y. Jin, and A. Ben-Yakar, “Neurosurgery: functional regeneration after laser axotomy,” Nature 432, 822 (2004). [CrossRef]  

5. V. Ntziachristos, “Going deeper than microscopy: the optical imaging frontier in biology,” Nat. Methods 7, 603–614 (2010). [CrossRef]  

6. Y. Liu, C. Zhang, and L. V. Wang, “Effects of light scattering on optical-resolution photoacoustic microscopy,” J. Biomed. Opt. 17, 126014 (2012). [CrossRef]  

7. I. M. Vellekoop and A. P. Mosk, “Focusing coherent light through opaque strongly scattering media,” Opt. Lett. 32, 2309–2311 (2007). [CrossRef]  

8. D. B. Conkey, A. M. Caravaca-Aguirre, and R. Piestun, “High-speed scattering medium characterization with application to focusing light through turbid media,” Opt. Express 20, 1733–1740 (2012). [CrossRef]  

9. T. Chaigne, O. Katz, A. C. Boccara, M. Fink, E. Bossy, and S. Gigan, “Controlling light in scattering media non-invasively using the photoacoustic transmission matrix,” Nat. Photonics 8, 58–64 (2014). [CrossRef]  

10. J. W. Tay, P. Lai, Y. Suzuki, and L. V. Wang, “Ultrasonically encoded wavefront shaping for focusing into random media,” Sci. Rep. 4, 3918 (2014). [CrossRef]  

11. P. Lai, L. Wang, J. W. Tay, and L. V. Wang, “Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media,” Nat. Photonics 9, 126–132 (2015). [CrossRef]  

12. A. M. Caravaca-Aguirre, E. Niv, D. B. Conkey, and R. Piestun, “Real-time resilient focusing through a bending multimode fiber,” Opt. Express 21, 12881–12887 (2013). [CrossRef]  

13. D. Akbulut, T. J. Huisman, E. G. van Putten, W. L. Vos, and A. P. Mosk, “Focusing light through random photonic media by binary amplitude modulation,” Opt. Express 19, 4017–4029 (2011). [CrossRef]  

14. A. P. Mosk, A. Lagendijk, G. Lerosey, and M. Fink, “Controlling waves in space and time for imaging and focusing in complex media,” Nat. Photonics 6, 283–292 (2012). [CrossRef]  

15. C.-L. Hsieh, Y. Pu, R. Grange, and D. Psaltis, “Digital phase conjugation of second harmonic radiation emitted by nanoparticles in turbid media,” Opt. Express 18, 12283–12290 (2010). [CrossRef]  

16. I. M. Vellekoop and C. M. Aegerter, “Scattered light fluorescence microscopy: imaging through turbid layers,” Opt. Lett. 35, 1245–1247 (2010). [CrossRef]  

17. I. M. Vellekoop, M. Cui, and C. Yang, “Digital optical phase conjugation of fluorescence in turbid tissue,” Appl. Phys. Lett. 101, 081108 (2012). [CrossRef]  

18. X. Xu, H. Liu, and L. V. Wang, “Time-reversed ultrasonically encoded optical focusing into scattering media,” Nat. Photonics 5, 154–157 (2011). [CrossRef]  

19. K. Si, R. Fiolka, and M. Cui, “Fluorescence imaging beyond the ballistic regime by ultrasound-pulse-guided digital phase conjugation,” Nat. Photonics 6, 657–661 (2012). [CrossRef]  

20. Y. M. Wang, B. Judkewitz, C. A. DiMarzio, and C. Yang, “Deep-tissue focal fluorescence imaging with digitally time-reversed ultrasound-encoded light,” Nat. Commun. 3, 928 (2012). [CrossRef]  

21. Z. Yaqoob, D. Psaltis, M. S. Feld, and C. Yang, “Optical phase conjugation for turbidity suppression in biological samples,” Nat. Photonics 2, 110–115 (2008). [CrossRef]  

22. M. Cui, E. J. McDowell, and C. Yang, “An in vivo study of turbidity suppression by optical phase conjugation (TSOPC) on rabbit ear,” Opt. Express 18, 25–30 (2010). [CrossRef]  

23. M. Cui and C. Yang, “Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation,” Opt. Express 18, 3444–3455 (2010). [CrossRef]  

24. M. Gross, M. Lesaffre, F. Ramaz, P. Delaye, G. Roosen, and A. C. Boccara, “Detection of the tagged or untagged photons in acousto-optic imaging of thick highly scattering media by photorefractive adaptive holography,” Eur. Phys. J. E 28, 173–182 (2009). [CrossRef]  

25. Y. Liu, P. Lai, C. Ma, X. Xu, A. A. Grabar, and L. V. Wang, “Optical focusing deep inside dynamic scattering media with near-infrared time-reversed ultrasonically encoded (TRUE) light,” Nat. Commun. 6, 5904 (2015). [CrossRef]  

26. E. H. Zhou, H. Ruan, C. Yang, and B. Judkewitz, “Focusing on moving targets through scattering samples,” Optica 1, 227–232 (2014). [CrossRef]  

27. S. N. Chandrasekaran, H. Ligtenberg, W. Steenbergen, and I. M. Vellekoop, “Using digital micromirror devices for focusing light through turbid media,” Proc. SPIE 8979, 897905 (2014). [CrossRef]  

28. C. Ma, X. Xu, Y. Liu, and L. V. Wang, “Time-reversed adapted-perturbation (TRAP) optical focusing onto dynamic objects inside scattering media,” Nat. Photonics 8, 931–936 (2014). [CrossRef]  

29. I. Yamaguchi and T. Zhang, “Phase-shifting digital holography,” Opt. Lett. 22, 1268–1270 (1997). [CrossRef]  

30. D. Z. Anderson and J. Feinberg, “Optical novelty filters,” IEEE J. Quantum Electron. 25, 635–647 (1989). [CrossRef]  

31. D. A. Boas and A. K. Dunn, “Laser speckle contrast imaging in biomedical optics,” J. Biomed. Opt. 15, 011109 (2010). [CrossRef]  

32. M. Jang, H. Ruan, I. M. Vellekoop, B. Judkewitz, E. Chung, and C. Yang, “Relation between speckle decorrelation and optical phase conjugation (OPC)-based turbidity suppression through dynamic scattering media: a study on in vivo mouse skin,” Biomed. Opt. Express 6, 72–85 (2015). [CrossRef]  

33. N. Ji, T. R. Sato, and E. Betzig, “Characterization and adaptive optical correction of aberrations during in vivo imaging in the mouse cortex,” Proc. Natl. Acad. Sci. USA 109, 22–27 (2012). [CrossRef]  

34. C.-C. Wang, C. Thorpe, S. Thrun, M. Hebert, and H. Durrant-Whyte, “Simultaneous localization, mapping and moving object tracking,” Int. J. Rob. Res. 26, 889–916 (2007). [CrossRef]  

35. R. Cudney, R. Pierce, and J. Feinberg, “The transient detection microscope,” Nature 332, 424–426 (1988). [CrossRef]  

36. L. V. Wang and S. Hu, “Photoacoustic tomography: in vivo imaging from organelles to organs,” Science 335, 1458–1462 (2012). [CrossRef]  

37. C. C. Dierickx, J. M. Casparian, V. Venugopalan, W. A. Farinelli, and R. R. Anderson, “Thermal relaxation of port-wine stain vessels probed in vivo: the need for 1–10-millisecond laser pulse treatment,” J. Invest. Dermatol. 105, 709–714 (1995). [CrossRef]  

38. H. F. Zhang, K. Maslov, G. Stoica, and L. V. Wang, “Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imaging,” Nat. Biotechnol. 24, 848–851 (2006). [CrossRef]  

39. L. Wang, J. Xia, J. Yao, K. I. Maslov, and L. V. Wang, “Ultrasonically encoded photoacoustic flowgraphy in biological tissue,” Phys. Rev. Lett. 111, 204301 (2013). [CrossRef]  

40. L. Hatle and B. Angelsen, Doppler Ultrasound in Cardiology: Physical Principles and Clinical Applications (Lea & Febiger, 1985).

41. B. Jayet, J.-P. Huignard, and F. Ramaz, “Optical phase conjugation in Nd: YVO4 for acousto-optic detection in scattering media,” Opt. Lett. 38, 1256–1258 (2013). [CrossRef]  

42. C. Ma, X. Xu, and L. V. Wang, “Analog time-reversed ultrasonically encoded light focusing inside scattering media with a 33,000× optical power gain,” Sci. Rep. 5, 8896 (2015). [CrossRef]  

43. J. W. Tay, J. Liang, and L. V. Wang, “Amplitude-masked photoacoustic wavefront shaping and application in flowmetry,” Opt. Lett. 39, 5499–5502 (2014). [CrossRef]  

44. A. Drémeau, A. Liutkus, D. Martina, O. Katz, C. Schülke, F. Krzakala, S. Gigan, and L. Daudet, “Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques,” Opt. Express 23, 11898–11911 (2015). [CrossRef]  

45. D. Kim, W. Choi, M. Kim, J. Moon, K. Seo, S. Ju, and W. Choi, “Implementing transmission eigenchannels of disordered media by a binary-control digital micromirror device,” Opt. Commun. 330, 35–39 (2014). [CrossRef]  

46. D. Kim, J. Moon, M. Kim, T. D. Yang, J. Kim, E. Chung, and W. Choi, “Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle,” Opt. Lett. 39, 1921–1924 (2014). [CrossRef]  

47. X. Zhang and P. Kner, “Binary wavefront optimization using a genetic algorithm,” J. Opt. 16, 125704 (2014). [CrossRef]  

48. D. Wang, E. H. Zhou, J. Brake, H. Ruan, M. Jang, and C. Yang, “Focusing through dynamic tissue with millisecond digital optical phase conjugation,” Optica 2, 728–735 (2015). [CrossRef]  

49. R. Weissleder and M. J. Pittet, “Imaging in the era of molecular oncology,” Nature 452, 580–589 (2008). [CrossRef]  

50. T. J. Dougherty, C. J. Gomer, B. W. Henderson, G. Jori, D. Kessel, M. Korbelik, J. Moan, and Q. Peng, “Photodynamic therapy,” J. Natl. Cancer Inst. 90, 889–905 (1998).

51. A. M. Packer, B. Roska, and M. Häusser, “Targeting neurons and photons for optogenetics,” Nat. Neurosci. 16, 805–815 (2013). [CrossRef]  

Supplementary Material (1)

NameDescription
Supplement 1: PDF (1924 KB)      Supplemental document

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (6)

Fig. 1.
Fig. 1. Principle and schematic of b-TRAP focusing. (a)–(c) Principle of b-TRAP focusing (for details see text). (d) Schematic of the focusing method. The green (solid) arrows represent the light path in the probing process; the blue (slim) arrows show the light path in the time-reversal process. AOM, acousto-optic modulator; BS, beam splitter; CL, camera lens; L, lens; M, mirror; OS, optical shutter; sCMOS, scientific complementary metal oxide semiconductor camera; SF, spatial filter (zero-order block); SLM, spatial light modulator.
Fig. 2.
Fig. 2. Influence of field sampling scheme on the focusing quality under both target and medium decorrelations. (a)–(c) Time-dependent correlation coefficients of the scattered electromagnetic fields due to the target and the background (upper rows), and the field sampling schemes (lower rows). (a) Full-field (amplitude and phase) sampling using a phase-shifting scheme. (b) Amplitude-only sampling with double camera exposures and digital subtraction. (c) Amplitude-only sampling with single camera exposure and automatic analog subtraction. (d)–(f) Simulated focal light intensity distributions corresponding to the sampling schemes in (a)–(c), normalized by the peak intensity in (f).
Fig. 3.
Fig. 3. Influence of beam ratio IS/IR on the PBR of b-TRAP focusing. Discrete points are from numerical simulations, whereas lines are from the analytical model. The total number of controls is 100.
Fig. 4.
Fig. 4. Tracking a moving target inside scattering media. (a) Experimental scheme. The hair target between two scattering media moves back and forth on a motorized stage. (b) Measured time trace of the focal light intensity distribution. Each row depicts the light intensity distribution (integrated along y) at a fixed time point. Each column shows the temporal evolution of the intensity at a fixed position. Process repetition rate, 7 Hz. Inset: intensity profile along the dashed line.
Fig. 5.
Fig. 5. Tissue-mimicking phantom experiment. (a) Experimental arrangement. RBC, red blood cell; BS, beam splitter. (b) Focal light intensity distribution, each averaged over 100 speckle realizations, measured at different movement speeds of the media. (c) Medium’s correlation time as a function of its movement speed. The open triangles are measured data, whereas the solid line is the fitted curve. (d) Evolution of the focal intensity profile with increasing media decorrelation rate. Indices (i) through (iv) in (b)–(d) show different media’s correlation times as shown in (c). Scale bar, 500 μm.
Fig. 6.
Fig. 6. Deep-flow measurement with single-exposure b-TRAP focusing. (a) Simplified schematic. d, displacement; D, size of the moving particle. (b, c) Intensity maps of the exterior differential field (upper row, simulation) and interior focal field (lower row, experimental) at various target displacements. (d) Correlation of the scattered fields at different target displacements. Filled stars, simulation; dashed curve, theory. (e) Flow measurement results showing focal PBR as a function of flow speed, obtained at 500 and 800 Hz laser repetition rates. Discrete points are experimental data, whereas curves are theoretical fittings. Scale bar, 500 μm.

Equations (6)

Equations on this page are rendered with MathJax. Learn more.

I(t1)=|ES(t1)|2+|ER|2+ES*(t1)ER+ES(t1)ER*.
I(t2)=|ES(t2)|2+|ER|2+ES*(t2)ER+ES(t2)ER*.
ΔI=I(t2)I(t1)=Δ|ES|2+ΔES*ER+ΔESER*,
I=|ES|2+2|ER|2ΔES*ERΔESER*,
tC[s]=1.2[μm]×{v[μm/s]}1,
PTRAP=Pmax{1{ξsinξ}/π},
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.