Abstract
Light scattering inhibits high-resolution optical imaging, manipulation, and therapy deep inside biological tissue by preventing focusing. To form deep foci, wavefront-shaping techniques that break the optical diffusion limit have been developed. For in vivo applications, such focusing must provide a high gain, high speed, and a high focal peak-to-background ratio. However, none of the previous techniques meet these requirements simultaneously. Here, we overcome this challenge by rapidly measuring the perturbed optical field within a single camera exposure followed by adaptively time-reversing the phase-binarized perturbation. Consequently, a phase-conjugated wavefront is synthesized within a millisecond, two orders of magnitude shorter than the digitally achieved record. We demonstrate real-time focusing in dynamic scattering media and extend laser speckle contrast imaging to new depths. The unprecedented combination of a fast response, high gain, and high focusing contrast makes this work a major stride toward in vivo deep-tissue optical imaging, manipulation, and therapy.
© 2015 Optical Society of America
1. INTRODUCTION
Visible and near-infrared photons occupy a unique portion of the electromagnetic spectrum: Through noncarcinogenic molecular interactions with biological tissue and exogenous agents, they provide rich structural and physiological information [1] and noninvasive solutions for manipulation [2], control [3], and therapy [4]. However, these photons undergo severe scattering in tissue, rendering traditional control over their propagation completely ineffective beyond the optical diffusion limit—about 1 mm in biological tissue [5,6]. Such scattering shuts the door to important diagnostic and therapeutic applications at depths.
In recent years, the optical diffusion limit has been conquered by two categories of wavefront-shaping (WFS) techniques: iterative WFS and optical time reversal. In iterative WFS [7–13], a subset of the transmission matrix [14] of the scattering medium is measured iteratively. Subsequently, the phase of the light is controlled spatially to compensate for the inhomogeneous delays due to random scattering, generating a focus through constructive interference. In optical time reversal, the optical wavefront from a real [15–17] or virtual guide star [18–20] is detected, and its phase-conjugated copy is converged back to the origin. A feasible approach to achieving time reversal is through optical phase conjugation (OPC) [21–23].
Due to the highly dynamic and scattering nature of living tissue, it is important that the focusing be sufficiently fast (ideally with a response time of [24,25]) and have high quality [i.e., having a large number of independent control elements for a high focal peak-to-background ratio (PBR) [14]]. Consequently, an important figure of merit is the average mode time (i.e., the average operation time per spatial mode [7,8,14]), which should ideally approach (for a 1 ms response time with a billion modes).
However, the average mode times achieved by existing techniques are orders of magnitude greater than , preventing any practical applications in biological tissue. For example, iterative WFS achieved an average mode time of (37 ms for 256 spatial modes [12]) in the fastest implementation of this technique. Ultimately, when data transfer and processing times are assumed to be negligible, iterative WFS can achieve an average mode time of by employing a digital micromirror device (DMD) for wavefront control [8,12,13]. In contrast, because OPC measures the desired wavefront at once, it is potentially faster. Analog OPC [18,21,22,25] approaches based on nonlinear optical crystals demonstrated a short average mode time (, a 10 ms response time for modes [25]), but suffered from an energy gain (defined as the ratio of the focal light energy in the reading phase to that in the probing phase) well below unity, which is a drawback detrimental to widespread applications. In comparison, digital OPC (DOPC) [15,19,20] provides inherently large gains and reasonably fast responses, with being realized recently for focusing inside scattering media [26] (a 100 ms response time with 50,000 spatial modes). The lowest possible average mode time () for previous DOPC techniques is dictated by the phase modulation speed (assuming a 30 ms settling time and spatial modes), and it is still four orders of magnitude longer than the goal of . To break through this limit, the slow phase modulation must be replaced by a faster binary amplitude or phase modulation [27], which could potentially reach using a DMD (assuming an 18 μs settling time [13] and spatial modes). To date, none of the existing DOPC technologies for focusing inside scattering media have been demonstrated using binary modulation.
Here we address this challenge by demonstrating light focusing inside scattering media using binary phase modulation. The technology, named binarized time-reversed adapted-perturbation optical focusing (-TRAP), has achieved the shortest average mode time to date () among all methods developed for focusing inside scattering media with high energy gains. Compared with the binary-amplitude WFS technology [13], which finds and utilizes the same binary mask, our technology uses an adaptive mask, enhances the speed by times, and doubles the focusing quality at no additional cost. More strikingly, we show that by using -TRAP, the formation time of the binary mask is determined only by the laser pulse interval, which is highly tunable and can be less than 1 μs. These features not only facilitate fast light focusing, but also enable us to acquire detailed information about tissue dynamics (such as blood flow speed). The capabilities demonstrated pave the way toward in vivo deep-tissue biophotonics.
2. METHODS
A. Basic Principle
Time reversal by analysis of changing wavefronts from kinetic targets (TRACK) and TRAP optical focusing [26,28] employ intrinsic tissue dynamics as guide stars for completely noninvasive and noncontact light focusing inside scattering media. In short, if the scattered fields at two instants are recorded in the presence of internal dynamic perturbations (e.g., absorption or refractive index changes), subtracting the two fields generates a differential field whose conjugate copy enables focusing at the perturbed sites by canceling the scattering contribution originating from the static portion of the medium.
The original TRAP focusing [28] relied on phase-shifting holography [29] to record the complex amplitude of the scattered electromagnetic fields, which took multiple intensity measurements to accomplish and was impractically slow for many applications. In comparison, -TRAP measures each field indirectly within the time duration of a single laser pulse. As shown in Fig. 1(a), at instant , a short laser pulse probes the scattering medium in which the permittivity of the target (i.e., the guide star) is . The exterior scattered light field, termed the “sample beam,” whose complex amplitude is expressed as , is combined with a planar reference beam on an amplitude-only spatial light modulator (SLM). The SLM surface is imaged onto a scientific complementary metal oxide semiconductor camera (sCMOS) to generate a time-averaged intensity pattern
As shown in Fig. 1(b), at a later instant , the above process is repeated, at which time the target permittivity has changed to from either a naturally occurring event, such as movement, or from an externally induced perturbation. The result is a different intensity pattern
Subtracting the two patterns [Eqs. (1) and (2)] generates multiple terms:
where and . The second term on the right-hand side in Eq. (3) encodes the TRAP field , which can be reconstructed upon reading an amplitude hologram with a conjugate reference (reading) beam [Fig. 1(c)]. It should be noted that -TRAP focusing dramatically simplifies the complicated task of complex amplitude measurement and allows indirect, single-laser-shot electric field recording. The advantages of the new technology will be discussed in detail in the next section.The above focusing procedure can be implemented using the schematic shown in Fig. 1(d). The system employs a Mach–Zehnder interferometric structure where the scattering medium resides in one arm and the planar reference/reading beam is generated in the other. Intensity patterns and are recorded via an sCMOS camera. The SLM, along with the camera, forms a DOPC system [23]. Adjusting the driving frequencies ( and ) of the two acousto-optic modulators (AOMs) allows the system to work under different operation modes, as detailed in the next section. For a more detailed description of the system setup, see Supplement 1, Method A.
B. Operation Modes
TRAP relies on embedded novelties [30] to guide light focusing, meaning that the target’s permittivity must be time-variant. Accordingly, the light field scattered by the target continuously decorrelates over time [31]. In real practice, the background medium (e.g., biological tissue) also generates time-variant scattering, resulting in a continuously decorrelating background field. The focusing quality sensitively hinges on the background field decorrelation during the entire time-reversal process [25,32]. Hence, TRAP focusing is valid only if the field from the target decorrelates faster than the field from the surrounding medium. The time interval between the field measurements must be chosen properly to allow detectable target decorrelation yet a highly correlated background. The above condition is illustrated in Figs. 2(a)–2(c). The curves drawn on the upper rows depict distinct correlation decays derived from the target’s and background’s scatterings. During the process, the difference between the two field measurements exposes the target decorrelation against a relatively stable background. For example, the correlation time of flowing blood is of the order of milliseconds, whereas that of the surrounding tissue varies, but is at least 10 times slower [22,25,33] with proper stabilization.
Note that the duration of each field measurement must be shorter than the target decorrelation time to avoid significant reduction of the focal PBR. As shown in Fig. 2(a), the original TRAP focusing scheme relied on digital phase-shifting holography, which required at least four laser shots synchronized with four camera exposures to complete a single field measurement. The speed of the method was primarily restricted by the camera frame rate. For example, if the camera ran at 50 Hz, the minimum duration of four exposures was . Consequently, the target needed to be stable within 60 ms, which is impractically long for many applications. Moreover, the second field measurement had to be delayed significantly (e.g., to after 1 s) due to the slow target decorrelation, making the method applicable only to a nearly stable background.
To remove such limitations, the field measurement time must be shortened. As shown in Fig. 2(b), -TRAP records each of the two fields with a single laser shot, which is accomplished on a time scale defined by the laser pulse width. By using a laser with a 6 ns pulse width, the original constraint on the target correlation time is relaxed by seven orders of magnitude (from 60 ms to 6 ns [28]). Such a fast field measurement makes -TRAP applicable to almost any biological targets. The phase differences between the reference beam and the static portion of the sample beam are kept constant for the two measurements, and thus, digitally subtracting the two intensity patterns directly generates the TRAP field [Eq. (3)]. The response speed of the scheme is limited only by the camera frame rate and the SLM refresh time. Because it requires two camera exposures, the scheme is named double-exposure -TRAP focusing.
-TRAP focusing has been made even more powerful by the single camera-exposure scheme described below (referred to as single-exposure -TRAP hereafter), which can reduce the hologram formation time by two orders of magnitude in comparison with the state of the art [26]. As shown in Fig. 2(c), in this mode, one camera exposure records two consecutive laser shots, with a phase shift introduced between the sample and reference beams in the second shot. The intensities of the first and second light pulses are and , respectively. In a single exposure, the two intensities are added automatically by the camera sensor, resulting in a total intensity of
where , and the TRAP field is encoded in the third term. By reading the hologram using a planar reading beam, the TRAP field is reconstructed. In this focusing mode, the time interval between the two field measurements is determined by the laser repetition rate, making the procedure independent of the camera frame rate. Thus, a hologram can be formed within less than 1 μs for operation at a laser repetition rate (e.g., by using a mode-locked laser). The ultimate speed is determined only by the image transfer and SLM refresh rates.The advantage of -TRAP focusing is demonstrated by the simulation results shown in Figs. 2(d)–2(f). In these simulations, a point target moves (downward) inside a dynamic scattering medium. The original TRAP scheme [Fig. 2(a)] fails to focus [Fig. 2(d)] due to its low speed. In vivid contrast, -TRAP focusing successfully captures the target movement and focuses into the time-variant scattering media with double exposures [Fig. 2(e)] and a single exposure [Fig. 2(f)]. However, single-exposure -TRAP shows the strongest background suppression [Fig. 2(f)], thanks to its higher speed and greater tolerance to medium decorrelation: For TRAP to work, the medium should be stable when and are measured—a requirement most easily fulfilled by the single-exposure scheme. In the simulation, the single-exposure approach yields the highest PBR since the background decorrelates 10 times less than that in double-exposure -TRAP and 70 times less than that in traditional TRAP focusing. See in Supplement 1, Method B, for the detailed simulation method.
In the experiment, for double-exposure -TRAP focusing, the modulation frequencies of AOM1 and AOM2 are set to (50 MHz is the central frequency of the device) and . The frequency difference is , where is the frame rate of the camera and is a non-negative integer. The laser repetition rate is , where is a positive integer. In the single-exposure scheme, the sign of the beat between the sample and reference beams flips from shot to shot, requiring , where is a non-negative integer. Laser shots are synchronized with camera exposures, with and , where is the camera exposure time.
C. Hologram Binarization
SLMs with binary modulation, such as DMDs, provide much faster actuation in comparison with their grayscale-modulation counterparts. As such, the intensity holograms shown in Eqs. (3) and (4) are binarized to facilitate the implementation of -TRAP focusing on such devices. The binarization process is straightforward: The mean intensity of the hologram is used as a threshold. Pixel values exceeding the threshold are set to unity; otherwise, they are set to 0. We used a zero-order block to double the focal PBR by converting binary amplitude to binary phase modulation [27].
The binarization process is subject to contamination from the speckle background ( in Eq. (3) and in Eq. (4)], which causes error in the hologram and consequently reduces the focal PBR. In order for the binarization to work properly, the reference beam intensity should be sufficiently large, so that the TRAP term [ in Eqs. (3) and (4)] dominates. A theoretical model is provided in Supplement 1, Discussion C, to show the relationship between the beam ratio and the focal PBR. Computer simulations were performed to verify the theory. Simulation and analytical results are coplotted in Fig. 3 for both the double- and single-exposure sampling schemes. As evident from the figure, the PBRs undergo continuous reduction when the beam ratio increases.
In -TRAP focusing, we used an on-axis spatial sampling scheme. It is also possible to use an off-axis sampling scheme for both double- and single-exposure TRAP hologram measurements [26]. The advantage of using an off-axis scheme is apparent: by using a sufficiently high carrier spatial frequency, the TRAP term can be separated from the speckle background in the spatial frequency domain. However, this comes at the expense of a reduced spatial bandwidth, resulting in 16 times fewer number of controls in the off-axis scheme compared with that in the on-axis scheme at the same spatial sampling capacity (i.e., camera pixel count; see Supplement 1, Discussion A, for a detailed analysis). Equivalently, the focal PBR will be 16 times lower. According to Fig. 3, as long as the beam ratio is below 6% for single exposure and 10 for double-exposure schemes, the on-axis schemes yields higher PBRs than their off-axis counterparts. Moreover, to calculate the binary hologram, the off-axis scheme has much higher computational complexity in comparison with the on-axis scheme (see, e.g., Ref. [32]), giving rise to a much slower response. Considering all the above factors, we used on-axis sampling scheme, in conjunction with hologram binarization for the subsequent experiments.
3. RESULTS
A. Moving-Object Tracking
Real-time tracking of moving objects has extensive applications [34,35] and TRAP (and TRACK) focusing is the only known optical method that tracks moving objects inside scattering media. A robust tracking system must meet two criteria. First, the time it spends on field measurements must be sufficiently short. Since there is no external control over the objects’ movement speeds, it is essential that the field measurement be accomplished sufficiently fast to accommodate potentially fast field decorrelations. Second, the entire focusing procedure, including the measurement, calculation, and display of the hologram, must be finished within a short time span so as to minimize the spatial lag of the focus and to robustly adapt to any potential host medium decorrelation.
In a demonstration of the original TRAP focusing, the target moved slowly, with an estimated decorrelation time of . With the new -TRAP focusing system, we shortened the field measurement time from 60 ms down to 6 ns and reduced the repetition period from to 140 ms. These speed improvements allowed us to optically track fast-moving objects inside scattering media. A simplified experimental setting is depicted in Fig. 4(a), where a black human hair target ( in diameter), positioned vertically between two optical diffusers (DG10-600, Thorlabs, USA), was mounted onto a motorized stage. The target was moved back and forth in the direction at a speed of (with an estimated decorrelation time of ), while -TRAP focusing was performed at a repetition rate of 7 Hz. A detailed explanation of the timing of the focusing procedure, including key steps and their execution times, are provided in Supplement 1, Method C. The focal light intensity distribution was sampled using a beam splitter onto the detection plane of a CMOS camera (Firefly MV, Point Gray, Canada) to monitor the focusing process in real time. The two-dimensional (2D) light intensity distribution was then averaged along , condensed into a 1D intensity map, and stacked in time to form an intensity distribution time trace, as shown in Fig. 4(b). The movement of the target was clearly revealed by the tracking focus. Most of the focusing patterns comprised two foci, typical of TRAP focusing patterns induced by a moving object [28]. As shown in the inset in Fig. 4(b), the twin foci were contributed by the old and new target positions.
B. Tissue-Mimicking Phantom Experiment
One unique feature of TRAP focusing is its ability to concentrate light onto endogenous contrast agents, such as moving red blood cells (RBCs). As RBCs are exclusively confined within blood vessels, TRAP focusing selectively deposits time-reversed photons onto the vasculature. This feature is potentially useful in applications such as photoacoustic tomography of blood vessels [36] and treatment of port-wine stains [37]. It is important to note that living tissue is associated with two distinct correlation times: a fast decorrelation due to blood flow and a slow one from the relatively stationary background [25,32]. The TRAP focusing procedure must be able to capture the fast-changing information and adapt to the slow background evolution.
We demonstrated the above capability in the tissue-mimicking phantom experiment shown in Fig. 5(a). The phantom was composed of two ground-glass diffusers (DG10-600, Thorlabs, USA) as scattering media with a tube (300 μm inner diameter, silicone) containing flowing blood placed vertically in between. The mimic blood vessel was completely invisible outside the ground glass. To mimic tissue decorrelation with a controlled correlation time, the scattering layers were mounted onto a motorized stage with adjustable movement speed. The speckle correlation time [25] of the scattered light was measured as a function of the media’s movement speed and was subsequently fitted according to
as shown in Fig. 5(c). From Eq. (5), we were able to pre-set the tissue correlation time by controlling the media’s movement speeds. During the focusing demonstration, diluted bovine blood [1 (blood):8 (phosphate-buffered saline solution) by volume] was pumped through the silicone tube at a constant flow rate. The moving RBCs perturbed the scattered field, forming targets for time-reversed focusing of the entire vessel. While the focusing procedure was performed at a repetition rate of 7 Hz, the scattering media were translated at various speeds to set the background correlation time to , 0.81, 0.41, and 0.28 s; the corresponding 2D focal light intensity distributions and 1D cross-sectional intensity profile along are plotted in Figs. 5(b) and 5(d) in subplots (i)–(iv), respectively. Despite an intensity drop, the focus was well preserved, even when the background medium decorrelated within as short as 0.28 s. Such demonstrated capabilities take a quantum leap from an earlier demonstration [28], where the slow response of the system forced us to temporarily stop the blood flow to facilitate field measurements, and required absolutely stationary background media.C. Deep-Flow Measurement
As shown in the preceding section, blood flow perturbs the scattered light field, which enables time-reversed focusing: The field decorrelation associated with the RBC movement is captured externally and is converted to a differential field, the conjugate copy of which ultimately leads to the time-reversed focusing. Two consecutive laser pulses “see” two sets of spatially shifted RBC positions, as illustrated in Fig. 6(a). The displacement , where is the flow speed and is the pulse interval. A larger displacement results in a greater decorrelation [Fig. 6(d)], creating a stronger differential field [Fig. 6(b)] and a brighter focus [Fig. 6(c)]. The focusing power () is a function of the RBC displacement:
where ; is the average diameter of the moving particle and is the maximum power (see Supplement 1, Method D, for a detailed analysis).At fixed , was adjusted by varying , giving rise to dramatically different focal PBRs. Blood flow speed was controlled by a motorized syringe pump during the measurement. We used a hybrid scheme to generate the digital hologram for the best focal PBR. Two laser repetition rates were employed during the test: and . For , , , and . For , , , and . At a fixed flow speed, 51 single-exposure -TRAP holograms were recorded and the hybrid holograms were calculated using (), where represents the th hybrid hologram and denotes the th single-exposure hologram. The focal PBR was then characterized using a CMOS camera (Firefly MV, Point Gray, Canada) by averaging over the 50 corresponding focal light patterns. Repeating the above procedure at various flow speeds produced the experimental results shown in Fig. 6(e). To finalize the characterization process, the results were then fitted using a nonlinear least-square model to Eq. (6), with and as unknown parameters. Experimental results are compared with theoretical ones for (500 Hz laser repetition rate) and (800 Hz laser repetition rate) in Fig. 6(e). The theoretical curves were plotted based on Eq. (6), with and fitted to the experimental data. The effective RBC diameters were found to be 3.4 and 3.2 μm for and 1.25 ms, respectively; the difference is attributed to measurement noise. For flow measurement, the laser repetition rate can be swept to scan , and can then be obtained readily by fitting. The focal PBR and location can be acquired photoacoustically [38].
In the experiment, the interval between the two field measurements must be precisely adjustable and can be squeezed below the target decorrelation time. Among all technologies developed to date, only single-exposure -TRAP focusing has this unique capability. It is important to note that in such a working mode, the time to generate a hologram is entirely dependent on the laser pulse interval (as opposed to the camera frame rate), which is short and highly adjustable. Consequently, the finely and broadly tunable makes the method extremely appealing due to its large dynamic range: it can measure both slow [39] and fast [40] flow, and extends the laser speckle contrast imaging of blood flow [31] into the diffusive regime.
4. DISCUSSION AND CONCLUSION
We discovered that the -TRAP mask is equivalent to the hologram generated by the binary amplitude iterative WFS technique [13], but we doubled the PBR by employing a zero-order block for binary phase modulation [27] (see Supplement 1, Discussion C, for details). Using a DMD, the binary amplitude iterative WFS technique took several minutes to find the mask with 3228 degrees of freedom (DOFs; i.e., number of controlled spatial modes); the limited speed was attributed to the iterative algorithm and data transfer between a personal computer and the DMD. In comparison, -TRAP focuses in 143 ms with a DOF of , equivalently faster than the iterative WFS approach on a per mode basis.
In OPC, two types of systems were developed. The analog systems perform OPC using nonlinear crystals. The response of such systems can be fast, ranging from milliseconds [25] to microseconds [41]. The DOFs of the analog systems are large [25] and can exceed . Nevertheless, the gains of the systems are low. Despite a large power gain demonstrated recently using a pulsed hologram readout [42], the achievable energy gain is still well below unity. Without large energy gains, many applications are still infeasible.
In digital systems, OPC is accomplished by digital SLMs, which can provide high gains [20]. However, the low camera frame rates significantly limit the field measurement times and the overall speeds. A single-shot off-axis holographic scheme has been employed to reduce the field measurement time and accelerate focusing [32]. However, the speed improvement compromises spatial resolution and reduces the total number of DOFs significantly (see Supplement 1, Discussion A). In contrast, -TRAP focusing achieves a similar field measurement time (enabled by single-shot holographic recording) while preserving the number of DOFs; thus, the technology has the shortest average mode time among all digital systems developed to date. (We have demonstrated an average mode time of , using a focusing repetition rate of 7 Hz and spatial modes.) Moreover, for double-exposure -TRAP focusing, the computational load is significantly reduced compared with that in other digital approaches. It took on a computer with a 3.6 GHz quad-core i7 CPU (Intel, USA) and 1600 MHz memory frequency for Matlab to generate a binary mask with resolution. The single-exposure scheme further improves the focusing speed by automatically forming the TRAP hologram within one camera exposure, thereby decoupling the speed from the camera frame rate and hologram computation time, leaving the ultimate speed defined by the rates of data transfer and SLM actuation. In deep-flow measurements, we have achieved a hologram formation time of 1.25 ms, which is nearly two orders of magnitude shorter than that of the state-of-the-art technique [26]. By using a pulsed laser with a repetition rate, the hologram formation time can be further reduced to below 1 μs, sufficiently fast for most biological applications. Moreover, this unique capability allows us to not only detect but also quantify target decorrelation during time reversal (which is the key to deep-flow measurement).
The demonstrated binary modulation makes -TRAP focusing implementable on DMDs with minimal system modification, which can potentially further improve light focusing speed and make in vivo applications possible. Currently, besides low speed, the number of DOFs supported by a liquid-crystal-based SLM is insufficient for most real applications, since the resultant low focal PBR in deep tissue is unsuitable for applications such as imaging, therapy, or control. On the other hand, the DMD has recently emerged as an attractive solution for optical time reversal, thanks to its high speed [8,12,13,27,43–48], and its relatively low price makes the use of multiple devices in parallel affordable, which can potentially increase the total number of DOFs dramatically. The method invented here can be integrated with other time-reversal-based approaches, such as ultrasonically encoded focusing [time-reversed ultrasonically encoded (TRUE)] [18–20], to improve their speeds and efficiencies.
Single-exposure -TRAP focusing has a smaller diffraction efficiency than the double-exposure approach because the ratio of the TRAP component in the hologram is lower. As dictated by the nature of amplitude modulation, -TRAP schemes have weaker diffractions compared with focusing methods implementing phase modulations; the focusing efficiency is about 10 times lower (see Supplement 1, Discussion B). It is important to note that a lower diffraction efficiency does not necessarily lead to lower PBRs (which determines the focusing quality). The light reflected as the zero-order component can be effectively blocked by a spatial filter, leading to binary phase modulation with a focal PBR of of that attainable using a phase-only approach (see Supplement 1, Discussion C). To compensate for the lower reflectivity, stronger input light can be used as long as damage to the SLM is avoided. Multiple DMDs can work in parallel to further enhance the energy gain.
In sum, optical time-reversal techniques promise to revolutionize biomedical optics by dramatically extending the depth of optical focusing inside tissue. However, several key factors, including gain, speed, and focal PBR, must be simultaneously improved to implement these techniques in vivo. -TRAP focusing has shown great potential in fulfilling all these criteria and in bridging the gap between laboratory explorations and real-world applications of deep-tissue biophotonics. The technology has anticipated applications in deep-tissue molecular imaging [49], flow measurement and cytometry [26], photodynamic therapy [50], optogenetics [51], microsurgery [4], and more.
Funding
National Institutes of Health (NIH) (DP1 EB016986, R01 CA186567).
Acknowledgment
We thank Song Hu for discussions about the flow measurement experiment and James Ballard for editing the manuscript.
See Supplement 1 for supporting content.
REFERENCES
1. L. V. Wang and H.-i. Wu, Biomedical Optics: Principles and Imaging (Wiley, 2012).
2. D. G. Grier, “A revolution in optical manipulation,” Nature 424, 810–816 (2003). [CrossRef]
3. E. S. Boyden, F. Zhang, E. Bamberg, G. Nagel, and K. Deisseroth, “Millisecond-timescale, genetically targeted optical control of neural activity,” Nat. Neurosci. 8, 1263–1268 (2005). [CrossRef]
4. M. F. Yanik, H. Cinar, H. N. Cinar, A. D. Chisholm, Y. Jin, and A. Ben-Yakar, “Neurosurgery: functional regeneration after laser axotomy,” Nature 432, 822 (2004). [CrossRef]
5. V. Ntziachristos, “Going deeper than microscopy: the optical imaging frontier in biology,” Nat. Methods 7, 603–614 (2010). [CrossRef]
6. Y. Liu, C. Zhang, and L. V. Wang, “Effects of light scattering on optical-resolution photoacoustic microscopy,” J. Biomed. Opt. 17, 126014 (2012). [CrossRef]
7. I. M. Vellekoop and A. P. Mosk, “Focusing coherent light through opaque strongly scattering media,” Opt. Lett. 32, 2309–2311 (2007). [CrossRef]
8. D. B. Conkey, A. M. Caravaca-Aguirre, and R. Piestun, “High-speed scattering medium characterization with application to focusing light through turbid media,” Opt. Express 20, 1733–1740 (2012). [CrossRef]
9. T. Chaigne, O. Katz, A. C. Boccara, M. Fink, E. Bossy, and S. Gigan, “Controlling light in scattering media non-invasively using the photoacoustic transmission matrix,” Nat. Photonics 8, 58–64 (2014). [CrossRef]
10. J. W. Tay, P. Lai, Y. Suzuki, and L. V. Wang, “Ultrasonically encoded wavefront shaping for focusing into random media,” Sci. Rep. 4, 3918 (2014). [CrossRef]
11. P. Lai, L. Wang, J. W. Tay, and L. V. Wang, “Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media,” Nat. Photonics 9, 126–132 (2015). [CrossRef]
12. A. M. Caravaca-Aguirre, E. Niv, D. B. Conkey, and R. Piestun, “Real-time resilient focusing through a bending multimode fiber,” Opt. Express 21, 12881–12887 (2013). [CrossRef]
13. D. Akbulut, T. J. Huisman, E. G. van Putten, W. L. Vos, and A. P. Mosk, “Focusing light through random photonic media by binary amplitude modulation,” Opt. Express 19, 4017–4029 (2011). [CrossRef]
14. A. P. Mosk, A. Lagendijk, G. Lerosey, and M. Fink, “Controlling waves in space and time for imaging and focusing in complex media,” Nat. Photonics 6, 283–292 (2012). [CrossRef]
15. C.-L. Hsieh, Y. Pu, R. Grange, and D. Psaltis, “Digital phase conjugation of second harmonic radiation emitted by nanoparticles in turbid media,” Opt. Express 18, 12283–12290 (2010). [CrossRef]
16. I. M. Vellekoop and C. M. Aegerter, “Scattered light fluorescence microscopy: imaging through turbid layers,” Opt. Lett. 35, 1245–1247 (2010). [CrossRef]
17. I. M. Vellekoop, M. Cui, and C. Yang, “Digital optical phase conjugation of fluorescence in turbid tissue,” Appl. Phys. Lett. 101, 081108 (2012). [CrossRef]
18. X. Xu, H. Liu, and L. V. Wang, “Time-reversed ultrasonically encoded optical focusing into scattering media,” Nat. Photonics 5, 154–157 (2011). [CrossRef]
19. K. Si, R. Fiolka, and M. Cui, “Fluorescence imaging beyond the ballistic regime by ultrasound-pulse-guided digital phase conjugation,” Nat. Photonics 6, 657–661 (2012). [CrossRef]
20. Y. M. Wang, B. Judkewitz, C. A. DiMarzio, and C. Yang, “Deep-tissue focal fluorescence imaging with digitally time-reversed ultrasound-encoded light,” Nat. Commun. 3, 928 (2012). [CrossRef]
21. Z. Yaqoob, D. Psaltis, M. S. Feld, and C. Yang, “Optical phase conjugation for turbidity suppression in biological samples,” Nat. Photonics 2, 110–115 (2008). [CrossRef]
22. M. Cui, E. J. McDowell, and C. Yang, “An in vivo study of turbidity suppression by optical phase conjugation (TSOPC) on rabbit ear,” Opt. Express 18, 25–30 (2010). [CrossRef]
23. M. Cui and C. Yang, “Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation,” Opt. Express 18, 3444–3455 (2010). [CrossRef]
24. M. Gross, M. Lesaffre, F. Ramaz, P. Delaye, G. Roosen, and A. C. Boccara, “Detection of the tagged or untagged photons in acousto-optic imaging of thick highly scattering media by photorefractive adaptive holography,” Eur. Phys. J. E 28, 173–182 (2009). [CrossRef]
25. Y. Liu, P. Lai, C. Ma, X. Xu, A. A. Grabar, and L. V. Wang, “Optical focusing deep inside dynamic scattering media with near-infrared time-reversed ultrasonically encoded (TRUE) light,” Nat. Commun. 6, 5904 (2015). [CrossRef]
26. E. H. Zhou, H. Ruan, C. Yang, and B. Judkewitz, “Focusing on moving targets through scattering samples,” Optica 1, 227–232 (2014). [CrossRef]
27. S. N. Chandrasekaran, H. Ligtenberg, W. Steenbergen, and I. M. Vellekoop, “Using digital micromirror devices for focusing light through turbid media,” Proc. SPIE 8979, 897905 (2014). [CrossRef]
28. C. Ma, X. Xu, Y. Liu, and L. V. Wang, “Time-reversed adapted-perturbation (TRAP) optical focusing onto dynamic objects inside scattering media,” Nat. Photonics 8, 931–936 (2014). [CrossRef]
29. I. Yamaguchi and T. Zhang, “Phase-shifting digital holography,” Opt. Lett. 22, 1268–1270 (1997). [CrossRef]
30. D. Z. Anderson and J. Feinberg, “Optical novelty filters,” IEEE J. Quantum Electron. 25, 635–647 (1989). [CrossRef]
31. D. A. Boas and A. K. Dunn, “Laser speckle contrast imaging in biomedical optics,” J. Biomed. Opt. 15, 011109 (2010). [CrossRef]
32. M. Jang, H. Ruan, I. M. Vellekoop, B. Judkewitz, E. Chung, and C. Yang, “Relation between speckle decorrelation and optical phase conjugation (OPC)-based turbidity suppression through dynamic scattering media: a study on in vivo mouse skin,” Biomed. Opt. Express 6, 72–85 (2015). [CrossRef]
33. N. Ji, T. R. Sato, and E. Betzig, “Characterization and adaptive optical correction of aberrations during in vivo imaging in the mouse cortex,” Proc. Natl. Acad. Sci. USA 109, 22–27 (2012). [CrossRef]
34. C.-C. Wang, C. Thorpe, S. Thrun, M. Hebert, and H. Durrant-Whyte, “Simultaneous localization, mapping and moving object tracking,” Int. J. Rob. Res. 26, 889–916 (2007). [CrossRef]
35. R. Cudney, R. Pierce, and J. Feinberg, “The transient detection microscope,” Nature 332, 424–426 (1988). [CrossRef]
36. L. V. Wang and S. Hu, “Photoacoustic tomography: in vivo imaging from organelles to organs,” Science 335, 1458–1462 (2012). [CrossRef]
37. C. C. Dierickx, J. M. Casparian, V. Venugopalan, W. A. Farinelli, and R. R. Anderson, “Thermal relaxation of port-wine stain vessels probed in vivo: the need for 1–10-millisecond laser pulse treatment,” J. Invest. Dermatol. 105, 709–714 (1995). [CrossRef]
38. H. F. Zhang, K. Maslov, G. Stoica, and L. V. Wang, “Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imaging,” Nat. Biotechnol. 24, 848–851 (2006). [CrossRef]
39. L. Wang, J. Xia, J. Yao, K. I. Maslov, and L. V. Wang, “Ultrasonically encoded photoacoustic flowgraphy in biological tissue,” Phys. Rev. Lett. 111, 204301 (2013). [CrossRef]
40. L. Hatle and B. Angelsen, Doppler Ultrasound in Cardiology: Physical Principles and Clinical Applications (Lea & Febiger, 1985).
41. B. Jayet, J.-P. Huignard, and F. Ramaz, “Optical phase conjugation in Nd: YVO4 for acousto-optic detection in scattering media,” Opt. Lett. 38, 1256–1258 (2013). [CrossRef]
42. C. Ma, X. Xu, and L. V. Wang, “Analog time-reversed ultrasonically encoded light focusing inside scattering media with a 33,000× optical power gain,” Sci. Rep. 5, 8896 (2015). [CrossRef]
43. J. W. Tay, J. Liang, and L. V. Wang, “Amplitude-masked photoacoustic wavefront shaping and application in flowmetry,” Opt. Lett. 39, 5499–5502 (2014). [CrossRef]
44. A. Drémeau, A. Liutkus, D. Martina, O. Katz, C. Schülke, F. Krzakala, S. Gigan, and L. Daudet, “Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques,” Opt. Express 23, 11898–11911 (2015). [CrossRef]
45. D. Kim, W. Choi, M. Kim, J. Moon, K. Seo, S. Ju, and W. Choi, “Implementing transmission eigenchannels of disordered media by a binary-control digital micromirror device,” Opt. Commun. 330, 35–39 (2014). [CrossRef]
46. D. Kim, J. Moon, M. Kim, T. D. Yang, J. Kim, E. Chung, and W. Choi, “Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle,” Opt. Lett. 39, 1921–1924 (2014). [CrossRef]
47. X. Zhang and P. Kner, “Binary wavefront optimization using a genetic algorithm,” J. Opt. 16, 125704 (2014). [CrossRef]
48. D. Wang, E. H. Zhou, J. Brake, H. Ruan, M. Jang, and C. Yang, “Focusing through dynamic tissue with millisecond digital optical phase conjugation,” Optica 2, 728–735 (2015). [CrossRef]
49. R. Weissleder and M. J. Pittet, “Imaging in the era of molecular oncology,” Nature 452, 580–589 (2008). [CrossRef]
50. T. J. Dougherty, C. J. Gomer, B. W. Henderson, G. Jori, D. Kessel, M. Korbelik, J. Moan, and Q. Peng, “Photodynamic therapy,” J. Natl. Cancer Inst. 90, 889–905 (1998).
51. A. M. Packer, B. Roska, and M. Häusser, “Targeting neurons and photons for optogenetics,” Nat. Neurosci. 16, 805–815 (2013). [CrossRef]