Multimode optical fibers are attractive for biomedical and sensing applications because they possess a small cross section and can bend over small radii of curvature. However, mode phase-velocity dispersion and random mode coupling change with bending, temperature, and other perturbations, producing scrambling interference among propagating modes; hence preventing its use for focusing or imaging. To tackle this problem we introduce a system capable of re-focusing light through a multimode fiber in 37ms, one order of magnitude faster than demonstrated in previous reports. As a result, the focus spot can be maintained during significant bending of the fiber, opening numerous opportunities for endoscopic imaging and energy delivery applications. We measure the transmission matrix of the fiber by projecting binary-amplitude computer generated holograms using a digital micro-mirror device controlled by a field programmable gate array. The system shows two orders of magnitude enhancements of the focus spot relative to the background.
©2013 Optical Society of America
In the 1970’s, Yariv et al. provided a theoretical description of image transmission through optical fibers [1,2] and several groups proved the concept later on [3,4]. Lately, there has been a renewed interest in the topic sparked by the new spatial light modulator (SLM), cameras, and computation technical capabilities. For instance, Bianchi et al.  demonstrated the generation of multiple spots through a MMF utilizing a liquid crystal (LC) SLM and Monte-Carlo algorithm searching for the optimal input phase mask. In Ref [6,7]. digital optical phase conjugation generates a sharp focus at the output of a MMF which can be scanned for imaging. However, the speed of this system is limited by the refresh rate of the SLM, camera acquisition and processing time. Furthermore, digital holography requires a reference brought through a different channel outside the fiber itself. Other techniques use a transmission matrix (TM) approach allowing bright and dark field imaging . Alternatively, the TM information can be combined with averaged speckle imaging to attain widefield imaging . Random pattern projection followed by optimization of the measurements provides an increase resolution . Importantly, all these techniques rely on a pre-calibration of the optical fiber that typically takes several minutes, after which the fiber should not experience any significant physical change, thus precluding their use in a perturbation prone environment.
In a seemingly different area, two decades ago, Freund introduced the idea of transmitting an image through scattering materials ; an idea that only over the last few years has became a reality [12–19]. Vellekoop introduced phase control algorithms using a liquid crystal spatial light modulator (LC-SLM) to overcome the scattering effects produced by turbid media [12,13]. These algorithms are based on a division of the input and output fields into spatial modes, along with the iterative optimization of a merit function. Popoff et al.  measured the TM of the scattering material by projecting an orthonormal basis set and measuring the output field for each basis element. After the measurement, the material is characterized and the measured relationship between spatial input and output modes allows focusing to any output mode. A different technique scans different input angles at high speed with the help of galvanometric mirrors . The optimal phase is then found in k-space and transformed to the spatial domain. Moreover, optical phase conjugation  using photorefractive crystals and digital optical phase conjugation  has been used to compensate for turbidity. Taking advantage of this control, scattering media may be employed as a superlens improving the numerical aperture of an optical system . These techniques not only control the light spatially, but can also compress ultra-short pulses in time . Interestingly, similar techniques have been adopted lately to overcome mode dispersion and coupling in multimode optical fibers [5–10]. The observation is that the speckle field formed at the output of a MMF is similar to the one produced when light propagates through turbid media, even though it is the result of significantly different interfering modes.
Most biomedical applications require placing the fiber within tissue involving shape and temperature changes that produce modifications in the spatial configuration of optical modes. However, it should be emphasized that all these techniques developed for imaging or focusing through MMFs [5–10] are contingent on avoiding any significant disturbance to the fiber during the experiment. Furthermore, a significant issue that limits real time implementation is the latency of the communication between the photodetector, the computer controlling the experiment, and the SLM. Therefore, we introduce a real-time phase mask optimization through a MMF using a TM measurement technique . The algorithm is implemented in a field programmable gate array (FPGA), which controls a DMD at full speed, improving one order of magnitude the overall focusing time with respect to our previous system that was applied in scattering materials . As a result, we overcome fiber perturbation effects at video frame rates.
In Sec. 2 we describe the optical and embedded system, in Sec. 3 the experimental results, and in Sec. 4 we discuss the implications of this work.
2. Method and experimental setup
The setup of the system is shown in Fig. 1. A 532 nm collimated laser beam illuminates a 1024x768 binary amplitude digital micromirror device (DMD TI-DLP Discovery Kit D4100). Each mirror can be controlled to two different angular positions, essentially creating a binary amplitude image. To control the phase of the beam, a binary amplitude Lee hologram  encodes the desired wavefront with the DMD. A lens, f1, placed one focal length away from the DMD, Fourier transforms the hologram and an iris in the Fourier plane blocks all the diffraction orders except the −1st, which encodes the information of the desired phase distribution. The lens f2 is used to image the phase mask on the back focal plane of a 10X (NA = 0.25) objective that couples the light into a 365μm core diameter MMF, 0.22 NA (BFL22-365-Thorlabs), which can propagate an estimated 1.1x105 modes.
At the output of the MMF, the light is received by a 40X (NA = 0.65) objective which images the surface of the fiber onto a 50μm pinhole placed before a photodetector. The objective magnification and the pinhole size are chosen to match the pinhole diameter to the speckle spot size at the image plane. To control and characterize the movement of the fiber, we use an automated translation stage that bends the fiber by a measurable angle, θ, shown in the inset of Fig. 1.
A beam splitter placed after the tube lens and before the pinhole creates a second image plane on a CMOS camera (Hamamatsu ORCA Flash 2.8) which enables high frame rate video recording for data analysis and speckle decorrelation time measurement. The photodetector signal is digitized by an analog-to-digital converter (ADC) triggered by the customizable FPGA on the DMD controller board. The intensity values are oversampled and the average value is used to build the hologram with the optimal phase mask encoded to produce the focus spot.
2.2. Transmission matrix implementation in FPGA
For real-time experiments, a hardware implementation is often necessary to reduce latency and computation times. A phase shifting method based on three measurements per input mode for TM determination [14,22] is implemented directly on a Virtex5 custom FPGA, APPSFPGA, which is included in the DLP4100 Discovery Kit. A separate analog-to-digital converter (ADC), with a buffered analog input, digitizes the signal and provides the input to the FPGA board. APPSFPGA controls the DMD indirectly via the DDC4100 (digital controller) and DAD2000 (power and reset driver) found on the DLP4100 kit. It is also responsible for accurate triggering of the analog signal conversion as well as storage of the digitized output. For functional verification of the algorithm, modules emulating the DDC4100, DMD and ADC were designed and used during the simulation stage. Figure 2 shows a high-level block diagram of the hardware implementation of the TM focusing system. This configuration is independent of an external computation source and therefore able to toggle the DMD at the maximum frame rate. As a result, the system enables the measurements of the amplitude and phase corresponding to 256 different input modes (with three different reference phases per input mode) in 33.8 ms, corresponding to an update frequency of 22,7 KHz. Processing this information to construct the optimal phase mask, then sending to and projecting on the DMD adds an additional 3 ms. It is worthwhile to highlight the speed improvement from our previous report implemented in an application with scattering media , where a computer was used and the time spent in this part of the process was in excess of 200ms. The optimized, focusing phase mask projection time can be varied based on experimental conditions. For this experiment we match focusing time with the measurement time: 37 ms, which provides a 50% duty cycle and allows for repetitive focusing at a constant rate of 13Hz.
3. Experiment and results
To quantify the performance of the system, we bend the fiber with different speeds and accelerations to create a dynamic environment. Bending the fiber alters the mode coupling within the fiber; this is manifested by a speckle pattern change at the fiber output. The speckle pattern change is quantified by measuring the 2D correlation between the speckle pattern associated with a bent fiber and a straight fiber. By analyzing the correlation between captured speckle image frames from the CMOS using a static input illumination, the average decorrelation time associated with each setting of the stage is obtained.
To illustrate the sensitivity of the fiber to spatial changes, we measure the focus degradation as the fiber is bent without adaptive correction. In Fig. 3(a) we observe how by displacing the fiber less than 0.1 mm, corresponding to bending the fiber just 0.09° in our configuration, the focus completely disappears. This illustrates the high sensitivity of our fiber to spatial displacements due to mode coupling. To demonstrate the performance of the system, we compare the degradation of the focus spot for two cases: a) with a static phase mask, and b) with adaptive wavefront correction. Figures 3(b) and 3(c) shows the output field intensity of the fiber taken by the camera at different positions of the translation stage. Figure 3(b) illustrates how bending the fiber quickly degrades the created focus when the phase mask is not re-optimized. In Fig. 3(c), the image is shown at the output of the fiber with the adaptive system on. The stage moves with an initial acceleration of 2 mm/s2 until reaching a constant velocity of 1 mm/s, corresponding to an average speckle decorrelation time of 150ms. Despite the fast rate of change, the focus enhancement remains high and stable. Note that the enhancements at θ = 0° in Fig. 3(b) and 3(c) do not match because the enhancement achieved is highly sensitive to the initial conditions.
To test the efficiency of the system, we track the dynamics of the focus enhancement as a function of time as the fiber bends, as shown in Fig. 4 (blue line). The zone delimited by the red line corresponds to the interval when the stage is moving. The bending angle of the fiber as a function of time is represented in green. We observe that the enhancement is constant while the stage is not moving. Once the stage starts moving, we observe that the enhancements achieved with the bending fiber are smaller and more variable than with a static fiber, which is due to the dynamics of the transmission matrix; the result of performing measurements while the system is changing.
It is worth noting that even for an average decorrelation time of 50 ms, close to the system cycle time (37 ms), the enhancement obtained does not fall too low, with values around 40. In this case, some of the modes measured have changed after 37 ms, which is the period from the first measurement to the projection of the optimal phase mask, explaining the lower enhancement. Videos of the focus spot for different bending speeds can be found in Media 1, Media 2, and Media 3. Furthermore, a higher number of input modes could be used to increase the enhancement as a trade off to speed. Note also that while we present small angle bends because of the range limitation of the automated translation stage, larger angle perturbations have been tested with a manual stage leading to similar enhancement.
4. Discussion and conclusion
We have demonstrated real-time focusing through a dynamically bending MMF. In these experiments we used a fiber with more than 100,000 propagating modes to demonstrate the concept. A smaller diameter fiber, which would propagate fewer modes allowing for a larger bending angle before total speckle decorrelation, could also be used. The system creates a focus in 37 ms at the output plane of the fiber leading to enhancements between 50 and 100 during fiber perturbation. As a result of the known relationship between number of modes and focus enhancement, faster operation could be achieved at the expense of enhancement factor. The FPGA implementation enables the system to perform at a constant rate of 13Hz with a 50% duty cycle. The FPGA operation is totally configurable and the phase mask update protocol could be adapted to the application. For example, different algorithms allowing steady state focusing  and existing imaging modalities [6–11] could be implemented. The system can have applications in photodynamic therapy where localized energy delivery is needed. A very similar system can be modified for use with dynamic scattering materials, like biological tissue, possessing decorrelation times on the order of ~10 ms .
Ongoing research is exploring different feedback mechanisms that can substitute the photodetector at the end of the fiber. For instance, the system could be adapted for imaging purposes by introducing a sparse fluorophore population in the output plane and using the emitted light for feedback , or using opto-acoustic effects as demonstrated in scattering media .
We acknowledge support from the National Science Foundation award DGE-0801680. We thank Dr. Miguel Rodriguez and Dr. Carlos Olalla for helpful discussions about the circuit and FPGA design and Yael Niv for helping in the verification process.
References and links
1. A. Yariv, “Three-dimensional pictorial transmission in optical fibers,” Appl. Phys. Lett. 28(2), 88–89 (1976). [CrossRef]
2. A. Gover, C. P. Lee, and A. Yariv, “Direct transmission of pictorial information in multimode optical fibers,” J. Opt. Soc. Am. 66(4), 306–311 (1976). [CrossRef]
4. A. A. Friesem, U. Levy, and Y. Silberberg, “Parallel transmission of images through single optical fibers,” Proc. IEEE 71(2), 208–221 (1983). [CrossRef]
5. R. D. Leonardo, S. Bianchi, and R. D. Leonardo, “Hologram transmission through multi-mode optical fibers,” Opt. Express 19, 247–254 (2010).
6. I. N. Papadopoulos, S. Farahi, C. Moser, and D. Psaltis, “Focusing and scanning light through a multimode optical fiber using digital phase conjugation,” Opt. Express 20(10), 10583–10590 (2012). [CrossRef] [PubMed]
7. I. N. Papadopoulos, S. Farahi, C. Moser, and D. Psaltis, “High-resolution, lensless endoscope based on digital scanning through a multimode optical fiber,” Biomed. Opt. Express 4(2), 260–270 (2013). [CrossRef] [PubMed]
9. Y. Choi, C. Yoon, M. Kim, T. D. Yang, C. Fang-Yen, R. R. Dasari, K. J. Lee, and W. Choi, “Scanner-free and wide-field endoscopic imaging by using a single multimode optical fiber,” Phys. Rev. Lett. 109(20), 203901 (2012). [CrossRef] [PubMed]
11. I. Freund, “Looking through walls and around corners,” Physica A 168(1), 49–65 (1990). [CrossRef]
13. I. M. Vellekoop and A. P. Mosk, “Phase control algorithms for focusing light through turbid media,” Opt. Commun. 281(11), 3071–3080 (2008). [CrossRef]
14. S. M. Popoff, G. Lerosey, R. Carminati, M. Fink, A. C. Boccara, and S. Gigan, “Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media,” Phys. Rev. Lett. 104(10), 100601 (2010). [CrossRef] [PubMed]
15. M. Cui, “A high speed wavefront determination method based on spatial frequency modulations for focusing light through random scattering media,” Opt. Express 19(4), 2989–2995 (2011). [CrossRef] [PubMed]
17. M. Cui and C. Yang, “Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation,” Opt. Express 18(4), 3444–3455 (2010). [CrossRef] [PubMed]
18. Y. Choi, T. D. Yang, C. Fang-Yen, P. Kang, K. J. Lee, R. R. Dasari, M. S. Feld, and W. Choi, “Overcoming the diffraction limit using multiple light scattering in a highly disordered medium,” Phys. Rev. Lett. 107(2), 023902 (2011). [CrossRef] [PubMed]
19. O. Katz, E. Small, Y. Bromberg, and Y. Silberberg, “Focusing and compression of ultrashort pulses through scattering media,” Nat. Photonics 5(6), 372–377 (2011). [CrossRef]
20. D. B. Conkey, A. M. Caravaca-Aguirre, and R. Piestun, “High-speed scattering medium characterization with application to focusing light through turbid media,” Opt. Express 20(2), 1733–1740 (2012). [CrossRef] [PubMed]
21. W. H. Lee, “Computer-Generated Holograms: Techniques and Applications,” in Prog. Optics XVI, E. Wolf, E. Wolf, ed., North-Holl (1978).
22. J. H. Schreiber and H. Bruning, “Phase shifting interferometry,” in Optical Shop Testing, D. Malacara, ed., 3rd ed. (Wiley, 2007), pp. 547–666.
24. D. B. Conkey, A. M. Caravaca-Aguirre, E. Niv, and R. Piestun, “High-speed, phase-control of wavefronts with binary amplitude DMD for light control through dynamic turbid media,” Proc. SPIE 8617, 86170I, 86170I-6 (2013). [CrossRef]
25. J. Tang, R. N. Germain, and M. Cui, “Superpenetration optical microscopy by iterative multiphoton adaptive compensation technique,” Proc. Natl. Acad. Sci. U.S.A. 109(22), 8434–8439 (2012). [CrossRef] [PubMed]
26. F. Kong, R. H. Silverman, L. Liu, P. V. Chitnis, K. K. Lee, and Y. C. Chen, “Photoacoustic-guided convergence of light through optically diffusive media.,” Opt. Lett. 36(11), 2053–2055 (2011). [CrossRef] [PubMed]