Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Compact multi-band fluorescent microscope with an electrically tunable lens for autofocusing

Open Access Open Access

Abstract

Autofocusing is a routine technique in redressing focus drift that occurs in time-lapse microscopic image acquisition. To date, most automatic microscopes are designed on the distance detection scheme to fulfill the autofocusing operation, which may suffer from the low contrast of the reflected signal due to the refractive index mismatch at the water/glass interface. To achieve high autofocusing speed with minimal motion artifacts, we developed a compact multi-band fluorescent microscope with an electrically tunable lens (ETL) device for autofocusing. A modified searching algorithm based on equidistant scanning and curve fitting is proposed, which no longer requires a single-peak focus curve and then efficiently restrains the impact of external disturbance. This technique enables us to achieve an autofocusing time of down to 170 ms and the reproductivity of over 97%. The imaging head of the microscope has dimensions of 12 cm × 12 cm × 6 cm. This portable instrument can easily fit inside standard incubators for real-time imaging of living specimens.

© 2015 Optical Society of America

1. Introduction

Over the years, time-lapse imaging [1,2 ] and real-time observation have become widely used approaches to monitor living cells and developing organelles. These techniques suffer from ‘focus drift’ where the specimen moves out of the focal plane during image acquisition [3]. Actually, focus drift occurs in almost every microscope system due to various factors, including initiative motion of the living specimen, thermal drift, mechanical instability and immersion media fluctuations, etc [3–5 ].

To redress focus drift in the time-lapse imaging process, researchers have developed a variety of autofocusing solutions including both software-based and hardware-based approaches [6]. Hardware-based autofocusing systems are generally based on the measurement of the distance between the objective and the specimen by detecting reflected light from the specimen or the surface of coverslip. This scheme has been used in most commercial autofocusing microscopes like the IX81-ZDC2 autofocus microscope provided by Olympus [7] and the CRISP autofocus system provided by ASI [8]. Success requires a near-infrared laser [7] or LED [8] as specialized illumination source. These approaches are precise when the signal to noise ratio (SNR) of the reflected signal is sufficiently high. However, the SNR may decline as a result of multiple reflections due to the refractive index mismatch at the water/glass interface. Therefore the flexibility of such schemes is limited.

In contrast, the software-based category is more flexible [9–11 ]. An autofocusing algorithm and a searching scheme are primarily required for a software-based autofocusing system. Varieties of autofocusing algorithms based on diverse principles have been developed, including Variance [12], Vol-4 [13], and Brenner gradient [14], etc. These algorithms extract focus-related information of the captured images like sharpness or brightness at different layers and in turn drive the axial scanning mechanism to the focal plane (FP) with the guidance of special searching algorithms.

Typical axial scanning control mechanisms include motorized and piezoelectric stages. The primary advantages of motorized stages are their high reproducibility and the long travel range. However, their limited travelling velocity tremendously impedes the autofocusing speed. When more rapid autofocusing is required, the better choice may be piezoelectric stages, which offer greater precision and higher speed than the stepper motors. Piezoelectric stages are normally confronted with challenges for their finite travel range (generally under 200 micrometers) and high cost. Finally, both motorized and piezoelectric stages may suffer from motion artifacts, which are detrimental to autofocusing when using immersion objectives.

Here, we present a scheme of compact automatic microscope by using a commercially available electrically tunable lens (ETL) for autofocusing. The ETL is a variable focal length lens [15,16 ] that can realize “optical axial scanning” rather than the conventional “mechanical axial scanning”, which has been implemented in applications like confocal [17], two-photon [18,19 ] and light-sheet [20] microscopy for its compact structure, low price and fast tuning speed. The focal length of the ETL tends to be a nonlinear function of the supplied control current. We calibrated the influence of the nonlinearity on autofocusing and promoted a modified searching scheme. By driving the ETL to refocus at 100 Hz and utilizing the modified searching scheme, an autofocusing time of 170 ms and the reproductivity of over 97% were achieved.

2. System configuration

The compact multi-band fluorescent microscope apparatus is shown in Fig. 1 . A custom-built, 4-wavelength LEDs array is used as the excitation source. The four LEDs chips with different wavelength (405, 470, 565 and 630 nm) are assembled in one base module and encapsulated together. The four beams are coupled into a 1 m length multimode fiber (M71L01, Ø1000 µm, 0.48 NA, Thorlabs Inc., USA), and collimated by a fiber collimator (F240SMA, 0.51 NA, Thorlabs Inc., USA). The collimated light passes through a dichroic mirror and is focused by the objective lens to illuminate the sample. A quad-band filter sets (including a 390/482/563/640 nm quad-band bandpass excitation filter F1, a 446/523/600/677 nm quad-band bandpass emission filter F2, and a R405/488/561/635 nm quad-edge dichroic beamsplitter DM1, Semrock Inc., USA) are used to separate the excitation and fluorescence beams. The ETL (EL-10-30-C-VIS-LD-MV, Optotune AG, Switzerland) is mounted to the objective rear stop. The focus of the objective can be shifted axially by tuning the control current of the ETL. A USB3.0 CMOS camera with a maximum full-frame rate of 60 fps (DCC3240M, 1280 × 1024 pixels, 12 bits gray depth, Thorlabs Inc., USA) is used to record the 2D images. In addition, an optional dichroic mirror DM2 and a second camera can be attached to the microscope to observe dual-channel fluorescence simultaneously. Autofocusing and image collection are carried out by custom developed software programmed in Matlab. All the opto-mechanic components are assembled into the imaging head of ~12 cm × 12 cm × 6 cm shown in Fig. 1(a). Because the imaging head of the microscope is compact, the whole microscope system can be easily arranged in either upright or inverted geometries for different applications, as is shown in Fig. 1(b) and Fig. 1(c). Figure 1(d) is the photograph of the microscope instrument with an upright arrangement.

 figure: Fig. 1

Fig. 1 Schematic of the compact multi-band fluorescent microscope with an ETL for autofocusing. (a) Light path diagram of the microscope imaging head. F1: excitation filter, F2: emission filter, ETL: electrically tunable lens, OL: offset lens, MO: microscope objective, M1 and M2: mirrors, TL: tube lens, DM1 and DM2: dichroic mirrors. (b) and (c) are the diagrams of the setup in upright and inverted geometries, respectively. (d) Photograph of the microscope instrument with an upright arrangement.

Download Full Size | PDF

The photographs of the fiber-coupled output 4-wavelength LEDs array light source are shown in Fig. 2 . The 4 vertical structured LED chips with different wavelength (405, 470, 565 and 630 nm) are mounted on a copper substrate with excellent heat dissipation efficiency and the thermal resistance of the module is less than 0.8 °C/W. The upper surface of each chip is cathode and attached to the cathode of the electrical source with gold thread. The back surface of each chip is anode and packaged on the copper substrate. The 4-LED chips are common anodes and can be turned on separately with the help of independent cathode control. The size of each chip is 1 × 1 mm2, yielding a total light-emitting area of 2.1 × 2.1 mm2. The light divergence angle of each LED chip is 160°. An optical cone (wide diameter of 4.5 mm, narrow diameter of 1.2 mm, and length of 13 mm) is directed against the light-emitting area. The on-off and output power of each wavelength is individually controlled by the LEDs controller, which enables the LEDs either a single-band output or multi-band output simultaneously. The output powers of the four bands of 405, 470, 565 and 630 nm are ranged in 0~8.2 mW, 0~6.4 mW, 0~7.7 mW and 0~5.4 mW, respectively, which are measured after the fiber collimator by using an optical power meter (S130C, Thorlabs Inc., USA). More power up to 12 mW can be obtained by further increasing the LED current. The diameter of the LED beam at the back aperture of the objective is about 10 mm. Considering the transmission of the objectives, we can normally get 3~6 mW light power for each wavelength in the sample plane, which is sufficient for wide-field fluorescence imaging and autofocusing in our present circumstance.

 figure: Fig. 2

Fig. 2 Photographs of the fiber-coupled output 4-wavelength LEDs array light source. (a) The 4-wavelength LEDs array module. (b) Fiber-coupled output LEDs head mounted on a 65 mm long heatsink. (c) Power supply and controller of the LED package. (d) SMA fiber collimator connecting to the input port of microscope.

Download Full Size | PDF

3. Implement of autofocusing

3.1 Characteristics of ETL

The ETL produced by Optotune AG is a liquid lens as shown in Fig. 3 . By controlling the current of the motor bobbin, liquid inside the container is squeezed in and out the lens volume, resulting axial shift of the focus [21]. We employ the C-Mount ETL system with the tunable focal length from 80 mm to 200 mm and mount it close to the back focal plane of either a 10 × /NA0.3 or a 40 × /NA0.6 objective (Nikon Inc., Japan). In this manner, we can get an effective axial scan range of 2.17 mm and 128 μm for the 10 × and 40 × objectives respectively by tuning the ETL control current from 0 to 200 mA, as is shown in Fig. 4(a) and Fig. 4(b).

 figure: Fig. 3

Fig. 3 Principle illustration of the ETL [21]. (a) An intuitional view of the structure of the ETL. Container wrapped by the polymer is filled with specially-produced optical fluid. (b) A photograph of the ETL. (c) Illustration of shifting focal plane (FP) by adjusting the control current (Ii). Different from the axial scanning control mechanism by using stages, this configuration avoids motion artifacts and the shifting range varies with the magnification and numerical aperture of the objective.

Download Full Size | PDF

 figure: Fig. 4

Fig. 4 Characterization of variation tendency of focal position and relative magnification during tuning the control current. (a) Measured focal position of the 10 × objective lens as a function of the ETL control current. (b) Measured focal position of the 40 × objective lens as a function of the ETL control current. (c) Measured relative magnification as a function of the ETL control current.

Download Full Size | PDF

While using the ETL to achieve fast “optical axial scanning”, several points must be taken into consideration. The most common issue is the nonlinear relation between the focal position and the control current, which has been evaluated as a parabolic equation by Jabbour et al. [17] and Grewe et al. [19] to character the axial scan range in the confocal and the two-photon microscopes, respectively. As verification, we measured the relative change of the focal position when tuning the control current and found that the nonlinear relation did exist. To describe the nonlinearity quantitatively, parabolic fittings are employed as shown in Fig. 4(a) and Fig. 4(b). Equation (1) and Eq. (2) are respectively the fitting results for the 10 × and 40 × objectives:

z10×=1.12×105I2+8.59×103I,
z40×=4.10×107I2+5.56×104I,
where I represents the control current (mA), z 10 × and z 40 × are respectively focal positions (mm) for 10 × and 40 × objectives. In both equations we define focal position at 0 mA as zero.

As most objectives are designed to be telecentric, direct appending of the ETL will lead to an non-telecentric assemblling, finally resulting in a relative variation of the magnification. This problem can be avoided by employing an additional 4f configuration [20] with the cost of increasing the physical size of the whole system. The change of the magnification in our system is also quantitated (Fig. 4(c)). The magnification varies from a factor of 1 at 0 mA to 0.83 at 200 mA, which reveals 17% variation over the whole scan range. Similar research on this issue was performed by Naikai [22] when observing intracellular structures and protein complexes. For autofocusing, the impact of magnification variation is negligible compared with the defocusing.

3.2 Autofocusing algorithms

Over the past years, numerous autofocusing algorithms have been proposed to redress focus drift. These algorithms employed the focus value (FV) to distinguish the in-focus image and the defocused ones. Although different algorithms use different parameters as their focus values, the common characteristic of the focus values is that it should reach the maximum at the focal plane and decreases rapidly and monotonously with defocusing. For example, the Variance algorithm calculates the variance of the acquired image as the focus value, while the Image Intensity algorithm sum up the square of the image gray values [10,11 ], The ideal outline of the focus value curve is illustrated in Fig. 5 . Thus, the position of the focal plane can be precisely obtained by searching the maximum focus value of the whole curve.

 figure: Fig. 5

Fig. 5 Profile of an ideal focus curve. Focus values are calculated with the images captured at different axial positions. The focus curve reaches the maximum at the focal plane and decreases rapidly and monotonously with defocusing.

Download Full Size | PDF

Typically, the focus value curve can be described by different mathematical models such as the polynomial [23], Gaussian [24] or Lorentzian models [14]. In this letter, we adopted the Gaussian model as it more closely approximates the measured curve:

f(z)=ae(zz0)22b2,
where z and f(z) represent relative axial position and focus value respectively, and a, b and z0 are undetermined coefficients.

On account of the nonlinearity between the focal position and control current of the ETL, the focus curve needs to be calibrated in the beginning. Figure 6 depicts the calibration process of the new focus curve, while Fig. 6(a) is the original focus curve and Fig. 6(c) is the calibrated focus curve. Outline of the modified focus curve is obviously distorted into an asymmetrical profile. Quantitive conclusion can be obtained from the composite relation of control current and focus value by directly substituting Eq. (1) (or Eq. (2)) into Eq. (3):

F(I)=ae(pI2+qIz0)22b2,
where p and q are respectively known quadratic and monomial coefficients in Eq. (1) (or Eq. (2)), a, b and z0 are undetermined parameters, which imply that at least three focus values at different control currents are required to fit Eq. (4). In the next section, we will utilize the calibrated focus curve to determine the focal plane.

 figure: Fig. 6

Fig. 6 Calibration of the focus curve to compensate the nonlinear relationship between the focal position and the control current of ETL. (a) The original focus curve. (b) Nonlinear relationship between the control current and the relative axial position. (c) Calibrated focus curve obtained by mapping the relationship of control current and the focus value.

Download Full Size | PDF

3.3 Autofocusing rapidly and correctly

A superior autofocusing algorithm should get the maximal focus value right at the focal plane. To find this maximum efficiently, researchers often employ a sort of one-dimensional searching algorithms such as Fibonacci, mount-climbing or golden-section methods. Speeds of such schemes are rather high, which only takes several steps to reach the focus. However, they are quite sensitive to the local maximums of the focus curve. The fluctuation of illumination and the mechanical vibration of environment may be the most common inducements of the local maximums, which usually manifest as jitters in the focus curve (see Fig. 7 ). In addition, we found it is difficult to autofocus correctly when observing thick samples. One reason is the image degration caused by inhomogeneous optical properties of the thick sample. “Guide star” technique, which employs a reference point-source behind the inhomogeneous medium for measuring the shape of the wave-front, combined with the adaptive optics method is usually used to correct the aberrations and improve the imaging quality [25,26 ]. Yet, the more important cause comes from the multi-peaks of the focus curve, which is mainly formed by two or more projections of the sample at different depth in the field-of-view, as is illustrated in Fig. 7. Any local maximum in the focus curve may lead to a mistaken convergence of the searching algorithm, ultimately resulting in a failure to autofocus precisely.

 figure: Fig. 7

Fig. 7 Measured multi-peaks focus curve. Multiple peaks caused by multi-layer specimen and jitters caused by system instability are the main reasons for local maximums, which probably lead to a mistaken convergence of the searching algorithm.

Download Full Size | PDF

To circumvent this restriction, we developed a modified searching scheme, illustrated as a flow chart in Fig. 8 . This algorithm is based on coarse equidistant scanning and curve fitting rather than simple iteration and as such is different from the conventional searching algorithms. It does not require the focus curve to present single peak and is no more sensitive to jitters caused by vibrations of the system. It is worth noting that although more frequent equidistant scanning can provide better accuracy, it will require much time. Thus, it is crucial to adjust the space of scanning for a given searching range to reach a balance between speed and accuracy. In general, nine steps of calculation are enough for a searching range of 20 mA (equivalent to a defocusing distance of 12 μm for the 40 × objective). That is, a step interval of 2~3 mA is acceptable in most cases to reach a comparable speed as the conventional scheme but achieves much higher stability. Besides, sub-window technique is also adopted to shrink the FV’s computing time and avoid local maximums caused by multi-layer samples.

 figure: Fig. 8

Fig. 8 Flowchart of the promoted searching scheme. The whole process could be divided into two stages. In the first stage, raw images are captured at even-spaced control currents and corresponding focus values are calculated. Maximal point and its four neighbors are preserved for later use. In the second stage, the five points are assigned into two groups. F(I) in the flow chart presents the function in Eq. (4) and a, b, and z0 are the corresponding unknown coefficients. By fitting the measured points to F(I), the unknown coefficients in F(I) can be determined. Further, via solving their stationary points of the determined functions, we can get the maximum points of the fitted curves IM1 and IM2. Arithmetic mean value of the two is set as the final control current.

Download Full Size | PDF

4. Experimental results

4.1 Multi-band fluorescent imaging

To demonstrate the multi-band fluorescent imaging capability of the microscope, we employ the multi-dye labeled specimens, a mouse kidney cryosection and a bovine pulmonary artery endothelial (BPAE) cell (Molecular Probes Inc., USA) to embody the multi-band information. The color-fused fluorescent images are shown in Fig. 9 . The glomeruli and convoluted tubules of the mouse kidney cells are stained with the green-fluorescent lectin, Alexa Fluor 488 wheat germ agglutinin, thus a instinct view of these parts can be recognised by the green color in Fig. 9(a). Similarly, the nuclei (counterstained with DAPI) can be distinguished by the blue color. For the BPAE cells, mitochondria, F-actin and the nuclei were respectively labeled with MitoTracker Red CMXRos, Alexa Fluor 488 phalloidin and DAPI, which represent the red, green and blue components in Fig. 9(b).

 figure: Fig. 9

Fig. 9 Color-fused fluorescent images of multi-dye labeled specimens. (a) The mouse kidney cells excited by the wavelengths of 405 and 470 nm successively, observed with the 10 × objective. (b) The BPAE cells excited by the wavelengths of 405, 470 and 565 nm successively, observed with the 40 × objective.

Download Full Size | PDF

4.2 Autofocusing software

Figure 10 is the main interface of the autofocusing software written in Matlab. The CMOS camera is connected via the ActiveX component and the ETL is controlled though serial port communication. Control panels for both devices are designed for parameter adjustment. The sub-window for autofocusing can be selected either by entering parameters or by simply selecting a rectangular region of interest (ROI). Being designed to be easy to use, this interface enables the observer to implement autofocusing by simply clicking on the specified button. In addition, time-lapse imaging is also integrated into the graphical interface for further application.

 figure: Fig. 10

Fig. 10 Main interface of the autofocusing software (see Visualization 1 for demonstration).

Download Full Size | PDF

As performance of autofocusing algorithms are susceptible to specimen type, illumination scenarios and noise levels, we integrate sixteen autofocusing algorithms [10–14 ] in the software to meet different circumstances. These sixteen algorithms can be classified into four groups, that is, derivative-based algorithms, statistical algorithms, histogram-based algorithms and intuitive algorithms. The detailed information on the algorithms is listed in Table 1 . Performance of the autofocusing algorithms and their ranking process under different circumstances can be found in the prior literatures [10–14 ]. For the fluorescent scenario in this article, the Variance, Normalized Variance, Vol-4, Vol-5, and Brenner gradient algorithms are proved to have better performance than the others.

Tables Icon

Table 1. Classification of autofocusing algorithms

To offer an aid when selecting the autofocusing algorithm, a rapid one-click analysis module to find the optimal algorithm is attached in Algorithm Selection tab control. With the autofocusing algorithm selected, autofocusing can be completed accurately and rapidly with the guidance of the promoted searching scheme.

4.3 Speed and reproductivity

Besides the mouse kidney cells and the BPAE cells, the custom-prepared fluorescent beads are also used to embody a variety of information. In the autofocusing experiment, the size of the sub-window is unified as 100 × 100 pixels, while the CMOS camera works at the full resolution of 1280 × 1024 pixels. For concision, only the 40 × objective is used for demonstration of autofocusing here. The best algorithms for beads, mouse kidney cells and BPAE cells are testified to be the Variance, Vol-5 and Brenner gradient, respectively.

The average execution time of autofocusing varies with the type of specimen. Runtime for autofocusing of fluorescent beads is about 170 ms, that is, (10 ms ETL settling time + 6 ms camera exposure time + 3 ms focus value computing time) × 9 axial moving steps, as is shown in Fig. 11 . This turns out to be fastest among the three specimens and is attributed mainly to the strong fluorescent signal from the beads and the sufficent illumination power, both of which reduce the camera’s exposure time. In contrast, for the mouse kidney cells and BPAE cells, the fluorescent signals are relatively weak and the exposure time must be increased to obtain a sufficient SNR. Under this circumstance, autofocusing runtime for mouse kidney cells is 1.04 s, that is, (10 ms ETL settling time + 102 ms camera exposure time + 3 ms focus value computing time) × 9 axial moving steps. As is analyzed above, autofocusing speed of the system is basically limited by the camera’s sensitivity, thus better results can be achieved by employing more sensitive cameras.

 figure: Fig. 11

Fig. 11 Time-sequence chart of the autofocusing process based on the camera’s time shaft. Camera works in the trigger mode and is triggered periodly. One autofocusing process contains nine steps, and each step includes three events, i.e., camera exposure, FV calculation and ETL settling.

Download Full Size | PDF

To verify the autofocusing reproductivity of the fluorescent microscope, 1200 repetitive tests are conducted on the three types of specimens, i.e., 3 groups of experiments are organized and each group repeats 400 times. The excitation wavelength is selected to be 405 nm. A periodic defocusing of the specimen is carried out by a motorized z-stage on which the specimen is placed. The whole test can be treated as an alternate process of autofocusing and defocusing between two focal planes denoted as FP_A and FP_B, that is, firstly move the specimen to FP_A (defocusing process) and consequently make autofocusing to FP_A by using the ETL, afterwards move the specimen to FP_B and then make autofocusing to FP_B with the ETL, and so forth. For each focal plane, both autofocusing and defocusing take place 200 times. For every autofocusing, what we can obtain include the final control current of ETL and the in-focus image. Both of them provide clues to justify whether the autofocusing is successful. However, judgment by the image quality is a subjective approach that depends on the observer or the merit of criteria, which is not consistent with our purpose to quantify the reproductivity. The control currents of ETL for autofocusing are proved to distribute tightly around two values corresponding to the two focal planes in practice. The statistic histograms of the control currents for the beads are shown in Fig. 12 . We assume that the FP_A and FP_B stand at the centroid (I A and I B) of the measured control currents, and consider a successful autofocusing to occur if the final control current falls into a range corresponding to the depth-of-field (DOF) of the objective lens, which is determined by Eq. (5) [10]:

DOF=λnNA2+2nPM2(NA),
where λ indicates the emission wavelength (λ = 446 nm), n denotes the refractive index of the medium (n = 1), NA is the numeral aperture (NA = 0.6), P presents the pixel size of the camera (P = 5.3 μm), and M is the magnification of the system (M = 40). Thus, the DOF turns out to be 1.25 μm for the test, which corresponds to 1.95 mA in control current (saying ΔIDOF). We define the reproductivity as the rate of successfully autofocusing counts to the testing number. Eventually, the reproductivity values for the three groups of tests are measured to be 97.5% (the beads), 97% (the mouse kidney cells) and 96.8% (the BPAE cells), resulting in an average reproductivity of 97.1%.

 figure: Fig. 12

Fig. 12 Statistic histogram of the final control currents for the reproductivity calibration. The whole test can be treated as an alternate process of autofocusing and defocusing between FP_A and FP_B. ΔIDOF here represents the difference in current that is used to tune a range of DOF around the center focal point. Reproductivity is defined as the percentage of the control current falling into the range of ΔIDOF.

Download Full Size | PDF

5. Summary

In summary, we have developed a compact multi-band fluorescent microscope by using an electrically tunable lens (ETL) device for autofocusing and a fiber-coupled quad-band LEDs as illumination source. The combination of the ETL and the fiber-coupled output 4-wavelength LEDs array light source can realize fast axial scan and make the microscope more compact and cost-effective. With the new promoted searching scheme based on equidistant scanning and curve fitting, we demonstrate that the setup has a minimum autofocusing time of 170 ms and a reproductivity of over 97%. The whole microscope system can be easily arranged in either upright or inverted geometries and applied to time-lapse imaging and real-time observation.

Acknowledgments

This work was supported by Natural Science Foundation of China (NSFC) (61522511, 61275193, 81427802, 11404389), and the National Basic Research Program (973 Program) of China (2012CB921900).

References and links

1. M. M. Frigault, J. Lacoste, J. L. Swift, and C. M. Brown, “Live-cell microscopy - tips and tools,” J. Cell Sci. 122(6), 753–767 (2009). [CrossRef]   [PubMed]  

2. H. Landecker, “Seeing things: from microcinematography to live cell imaging,” Nat. Methods 6(10), 707–709 (2009). [CrossRef]   [PubMed]  

3. M. Kreft, M. Stenovec, and R. Zorec, “Focus-drift correction in time-lapse confocal imaging,” Ann. N. Y. Acad. Sci. 1048(1), 321–330 (2005). [CrossRef]   [PubMed]  

4. E. Meijering, I. Smal, O. Dzyubachyk, and J. Olivo-Marin, “Time-Lapse Imaging,” in Microscope Image Processing, Q. Wu, F. A. Merchant, K. R. Castleman, eds. (Elsevier Academic Press, 2008).

5. C. Geisler, T. Hotz, A. Schönle, S. W. Hell, A. Munk, and A. Egner, “Drift estimation for single marker switching based imaging schemes,” Opt. Express 20(7), 7274–7289 (2012). [CrossRef]   [PubMed]  

6. F. Shen, L. Hodgson, and K. Hahn, “Digital autofocus methods for automated microscopy,” Methods Enzymol. 414, 620–632 (2006). [CrossRef]   [PubMed]  

7. Olympus headline details, “New Olympus IX81®-ZDC2 Zero Drift Inverted Microscope System Offers Continuous Autofocus for Time-Lapse Imaging,” (Olympus Imaging America Inc., 2010), http://www.olympusamerica.com/cpg_section/cpg_headlineDetails.asp?pressNo=770.

8. ASI product instruction, “CRISP autofocus instruction manual,” (Applied Scientific Instrumentation, Inc., 2013), http://www.asiimaging.com/downloads/manuals/CRISP%20Autofocus%20Manual.pdf.

9. M. Zeder and J. Pernthaler, “Multispot live-image autofocusing for high-throughput microscopy of fluorescently stained bacteria,” Cytometry A 75(9), 781–788 (2009). [CrossRef]   [PubMed]  

10. O. A. Osibote, R. Dendere, S. Krishnan, and T. S. Douglas, “Automated focusing in bright-field microscopy for tuberculosis detection,” J. Microsc. 240(2), 155–163 (2010). [CrossRef]   [PubMed]  

11. A. Kimura, M. G. F. Costa, C. F. F. C. Filho, L. B. M. Fujimoto, and J. Salem, “Evaluation of autofocus functions of conventional sputum smear microscopy for tuberculosis,” In Engineering in Medicine and Biology Society (IEEE,2010) pp. 3041–3044.

12. X. Y. Liu, W. H. Wang, and Y. Sun, “Dynamic evaluation of autofocusing for automated microscopic analysis of blood smear and pap smear,” J. Microsc. 227(1), 15–23 (2007). [CrossRef]   [PubMed]  

13. R. Redondo, G. Bueno, J. C. Valdiviezo, R. Nava, G. Cristóbal, O. Déniz, M. García-Rojo, J. Salido, M. M. Fernández, J. Vidal, and B. Escalante-Ramírez, “Autofocus evaluation for brightfield microscopy pathology,” J. Biomed. Opt. 17(3), 036008 (2012). [CrossRef]   [PubMed]  

14. S. Yazdanfar, K. B. Kenny, K. Tasimi, A. D. Corwin, E. L. Dixon, and R. J. Filkins, “Simple and robust image-based autofocusing for digital microscopy,” Opt. Express 16(12), 8670–8677 (2008). [CrossRef]   [PubMed]  

15. M. Humar, M. Ravnik, S. Pajk, and I. Muševič, “Electrically tunable liquid crystal optical microresonators,” Nat. Photonics 3(10), 595–600 (2009). [CrossRef]  

16. O. Pishnyak, S. Sato, and O. D. Lavrentovich, “Electrically tunable lens based on a dual-frequency nematic liquid crystal,” Appl. Opt. 45(19), 4576–4582 (2006). [CrossRef]   [PubMed]  

17. J. M. Jabbour, B. H. Malik, C. Olsovsky, R. Cuenca, S. Cheng, J. A. Jo, Y. S. L. Cheng, J. M. Wright, and K. C. Maitland, “Optical axial scanning in confocal microscopy using an electrically tunable lens,” Biomed. Opt. Express 5(2), 645–652 (2014). [CrossRef]   [PubMed]  

18. J. L. Chen, O. A. Pfäffli, F. F. Voigt, D. J. Margolis, and F. Helmchen, “Online correction of licking-induced brain motion during two-photon imaging with a tunable lens,” J. Physiol. 591(19), 4689–4698 (2013). [CrossRef]   [PubMed]  

19. B. F. Grewe, F. F. Voigt, M. van ’t Hoff, and F. Helmchen, “Fast two-layer two-photon imaging of neuronal cell populations using an electrically tunable lens,” Biomed. Opt. Express 2(7), 2035–2046 (2011). [CrossRef]   [PubMed]  

20. F. O. Fahrbach, F. F. Voigt, B. Schmid, F. Helmchen, and J. Huisken, “Rapid 3D light-sheet microscopy with a tunable lens,” Opt. Express 21(18), 21010–21026 (2013). [CrossRef]   [PubMed]  

21. Datasheet: EL-10–30-Series, “Fast electrically tunable lens EL-10-30 series”, (Optotune AG, 2014), http://www.optotune.com/products/focus-tunable-lenses/electrical-lens-el-10-30-c.

22. Y. Nakai, M. Ozeki, T. Hiraiwa, R. Tanimoto, A. Funahashi, N. Hiroi, A. Taniguchi, S. Nonaka, V. Boilot, R. Shrestha, J. Clark, N. Tamura, V. M. Draviam, and H. Oku, “High-speed microscopy with an electrically tunable lens to image the dynamics of in vivo molecular complexes,” Rev. Sci. Instrum. 86(1), 013707 (2015). [CrossRef]   [PubMed]  

23. W. Böcker, W. Rolf, W. U. Müller, and C. Streffer, “A fast autofocus unit for fluorescence microscopy,” Phys. Med. Biol. 42(10), 1981–1992 (1997). [CrossRef]   [PubMed]  

24. S. K. Nayar and Y. Nakagawa, “Shape from focus,” Pattern Anal. Machine Intell. 16(8), 824–831 (1994). [CrossRef]  

25. R. Aviles-Espinosa, J. Andilla, R. Porcar-Guezenec, O. E. Olarte, M. Nieto, X. Levecq, D. Artigas, and P. Loza-Alvarez, “Measurement and correction of in vivo sample aberrations employing a nonlinear guide-star in two-photon excited fluorescence microscopy,” Biomed. Opt. Express 2(11), 3135–3149 (2011). [CrossRef]   [PubMed]  

26. X. Tao, O. Azucena, M. Fu, Y. Zuo, D. C. Chen, and J. Kubby, “Adaptive optics microscopy with direct wavefront sensing using fluorescent protein guide stars,” Opt. Lett. 36(17), 3389–3391 (2011). [CrossRef]   [PubMed]  

Supplementary Material (1)

NameDescription
Visualization 1: MOV (5521 KB)      Main interface of the autofocusing software

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (12)

Fig. 1
Fig. 1 Schematic of the compact multi-band fluorescent microscope with an ETL for autofocusing. (a) Light path diagram of the microscope imaging head. F1: excitation filter, F2: emission filter, ETL: electrically tunable lens, OL: offset lens, MO: microscope objective, M1 and M2: mirrors, TL: tube lens, DM1 and DM2: dichroic mirrors. (b) and (c) are the diagrams of the setup in upright and inverted geometries, respectively. (d) Photograph of the microscope instrument with an upright arrangement.
Fig. 2
Fig. 2 Photographs of the fiber-coupled output 4-wavelength LEDs array light source. (a) The 4-wavelength LEDs array module. (b) Fiber-coupled output LEDs head mounted on a 65 mm long heatsink. (c) Power supply and controller of the LED package. (d) SMA fiber collimator connecting to the input port of microscope.
Fig. 3
Fig. 3 Principle illustration of the ETL [21]. (a) An intuitional view of the structure of the ETL. Container wrapped by the polymer is filled with specially-produced optical fluid. (b) A photograph of the ETL. (c) Illustration of shifting focal plane (FP) by adjusting the control current (I i ). Different from the axial scanning control mechanism by using stages, this configuration avoids motion artifacts and the shifting range varies with the magnification and numerical aperture of the objective.
Fig. 4
Fig. 4 Characterization of variation tendency of focal position and relative magnification during tuning the control current. (a) Measured focal position of the 10 × objective lens as a function of the ETL control current. (b) Measured focal position of the 40 × objective lens as a function of the ETL control current. (c) Measured relative magnification as a function of the ETL control current.
Fig. 5
Fig. 5 Profile of an ideal focus curve. Focus values are calculated with the images captured at different axial positions. The focus curve reaches the maximum at the focal plane and decreases rapidly and monotonously with defocusing.
Fig. 6
Fig. 6 Calibration of the focus curve to compensate the nonlinear relationship between the focal position and the control current of ETL. (a) The original focus curve. (b) Nonlinear relationship between the control current and the relative axial position. (c) Calibrated focus curve obtained by mapping the relationship of control current and the focus value.
Fig. 7
Fig. 7 Measured multi-peaks focus curve. Multiple peaks caused by multi-layer specimen and jitters caused by system instability are the main reasons for local maximums, which probably lead to a mistaken convergence of the searching algorithm.
Fig. 8
Fig. 8 Flowchart of the promoted searching scheme. The whole process could be divided into two stages. In the first stage, raw images are captured at even-spaced control currents and corresponding focus values are calculated. Maximal point and its four neighbors are preserved for later use. In the second stage, the five points are assigned into two groups. F(I) in the flow chart presents the function in Eq. (4) and a, b, and z0 are the corresponding unknown coefficients. By fitting the measured points to F(I), the unknown coefficients in F(I) can be determined. Further, via solving their stationary points of the determined functions, we can get the maximum points of the fitted curves IM1 and IM2 . Arithmetic mean value of the two is set as the final control current.
Fig. 9
Fig. 9 Color-fused fluorescent images of multi-dye labeled specimens. (a) The mouse kidney cells excited by the wavelengths of 405 and 470 nm successively, observed with the 10 × objective. (b) The BPAE cells excited by the wavelengths of 405, 470 and 565 nm successively, observed with the 40 × objective.
Fig. 10
Fig. 10 Main interface of the autofocusing software (see Visualization 1 for demonstration).
Fig. 11
Fig. 11 Time-sequence chart of the autofocusing process based on the camera’s time shaft. Camera works in the trigger mode and is triggered periodly. One autofocusing process contains nine steps, and each step includes three events, i.e., camera exposure, FV calculation and ETL settling.
Fig. 12
Fig. 12 Statistic histogram of the final control currents for the reproductivity calibration. The whole test can be treated as an alternate process of autofocusing and defocusing between FP_A and FP_B. ΔIDOF here represents the difference in current that is used to tune a range of DOF around the center focal point. Reproductivity is defined as the percentage of the control current falling into the range of ΔIDOF .

Tables (1)

Tables Icon

Table 1 Classification of autofocusing algorithms

Equations (5)

Equations on this page are rendered with MathJax. Learn more.

z 10 × = 1.12 × 10 5 I 2 + 8.59 × 10 3 I ,
z 40 × = 4.10 × 10 7 I 2 + 5.56 × 10 4 I ,
f ( z ) = a e ( z z 0 ) 2 2 b 2 ,
F ( I ) = a e ( p I 2 + q I z 0 ) 2 2 b 2 ,
D O F = λ n N A 2 + 2 n P M 2 ( N A ) ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.