Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

A simple image processing pipeline to sharpen topology maps in multi-wavelength interference microscopy

Open Access Open Access

Abstract

Multi-wavelength standing wave (SW) microscopy and interference reflection microscopy (IRM) are powerful techniques that use optical interference to study topographical structure. However, the use of more than two wavelengths to image the complex cell surface results in complicated topographical maps, and it can be difficult to resolve the three-dimensional contours. We present a simple image processing method to reduce the thickness and spacing of antinodal fringes in multi-wavelength interference microscopy by up to a factor of two to produce clearer and more precise topographical maps of cellular structures. We first demonstrate this improvement using model non-biological specimens, and we subsequently demonstrate the benefit of our method for reducing the ambiguity of surface topography and revealing obscured features in live and fixed-cell specimens.

Published by Optica Publishing Group under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.

Interference-based microscopy is a proven tool in the study of internal and external cellular structures. One of the most prominent interference-based microscopy techniques is standing wave (SW) microscopy, which was first demonstrated by Lanni et al. in 1986 [1]. The image contrast in SW microscopy arises from an interference effect by one of two main methods: either the specimen is illuminated from opposite directions with two beams [1], or the specimen is placed in contact with a mirror [1,2]. The optical interference pattern that results from the SW is used to excite fluorescence from the specimen. In SW microscopy, the antinodal fringe thickness is $\frac{{{\lambda _{exc}}}}{{4n}}$ [1,3,4], where λexc is the excitation wavelength used and n is the refractive index of the specimen. Antinodal planes are axially separated by $\frac{{{\lambda _{exc}}}}{{2n}}$: in air, this results in a sampling density that is approximately 50%. SW microscopy is compatible with the imaging of fixed and live cells using confocal and widefield microscopy [14].

The recently developed TartanSW method is a multi-wavelength version of SW microscopy which uses multiple wavelengths that are close to the peak excitation wavelength of the fluorophore to excite the specimen. This increases the axial sampling from approximately 50% observed for single-wavelength SW imaging to up to 98%, but there exists considerable overlap in the axial positions of the antinodes [5]. This results in complex and low-contrast images, and the cell topography can be difficult to extract from the multi-color datasets.

Another technique that makes use of the principle of optical interference to obtain axial super-resolution is the label-free method interference reflection microscopy (IRM). Since the development of the technique in 1964, this method has been applied to a variety of live and fixed-cell specimens for the observation of cellular features with an axial resolution which exceeds that possible with widefield and confocal microscopy [6,7]. As in SW microscopy, the contrast in IRM arises from the interference of light waves. However, IRM relies on reflected waves from different refractive index boundaries at the specimen plane, and this method is used to produce topographical images of unstained cellular specimens [7]. The antinodal plane thickness in IRM is given by $\frac{{{\lambda _{ill}}}}{{4n}}$, where λill is the wavelength of illumination and n is the refractive index of the specimen [7,8]. Antinodal interference fringes are axially separated by $\frac{{{\lambda _{ill}}}}{{2n}}$. The numerical aperture (NA) of the imaging objective in IRM dictates the depth of field, which determines the number of interference fringes that can be detected [7,9].

It has been recently shown that IRM can make use of multiple illumination wavelengths to gain insights into the motility of bacterial cells [10]. The use of additional wavelengths enabled more precise visualization of the position of the cell membrane relative to the glass substrate. However, there existed considerable overlap in the fringe pattern which complicated the interpretation of gliding motility.

We present a simple image processing method to reduce the thickness and spacing of antinodal fringes in TartanSW microscopy and multi-wavelength IRM by up to a factor of two, to produce a sharper and more precise topographical map of cellular structures. We use a difference operation to identify the spatial overlap in antinodal fringes in SW and IRM images in different imaging channels and hence improve the axial sampling precision of the antinodal fringes. A difference operation is used instead of a simple subtraction to avoid the generation of negative intensity values.

We first performed three-wavelength TartanSW imaging of a model specimen and we used these data to test the method. A 30-mm focal length plano–convex lens (Edmund Optics) was coated with a solution of 0.01% (w/v) poly-L-lysine in H2O (Sigma Aldrich) for 45–60 minutes, and then washed in de-ionized H2O and blow dried. The curved side of the specimen was submerged overnight in a 30-μM solution of DiI (Invitrogen) and dimethyl sulfoxide (Sigma). The specimen was then washed again in de-ionized H2O prior to imaging.

The lens specimen was placed with the curved surface in contact with a plane aluminum reflector (TFA-20C03-10, Laser 2000) and TartanSW imaging was performed using an upright widefield epifluorescence microscope (BX50, Olympus) with a 10x/0.4 dry objective lens (UPlanSApo, Olympus). Illumination was provided sequentially from 490-nm, 525-nm, and 550-nm light-emitting diodes (LEDs) (pE-4000, CoolLED). Emitted fluorescence was collected using a CMOS camera (ORCA-Flash 4.0LT, Hamamatsu) which was used with a 2.99x magnification camera port between microscope and camera. The LEDs and camera were synchronized and triggered using WinFluor software [11] with a 100-ms exposure time for each LED.

Using Fiji [12], a multi-color merge of the individual SW images from each excitation channel was performed to create the TartanSW image. This was followed by a difference operation using the image calculator function in Fiji, firstly with the difference between images obtained with 525-nm and 490-nm illumination, and then with the difference between images obtained with 550-nm and 525-nm illumination. A two-color merge of the individual difference images was then performed in Fiji. To quantify the full width at half maximum (FWHM) antinodal fringe thickness and antinodal spacing in both TartanSW and the difference images, a radially averaged line intensity plot was obtained for each channel of both datasets using the MATLAB script published previously [13].

The data from the imaged lens specimen are shown in Fig. 1. Figure 1(A) shows the TartanSW image with a false-color merge, using images obtained with excitation wavelengths of 490 nm, 525 nm, and 550 nm as blue, green, and red, respectively. The radially averaged line intensity plot of the TartanSW image is shown in Fig. 1(B). Figure 1(C) shows the result of the image difference operation, with the difference between 525 nm and 490 nm shown in green and the difference between 550 nm and 525 nm displayed in magenta. The radially averaged line intensity plot from this difference operation is shown in Fig. 1(D).

 figure: Fig. 1.

Fig. 1. (A) TartanSW image of a lens specimen prepared with a monolayer of DiI on the curved surface. Sequential excitation wavelengths of 490 nm, 525 nm, and 550 nm were applied, and the resultant images are false colored in blue, green, and red look-up tables, respectively. (B) Radially averaged line intensity plot showing fluorescence intensities of individual channels of the TartanSW image in (A) for 490-nm (blue), 525-nm (green), and 550-nm (red) excitation wavelengths with respect to the distance from the mirror surface. (C). A difference image of |525 nm – 490 nm| (green) and |550 nm – 525 nm| (magenta) of the same individual channels used to create (A). (D) Radially averaged line intensity plot showing fluorescence intensities of individual channels of the difference image in (A) for |525 nm – 490 nm| (green) and |550 nm – 525 nm| (magenta).

Download Full Size | PDF

Table 1 shows the experimental values for FWHM antinodal fringe thickness and antinodal fringe spacing for each of the illumination wavelengths used for TartanSW imaging of the lens specimen shown in Fig. 1(B), together with the theoretical values for these parameters.

Tables Icon

Table 1. Measured and Theoretical Values of Antinodal Fringe Thickness at FWHM and Antinodal Fringe Spacing for TartanSW Imaging of an f = 30 mm Lens Specimen

Table 2 shows the measured results for the FWHM antinodal fringe thicknesses and average antinodal fringe spacings for difference imaging obtained with illumination wavelengths of |525 nm – 490 nm| and |550 nm – 525 nm| over a height of 1.6 µm from the mirror surface, extracted from Fig. 1(D). Theoretical values shown in Tables 1 and 2 are calculated using $\frac{{{\lambda _{exc}}}}{{2n}}$ or from a simulation of the difference operation presented in Supplement 1.

Tables Icon

Table 2. Measured and Average Theoretical Antinodal Fringe Thickness at FWHM and Antinodal Fringe Spacing after Applying the Difference Operation to TartanSW Images of an f = 30 mm Lens Specimen

We measured up to a twofold reduction in both FWHM antinodal fringe thickness and antinodal fringe spacing in the difference image compared to the TartanSW data. This reduction in fringe thickness facilitates an improvement in antinodal fringe sampling precision of the same factor. We also noted an improvement in image contrast in the higher-order antinodal fringes.

Next, we applied the difference operation to fluorescence images of live and fixed-cell specimens obtained using widefield and confocal point scanning illumination. Live MCF-7 cells were labeled with the lipophilic membrane dye DiI and plated onto first surface reflectors (Laser2000) using the previously reported protocol [5]. The mirrors were submerged in 4% BSA + PBS and imaged using the same protocol and equipment as described above with the exception that a 40x/0.8 water dipping objective lens (LUMPLFLN, Olympus) was used for cell imaging.

A sample of 3T3 cells was plated onto the same type of mirror and fixed using 4% paraformaldehyde (PFA) before labeling with rhodamine phalloidin (Invitrogen) using the method described previously [5]. Specimens were mounted in PBS and imaged using a confocal microscope (SP5, Leica) with a 40x/0.8 water dipping objective (HCX APO LUV-I, Leica). Excitation was provided sequentially using 488-nm, 514-nm, and 543-nm laser lines with a scan speed of 100 Hz, line averaging of 8, and an image size of 2048 pixels and no digital zoom. For each wavelength, fluorescence was detected between 550 and 650 nm. All raw image data were opened in Fiji. TartanSW images were created as reported previously [5] and the difference operation was applied using the same method as for the lens specimen.

TartanSW images of both live and fixed-cell specimens are presented in Fig. 2. As shown in Figs. 2(A) and 2(C), signals from higher-order fringes appear with low contrast in the images, making it difficult to interpret the cell structure. Some adjustment of the gamma scale can be used to slightly improve this, but it is difficult to improve the color specificity while avoiding saturation of the image. The application of the difference operation, evidenced by Figs. 2(B) and 2(D) with digitally zoomed regions of interest, improves the sharpness of the cell structure. This is evident in the TartanSW images of rhodamine phalloidin labeled F-actin. Our method selectively removed signals originating from low-order fringes which overlap for the different wavelengths. The difference method removed saturated signals from the raw TartanSW images that originated from dense cell regions close to the mirror surface [see Fig. 2(C)]. As a result, actin structures at the basal cell membrane are more clearly visible [see Fig. 2(D)].

 figure: Fig. 2.

Fig. 2. (A) Widefield TartanSW image of live MCF-7 cells stained with DiI. (B) Difference image of (A) with |525 nm – 490 nm| in green and |550 nm – 525 nm| in magenta. (C) Confocal TartanSW image of fixed 3T3 cells labeled with rhodamine phalloidin. (D) Difference image of (C) with |525 nm – 490 nm| in green and |550 nm – 525 nm| in magenta. Yellow boxes show regions of interest with a digitally expanded zoom of these areas for each image.

Download Full Size | PDF

Time-lapse widefield imaging using the difference operation to observe changes in cell topography was also performed. Live MCF-7 cells labeled with the membrane stain DiI were imaged using the same widefield microscope setup used to image the lens specimen, with 100-ms exposure time at 20 second intervals over a total period of 16 minutes, and the difference operation applied as reported. Visualization 1 shows an example dataset, where small changes in the cell topography are revealed as a shift in the position of the high-contrast antinodal fringes.

We also applied the difference operation to images obtained with multi-wavelength IRM. Again, we first performed imaging of a 72-mm focal length plano–convex lens placed upon a microscope coverslip (631-0153, VWR). Since the contrast in IRM arises from reflection, no fluorescent stain was required. Multi-wavelength IRM was carried out using the same equipment and method as described by Rooney et al. in Ref. [10]. The lens specimen was imaged using a confocal microscope set in reflection mode with a 10x/0.3 UPLANFL lens (Olympus, Japan) using 488-nm and 514-nm lasers, and the difference method was applied. Data are shown in Fig. 3(A).

 figure: Fig. 3.

Fig. 3. (A) A false-color composite difference image of an f = 72 mm lens specimen acquired using multi-wavelength IRM. The difference image of |514 nm – 488 nm| is shown in green, and |543 nm – 514 nm| is shown in magenta. (B) A false-color composite difference image of fixed MeT-5A cells. The difference image of |514 nm – 488 nm| is shown in green, and |543 nm – 514 nm| is shown in magenta.

Download Full Size | PDF

Fixed MeT-5A cells (ATCC, CRL-9444) were also imaged using multi-wavelength IRM to evaluate the value of the difference operation for the study of more complex structures. Cells were plated on poly-L-lysine-coated coverslips 24 hours prior to fixation in 4% PFA. The cells were mounted in ProLong Diamond Antifade mountant (Invitrogen) (n = 1.46). The cell specimen was imaged with a confocal microscope (SP5, Leica), using a 20x/0.7 objective (506513, Leica), and a 488-nm, 514-nm, or 633-nm laser line for illumination. A 10-frame average was taken, and the difference operation was performed. Data are shown in Fig. 3(B).

Using the same radially averaged line intensity measurement method to that applied to TartanSW data, applying the difference operation to multi-wavelength IRM images of the lens resulted in FWHM antinodal fringe thicknesses of 60.0 nm for |514 nm – 488 nm| and 64.7 nm for |543 nm – 514 nm|. This offers a considerable improvement over conventional IRM where FWHM antinodal fringe thicknesses of 83.6 nm, 88.0 nm, and 108.3 nm are the thinnest possible with illumination wavelengths of 488 nm, 514 nm, and 543 nm. Furthermore, the difference operation when applied to multi-wavelength IRM cell images showed similar improvement in antinodal fringe position precision and contrast to that obtained when applied to TartanSW datasets.

Antinodal plane thickness in SW microscopy is often considered equivalent to the axial resolution, but this is not strictly correct. The full theoretical structure of the widefield SW point spread function (PSF) can be obtained from the following equation [14]:

$$PS{F_{SW}} = \left[ {1 + \textrm{cos}\left( {\left( {\frac{{4\pi n}}{{{\lambda_{exc}}}}} \right)z} \right)} \right]{[\textrm{sinc}\left( {\frac{{N{A^2}}}{{2n{\lambda_{em}}}}z} \right)]^2}{\; }, $$
where NA is the numerical aperture of the imaging objective and λem is the peak emission wavelength being detected, and the illumination intensity profile I for IRM is given by [15]
$$2I = S - D\frac{{\textrm{sin(y)}}}{y}\textrm{cos}\left\{ {\frac{{4\pi n}}{{{{\boldsymbol \lambda }_{{\boldsymbol ill}}}}}\left[ {z\left( {1 - \textrm{si}{\textrm{n}^2}\left( {\frac{\alpha }{2}} \right)} \right)} \right]} \right\}, $$
where S and D are the sum and difference of the maximum and minimum intensities, respectively; z and y are the axial and lateral distances, respectively; and $\alpha $ is half the angle of the cone of illumination. While we observe a thinning of the antinodal fringe position with the difference operation in both fluorescence and reflection interference methods studied here, this is not exactly commensurate with an improvement in axial resolution, and we have avoided this direct comparison. We also note that performing the difference operation to improve antinodal fringe thickness comes at a cost of reduced sampling density. We therefore propose the difference operation as an aid to the interpretation of multi-color interference microscopy images, which has broad applications, including surface profile analysis [16], absolute measurement of thin-film thickness [17], and characterization of protein patterns in live cells [18].

There are specific imaging conditions where the difference operation should be used with great care. For example, where there exist similar intensity values in the same region of multiple channels, such as the region close to the center of Fig. 2(A), this will result in a region containing zero intensity values, as can be seen in the corresponding region of Fig. 2(B). Also, since the contrast improvement is mostly observed in the higher-order fringes, this method is best suited to imaging thicker cell specimens with a topological shape that does not lead to overlapping antinodal planes in the axial dimension, e.g., a curved surface in contact with a flat substrate [19]. As with conventional high-resolution imaging, the Nyquist sampling criterion should be fulfilled [20].

Our data show that the difference operation increases the contrast of the images, and it can increase the visibility of structures that are difficult to detect in multi-wavelength interference microscopy. This is evident in Fig. 2, where internal membrane structures that are barely visible in TartanSW data can be clearly observed after the difference operation has been applied. These internal structures can be observed even through the highly scattering cell nucleus, which we expect is represented by the dark gray region in the center of the cell image. This increased contrast may aid in the sensitive detection of tiny deformations in the cell membrane, and in object segmentation and three-dimensional particle tracking in live cells.

Funding

Engineering and Physical Sciences Research Council (EP/L016559/1); Biotechnology and Biological Sciences Research Council (BB/P02565X/1, BB/T011602/1); Medical Research Council (MR/K015583/1).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Supplemental document

See Supplement 1 for supporting content.

REFERENCES

1. F. Lanni, Applications of Fluorescence in the Biomedical Science (Alan R. Liss, 1986).

2. R. Amor, S. Mahajan, W. B. Amos, and G. McConnell, Sci. Rep. 4, 7359 (2014). [CrossRef]  

3. B. Bailey, D. L. Farkas, D. L. Taylor, and F. Lanni, Nature 366, 44 (1993). [CrossRef]  

4. F. Lanni and B. Bailey, Trends Cell Biol. 4, 262 (1994). [CrossRef]  

5. J. K. Schniete, P. W. Tinning, R. C. Scrimgeour, G. Robb, L. S. Kölln, K. Wesencraft, N. R. Paul, T. J. Bushell, and G. McConnell, Sci. Rep. 11, 2903 (2021). [CrossRef]  

6. A. S. G. Curtis, J. Cell Biol. 20, 199 (1964). [CrossRef]  

7. V. A. Barr and S. C. Bunnel, J. R. Soc. Interface. 11, 20140684 (2014). [CrossRef]  

8. D. Halliday, R. Resnick, and J. Walker, Fundamentals of Physics (7th ed.). John Wiley & Sons. ISBN 0-471-42959-7. (2005).

9. I. Weber, Methods Enzymol. 361, 34 (2003). [CrossRef]  

10. L. M. Rooney, L. S. Kölln, R. Scrimgeour, W. B. Amos, P. A. Hoskisson, and G. McConnell, mSphere 5, 1 (2020). [CrossRef]  

11. J. Dempster, D. L. Wokosin, K. D. McCloskey, J. M. Girkin, and A. M. Gurney, Br. J. Pharmacol.137, (2002).

12. J. Schindelin, I. Arganda-Carreras, E. Frise, V. Kaynig, M. Longair, T. Pietzsch, S. Preibisch, C. Rueden, S. Saalfeld, B. Schmid, J. Y. Tinevez, D. J. White, V. Hartenstein, K. Eliceiri, P. Tomancak, and A. Cardona, Nat. Methods 9, 676 (2012). [CrossRef]  

13. P. W. Tinning, R. Scrimgeour, and G. Mcconnell, Biomed. Opt. Express 9, 1745 (2018). [CrossRef]  

14. V. Krishnamurthi, B. Bailey, and F. Lanni, Image Acquis. Process. 2655, 18 (1996). [CrossRef]  

15. L. Limozin and K. Sengupta, ChemPhysChem 10, 2752 (2009). [CrossRef]  

16. X. Tian, X. Tu, J. Zhang, O. Spires, N. Brock, S. Pau, and R. Liang, Opt. Express 26, 18279 (2018). [CrossRef]  

17. J. de Ruiter, F. Mugele, and D. van den Ende, Phys. Fluids 27, 012104 (2015). [CrossRef]  

18. O. Theodoly, N. Garcia-Seyda, F. Bedu, X. Luo, T. Mignot, J. Giermanska, J.-P. Chapel, M. Métivier, and M.-P. Valignat, PLoS One 13, e0207881 (2018). [CrossRef]  

19. J. Rädler and E. Sackmann, J. Phys. II France 3, 727 (1993). [CrossRef]  

20. C. E. Shannon, Proc. IRE 37, 10 (1949). [CrossRef]  

Supplementary Material (2)

NameDescription
Supplement 1       Supplemental Document
Visualization 1       Visualisation 1

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (3)

Fig. 1.
Fig. 1. (A) TartanSW image of a lens specimen prepared with a monolayer of DiI on the curved surface. Sequential excitation wavelengths of 490 nm, 525 nm, and 550 nm were applied, and the resultant images are false colored in blue, green, and red look-up tables, respectively. (B) Radially averaged line intensity plot showing fluorescence intensities of individual channels of the TartanSW image in (A) for 490-nm (blue), 525-nm (green), and 550-nm (red) excitation wavelengths with respect to the distance from the mirror surface. (C). A difference image of |525 nm – 490 nm| (green) and |550 nm – 525 nm| (magenta) of the same individual channels used to create (A). (D) Radially averaged line intensity plot showing fluorescence intensities of individual channels of the difference image in (A) for |525 nm – 490 nm| (green) and |550 nm – 525 nm| (magenta).
Fig. 2.
Fig. 2. (A) Widefield TartanSW image of live MCF-7 cells stained with DiI. (B) Difference image of (A) with |525 nm – 490 nm| in green and |550 nm – 525 nm| in magenta. (C) Confocal TartanSW image of fixed 3T3 cells labeled with rhodamine phalloidin. (D) Difference image of (C) with |525 nm – 490 nm| in green and |550 nm – 525 nm| in magenta. Yellow boxes show regions of interest with a digitally expanded zoom of these areas for each image.
Fig. 3.
Fig. 3. (A) A false-color composite difference image of an f = 72 mm lens specimen acquired using multi-wavelength IRM. The difference image of |514 nm – 488 nm| is shown in green, and |543 nm – 514 nm| is shown in magenta. (B) A false-color composite difference image of fixed MeT-5A cells. The difference image of |514 nm – 488 nm| is shown in green, and |543 nm – 514 nm| is shown in magenta.

Tables (2)

Tables Icon

Table 1. Measured and Theoretical Values of Antinodal Fringe Thickness at FWHM and Antinodal Fringe Spacing for TartanSW Imaging of an f = 30 mm Lens Specimen

Tables Icon

Table 2. Measured and Average Theoretical Antinodal Fringe Thickness at FWHM and Antinodal Fringe Spacing after Applying the Difference Operation to TartanSW Images of an f = 30 mm Lens Specimen

Equations (2)

Equations on this page are rendered with MathJax. Learn more.

P S F S W = [ 1 + cos ( ( 4 π n λ e x c ) z ) ] [ sinc ( N A 2 2 n λ e m z ) ] 2 ,
2 I = S D sin(y) y cos { 4 π n λ i l l [ z ( 1 si n 2 ( α 2 ) ) ] } ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.