Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Dual-beam manually-actuated distortion-corrected imaging (DMDI) with micromotor catheters

Open Access Open Access

Abstract

We present a new paradigm for performing two-dimensional scanning called dual-beam manually-actuated distortion-corrected imaging (DMDI). DMDI operates by imaging the same object with two spatially-separated beams that are being mechanically scanned rapidly in one dimension with slower manual actuation along a second dimension. Registration of common features between the two imaging channels allows remapping of the images to correct for distortions due to manual actuation. We demonstrate DMDI using a 4.7 mm OD rotationally scanning dual-beam micromotor catheter (DBMC). The DBMC requires a simple, one-time calibration of the beam paths by imaging a patterned phantom. DMDI allows for distortion correction of non-uniform axial speed and rotational motion of the DBMC. We show the utility of this technique by demonstrating en face OCT image distortion correction of a manually-scanned checkerboard phantom and fingerprint scan.

© 2017 Optical Society of America

1. Introduction

Two-dimensional scanning mechanisms, of which there are many demonstrated implementations [1, 2], are required for many endoscopic imaging modalities such as three-dimensional optical coherence tomography (OCT). Such scanners have been used to acquire 3D OCT images from many confined internal body sites including the coronary arteries, upper and lower gastrointestinal tracts, and respiratory tract [3–5]. Fiber optic rotary catheters that are either distally or proximally rotated are ideal for imaging long segments of tubular organs. Distally rotated catheters commonly employ stationary optical fibers directed toward an angled mirror that is spun by a micromotor, whereas in proximally rotated catheters, the entire optical fiber and beam-directing optics are rotated by an externally located motor. Each method has its advantages and disadvantages depending on the desired application.

Axial scanning along the second dimension is accomplished by pulling back the rotary catheter in a controlled fashion using a linear motor or by hand. Linear motor actuation generally produces evenly pitched, distortion-free imaging. However, patient or clinician motion artifacts can distort the images along the pullback axis. Additionally, the length of pullback is limited by the stroke of the linear actuator, necessitating multiple overlapping pullbacks for long imaging lengths.

Manual actuation along the pullback axis is attractive because it can greatly simplify the catheter construction and operation. This may result in cheaper, smaller, and more reliable catheters that will have greater clinical applicability. Additionally, the length of a manually-actuated pullback is only limited by the storage of the data acquisition system. However, the primary drawback of manual actuation is non-uniform pullback speed (NUPS) that can smear out or compress features along the pullback axis making image interpretation and analysis along this axis difficult.

A number of groups have investigated methods for correcting or tracking manually-scanned optical probes. Oversampling and correlation between A-scans have been used to correct for speed variation in 1-dimensional scanning for 2D optical coherence tomography (OCT) imaging [6–10]; however, due to the large mismatch in linear scanning speeds of rotary and pullback motion, extension of these methods to 2D rotary-pullback scanning is not straightforward. Magnetic sensors, and optical motion tracking encoders or sensors have also been used to discern scan motion in handheld OCT systems, although miniaturization into endoscopic catheters has yet to be realized [11–13]. Groups have demonstrated 3-dimensional anatomical imaging by reconstructing the pathway taken by OCT catheters with integrated electromagnetic tracking sensors but these efforts require a considerably greater degree of instrumental complexity [14, 15].

In this work, we present a new 2D scanning paradigm called Dual-beam Manually-actuated Distortion-corrected Imaging (DMDI). Conceptually, DMDI requires two imaging beams that scan mechanically along one dimension (fast axis) and are separated by a known distance in the orthogonal dimension (slow axis). As the sample is manually scanned primarily along the slow axis direction, measurement of the time difference between when the second beam passes by a feature also seen by the first beam can allow determination of the average scan speed and direction between those times. Knowledge of the scan speed and direction allows re-mapping of the distorted images from either of the beams to produce the distortion-corrected image.

We demonstrate an example of DMDI in a rotationally scanning dual-beam micromotor catheter (DBMC). The micromotor scans the fast axis in a rotational manner while motion along the axial axis is manually actuated. We first describe the calibration procedure of the DBMC to determine the scan paths of the beams. We then demonstrate the distortion correction procedure by imaging a patterned phantom. Finally, we show in vivo DMDI of a fingerprint pattern.

2. Methods

2.1 OCT imaging system

For the convenience of equipment in our lab, we use en face OCT as the imaging modality for this demonstration of DMDI, although in principle, any point-scanning imaging modality could be used. The employed dual-channel imaging OCT system is schematically shown in Fig. 1(i). A 23 mW, 100 kHz 1310 nm swept-source laser (AXP50125-6, Axsun Technologies, Billerica, MA) is 50/50 split and fed into two parallel Mach-Zehnder OCT interferometers. The sample arms of each of these interferometers feeds into one of the fiber pigtails of the DBMC. OCT signals from balanced detectors (PDB480C-AC, Thorlabs, Inc.) from each of the interferometers are simultaneously acquired by a dual-channel, k-clocked fast digitizer (ATS9350, Alazar Technologies, Inc., Pointe Claire, QC). The path length difference between the two interferometers is approximately 2 m, sufficiently different such that there is no OCT cross-talk between them.

 figure: Fig. 1

Fig. 1 Dual-channel OCT imaging system and dual beam micromotor catheter (DBMC). i) Schematic diagram of dual-channel OCT imaging system. SS = swept-source laser, PC = polarization controller, C = collimator, RM = reference mirror, CIRC = circulator, BD = balanced detector. ii) Model of DBMC (outermost plastic tubing not shown). DFP = dual fiber pigtail; GRIN = graded-index lens; MM = 4 mm OD micromotor, FPC = flexible printed circuit. Approximate paths of A and B beams at catheter outer diameter are shown in red and blue respectively. iii) Side view of DBMC showing approximate beam paths for A and B beams. iv) Photograph of the DBMC. The rigid length of the DBMC is indicated. Scale bar is 1 cm.

Download Full Size | PDF

2.2 Dual beam micromotor catheter (DBMC)

The dual beam micromotor catheter (DBMC) used for these experiments is shown in Fig. 1(ii-iv). A dual SMF-28 fiber pigtail (DFP, KFP-V-2-8D-250S-250-1310-FC/APC, Photop Technologies, Inc., Santa Clara, CA) was aligned to a GRIN lens (GRIN2313A, Thorlabs Inc., Newton, NJ) using a glass ferrule (51-2800-1800, Thorlabs, Inc.). Both the DFP and GRIN lens were polished at 8° and anti-reflection coated for 1310 nm. The fibers within the DFP are separated by 250 μm and oriented vertically to one another if viewing the 8° polish angle from the side. The distance between the DFP and GRIN was adjusted to place the focus of a 1310 nm light source approximately 3.5 mm from the end face of the GRIN with a circular spot size of 14 μm measured with a beam profiler (BeamMap2, DataRay Inc., Redding, CA). An aluminum-coated 1 mm right angle prism (MPCH-1.0, Tower Optical Corporation, Boynton Beach, FL) was mounted to the shaft of a 4 mm OD micromotor (SBL04-0829, Namiki Precision of California, Inc., Belmont, CA) with a bead of UV-curing adhesive (NOA 63, Norland Products Inc., Cranbury, NJ) at approximately 8° angle to avoid strong back-reflections within the system. The DFP assembly was inserted into a plastic tube with the same outer diameter as that of the micromotor. The flexible printed circuit (FPC) feeding power to the micromotor was bent back alongside the motor and held against it with another section of thin-walled plastic tube giving an overall catheter OD of 4.7 mm. The minimum rigid length of the catheter is 28 mm. The imaging power at the sample was 2.1 and 2.4 mW for the A and B beams respectively. A commercial driver board (SOD12ST, Namiki Precision of California, Inc.) was used to drive the micromotor at 100 Hz for all experiments described in this paper. No frame-to-frame non-uniform rotational distortion (NURD) was observed when using this motor and driver combination.

The light paths for the two imaging beams are approximately shown in Fig. 1(ii-iii). Due to the 8° polish on the DFP exit face, one beam (beam A, red line) deflects and enters the GRIN near on-axis, hits the prism near center, and traces a roughly planar circular pattern on the catheter outer diameter. The other beam (beam B, blue line) deflects away from the GRIN axis, hits the prism off-center, and traces a non-planar elliptical pattern on the catheter outer diameter.

2.3 DBMC calibration

For calibration of the DBMC, a pattern consisting of groups of equally spaced, horizontal and vertical black lines was printed on standard white printer paper. This pattern was rolled around and taped over a 4.75/5.00 mm ID/OD plastic tube that slides easily but snugly over the DBMC. Care was taken during rolling to ensure that the circumferential lines were continuous at the paper seam. Imaging of the calibration pattern involved first stationary imaging of the lines parallel to the plastic tube axis. Following this, a linear stepper motor pushed the DBMC through the circumferential line pattern at a constant speed of 4 mm/s.

The major steps for calibrating the DBMC are outlined in the left panel of Fig. 2 and are described in more detail here. For calibration, after a small delay at the start of the data acquisition, the DBMC was pushed through the calibration phantom at vz = 4mm/s. The two imaging channels, A and B, are acquired as continuous streams of equally time-spaced A-lines with index N. Figure 3(i) shows en face OCT images A(n,fr) and B(n,fr), where the frame index, fr, is the integer division of N by Nfr, the number of A-lines per frame (Nfr = 100,000 A-lines per second / 100 frames per second), and n is the remainder. The en face OCT images are presented as mean intensity projections over the OCT depth dimension because the printed paper phantom has no encoded depth information. Each fr column of the image represents one rotation of the DBMC mirror, while n represents an angular position of the prism. Although N, fr and n are functions of time t and should be written as N(t), fr(t), and n(t), for notational simplicity the time dependence is not explicitly stated in further discussion. Apparent in the displayed images as a set of darker horizontal lines is the FPC at the top of image A and straddling the top/bottom border of image B that occludes imaging. The shift of the FPC position (and the rest of the pattern in general) between the two channels is indicative that the A and B channels image each point on the DBMC outer diameter at different fr and n values, therefore, at different times.

 figure: Fig. 2

Fig. 2 Outline of primary DMDI processing steps for (left) calibration and (right) distortion correcting images acquired with DBMCs.

Download Full Size | PDF

 figure: Fig. 3

Fig. 3 Calibration of DBMC using the paper calibration pattern. i) Raw en face OCT images from A and B channels. The range of the n axis is from 1 to 1000 A-lines, with each image column corresponding to one rotation of the prism. ii) Data and fit of positions of horizontal lines in i). iii) Aligned, shear-corrected, and θ calibrated images. The range of the θ axis is from 0° to 360°. iv) Scan pattern data and fit. v) Distortion corrected images. vi) Fixed pattern data and fit.

Download Full Size | PDF

The FPC is stationary relative to the A and B imaging positions throughout the scan so the small downwards drift (see small increasing gap towards top right of the A image) of the FPC in Fig. 3(i) from left to right is due to the asynchronous operation of the micromotor and the laser-triggered OCT data acquisition system. This small amount of image shear can be corrected by interpolating the continuous stream of A-lines so that the image frames are aligned. After shear-correction, the horizontal lines of the calibration phantom during the pushed portion of imaging still appear tilted due to a small amount of catheter rotation during axial actuation. Choosing Nref,(A,B) as the index of the A-line corresponding to the bottom edge of the FPC in both images, the images can be aligned by plotting as A(nA,frA) and B(nB,frB), where fr(A,B) is the integer division of N-Nref,(A,B) by Nfr and n(A,B) is the remainder. (Note: Here we use the subscripted (A,B) to represent two distinct terms or functions corresponding to each of the A and B imaging channels).

The equally-spaced horizontal lines of the printed phantom are approximately equally spaced in image A because the A beam hits near-center on the spinning prism and it scans the catheter outer diameter at roughly constant speed. However, the horizontal lines in image B are expanded at the top and compressed at the bottom because the B beam hits the spinning prism away from the rotational axis and thus scans the catheter outer diameter on one side of the catheter faster than the opposite side. Therefore, the first step in DBMC calibration is to find how index N maps to θ(A,B), the angular positions for each beam at the catheter surface.

The θ(A,B)(n(A,B)) calibrations were performed by averaging over the first 6 stationary (non-pushed) frames and thresholding the images to determine the positions n(A,B)j of the negative-going edges of the horizontal lines in images A and B. Only the negative-going edges were used for calibration as the phantom printing process does not ensure that the heights of the light and dark horizontal bars in the images are equal. The equally-spaced negative-going edges at angular positions θj, where j represents the jth edge position, correspond to nA,j and nB,j in images A and B respectively. θj can be represented as

θ=θ0+j(Δθ)

where θ0 is the offset from the bottom edge of the FPC (in the same direction as increasing n) to the first negative-going edge; and Δθ is the spacing of the negative-going edges, both of these are in units of degrees. The calibration from n(A,B) to θ(A,B) can be expressed as a linear term plus a kth-order cosine expansion with amplitudes and offsets c(A,B),k and n(A,B),k,off respectively, and periodic in Nfr:

θ(A,B)(n(A,B))=gn(A,B)+gkc(A,B),kcos(2πkNfr(n(A,B)n(A,B),k,off))gC(A,B),0

where g=360°1000Alines. The terms C(A,B),0 ensure that θ(A,B)(n(A,B)=0)=0, and are

C(A,B),0= gkc(A,B),kcos(2πkNfr(n(A,B),k, off))

Using Eqs. (1)-(3), the sets of [θj, nA,j] and [θj, nB,j] pairs were used to empirically fit for the unknown parameters θ0, Δθ, c(A,B),k and n(A,B),k,off. Least-squares minimization was used to find optimized set of parameters for Eqs. (1)-(3) with truncation of the cosine expansion at increasing values of k. The second-order truncation with the parameters shown in Table 1 was found to be sufficient to reduce the residuals between the fit and data to statistical noise variation. The plots of the data, second-order fits, and residuals of Eq. (2) for the DBMC used in this work are shown in Fig. 3(ii). Using the fitted parameters, the A(nA,frA) and B(nB,frB) images can be re-mapped to A(θ,frA) and B(θ,frB), as shown in Fig. 3(iii).

Tables Icon

Table 1. Fit parameters for θ calibration

The next step in the DBMC calibration makes use of the constant-speed actuated part of the images across the vertical lines of the calibration pattern to determine the scanning pattern of the imaging beams. The θ-calibrated images were smoothed with a Gaussian kernel and then a threshold was applied to obtain a binary mask. The frame indices of the edges of the vertical lines were identified for each image θ-row. As the vertical lines are equally spaced in the calibration pattern along z, the frame indices for each θ-pixel can be analyzed using simple linear regression of the frame index versus edge number yielding slopes m(A,B)(θ) in units of frames per edge, and intercepts b(A,B)(θ) in units of frames. The slopes for both A and B channels should be identical for all values of θ, such that mA(θ) = mB(θ) = m. The intercepts b(A,B)(θ) describe the average shape of the vertical lines as a function of θ in each of the A and B images in units of frames. For accuracy, the intercepts were fitted relative to the centermost vertical line of the calibration pattern. We define the functions Sfr(θ) and Ffr(θ), the scan pattern and fixed pattern in units of frames, respectively, as

Sfr(θ)=12[bA(θ)bB(θ)]
Ffr(θ)= 12[bA(θ)+bB(θ)]

The scan and fixed pattern functions in units of distance, S(θ) and F(θ), can be calculated using

S(θ)= [Sfr(θ)Nfr+nA(θ)+ Nref,AnB(θ)Nref,B]vzflaser
F(θ)= [Ffr(θ)Nfr+nA(θ)+ Nref,AnB(θ)Nref,B]vzflaser
where nA(θ) and nB(θ) are found by solving the inverse of Eq. (2), flaser is the laser sweep rate, and vz is the specified axial speed. S(θ) and F(θ) for the DBMC used in this work are plotted as solid lines in Figs. 3(iv) and 3(vi) respectively. The scan pattern function S(θ) describes the distance between the A and B light beams as a function of θ, which is needed for calculation of the axial speed for DMDI. The fixed pattern function F(θ) describes the deviation from a perfect circle of the midpoint between the A and B light beams. Again being periodic in Nfr, S(θ) and F(θ) can be fit to sine expansions:

S(θ)= s0+ksksin(2πkNfr(θθs,k,off))
F(θ)= f0+kfksin(2πkNfr(θθf,k,off))

S(θ) and F(θ) were empirically fit via least squares minimization with the fitted parameters shown in Table 2. The fits of S(θ) and F(θ) are shown as dashed lines in Figs. 3(iv) and 3(vi) respectively, along with their corresponding residuals below. S(θ) was truncated at 3rd-order after reducing the 4th-order residuals to the approximate noise level while F(θ) was truncated at 2nd-order as further expansion did not improve the fit substantially. The larger residuals between θ = 300° and 330° for F(θ) are likely due to the presence of the underlying FPC that causes non-circular deformation at the outer diameter at these angles; in addition, the printed paper pattern overlaps itself near these angles, which causes the paper to be further from the outer diameter of the plastic tube.

Tables Icon

Table 2. Fit parameters for S(θ) and F(θ) calibrations

To generate the distortion corrected images, the images must be adjusted to account for the overall motion of the DBMC and also for the apparent distortions due to the scan and fixed patterns. The z position of any point in the A and B images is given by

zA(θ,t)=zDBMC(t) S(θ)F(θ)
zB(θ,t)=zDBMC(t) +S(θ)F(θ)
where zDBMC(t)=υz(t')dt' is the axial position of the DBMC. As F(θ) is subtracted in both Eqs. (10) and (11), the constant offset term f0 in Eq. (9) can be ignored. Using the constant axial velocity of 4 mm/s and Eqs. (10) and (11), A(θ,frA) and B(θ,frB) can be remapped to the distortion corrected images A(θ,z) and B(θ,z), as shown in Fig. 3(v).

2.4 Image distortion correction

A phantom to test the developed distortion correction algorithm was made by printing a 1 mm checkerboard pattern on paper and wrapping around a 4.75/5.00 mm ID/OD plastic tube (same as was used for the calibration pattern). An extra registration line was printed within the pattern to allow definite identification and correlation of each of the checkerboard squares in both of the images. After the start of acquisition, the DBMC was manually pushed through the test phantom at varying speed while also rotating it about the catheter axis. The overall acquisition time was a few seconds.

Once the calibration functions S(θ) and F(θ) for a DBMC are known, it can be used to produce distortion-corrected images using the process outlined on the right side of Fig. 2. A(nA,frA) and B(nB,frB) images of the 1 mm checkerboard pattern imaged with the DBMC after reference edge alignment and shear correction are shown in Fig. 4(i). The non-constant axial velocity and angular rotation of the DBMC during actuation are readily apparent. Starting from the dark vertical line approximately in the centre of the image, all vertices common to both A and B were manually registered using the MATLAB (Mathworks, Inc., Natick, MA) cpselect function as [(nA, frA), (nB, frB)]j (j = 1 …303) coordinate pairs. The registered control points are shown as green and red x’s in Fig. 4(ii). The average z velocity υ¯z,AB,j, between the jth pair of registered control points can be estimated as

υ¯z,AB,j=S(θA,j)+ S(θB,j)|tA,jtB,j|
where the numerator and denominator are the distance and time differences between the control points respectively, and t(AB),j = n(AB),j / flaser. Similarly, the average angular velocity ω¯AB,j between the jth pair of registered control points can be estimated as
ω¯AB,j=θsecond,j θfirst,j|tA,jtB,j|
where θfirst,j and θsecond,j are the θ values for the control points that are first and second in time respectively. Control point pairs with identical values of frA and frB were eliminated from further analysis because the errors associated with the manual selection of these control points are relatively large compared to the time differences being measured. The eliminated control points (n = 8) are shown as red x’s in Fig. 4(ii), while all others are shown in green (n = 295). To estimate the instantaneous z and angular velocity at all values of time, vectors υz(t) and ω(t) were created where the individual elements are an equally weighted average of all υ¯z,AB,j and ω¯AB,j, respectively, defined for that t. The axial speed at the beginning and ends of the images where only a single beam imaged was set to an insignificantly small value – to have a single-valued z(A,B)(θ,t) – and the axial speed was interpolated for times in the middle of the data set where axial speed was otherwise undefined. Plots of ω(t) and υz(t) averaged over each frame are shown in the upper panes of Figs. 4(iii) and 4(v) respectively. Integrating ω(t) and υz(t) over time gives the catheter angular displacement φ(t) and the catheter displacement zDBMC(t) as functions of time, respectively, shown averaged over each frame in the lower panes of Figs. 4(iii) and 4(v).

 figure: Fig. 4

Fig. 4 Image correction of 1mm checkerboard pattern with manual axial and rotational actuation. i) Aligned and shear-corrected images of channels A and B. ii) Control points (n = 303) used for A/B image registration. Green points (n = 295) were used for distortion correction, while red points (n = 8) were omitted. iii) Catheter rotation characterization. iv) Axial actuation characterization. v) Rotation distortion-corrected images. vi) Rotation and axial distortion-corrected images.

Download Full Size | PDF

Performing the θ calibration step using Eqs. (2) and (3), and the fitted parameters in Table 1 gives the A(θ,frA) and B(θ,frB) images (not shown). To remove the image distortion caused by rotation of the DBMC, θ(t) needs to be remapped to θ’(t) = θ(t)- φ(t) to give the A(θ’,frA’) and B(θ’,frB’) images shown in Fig. 4(iv). Mapping of the z axis using Eqs. (10) and (11) produces images A(θ’,z) and B(θ’,z) shown in Fig. 4(vi).

3. Results

In vivo DMDI imaging was evaluated by fingerprint imaging. A 4.75/5.00 mm ID/OD plastic tube was grasped by three fingers while manually pushing the DBMC through it. The distortion correction procedure described in the proceeding section was performed on the manually-actuated finger imaging with the corresponding images shown in Fig. 5. Apart from the FPC, the dark horizontal bands in Fig. 5(i) correspond to the three spaces between the three fingers being scanned. Sweat ducts as indicated in Fig. 5(ii) were used as the registration control points. The full distortion-corrected images are shown in Fig. 5(iv).

 figure: Fig. 5

Fig. 5 Distortion correction for manually-actuated DBMC imaging across fingers. i) Aligned and shear-corrected images of channels A and B. ii) control points (n = 312) used for image registration. Green points (n = 308) were used for catheter angular and axial speed characterization, while red points (n = 4) were omitted. iii) Catheter angular rotation and axial displacement characterization. iv) Distortion-corrected images.

Download Full Size | PDF

4. Discussion

As can be seen in the imaging of the checkerboard pattern in Fig. 4, the 2D distortion correction procedure outlined in this work restores the original pattern quite well over a range of axial and rotational velocities. In the corrected images, the vertical lines of the pattern are straight and roughly 1 mm spaced, as designed. The horizontal lines are straight, though they have a downward tendency dropping approximately 17° over 20 mm length. This may be reflective of a small angle calibration error. For the finger imaging (Fig. 5), it is qualitatively easy to see that axial distortions are improved in the corrected images relative to the original image.

In DMDI, the maximum measurable axial velocity υz,max, is the maximum distance separation of the two (or multiple) imaging beams Smax, multiplied by the frame rate of the fast axis ffr:

υz,max= Smaxffr

For the DBMC used in this work Smax = 0.48 mm and ffr = 100 Hz giving a maximum theoretical axial speed limit of 48 mm/s. Realistically, however, the maximum measurement speed is reduced by the uncertainty in selecting the registration control points, and by the fact that there may be no control points located near Smax. It is possible to increase υz,max by increasing Smax but this also increases the ‘dead’ (uncorrectable) zones at the beginning and ends of the scans where only one beam has scanned. Increasing ffr can also increase υz,max as the micromotor used in this DBMC can spin much faster (>500 Hz) with a concomitant reduction in resolution along the fast axis.

For DBMCs, catheter rotation is in the same direction as the fast axis. As actuation of the DBMC is primarily along the axial axis, the maximum angular velocity that can be measured is far beyond what can be realized practically. The lower limit of angular velocity that can be measured is determined by the accuracy of the θ(N) calibration, the accuracy of shear correction, and the accuracy of selecting the registration control points.

While distortion correction using DMDI described here has only been applied to 2D en face OCT images, representative 3D OCT volumes could be generated by applying the same distortion correction to the corresponding dimensions of the original 3D OCT volumes. However, these volumes would not necessarily be correct physical representations because the two imaging beams do not exit the catheter at the same angles. An improved distortion-correction algorithm that uses the full 3D OCT information should be possible that generates the physically-correct 3D OCT volume.

The biggest limitation in the implementation of DMDI described here is the laborious procedure of manually picking the numerous co-registered control points. Our group is currently working to automate this step to improve usability. Another potential problem arises if the images do not have enough sufficient unique features for co-registration, or conversely, if too many similar features frustrate unequivocal co-registration. These problems may be alleviated in OCT by using the depth dimension to increase or decrease the number of identifiable image features accordingly.

For DMDI with a DBMC, the need for only one mechanical scanner greatly simplifies the complexity of the catheter and driving mechanism, and perhaps expands capabilities for biomedical imaging applications. While correcting for distortions due to manual actuation, DMDI simultaneously corrects for axial and azimuthal motion artifacts due to voluntary or non-voluntary (cardiac, respiratory) patient motion as well as clinician motion. These motion artifacts are not easily corrected with single-channel rotary-pullback imaging catheters. Additionally, as the axial imaging length is not limited, a rotationally-scanning DBMC may be useful for distortion-corrected imaging in long cylindrically symmetric organs.

Using a DBMC, detailed OCT imaging of the entire colon, as was previously demonstrated with multiple image acquisitions [16], could potentially be acquired in a single data acquisition. A DBMC could also be implemented in a capsule-type device for esophageal OCT imaging, similar to those previously demonstrated [17, 18], but with reduced imaging distortions along the axial pullback axis. DBMCs based on smaller, commercially-available micromotors down to 0.9 mm OD could allow imaging of coronary arteries or other confined body sites. The current sized or a larger diameter DBMC could allow large field-of-view imaging of larger planar surfaces such as the oral cavity or skin, compared to previous demonstrations with rotary-pullback catheters [19]. Testing of DBMC imaging in these and other organ sites will be necessary to assess whether there are appropriate numbers of registration points to allow accurate DMDI distortion correction.

Endoscopic rotational 2D scanners are usually operated in a pullback fashion by first advancing the catheter past the region of interest (ROI) and then having controlled actuation back over the ROI. This is because the catheters must be advanced by hand slowly, and often with many pauses, to avoid tissue damage. Due to their speed-correcting ability, DBMCs can provide distortion-corrected imaging both in the push-forward and pullback directions. Imaging in the push-forward direction may allow better guidance of catheters, while also reducing the chances that valuable imaging sites are missed.

In this demonstration of DMDI, both imaging channels employed OCT imaging, resulting in redundant distortion-corrected images. However, the imaging modalities need not necessarily be identical, they are only required to have common identifiable features. For example, one channel could be single-mode fiber (SMF) to acquire OCT, and the other could be dual-clad fiber (DCF) to acquire OCT-autofluorescence imaging (OCT-AFI) [20]. It is known that the OCT channel in OCT-AFI provides inferior imaging compared to OCT imaging with SMF due to cross-coupling of the IR light between the inner cladding and core in DCF. However, the DCF OCT image quality should be sufficient to provide the image registration required to correct distortions in the SMF-acquired OCT image. In this way, both high quality OCT and AFI images could be obtained with a dual-modality DMDI device.

Although OCT was used in this demonstration of DMDI, any point imaging modality such as fluorescence or reflectance imaging could be used as well. Thus, this method is more widely applicable over methods that rely on speckle correlation/decorrelation.

5. Conclusion

To the best of our knowledge, this is the first demonstration using two beams and a fast one-dimensional scanner to produce two-dimensional manually-actuated, distortion-corrected images. We demonstrated the utility of this technique by constructing and calibrating a dual-beam catheter that scans with a micromotor. We think that this technique will find many applications in biomedical optical imaging.

Funding

Canadian Institutes of Health Research (CIHR) and the National Science and Engineering Research Council of Canada (NSERC); BC Cancer Foundation Research Studentship Award.

References and links

1. D. C. Adams, Y. Wang, L. P. Hariri, and M. J. Suter, “Advances in endoscopic optical coherence tomography catheter designs,” IEEE J. Sel. Top. Quantum Electron. 22(3), 210–221 (2016). [CrossRef]  

2. J. G. F. Chao Zhou, T. H. Tsai, and H. Mashimo, “Endoscopic optical coherence tomography,” in Optical Coherence Tomography: Technology and Applications, 2nd ed., W. D. a. J. G. Fujimoto, ed. (2015), pp. 2077–2108.

3. T. Adriaenssens and G. J. Ughi, “Recent advances in the field of optical coherence tomography,” Curr. Cardiovasc. Imaging Rep. 10(7), 23 (2017). [CrossRef]  

4. T.-H. Tsai, J. G. Fujimoto, and H. Mashimo, “Endoscopic optical coherence tomography for clinical gastroenterology,” Diagnostics (Basel) 4(2), 57–93 (2014). [CrossRef]   [PubMed]  

5. M. J. Gora, M. J. Suter, G. J. Tearney, and X. Li, “Endoscopic optical coherence tomography: technologies and clinical applications [Invited],” Biomed. Opt. Express 8(5), 2405–2444 (2017). [CrossRef]   [PubMed]  

6. A. Ahmad, S. G. Adie, E. J. Chaney, U. Sharma, and S. A. Boppart, “Cross-correlation-based image acquisition technique for manually-scanned optical coherence tomography,” Opt. Express 17(10), 8125–8136 (2009). [CrossRef]   [PubMed]  

7. X. Liu, Y. Huang, and J. U. Kang, “Distortion-free freehand-scanning OCT implemented with real-time scanning speed variance correction,” Opt. Express 20(15), 16567–16583 (2012). [CrossRef]  

8. Y. Wang, Y. Wang, A. Akansu, K. D. Belfield, B. Hubbi, and X. Liu, “Robust motion tracking based on adaptive speckle decorrelation analysis of OCT signal,” Biomed. Opt. Express 6(11), 4302–4316 (2015). [CrossRef]   [PubMed]  

9. Y. Huang, X. Liu, C. Song, and J. U. Kang, “Motion-compensated hand-held common-path Fourier-domain optical coherence tomography probe for image-guided intervention,” Biomed. Opt. Express 3(12), 3105–3118 (2012). [CrossRef]   [PubMed]  

10. N. Uribe-Patarroyo and B. E. Bouma, “Rotational distortion correction in endoscopic optical coherence tomography based on speckle decorrelation,” Opt. Lett. 40(23), 5518–5521 (2015). [CrossRef]   [PubMed]  

11. B. Y. Yeo, R. A. McLaughlin, R. W. Kirk, and D. D. Sampson, “Enabling freehand lateral scanning of optical coherence tomography needle probes with a magnetic tracking system,” Biomed. Opt. Express 3(7), 1565–1578 (2012). [CrossRef]   [PubMed]  

12. N. Iftimia, G. Maguluri, E. W. Chang, S. Chang, J. Magill, and W. Brugge, “Hand scanning optical coherence tomography imaging using encoder feedback,” Opt. Lett. 39(24), 6807–6810 (2014). [CrossRef]   [PubMed]  

13. P. Pande, G. L. Monroy, R. M. Nolan, R. L. Shelton, and S. A. Boppart, “Sensor-based technique for manually scanned hand-held optical coherence tomography imaging,” J. Sens. 2016, 1–7 (2016). [CrossRef]  

14. B. Lau, R. A. McLaughlin, A. Curatolo, R. W. Kirk, D. K. Gerstmann, and D. D. Sampson, “Imaging true 3D endoscopic anatomy by incorporating magnetic tracking with optical coherence tomography: proof-of-principle for airways,” Opt. Express 18(26), 27173–27180 (2010). [CrossRef]   [PubMed]  

15. J. C. Jing, L. Chou, E. Su, B. J. F. Wong, and Z. Chen, “Anatomically correct visualization of the human upper airway using a high-speed long range optical coherence tomography system with an integrated positioning sensor,” Sci. Rep. 6(1), 39443 (2016). [CrossRef]   [PubMed]  

16. D. C. Adler, C. Zhou, T.-H. Tsai, J. Schmitt, Q. Huang, H. Mashimo, and J. G. Fujimoto, “Three-dimensional endomicroscopy of the human colon using optical coherence tomography,” Opt. Express 17(2), 784–796 (2009). [CrossRef]   [PubMed]  

17. M. J. Gora, J. S. Sauk, R. W. Carruth, K. A. Gallagher, M. J. Suter, N. S. Nishioka, L. E. Kava, M. Rosenberg, B. E. Bouma, and G. J. Tearney, “Tethered capsule endomicroscopy enables less invasive imaging of gastrointestinal tract microstructure,” Nat. Med. 19(2), 238–240 (2013). [CrossRef]   [PubMed]  

18. K. Liang, G. Traverso, H.-C. Lee, O. O. Ahsen, Z. Wang, B. Potsaid, M. Giacomelli, V. Jayaraman, R. Barman, A. Cable, H. Mashimo, R. Langer, and J. G. Fujimoto, “Ultrahigh speed en face OCT capsule for endoscopic imaging,” Biomed. Opt. Express 6(4), 1146–1163 (2015). [CrossRef]   [PubMed]  

19. A. M. D. Lee, L. Cahill, K. Liu, C. MacAulay, C. Poh, and P. Lane, “Wide-field in vivo oral OCT imaging,” Biomed. Opt. Express 6(7), 2664–2674 (2015). [CrossRef]   [PubMed]  

20. H. Pahlevaninezhad, A. M. D. Lee, T. Shaipanich, R. Raizada, L. Cahill, G. Hohert, V. X. D. Yang, S. Lam, C. MacAulay, and P. Lane, “A high-efficiency fiber-based imaging system for co-registered autofluorescence and optical coherence tomography,” Biomed. Opt. Express 5(9), 2978–2987 (2014). [CrossRef]   [PubMed]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (5)

Fig. 1
Fig. 1 Dual-channel OCT imaging system and dual beam micromotor catheter (DBMC). i) Schematic diagram of dual-channel OCT imaging system. SS = swept-source laser, PC = polarization controller, C = collimator, RM = reference mirror, CIRC = circulator, BD = balanced detector. ii) Model of DBMC (outermost plastic tubing not shown). DFP = dual fiber pigtail; GRIN = graded-index lens; MM = 4 mm OD micromotor, FPC = flexible printed circuit. Approximate paths of A and B beams at catheter outer diameter are shown in red and blue respectively. iii) Side view of DBMC showing approximate beam paths for A and B beams. iv) Photograph of the DBMC. The rigid length of the DBMC is indicated. Scale bar is 1 cm.
Fig. 2
Fig. 2 Outline of primary DMDI processing steps for (left) calibration and (right) distortion correcting images acquired with DBMCs.
Fig. 3
Fig. 3 Calibration of DBMC using the paper calibration pattern. i) Raw en face OCT images from A and B channels. The range of the n axis is from 1 to 1000 A-lines, with each image column corresponding to one rotation of the prism. ii) Data and fit of positions of horizontal lines in i). iii) Aligned, shear-corrected, and θ calibrated images. The range of the θ axis is from 0° to 360°. iv) Scan pattern data and fit. v) Distortion corrected images. vi) Fixed pattern data and fit.
Fig. 4
Fig. 4 Image correction of 1mm checkerboard pattern with manual axial and rotational actuation. i) Aligned and shear-corrected images of channels A and B. ii) Control points (n = 303) used for A/B image registration. Green points (n = 295) were used for distortion correction, while red points (n = 8) were omitted. iii) Catheter rotation characterization. iv) Axial actuation characterization. v) Rotation distortion-corrected images. vi) Rotation and axial distortion-corrected images.
Fig. 5
Fig. 5 Distortion correction for manually-actuated DBMC imaging across fingers. i) Aligned and shear-corrected images of channels A and B. ii) control points (n = 312) used for image registration. Green points (n = 308) were used for catheter angular and axial speed characterization, while red points (n = 4) were omitted. iii) Catheter angular rotation and axial displacement characterization. iv) Distortion-corrected images.

Tables (2)

Tables Icon

Table 1 Fit parameters for θ calibration

Tables Icon

Table 2 Fit parameters for S(θ) and F(θ) calibrations

Equations (14)

Equations on this page are rendered with MathJax. Learn more.

θ= θ 0 +j(Δθ)
θ (A,B) ( n (A,B) )=g n (A,B) +g k c (A,B),k cos( 2πk N fr ( n (A,B) n (A,B),k,off ) )g C (A,B),0
C ( A,B ),0 = g k c ( A,B ),k cos( 2πk N fr ( n ( A,B ),k, off ) )
S fr ( θ )= 1 2 [ b A ( θ ) b B ( θ ) ]
F fr ( θ )=  1 2 [ b A ( θ )+ b B ( θ ) ]
S( θ )= [ S fr ( θ ) N fr + n A ( θ )+  N ref,A n B ( θ ) N ref,B ] v z f laser
F( θ )= [ F fr ( θ ) N fr + n A ( θ )+  N ref,A n B ( θ ) N ref,B ] v z f laser
S( θ )=  s 0 + k s k sin( 2πk N fr ( θ θ s,k,off ) )
F( θ )=  f 0 + k f k sin( 2πk N fr ( θ θ f,k,off ) )
z A ( θ,t )= z DBMC ( t ) S( θ )F( θ )
z B ( θ,t )= z DBMC ( t ) +S( θ )F( θ )
υ ¯ z,AB,j = S( θ A,j )+ S( θ B,j ) | t A,j t B,j |
ω ¯ AB,j = θ second,j   θ first,j | t A,j t B,j |
υ z,max =  S max f fr
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.