Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Continuous scanning mode for ptychography

Open Access Open Access

Abstract

We outline how ptychographic imaging can be performed without the need for discrete scan positions. Through an idealized experiment, we demonstrate how a discrete-position scan regime can be replaced with a continuously scanned one with suitable modification of the reconstruction scheme based on coherent modes. The impact of this is that acquisition times can be reduced, significantly aiding ptychographic imaging with x rays, electrons, or visible light.

© 2014 Optical Society of America

Ptychography [1] is a microscopy technique that permits high-resolution imaging with x rays [2,3], electrons [4,5], and visible light [6] in two and three dimensions [7] on biological [8] and materials science samples [9]. Ptychography works by collecting a series of J diffraction measurements from a sample, O, that is rastered through an illumination or probe, P, at discrete points j, with adjacent positions sharing some overlap. Due to large redundancy in the datasets, both the probe [3,10] and object can be reconstructed simultaneously using phase retrieval. Recent algorithmic advances have extended the technique to reconstruct multiple probe and object modes [11]; for example, when the illumination is partially coherent, the sample is dynamic [12] or there is significant detector point spread [13]. Additionally, the algorithms can be modified to account for multiple scattering from thick specimens [14] or when the data are under sampled on the detector [15].

The experimental setup of ptychography shares a number of similarities with scanning probe techniques, such as scanning transmission x-ray microscopy (STXM) and scanning electron microscopy (SEM), in that a probe is scanned across the sample with the transmitted (or diffracted) wave-field intensity recorded. However, for rapid data acquisition, the techniques such as STXM or SEM can acquire data while the sample (or probe) is scanned continuously across the sample without collecting data at discrete positions. This has the benefit that collection times can be reduced since no time is wasted waiting for motors to move and settle. Current state-of-the art setups still require motor settling times (0.15 s) that are similar to the exposure time (0.2 s) [16] for each position. Due to the large number of diffraction patterns collected for ptychography (typically thousands), a reduction in acquisition time would be highly desirable. In this Letter we demonstrate that a continuous scan regime (or “fly scan”) is equivalent to a degradation in spatial coherence. We approximate the continuous scanning by summing diffraction from adjacent positions and show that the deleterious effects of this can be ameliorated through postprocessing. The reduction in collection time using this scheme should enable studies of dynamics and in situ processes as well as reducing stability requirements on experimental components.

For a quasi-monochromatic, spatially coherent probe, the intensity at a position j will take a form of

Ij(q)=|Pz[P(r)O(r+rj)]|2,
where r is a real-space position coordinate, rj is the translation of the object [Fig. 1(a)], q is a reciprocal space position coordinate, and Pz is the Fresnel free-space propagator for a distance z [17]. If we consider the case of a continuously scanned sample with a detector that has finite detection time T, then the recorded intensity will now contain additional contributions coming from the positions around the previously discrete scan positions. The intensity can now be written as
Ij(q)=t1t2|Pz[P(r)O(r+rj+vt)]|2dt,
where t is time, v is a scan velocity (identical, but not necessarily constant for all j positions), and T=t2t1 is the (constant) integration time [Fig. 1(b)]. We now select a sufficiently small time step Δt, so that we can discretize Eq. (2) and sum over N discrete time steps to get
Ij(q)=n=0N1Δt|Pz[P(r)O(r+rj+vnΔt)]|2.
Since only relative translations are relevant, the translation rn=vnΔt can be absorbed into the probe modes, giving
Ij(q)=n=0N1Δt|Pz[P(rrn)O(r+rj)]|2,
which states that the intensity is now an incoherent sum of intensities from translated probes (probe modes). The significance of this is that a dataset taken without discrete position data (continuous scanning) can be recast as a periodic sample vibration problem Eq. (3) with sample translations of rn, as illustrated in Fig. 1. The case of a vibrating sample has been shown to be equivalent to a degradation in spatial coherence [18] and reconstructible [12] (for both discrete and continuous motion) using recent algorithmic advances [11] by absorbing the sample motion into the probe modes Eq. (4). For constant velocity, the integration time of the detector will dictate the apparent degree of partial coherence. This observation leads us to a simple heuristic for the scaling between the apparent coherence length, σl, and scanning, via σl(|v|T)1. It should be noted that the N illumination modes appearing in Eq. (4) can be written as an orthogonal set of N modes (with NN) that are themselves fully coherent but mutually incoherent [19]. The implications of this, along with the assertion that the integration time of the detector determines the apparent coherence length, means that the number of relevant modes N does not scale with our arbitrarily assigned number N, but instead scales with σl. This can be seen in Fig. 1(d), which shows the mode power for the first five orthogonal modes (n, obtained using singular value decomposition) calculated using different numbers of simulated horizontally translated probes (N) (but with the same maximum translation, i.e., coherence length). The mode power is relatively insensitive to the number of translated probes, but instead depends primarily on the maximum translation. The probe function used here was a Gaussian with maximum translation of one probe width (full width at half-maximum).

 figure: Fig. 1.

Fig. 1. (a) Conventional ptychography uses data collected with discrete translations rj. (b) For a continuously scanned sample with constant velocity v, the diffraction data will be made up of the positions that occupy a length |v|T around the scan positions rj due to an integration time of T. (c) The continuous scan can be discretized with steps separated by a small distance vΔt. (d) Mode power for the first five orthogonal modes (n) calculated using different numbers (N) of simulated translated probes, but with the same maximum translation (σl). The number of relevant modes is relatively insensitive to the number of translated positions but depends on the apparent coherence length.

Download Full Size | PDF

To test the ability of operating ptychography in a continuous scan regime, experiments were carried out at beamline 34 ID-C at the Advanced Photon Source in Chicago. A Kirk-Patrick Baez (KB) mirror system [20] was used to focus 9 keV x rays onto a sample that was placed at the approximate focus, 100 mm (200 mm) from the vertical (horizontal) mirror. Horizontal and vertical slits prior to the KB mirrors were used to adjust the spatial coherence entering the optics and resulted in a probe of 700 nm (horizontally) by 1000 nm (vertically) at the sample position. The sample was a lithographed 1.5 μm thick tungsten test pattern. Scanning of the sample stage perpendicular to the x-ray direction was achieved by a nPoint piezo scanner NPXY100Z25. Diffraction was recorded 2 m downstream using a TimePix Si pixel detector [21], consisting of 256×256 pixels of side length 55 μm, which allows detection of individual photons. At each position, five exposures of 0.5 s duration were collected. To improve the dynamic range of the data, a partially attenuating beamstop [22] was placed over the central region of the diffraction pattern. The beamstop consisted of a 200 μm thick silicon square that covered 30×30 pixels. The central region of the beamstop was scaled by the calculated absorption using tabulated values [23]. To reduce absorption from air between the sample and detector, a 1 m evacuated flight tube was installed (with Kapton windows).

A grid scan of 81 points horizontally (with 100 nm step size) and 11 points vertically (with 200 nm step size) was performed on a region of the sample that contained numerals and bars. Both the probe and object were reconstructed simultaneously using a multiresolution approach where initial low-resolution reconstructions were obtained (using cropped data), which were then used to seed the next higher-resolution reconstruction [12,24]. Three levels of resolution were used (64×64, 96×96, and 128×128 pixels), each lasting 500 iterations where propagation was achieved using a fast Fourier transform. The object was initialized with an array of random numbers and the probe from the KB mirror system was modeled as a rectangular lens. Position correction [10] was used for the highest resolution only, implemented using a local search (restricted to the nine closest pixels) and selecting the position that minimized the difference between the measured and calculated diffraction.

Figure 2(a) shows a reconstruction using all grid positions and a single sample and probe mode that amounts to a regular ptychography experiment (assuming full coherence), with intensity model given by Eq. (1). The sample features are well reproduced, with bars clearly visible along with some numerals at a resolution of 40 nm as determined from the phase-retrieval transfer function [25]. To test the equivalence of a continuously scanned sample and partial coherence, a new dataset was created by summing intensity measurements (in the horizontal direction only) from adjacent positions into bins to form a new set of diffraction measurements [Fig. 1(c)]. Two new datasets were created by summing diffraction from 4 and 7 adjacent horizontal positions [resulting in an intensity model of Eq. (3)]. The new datasets created from the 4 and 7 position summing now contained 20 and 11 points in the horizontal direction with step sizes of 400 and 700 nm, respectively. The last columns of the scan in the horizontal direction were omitted appropriately to obtain an integer number of points in the new scan. The increasing number of positions is equivalent to an increasing integration time or scan speed.

 figure: Fig. 2.

Fig. 2. (a) Reconstructed object phase assuming full coherence (1 mode, left) and partial coherence (five modes, right) for the original data. (b) Reconstruction using new positions that consist of summing four adjacent positions (over 400 nm horizontally), approximating a continuously scanned sample. The reconstruction assuming full coherence (left) is degraded compared to (a) but shows improvement when assuming partial coherence (right). This is also shown for a larger ((d), seven positions, 700 nm) level of summing, which would be equivalent to an increased scanning speed. With the increasing number of positions the reconstructions degrade (left) when the apparent reduction in spatial coherence is not taken into account. The scale bar is 1 μm.

Download Full Size | PDF

Figures 2(b) and 2(c) show reconstructions from the new datasets using a single illumination mode for the summing of four and seven positions, respectively. There is a clear degradation in the image quality [compared to Fig. 2(a)], with some distortion of the bars and numbers and an increased nonuniformity in the feature-free regions. This failure is attributed to the fact that using a single illumination mode does not adequately describe the forward process given by Eq. (3). With increased summing we see a degradation in the pertinent features of the image with the numbers becoming very hard to identify. The increased degradation with the size of the summation can be understood through the equivalence of the summing with partial spatial coherence, i.e., the larger the distance the summing occurs over, the smaller the (apparent) coherence length. To ameliorate the deleterious effects introduced by the summing, a second reconstruction was performed on the original and summed datasets using five illumination modes (initiated using random perturbations of the ideal probe [12]). The reconstructions for the datasets are shown in Figs. 2(a) and 2(d) (right-hand column, five modes) and the probes in Fig. 3. The reconstruction now reproduces the relevant features well, with the bars and numerals easily recognizable and represent a significant improvement over the single-mode reconstructions, supporting the thesis that continuous scanning can be modeled as partial spatial coherence. The original reconstruction [Fig. 2(a)] has seen some improvement, indicating that the illuminating wave field was not quite fully coherent. Figure 3 shows the relative orthogonal probe mode power from the reconstructions. It can be seen that the increased summing has resulted in a commensurate decrease in the primary mode power and increase in higher-order mode (n2) powers, a clear indication of partial coherence [1113,19,26]. An outstanding question is how many modes are required and how should this number be determined? Although a clear answer remains elusive and beyond the scope of this work, one strategy that could be employed would be to gradually incorporate more modes into the iterative procedure until the power in the highest (orthogonal) mode falls below some threshold value, for example, 1%.

 figure: Fig. 3.

Fig. 3. Increase in position summing (17) results in a decrease in the power contained in the primary mode (n=1), while the higher-order modes (n2) show a commensurate increase in relative power. The three modes with the most power are shown for the original dataset and the ×7 summing. The scale bar is 1 μm.

Download Full Size | PDF

Finally, we note that there are still some small-scale artifacts present in the reconstructions approximating the continuous scans. Possible explanations could be that there has been an apparent increase in step size, reducing the average overlap [12] from 0.92 for the original dataset 0.56 for the seven summed position dataset. However, a more likely explanation comes from noting that there is a requirement that the velocity be identical (but not necessarily constant) around each scan position Eq. (2). In reality, any positional errors that are present before summing and creating the new datasets will cause the effective velocity to be different for every scan position, violating the previously stated requirement. By comparing the original positions with those after iterative refinement for the original data without summation, we found that the average error for the horizontal positions was 3% and for the vertical, 12%. The actual positions (particularly the vertical) have enough error that when summing the data over adjacent positions the relative translations for each summed region are no longer identical, meaning Eq. (4) is not entirely true, even if position refinement is performed on the summed data.

We have demonstrated the equivalence of a continuous scanning regime in ptychography with partial spatial coherence. This scanning regime eliminates the need for discrete positions, avoiding time overheads associated with moving the object or probe. We anticipate this scheme will be adopted for rapid data collection across different ptychographic imaging modalities using x rays, electrons, and visible light, enabling a plethora of new and exciting science.

This work was supported by an FP7 advanced grant from the European Research Council under grant no. EP/I022562/1. X. H. is supported by the Department of Energy, Office of Basic Energy Sciences under Contract No. DE-AC-02- 98CH10886. The experimental work was carried out at the Advanced Photon Source Beamline 34-ID-C built with funds from the U.S. National Science Foundation under Grant No. DMR- 9724294 and operated by the U.S. Department of Energy, Office of Science, Office of Basic Energy Sciences under Contract No. DE-AC02-06CH11357. The authors gratefully acknowledge Graeme Morrison for design of the test pattern.

References

1. R. Hegerl and W. Hoppe, Berichte Der Bunsen-Gesellschaft Fur Physikalische Chemie 74, 1148 (1970).

2. J. M. Rodenburg, A. C. Hurst, A. G. Cullis, B. R. Dobson, F. Pfeiffer, O. Bunk, C. David, K. Jefimovs, and I. Johnson, Phys. Rev. Lett. 98, 034801 (2007). [CrossRef]  

3. P. Thibault, M. Dierolf, A. Menzel, O. Bunk, C. David, and F. Pfeiffer, Science 321, 379 (2008). [CrossRef]  

4. C. T. Putkunz, A. J. D’Alfonso, A. J. Morgan, M. Weyland, C. Dwyer, L. Bourgeois, J. Etheridge, A. Roberts, R. E. Scholten, K. A. Nugent, and L. J. Allen, Phys. Rev. Lett. 108, 073901 (2012). [CrossRef]  

5. M. J. Humphry, B. Kraus, A. C. Hurst, A. M. Maiden, and J. M. Rodenburg, Nat. Commun. 3, 730 (2012). [CrossRef]  

6. J. M. Rodenburg, A. C. Hurst, and A. G. Cullis, Ultramicroscopy 107, 227 (2007). [CrossRef]  

7. M. Dierolf, A. Menzel, P. Thibault, P. Schneider, C. M. Kewish, R. Wepf, O. Bunk, and F. Pfeiffer, Nature 467, 436 (2010). [CrossRef]  

8. K. Giewekemeyer, P. Thibault, S. Kalbfleisch, A. Beerlink, C. M. Kewish, M. Dierolf, F. Pfeiffer, and T. Salditt, Proc. Natl. Acad. Sci. USA 107, 529 (2010). [CrossRef]  

9. S. O. Hruszkewycz, M. V. Holt, C. E. Murray, J. Bruley, J. Holt, A. Tripathi, O. G. Shpyrko, I. McNulty, M. J. Highland, and P. H. Fuoss, Nano Lett. 12, 5148 (2012). [CrossRef]  

10. M. Guizar-Sicairos and J. R. Fienup, Opt. Express 16, 7264 (2008). [CrossRef]  

11. P. Thibault and A. Menzel, Nature 494, 68 (2013). [CrossRef]  

12. J. N. Clark, X. Huang, R. J. Harder, and I. K. Robinson, Phys. Rev. Lett. 112, 113901 (2014). [CrossRef]  

13. B. Enders, M. Dierolf, P. Cloetens, M. Stockmar, F. Pfeiffer, and P. Thibault, Appl. Phys. Lett. 104, 171104 (2014). [CrossRef]  

14. A. M. Maiden, M. J. Humphry, and J. M. Rodenburg, J. Opt. Soc. Am. A 29, 1606 (2012). [CrossRef]  

15. T. B. Edo, D. J. Batey, A. M. Maiden, C. Rau, U. Wagner, Z. D. Pešić, T. A. Waigh, and J. M. Rodenburg, Phys. Rev. A 87, 053850 (2013). [CrossRef]  

16. M. Guizar-Sicairos, I. Johnson, A. Diaz, M. Holler, P. Karvinen, H.-C. Stadler, R. Dinapoli, O. Bunk, and A. Menzel, Opt. Express 22, 14859 (2014). [CrossRef]  

17. D. M. Paganin, Coherent X-ray Optics (Oxford University, 2006).

18. J. N. Clark, C. T. Putkunz, E. Curwood, R. E. Scholten, I. McNulty, K. A. Nugent, and A. G. Peele, Opt. Lett. 36, 1954 (2011). [CrossRef]  

19. E. Wolf, J. Opt. Soc. Am. 72, 343 (1982). [CrossRef]  

20. P. Kirkpatrick and A. V. Baez, J. Opt. Soc. Am. 38, 766 (1948). [CrossRef]  

21. X. Llopart, R. Ballabriga, M. Campbell, L. Tlustos, and W. Wong, Nucl. Instrum. Methods Phys. Res. A 581, 485 (2007). [CrossRef]  

22. R. N. Wilke, M. Vassholz, and T. Salditt, Acta Crystallogr. Sect. A 69, 490 (2013). [CrossRef]  

23. B. L. Henke, E. M. Gullikson, and J. C. Davis, At. Data Nucl. Data Tables 54, 181 (1993). [CrossRef]  

24. B. McCallum and R. Bates, J. Mod. Opt. 36, 619 (1989). [CrossRef]  

25. H. N. Chapman, A. Barty, S. Marchesini, A. Noy, S. P. Hau-Riege, C. Cui, M. R. Howells, R. Rosen, H. He, J. C. H. Spence, U. Weierstall, T. Beetz, C. Jacobsen, and D. Shapiro, J. Opt. Soc. Am. A 23, 1179 (2006). [CrossRef]  

26. S. Flewett, H. M. Quiney, C. Q. Tran, and K. A. Nugent, Opt. Lett. 34, 2198 (2009). [CrossRef]  

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (3)

Fig. 1.
Fig. 1. (a) Conventional ptychography uses data collected with discrete translations r j . (b) For a continuously scanned sample with constant velocity v , the diffraction data will be made up of the positions that occupy a length | v | T around the scan positions r j due to an integration time of T . (c) The continuous scan can be discretized with steps separated by a small distance v Δ t . (d) Mode power for the first five orthogonal modes ( n ) calculated using different numbers ( N ) of simulated translated probes, but with the same maximum translation ( σ l ). The number of relevant modes is relatively insensitive to the number of translated positions but depends on the apparent coherence length.
Fig. 2.
Fig. 2. (a) Reconstructed object phase assuming full coherence (1 mode, left) and partial coherence (five modes, right) for the original data. (b) Reconstruction using new positions that consist of summing four adjacent positions (over 400 nm horizontally), approximating a continuously scanned sample. The reconstruction assuming full coherence (left) is degraded compared to (a) but shows improvement when assuming partial coherence (right). This is also shown for a larger ((d), seven positions, 700 nm) level of summing, which would be equivalent to an increased scanning speed. With the increasing number of positions the reconstructions degrade (left) when the apparent reduction in spatial coherence is not taken into account. The scale bar is 1 μm.
Fig. 3.
Fig. 3. Increase in position summing ( 1 7 ) results in a decrease in the power contained in the primary mode ( n = 1 ), while the higher-order modes ( n 2 ) show a commensurate increase in relative power. The three modes with the most power are shown for the original dataset and the × 7 summing. The scale bar is 1 μm.

Equations (4)

Equations on this page are rendered with MathJax. Learn more.

I j ( q ) = | P z [ P ( r ) O ( r + r j ) ] | 2 ,
I j ( q ) = t 1 t 2 | P z [ P ( r ) O ( r + r j + v t ) ] | 2 d t ,
I j ( q ) = n = 0 N 1 Δ t | P z [ P ( r ) O ( r + r j + v n Δ t ) ] | 2 .
I j ( q ) = n = 0 N 1 Δ t | P z [ P ( r r n ) O ( r + r j ) ] | 2 ,
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.