Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
TRANSMISSION ELECTRON MICROSCOPE SAMPLE ALIGNMENT SYSTEM AND METHOD
Document Type and Number:
WIPO Patent Application WO/2018/197959
Kind Code:
A1
Abstract:
A system and method involve applying an electron beam to a sample and obtaining an image of the sample with the applied electron beam. An orientation of the sample relative to the sample's zone axis is automatically determined based on a distribution of reflections in the image. The orientation of the sample is automatically adjusted to align with the sample's zone axis based on the determined orientation.

Inventors:
ZHANG DALIANG (SA)
HAN YU (SA)
LI KUN (SA)
ZHU YIHAN (SA)
Application Number:
PCT/IB2018/050910
Publication Date:
November 01, 2018
Filing Date:
February 14, 2018
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
UNIV KING ABDULLAH SCI & TECH (SA)
International Classes:
H01J37/28; H01J37/147; H01J37/20; H01J37/22; H01J37/26; H01J37/304
Foreign References:
US20110174972A12011-07-21
US20170309441A12017-10-26
Other References:
DUDEN T ET AL: "KSpaceNavigator as a tool for computer-assisted sample tilting in high-resolution imaging, tomography and defect analysis", ULTRAMICROSCOPY, ELSEVIER, AMSTERDAM, NL, vol. 111, no. 11, 14 August 2011 (2011-08-14), pages 1574 - 1580, XP028124669, ISSN: 0304-3991, [retrieved on 20110824], DOI: 10.1016/J.ULTRAMIC.2011.08.003
J. JANSEN ET AL: "Towards automatic alignment of a crystalline sample in an electron microscope along a zone axis", ULTRAMICROSCOPY, vol. 125, 5 November 2012 (2012-11-05), NL, pages 59 - 65, XP055473754, ISSN: 0304-3991, DOI: 10.1016/j.ultramic.2012.09.010
DALIANG ZHANG ET AL: "Atomic-resolution transmission electron microscopy of electron beam-sensitive crystalline materials", SCIENCE, vol. 359, no. 6376, 18 January 2018 (2018-01-18), US, pages 675 - 679, XP055473443, ISSN: 0036-8075, DOI: 10.1126/science.aao0865
Download PDF:
Claims:
WHAT IS CLAIMED IS:

1 . A method, comprising:

applying (205, 310) an electron beam to a sample (106);

obtaining (210, 315) an image of the sample (106) with the applied electron beam (104);

automatically determining (215, 320-330) an orientation of the sample (106) relative to the sample's zone axis based on a distribution of reflections in the image; and

automatically adjusting (220, 335) the orientation of the sample (106) to align with the sample's zone axis based on the determined orientation.

2. The method of claim 1 , wherein the automatic determination (215, 320-330) of the orientation of the sample (106) further comprises:

determining (320) a Laue circle of the imaged sample based on the distribution of reflections in the image; and

determining (325, 330) tilt angle adjustments (φ«, φβ) based on the determined Laue circle.

3. The method of claim 2, wherein the determination (215, 325, 330) of tilt angle adjustments further comprises:

determining (325) an angle (φ) between a path of the electron beam to the sample (106) (OE-O) and a first line {OL-OE) connecting a center of the Laue circle (OL) and a center of an Ewald sphere (OE).

4. The method of claim 3, further comprising:

decomposing (330) the determined angle (φ) into a first axis component (φα) and a second axis component.

5. The method of claim 4, wherein the decomposition (330) of the determined angle into the first and second axis components comprises:

determining (330A) a first vector (OL-OL ) , which is perpendicular to a oc-tilt axis, from the center of the Laue circle (OL) to a point on the first axis (OL ) (335A); determining (330B) the first axis component (φα) as an angle between the first line (OL-OE) and a second line (OL -OE) connecting the point on the first axis (OL ) to the center of the Ewald Sphere (OE); and

determining (330Ci) the second axis component (φβ) as an angle between the second line (OL -OE) and a third line (OE-0) corresponding to the path of the electron beam to the sample.

6. The method of claim 4, wherein the decomposition (330) of the determined angle into the first and second axis components comprises:

determining (330A) a first vector (OL-OL ) , which is perpendicular to a oc-tilt axis, from the center of the Laue circle (OL) to a point on the first axis (OL ) ;

determining (330B) the first axis component (φα) as an angle between the first line (OL-OE) and a second line (OL -OE) connecting the point on the first axis (OL ) to the center of the Ewald Sphere (OE) ; and

determining (330C2) the second axis component (φβ) as a difference between the determined angle (φ) and the first axis component (φ«).

7. The method of claim 1 , wherein after the orientation is automatically adjusted, the method comprises:

applying (340) the electron beam (1 04) to the sample (1 06); and

obtaining (345) another image of the sample (106) with the applied electron beam.

8. The method of claim 1 , further comprising:

receiving (305) an operator input requesting zone axis alignment of the sample, wherein the method is automatically performed in response to receipt of the operator input.

9. A system, comprising:

an electron gun (102);

a sample holder (108);

an imaging detector (1 12);

a positioning controller (122) coupled to the sample holder (106) and configured to adjust an orientation of a sample (106) in the sample holder (108); and a processor (1 16) communicatively coupled to the electron gun (102), the sample holder (108), the imaging detector (1 12), and the positioning controller (122), wherein the processor executes instructions to control the sample holder (108) based on an automatically calculated Laue circle of the imaged sample.

10. The system of claim 9, wherein the processor executes instructions to control the electron gun (102), the sample holder (108), the imaging detector (1 12), and the positioning controller (122) to

apply (205, 305) an electron beam (104) from the electron gun (102) to the sample (106);

obtain (210, 315) an image of the sample (106) with the applied electron beam from the imaging detector (1 12);

automatically determine (215, 320-330) an orientation of the sample (106) relative to the sample's zone axis based on the image based on the automatically calculated Laue circle; and automatically adjust (220, 335), via the sample holder (108), the orientation of the sample (106) to align with the sample's zone axis based on the determined orientation.

1 1 . The system of claim 9, wherein the processor (1 16) is configured to control an orientation of the sample (106) in the sample holder (108) by:

determining (325, 330) tilt angle adjustments (φ«, φβ) based on the calculated Laue circle using a distribution of reflections in the image of the sample.

12. The system of claim 1 1 , wherein the processor (106) is configured to determine (215, 320-330) the tilt angle adjustments by:

determining (325) an angle (φ) between a path of an electron beam from the electron gun (102) to the sample (OE-O) and a first line {OL-OE) connecting a center of the Laue circle {OL) and a center of an Ewald sphere (OE).

13. The system of claim 12, wherein the processor (106) is configured to:

decompose (330) the determined angle (φ) into a first axis component (φ«) and a second axis component.

14. The system of claim 13, wherein the processor (106) is configured to decompose (330) the determined angle into the first and second axis components by:

determining (330A) a first vector (OL-OL ) , which is perpendicular to a oc-tilt axis, from the center of the Laue circle (OL) to a point on the first axis (OL ) ;

determining (330B) the first axis component (φα) as an angle between the first line (OL-OE) and a second line (OL -OE) connecting the point on the first axis (OL ) to the center of the Ewald Sphere (OE) ; and

determining (330Ci) the second axis component (φβ) as an angle between the second line (OL -OE) and a third line (OE-O) corresponding to the path of the electron beam to the sample.

15. The system of claim 14, wherein the processor (106) is configured to decompose (330) the determined angle into the first and second axis components by:

determining (330A) a first vector (OL-OL ) , which is perpendicular to a oc-tilt axis, from the center of the Laue circle (OL) to a point on the first axis (OL ) ;

determining (330B) the first axis component (φα) as an angle between the first line (OL-OE) and a second line (OL -OE) connecting the point on the first axis (OL ) to the center of the Ewald Sphere (OE) ; and

determining (330C2) the second axis component (φβ) as a difference between the determined angle (φ) and the first axis component (φα).

16. The system of claim 9, further comprising:

an operator input device (1 20) configured to receive an operator input requesting zone axis alignment of the sample (305), wherein the processor (1 06) is configured to automatically apply the electron beam (104) (205, 305), obtain the image of the sample (1 06) (210, 310), determine the orientation of the sample (1 06) ((215, 320-335), and adjust the orientation of the sample (106) (220, 340) in response to receipt of the operator input (305).

17. A method, comprising :

automatically determining (215, 320-330) an orientation of a sample (106) relative to the sample's zone axis based on a distribution of reflections in an image of the sample;

automatically adjusting (220, 335) the orientation of the sample (106) to align with the sample's zone axis based on the determined orientation;

calculating (615A-615C) an amplitude filtered pattern (H) in a Fourier domain based on amplitude components of a plurality of Fourier transformed images (R) of a sequence of images (A(x, y), (f2 (x, y), (/n(*< y)) ;

replacing (620A) an amplitude component of the plurality of Fourier transformed images with the amplitude pattern (H) to form a plurality of filtered Fourier transformed images (Gi);

determining (620C) image shift information based on the plurality of filtered Fourier transformed images (Gi); and applying (625) the image shift information to images in the sequence of images (A(x,y), (f2(x,y), - , {fn(x>y)) to form a plurality of aligned images.

18. The method of claim 17, further comprising:

performing (620B) an inverse Fourier transform on the plurality of filtered Fourier transformed images (Gi) to form a corresponding plurality of reverse transformed, filtered images (gi), wherein the shift information is determined using the plurality of reverse transformed, filtered images (gi).

19. The method of claim 18, wherein the determination of the image shift information comprises:

cross-correlating (620C) the plurality of reverse transformed, filtered images (gi) with a consecutive one of the plurality of reverse transformed, filtered images (gi+i) to generate the image shift information for the plurality of reverse transformed, filtered images (gi).

20. The method of claim 17, further comprising:

summing (230, 330) the plurality of aligned images to form an image-shift- corrected summed image.

Description:
Transmission Electron Microscope Sample Alignment System and Method

BACKGROUND

TECHNICAL FIELD

[0001] Embodiments of the subject matter disclosed herein generally relate to systems and methods for aligning a sample for a transmission electron microscope (TEM).

DISCUSSION OF THE BACKGROUND

[0002] TEMs are commonly used for high resolution transmission electron microscopy (HRTEM) to image crystalline solids consisting of periodically arranged atoms. To reveal the symmetry of the materials, an HRTEM image must be taken with the sample aligned along certain directions, commonly referred to as the zone axis. This alignment is typically a manual process requiring in-depth understanding of the crystallography of the sample, which is lacking for many operators of an TEM.

[0003] Operators with an in-depth understanding of the crystallography of the sample must also understand the tilting behavior of the sample holder. Such an operator performs theoretical calculations based on the understanding of the crystallography and the tilting behavior of the sample holder to determine the tilt corrections that need to be made to the sample holder. Further, the tilt correction inevitably results in some sample movement relative to the electron beam, which requires further correction by the operator.

[0004] This manual process not only requires specialized knowledge but also is time consuming, typically requiring tens of minutes to perform. Moreover, the operator must expose the sample to the electron beam a number of times, including an initial exposure to identify the current sample orientation and at least a second exposure to confirm the tilt correction did in fact align the sample along the zone axes. This manual process typically involves more than two exposures due to, for example, the sample movement and/or the initial correction not completely aligning with the zone axes. These additional exposures can damage samples of materials sensitive to the electron beam (e.g., some materials can be damaged by a cumulative electron doses of less than 10 electrons per A 2 and many materials can be damaged by cumulative doses in the range of 10-20 e _ A- 2 ), and thus result in a subsequent exposure for studying the sample being performed on a damaged sample. The types of damage include knock-on damage, heating damage, and radiolysis. Although knock-on damage can be addressed using low accelerating voltages (e.g., 60-120 kV), the use of low-energy electrons results in poor image resolution and short penetration depth.

[0005] One attempt to address the manual process for zone access alignment involved a computer-assisted tool that evaluated intensity asymmetries in a diffraction pattern to determine the offset of the sample relative to its zone axis. Relying upon the intensity of reflections, however, can result in inaccurate alignment due to the influence of structure factors (i.e., the mathematic concept used to calculate kinematical diffraction intensity form the content of a unit cell) or dynamical effects (i.e., when a crystal is big enough, diffraction phenomenon can happen more than one time and the intensity of diffraction can be different than the values calculated from the structure factor). [0006] Thus, there is a need for methods and system that does not require an operator to have an in-depth understanding of the crystallography and tilting behavior of the sample holder and that minimizes the number of exposures of the sample to the electron beam to align the zone axes and is not influenced by structure factors and other dynamic effects.

SUMMARY

[0007] According to an embodiment, there is a method involving applying an electron beam to a sample and obtaining an image of the sample with the applied electron beam. An orientation of the sample relative to the sample's zone axis is automatically determined based on a distribution of reflections in the image. The orientation of the sample is automatically adjusted to align with the sample's zone axis based on the determined orientation.

[0008] According to another embodiment, there is a system, which includes an electron gun, a sample holder, an imaging detector, and a positioning controller coupled to the sample holder and configured to adjust an orientation of a sample in the sample holder. The system also includes a processor communicatively coupled to the electron gun, the sample holder, the imaging detector, and the positioning controller. The processor executes instructions to control the sample holder based on an automatically calculated Laue circle of the imaged sample.

[0009] According to a further embodiment, there is a method involving automatically determining an orientation of a sample relative to the sample's zone axis based on a distribution of reflections in an image of the sample. The orientation of the sample is automatically adjusted to align with the sample's zone axis based on the determined orientation. An amplitude filtered pattern is calculated in a Fourier domain based on amplitude components of a plurality of Fourier transformed images of a sequence of images. An amplitude component of the plurality of Fourier transformed images is replaced with the amplitude pattern to form a plurality of filtered Fourier transformed images. Image shift information is determined based on the plurality of filtered Fourier transformed images. The image shift information is applied to images in the sequence of images to form a plurality of aligned images.

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate one or more embodiments and, together with the description, explain these embodiments. In the drawings:

[0011] Figure 1 is a schematic diagram of an apparatus for automatic zone axis alignment of a sample according to an embodiment;

[0012] Figure 2 illustrates a flowchart of a method for automatic zone axis alignment of a sample according to an embodiment;

[0013] Figures 3A-3C illustrate flowcharts of methods for automatic zone axis alignment of a sample according to embodiments;

[0014] Figure 4A illustrates a Laue Circle of a sample according to an embodiment;

[0015] Figure 4B illustrates a sample after automatic zone axis alignment according to an embodiment; [0016] Figure 4C illustrates an intersection of a Laue Circle and an Ewald sphere according to an embodiment;

[0017] Figure 5 illustrates a sample before and after automatic zone axis alignment according to an embodiment;

[0018] Figure 6 illustrates a flowchart of a method for aligning a time series of images according to an embodiment;

[0019] Figures 7A-7D, 7F, and 7G are images of an object used for aligning a time series of images according to an embodiment; and

[0020] Figure 7E illustrates a graph of drift plots across the X- and Y-axes for a sequence of images according to an embodiment.

DETAILED DESCRIPTION

[0021] The following description of the exemplary embodiments refers to the accompanying drawings. The same reference numbers in different drawings identify the same or similar elements. The following detailed description does not limit the invention. Instead, the scope of the invention is defined by the appended claims. The following embodiments are discussed, for simplicity, with regard to the terminology and structure of high resolution transmission electron microscopy (HRTEM). However, the embodiments to be discussed next are not limited to HRTEM but may be applied to any type of microscopy in which the imaging beam can damage a sample during zone axis alignment.

[0022] Reference throughout the specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with an embodiment is included in at least one embodiment of the subject matter disclosed. Thus, the appearance of the phrases "in one embodiment" or "in an embodiment" in various places throughout the specification is not necessarily referring to the same embodiment. Further, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments.

[0023] According to an embodiment an electron beam is applied to a sample and an image of the sample with the applied electron beam is obtained. An orientation of the sample relative to the sample's zone axis is automatically determined based on a distribution of reflections in the image. The orientation of the sample is automatically adjusted to align with the sample's zone axis based on the determined orientation. Those skilled in the art would understand the zone axis refers to orientations of a crystal showing high-symmetry and generally refers to any direction referenced to the direct lattice of a crystal in three dimensions.

[0024] Figure 1 is a schematic diagram of an apparatus for automatic zone axis alignment of a sample according to an embodiment. The apparatus 100 is embodied as a transmission electron microscope (TEM). Specifically, an electron gun 102 applies an electron beam 104 to a sample 106, which is situated in a sample holder 108. A beam of electrons 1 10 passing through the sample 106 is received by an imaging detector 1 12, which can be film or a digital pixel detector, such as a direct-detection electron-counting (DDEC) camera (e.g., a Gatan K2 Summit) or a charge coupled device (CCD) camera. DDEC cameras are particularly useful due to the high detective quantum efficiency (DQE) that allows ultra-low electron doses. For example, a DDEC camera allows image acquisition at magnifications of at least 55,000 to achieve atomic resolution (i.e., a pixel size of 0.57 A x 0.57 A) with an electron beam dose as lows as 2-4 e- per pixel (i.e., doses as low as 6-12 e " A "2 ). Those skilled in the art will recognize an imaging detector represents a class of structures for obtaining an image of the sample 106.

[0025] The apparatus 100 also has a control system 1 14, which includes a processor 1 16, memory 1 18, input/output interface 120, and sample holder positioning controller 122, which can communicate with one another via bus 124. The input/output interface 120 allows an operator to communicate with the processor 1 16, memory 1 18, and/or the positioning controller 122 to operate the TEM. For example, the input/output interface 120 can include one or more displays for displaying samples imaged by imaging detector 1 12, as well as one or more input devices for manually controlling various aspects of the TEM (e.g., focus, sample positioning, etc.), and for initiating an automatic control of the TEM, as will be described in more detail below.

[0026] Those skilled in the art will recognize that the positioning controller 122 refers to a class of structures used by a TEM for controlling the orientation of sample. Although not illustrated for purposes of clarity, processor 1 16 is also communicatively coupled to electron gun 102 and imaging detector 1 12 via bus 124 to provide instructions to control these devices and receive outputs from these devices.

[0027] For ease of explanation some of the components of a TEM are not illustrated, however these additional components are not necessary for understanding the disclosed embodiments but nonetheless can be used with the disclosed embodiments.

[0028] As discussed above, conventional HRTEM studies require an operator with in-depth understanding of the crystallography of the sample and knowledge of the titling behavior of the sample holder. Such an operator would expose a sample to the electron beam, perform calculations and then use an input/output device to adjust the tilting of the sample by way of the sample holder. As illustrated in the upper-left hand corner of Figure 1 , the operator adjusts the orientation of the sample about the X-axis and Y-axis. In contrast, embodiments discussed in more detail below automatically adjust the sample orientation, which provides a more accurate alignment of the sample about the zone axis that minimizes the number and intensity of exposures of the sample for the orientation process. This automatic adjustment can be performed using processor instructions stored in memory 1 18 and executed by processor 1 16 using positioning controller 122 to control the orientation of the holder 108, and in turn the sample 106. Thus, these processor instructions can be loaded into a TEM to perform the methods discussed below.

[0029] Figure 2 illustrates a flowchart of a method for automatic zone axis alignment of a sample according to an embodiment. Initially, the processor 1 16 instructs electron gun 102 to apply an electron beam 104 to sample 106 (step 205). The processor 1 16 then obtains an image of the sample 106 from imaging detector 1 12 (step 210) and, using processor instructions detailed below, automatically determines an orientation of the sample 106 relative to its zone axis based on a distribution of reflections in the image (step 215). The processor 1 16, based on the determined orientation, automatically instructs positioning controller 122 to adjust the orientation of the sample 106 to align its zone axis (step 220). The processor 1 16 can adjust the orientation of sample 106 by sending an amount of adjustment about the X-axis and/or Y-axis or can send commands to start and stop the adjustment in either or both axes.

[0030] The obtained image of the sample can be quite noisy, which can result in small errors in the automatic determination of the sample orientation, as well as the automatic adjustment of the sample orientation. Thus, if the sample is not completely aligned along its zone axis after the sample orientation is automatically adjusted, steps 205-220 can be repeated to reduce the error. Recognition of whether the sample is orientated along its zone axis can be determined by an operator viewing the sample (in-depth understanding the crystallography of the sample is not required to identify the sample not being aligned along its zone axis) or can be performed automatically by processor 1 16.

[0031] The automatic zone axis alignment can be performed using a dose of, for example, -0.15 elk 2 , whereas conventional manual processes involve electron doses of more than tens of electrons per A 2 . This electron dosage difference can be significant for an HTREM study of, for example, radiation sensitive crystals with structures that change after total electron doses of 15 elk 2 to -20 elk 2 . The disclosed automatic zone axis alignment therefore provides the ability to perform more studies and/or at higher electron doses compared to a manual zone axis alignment. [0032] Figures 3A-3C illustrate flowcharts of methods for automatic zone axis alignment of a sample according to embodiments. Initially, the processor 1 16 receives a zone axis alignment request from an operator, for example via

input/output device 120 (step 305). The processor 1 16 instructs the electron gun 102 to apply an electron beam 104 on sample 106 (step 310). The electron beam density can be, in a non-limiting example, 0.03 e/A 2 /s with an exposure time of 2 seconds.

[0033] The processor 1 16 then obtains the imaged sample from imaging detector 1 12 (step 315). The sample can be imaged in the diffraction mode, which can also be referred to as the reflection mode. The processor 1 16 then determines the sample's Laue circle based on the distribution of reflections in the imaged sample forming a portion of the circumference of the Laue circle (step 320). A non- limiting example of this is illustrated in Figure 4A, in which O corresponds to the origin of the reciprocal lattice, OE corresponds to the center of the Ewald sphere, OL corresponds to the center of the Laue circle, φ corresponds to an angle of the sample's deviation from zone axis alignment, direction OE→0 corresponds to the electron beam incidence, and direction OE→OL corresponds to the zone axis.

[0034] The observed electron diffraction pattern of the imaged sample can be understood as the interaction between the reciprocal lattice of the crystal and Ewald sphere and when the incidence of the electron beam (e-beam in the Figure) deviates from the sample's zone axis by an angle φ, the zero-order Laue zone (ZOLZ) of the lattice intersects the Ewald sphere, thus forming the Laue circle. The radius of the Ewald sphere OE-0 is 1/λ, where λ is the wavelength of the electron beam. Because the Laue circle passes through the reciprocal lattice O, the Laue circle's radius O-OL is approximately equal to sin(< ) ( A)- Therefore, reducing the angle φ decreases the radius of the Laue circle and when the angle φ is 0 the electron beam incidence along the zone axis corresponds to the ZOLZ tangent to the Ewald sphere, an example of which is illustrated in Figure 4B. Moving the OL until it coincides with O is the equivalent of changing the alignment of the sample from "off-axis" to "on-axis." [0035] Accordingly, returning to Figure 3A, the processor 1 16 uses the determined Laue circle to determine φ and λ consistent with the discussion above (step 325). The processor 1 16 then decomposes φ into its constituent components φ« and φβ, where a and β are axes that are respectively parallel to the x- and y-axes and the oc-tilt axis is parallel with the long dimension of the sample holder 108 (step 330). The calculation of components φ« and φβ assumes both the oc-tilt and β-tilt axes are parallel to the plane of the electron diffraction. Although the β-tilt axis moves out of the plane once the a tilting is applied, the method provides an approximation with satisfactory results when the initial crystal orientation is relatively close to the zone axis, for example -5° < φ < 5°. Orientations outside of this range provide electron diffractions having very few observable reflections, which can make the determination of the Laue circle difficult.

[0036] Referring now to Figures 3B and 4C, processor 1 16 determines a first vector OL-OL ', which is perpendicular to the oc-tilt axis, from the center of the Laue circle OL to a point on the first axis OL ', which in this example is the oc-tilt axis (step 330A). The processor 1 16 then determines the first axis component φ« as an angle between a first line OL-OE connecting the center of the Laue circle Oi_ and the center of the Ewald sphere OE and a second line OL -OE connecting the point on the first axis OL ' O the center of the Ewald sphere OE (step 330B). The processor 1 16 determines the second axis component φβ as an angle between the second line OL - OE and a third line OE-0 corresponding to the path of the electron beam to the sample (step 330Ci). Alternatively, as illustrated in Figure 3C, the second axis component φβ can be determined as a difference between the determined angle φ and the angle of the first axis component φ« (step 330C2).

[0037] Returning to Figure 3A, the processor 1 1 6 then automatically applies φ« and φβ to sample holder 1 08, which can be performed using positioning controller 122 in the manner discussed above (step 335). This positioning also ensures the sample is within the aperture of the electron beam 104. The processor 1 1 6 instructs the electron gun 1 02 to apply another electron beam dose on the sample 1 06 (step 340) and obtains another image of the sample (step 345). The HTREM study is then conducted by imaging the sample in a time series manner to produce a plurality of images that are subsequently summed in a time series manner into a final image for study (step 350).

[0038] The second imaging of the sample is used to confirm the sample's zone axis alignment, which with the automatic process of the disclosed embodiments should result in alignment. In contrast, for conventional manual alignment techniques this second imaging typically reveals that additional adjustments are required for zone axis alignment requiring additional applications of the electron beam to the sample, which for radiation sensitive crystals may result in damage to the crystals and/or reduce the amount of radiation employed for the HTREM study itself. Even if more than two imagings are required using this method, the overall electron dose can be limited to less than 2 elk 2 . If a second imaging is required, steps 310-335 are repeated until the sample is aligned with its zone axis.

[0039] Figure 5 illustrates a sample before and after automatic zone axis alignment according to an embodiment. In this example, initial electron beam dosage was 0.03 e/A 2 /s with an exposure of 2 seconds, which resulted in the image on the left-hand side of the figure. Using this image, the tilting angles were determined to be φ«: -1 .79° and φ : -0.31 °, which when applied to the sample holder resulted in the image on the right-hand side of the figure in a second imaging. In this example, the overall electron dose to produce the two images was -0.15 elk 2 , which as illustrated in the right-hand side image provided successful zone axis alignment and thus reveals the symmetry of the sample.

[0040] The methods described above assume that the exact directions of the a- and β-axes of the sample holder for a particular transmission electron microscope are known. If not, a pre-calibration of the directions of the oc-tilt and β-tilt axes and tilting accuracy of the sample holder should be performed for the transmission electron microscope, for example using a standard single-crystalline sample. This pre-calibration can be performed once for a particular transmission electron microscope and then the methods can be performed for one or more samples with the calculated tilting directions accounting for the pre-calibration. In other words, after the pre-calibration, the zone axis alignment can be automatically performed for any number of samples. [0041] It will be recognized that during the HRTEM study, the sample, being a beam-sensitive material, can move due to beam-induced sample motion, which results in blurred images. Thus, the images from the HRTEM study should be aligned with each other. One way to align the images involves converting the images into the Fourier domain and then using the phase variation in the Fourier transformed images. However, HRTEM studies typically involve noisy images, which affects the accuracy of phase determination. The impact of noise can be minimized by selectively analyzing pixels in the Fourier transformed images with strong amplitudes, because phase determination of weak pixels is more easily influenced by noise and prone to errors. This can be achieved using an amplitude filter to confine the phase analysis to reliable strong-amplitude pixels.

[0042] Unlike the common methods that deal with the weak signals of individual images, the amplitude filter starts by combining the amplitude components of all of the Fourier transformed images in a time series of images to form an amplitude pattern. The amplitude pattern pinpoints the strong-amplitude pixels, as the reflections have invariable coordinates in the Fourier transformed images, irrespective of image drift. This results in hidden reflections emerging in the amplitude pattern. Background and weak pixels having amplitudes lower than a set threshold are filtered out from the amplitude pattern to form an amplitude filtered pattern. The amplitude filtered pattern is combined with the phase components from the original Fourier Transformed images to generate a series of modified Fourier Transformed images. This is followed an inverse Fourier Transformed being applied to the modified Fourier Transformed images to generate a series of filtered images. [0043] Finally, the image drift can be calculated using iterative cross- correlation based on the filtered images, and this information can be used to align the original images in the time series of images. The drift-corrected, summed image shows rich high-resolution structural details, whereas cross-correlation without the amplitude filter cannot correctly align the image time series of images until it is 1 x 1 x 1 0 binned, which results in a marked reduction in image resolution in the direction of the image drift.

[0044] Figure 6 illustrates a flowchart of a method for aligning a time series of images according to an embodiment. Initially, the processor 1 16 controls the electron gun 102 and imaging detector 1 12 to generate a sequence of images of the object by applying an electron beam to the object for a plurality of distinct time periods (step 602). Figure 7 A is an example of one individual image from the sequence of images, which shows the individual image is very noisy and the contrast is close to noise level, which can be due to the very short exposure time for capturing the individual image and/or the low electron dose applied to generate the image. The plurality of distinct time periods corresponds to a number of images in the sequence of images.

[0045] The image in Figure 7 A and all other example images illustrated in the figures were captured using a Titan Image Cs corrected Cube Transmission Electron Microscope (FEI) equipped with a K2-IS CMOS camera (manufactured by Gatan, Inc.), with 0.05s exposure per image, 120 images in total, and a mean count of approximately 0.013 e/pixel in each individual image. The object imaged is a UiO-66 nano-sized Metal Organic Framework (MOF) crystal. In contrast, conventional techniques require a dose greater than 0.67e _ per pixel per frame to attain sufficient a signal-to-noise ratio for reliable alignment.

[0046] The processor 1 1 6 receives a sequence of images

(fi (.x,y), (f 2 ( x > y)> --- , {f n (. x > y)) of an object from imaging detector 1 12 (step 605), which as discussed above includes at least two consecutive images of the sequence of images spatially shifted relative to each other. The processor 1 16 then transforms each image (fi) in the sequence of images (A(x, y), (f 2 (.x, y), --- , {f n (. x > y)) int0 a

Fourier domain using a Fourier transform to generate a corresponding plurality of

Fourier transformed images (Fi) (step 61 0). For a sequence of images containing / ' images (fi (x,y), h(x,y), fn(x,y), the Fourier transform of one individual image (1 )

[0048] The equation in polar form is as follows:

[0049] Fi(u, v) = \F i (u, v \e- u K u - v' > (2)

[0050] where | R(u,v)| is the amplitude and 0(u,v) is the phase of R(u,v).

[0051 ] The processor 1 1 6 calculates an amplitude filtered pattern in the Fourier domain by summing the amplitude components of the Fourier transformed images (Fi) to form an amplitude pattern (FA) (step 615A) and then applying an amplitude threshold to the amplitude pattern (FA) to generate an amplitude filtered pattern (H) (step 615B). The amplitude filtered pattern (H) includes pixels in the amplitude pattern (FA) having an amplitude at or above the amplitude threshold. Specifically, the Fourier transform amplitude components from all of the images in the sequence of images forms the amplitude pattern (FA), which can be denoted as: [0052] F A (.u, v) =∑ i n=1 \F i (u, v) \ (3)

[0053] In one non-limiting embodiment, the amplitude threshold It can be a value in the following range:

[0054] I t > 2 x I mean - I min (4)

[0055] Where Lean and I™, are the mean value and the minimum value among all of the pixels in the amplitude pattern (FA). Equation (4) describes one example of how to calculate the amplitude threshold It and it should be recognized that there are many other ways to calculate the amplitude threshold It.

[0056] An amplitude filtered pattern can be represented by:

[0057] «(„,„) = {*- 0 - ·¾ '' (5)

[0058] where is the intensity value at point {u, v) in the amplitude pattern FA(U, I/). Equation (5) describes on example of how to calculate the amplitude filtered pattern H(u,v) and it should be recognized that there are many other ways to calculate the amplitude filtered pattern H(u,v). One of these alternatives could involve keeping the value if l uv ≥lt (instead of using the value -lt).

[0059] As illustrated in Figure 7B, the amplitude pattern (FA) reduces the signal-to-noise ratio so that the amplitude peaks corresponding to the atomic structure of the imaged object can be observed above the noise. The image in Figure 70 is the amplitude filtered pattern H(u,v), which eliminates all pixels in the amplitude pattern having an amplitude value below the amplitude threshold of the amplitude filter while retaining the pixels having an amplitude value above the amplitude threshold of the amplitude filter. The image in Figure 70 was produced using an amplitude threshold that eliminates all pixels except those corresponding to approximately 100 pixels having the highest amplitude in the Fourier transformed and summed image. Thus, for example, the amplitude threshold can be set to result in a predetermined number of pixels in the amplitude filtered pattern (H).

[0060] Next, the processor 1 16 replaces the amplitude component |R(u,v)| of the individual Fourier transformed images R(u,v) with the amplitude filtered pattern

H(u,v) to form a plurality of filtered Fourier transformed images (Gi) (step 620A), which can be represented by the following equation:

[0061] Giiu. v = H(u, v e- i ^ u ^ (6)

[0062] The processor 1 16 then performs an inverse Fourier Transform on each of the plurality of filtered Fourier transformed images (Gi) to generate a corresponding plurality of reverse transformed, filtered images (gi), (step 620B).

Specifically, each filtered image gi(x,y) is represented by:

[0063] 9i(x, y) = JT G i (u, v)e 2ni ^ x+vy ^dudv (7)

[0064] Figure 7D illustrates an example of the image in Figure 7A after having the amplitude component replaced by the amplitude filtered pattern (H) and then transformed back into the original domain. As can be observed, the lattice features of the imaged object become visible, whereas those features are not visible in the original, individual image illustrated in Figure 7A.

[0065] The processor 1 16 then cross-correlates the plurality of reverse transformed, filtered images (gi) with a consecutive one of the plurality of reverse transformed, filtered images (gi+i) to generate image shift information for each of the plurality of reverse transformed, filtered images (gi). (step 620C). Thus, no image shift information is calculated for the first image (gi ) and image shift information for each subsequent image (gi+i) is based on the previous image in the sequence (i.e. , gi for the second image and gi-i for each image after the second image). A fixed image is not used for the cross-correlation because the filtered image gi(x,y) contains a periodic lattice, and thus the determination of drifts only works for motions within a periodic unit. The use of consecutive images for cross-correlation addresses this issue because the drift between two consecutive images is unlikely to exceed the unit cell length.

[0066] Figure 7E is a graph of an example of drift plots calculated from the cross-correlation, which shows the amount of drift in the X- and Y-axes for each image in the sequence relative to the previous image. Although these example drift plots are relatively linear, this may not occur in all implementations and the drift plots can take any form, depending upon the movement of the object during imaging, including one with appearing to contain random shifts.

[0067] The processor 1 1 6 then aligns the original images (fi) in the sequence of images (A(x,y), (f 2 (.x, y), --- , {f n ( . x > y)) by applying the image shift information to each original image (fi) in the sequence of images (step 625). Thus, a single iteration cycle of the cross-correlation includes a drift determination operation and a drift correction operation of all of the images in the sequence of images. Assuming that the drift correction determination includes m cycles and that the drift determined for image / ' (relative to image 1 ) at iterative cycle k is r,¾=[_-x,¾, Ay,i , the overall drift for image i,n relative to image 1 is:

[0068] n =∑£ =1 [Ax ik , Ay ik \ (8) [0069] Thus, the overall alignment can be improved by performing a number of iterative cycles. In one embodiment, the number of iterative cycles is, for example, ten cycles.

[0070] The processor 1 16 then sums the aligned images to form an image- shift-corrected summed image (step 630). The image-shift-corrected summed image can then be output, for example on a display via input/output interface 120 (step 635). Figure 7F illustrates a summed image generated without performing any alignment of the images in the sequence of images and Figure 7G illustrates summed images aligned in the manner described in connection with Figure 6. As will be appreciated, the lattice features are much clearer in the summed images of Figure 7G compared to that of Figure 7F.

[0071] It should be understood that this description is not intended to limit the invention. On the contrary, the exemplary embodiments are intended to cover alternatives, modifications and equivalents, which are included in the spirit and scope of the invention as defined by the appended claims. Further, in the detailed description of the exemplary embodiments, numerous specific details are set forth in order to provide a comprehensive understanding of the claimed invention. However, one skilled in the art would understand that various embodiments may be practiced without such specific details.

[0072] Although the features and elements of the present exemplary

embodiments are described in the embodiments in particular combinations, each feature or element can be used alone without the other features and elements of the embodiments or in various combinations with or without other features and elements disclosed herein.

[0073] This written description uses examples of the subject matter disclosed to enable any person skilled in the art to practice the same, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the subject matter is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims.