Here, we present a protocol to utilize machine-vision software to stabilize dynamic processes during TEM imaging, while concurrently indexing multiple streams of metadata to each image into a navigable timeline. We demonstrate how this platform enables automated calibration and mapping of the electron dose over the course of an experiment.
Transmission electron microscopy (TEM) enables users to study materials at their fundamental, atomic scale. Complex experiments routinely generate thousands of images with numerous parameters that require time-consuming and complicated analysis. AXON synchronicity is a machine-vision synchronization (MVS) software solution designed to address the pain points inherent to TEM studies. Once installed on the microscope, it enables the continuous synchronization of images and metadata generated by the microscope, detector, and in situ systems during an experiment. This connectivity enables the application of machine-vision algorithms that apply a combination of spatial, beam, and digital corrections to center and track a region of interest within the field of view and provide immediate image stabilization. In addition to the substantial improvement in resolution afforded by such stabilization, metadata synchronization enables the application of computational and image analysis algorithms that calculate variables between images. This calculated metadata can be used to analyze trends or identify key areas of interest within a dataset, leading to new insights and the development of more sophisticated machine-vision capabilities in the future. One such module that builds on this calculated metadata is dose calibration and management. The dose module provides state-of-the-art calibration, tracking, and management of both the electron fluence (e–/Å2·s-1) and cumulative dose (e–/Å2) that is delivered to specific areas of the sample on a pixel-by-pixel basis. This enables a comprehensive overview of the interaction between the electron beam and the sample. Experiment analysis is streamlined through a dedicated analysis software in which datasets consisting of images and corresponding metadata are easily visualized, sorted, filtered, and exported. Combined, these tools facilitate efficient collaborations and experimental analysis, encourage data mining and enhance the microscopy experience.
Transmission electron microscopes (TEMs) and their capabilities have benefited enormously from advances in cameras, detectors, sample holders, and computing technologies. However, these advances are hampered by disconnected data streams, limitations of human operation, and cumbersome data analysis1,2. Moreover, in situ and operando experiments adapt TEMs into real-time nanoscale laboratories, enabling samples to be studied in gas or liquid environments while simultaneously applying a range of external stimuli3,4,5. The adoption of such complex workflows have only magnified these limitations, and the resulting increase of the size and complexity of these data streams is an area of growing concern. Thus, there is a growing emphasis on utilizing machine-actionability to find, access, interoperate, and reuse data, a practice known as the FAIR principles6. Publishing research data in accordance with the FAIR principles concept has received favorable attention from governmental agencies around the world7,8, and application of the FAIR principles using machine-vision software is a key step in their adoption.
A machine-vision synchronization (MVS) software platform has been developed in response to the specific pain points inherent to performing and analyzing complex, metadata-heavy TEM experiments (particularly in situ and operando experiments)9. Once installed on the TEM, the MVS software connects, integrates, and communicates with the microscope column, detectors, and integrated in situ systems. This enables it to continuously collect images and align those images with their experimental metadata, forming a comprehensive searchable database, a timeline of the experiment from start to finish (Figure 1). This connectivity allows the MVS software to apply algorithms that intelligently track and stabilize a region of interest (ROI), even when samples are undergoing morphological changes. The software applies adjustments to stage, beam, and digital corrections as necessary to stabilize the ROI through its Drift Control and Focus Assist functions. In addition to enriching the images with the raw metadata produced from the different experimental systems, the software can produce new, computational metadata using image analysis algorithms to calculate variables between images, which allow it to automatically correct for sample drift or changes in focus.
TEM images, and their associated metadata collected through the MVS software, are organized as an experimental timeline which can be opened and viewed by anyone via the free, offline version of the analysis software, Studio (hereafter referred to as the analysis software)10. During an experiment, the MVS software syncs and records three types of images from the microscope's camera or detector, which are displayed at the top of the timeline below the image viewer: single acquisition (individual single aquisition images acquired directly from the TEM software), raw (images from the detector/camera live stream that have not had any digital drift corrections applied; these images may have been physically corrected via stage movement or beam shift), and drift corrected (images from the detector/camera live stream that have been digitally drift). Data collected during an experiment or session can be further refined into smaller sections or snippets of data, known as collections, with no loss of embedded metadata. From the analysis software, images, image stacks, and metadata can be directly exported into a variety of open format images and spreadsheet types for analysis using other tools and programs.
The framework of microscope control, stabilization, and metadata integration enabled by the MVS software also allows the implementation of additional machine-vision programs or modules, designed to alleviate limitations in current TEM workflows. One of the first modules developed to take advantage of this synchronization platform is electron dose calibration and spatial tracking of beam exposed areas within the sample. All TEM images are formed from the interaction between the sample and the electron beam. However, these interactions can also result in negative, inescapable impacts on the sample, such as radiolysis and knock-on damage11,12, and require a careful balance between applying a high enough electron dose to generate the image and minimizing the resulting beam damage13,14.
Although many users rely on screen current measurements to estimate the electron dose, this method has been shown to widely underestimate the actual beam current15. Qualitative dose values can be obtained via the screen current on the same microscope with the same settings, but reproducing these dose conditions using different microscopes or settings is highly subjective. Additionally, any imaging parameter adjustments made by the user during the experiment, such as spot size, aperture, magnification, or intensity, require a separate measurement of the screen current to calculate the resulting dose. Users must either rigorously limit the imaging conditions used during a given experiment or meticulously measure and record each lens condition used, significantly complicating and extending the experiment beyond what is feasible for normal operation of the microscope16,17.
Dose, referred to as dose software for this protocol, is a dose calibration software module that utilizes a dedicated calibration holder designed to enable automated current measurements. A Faraday cup, the gold standard for accurate beam current calibration15, is integrated into the tip of the calibration holder. The MVS software performs a series of beam current and beam area calibrations for each lens condition and embeds those values on the images at the pixel level.
In this video article, MVS software protocols designed to enhance all areas of the TEM workflow are presented using representative nanomaterial samples. A beam sensitive zeolite nanoparticle sample14 is used to demonstrate the calibration and dose management workflows. We perform a representative in situ heating experiment using an Au/FeOx nanocatalyst18,19 sample that undergoes significant morphological changes when heated. This in situ experiment highlights the software's stabilization algorithms and its ability to collate multiple streams of metadata, which is an inherent challenge for in situ and operando studies. Although not described in the protocol, because of its unique electron dose sensitivity, we discuss representative examples of the software's utility for liquid-EM studies (protocols for which have been previously reported in the literature20,21,22), and how these techniques can be applied to improve the understanding of the effect of dose on liquid-EM experiments. Finally, we show how data analysis is streamlined using the offline analysis software to visualize, filter, and export a variety of image, video, and data files into other accessible formats.
Figure 1: User interface examples for MVS and analysis software. (A) The synchronization software image viewing pane and control panel. A connection between the TEM and the synchronization software is established by activating the Connect button, which streams the images and metadata from the microscope into the synchronization software. From the image viewer, the operator can perform a variety of machine-vision assisted operations, such as Drift Correct and Focus Assist. It also provides the ability to apply Tag Images and Review Session without disrupting data collection. (B) Screenshot of the image analysis software highlighting the location of the Image View Port, Timeline, and the Metadata and Analysis panel. The analysis software can be accessed at any point during an experiment to review the images acquired up to that time point using the Review Session button. Please click here to view a larger version of this figure.
1. Method 1: Dose calibration of the transmission electron microscope for TEM and scanning TEM (STEM) imaging modes
2. Method 2: Determination of dose threshold using the MVS and dose software
3. Method 3: Metadata and trend analysis and data export using the analysis software
4. Method 4: In situ heating study of gold on iron oxide nanoparticles
This work highlights the utility of data acquisition using MVS software for TEM imaging and in situ experiments. Microscope alignment and condition setup were performed and selected through the TEM manufacturer's default controls. After initial setup, the protocols presented in this video article were conducted through the MVS software. A 300 kV TEM was used for all experiments presented in the video protocol and representative data, except for the comparison zeolite data which was acquired using a 200 kV cold FEG (Figure 3D–F and Table 1). All metadata was collected and aligned to its respective images automatically by the MVS software.
After launching the software and selecting the appropriate workflow from the menu, a connection to the microscope is established by activating the Connect button in the toolbar in the far left of the image viewer, as shown in Figure 1A. When the Connect button is highlighted, images and associated metadata from the microscope are automatically streamed into the MVS software and appear in the image view pane. These images and their associated metadata are saved chronologically in a timeline that can be opened, reviewed, and analyzed without interrupting the recording of new data into the timeline (Figure 1B). Streaming can be interrupted by the user at any time by deactivating the Connect icon.
Once the connection is activated, other workflows that are dependent on the MVS software framework can be accessed. In the examples shown in this video protocol, a dose calibration must be performed before utilizing the other functions of the MVS software. Dose calibration is an automated process controlled by the MVS software; it uses a dedicated Faraday cup dose calibration holder to measure the beam's current and area for the combination of parameters. The Faraday cup calibration holder, shown in Figure 2, connects to an external picoammeter, which precisely measures the beam current. Once inserted in the microscope, the fiducial alignment hole is centered and the desired beam conditions to be calibrated (spot sizes, apertures, and magnifications) are entered in the software. The software performs a series of calibration steps for each combination of the selected conditions. During dose calibration, the holder automatically moves between the integrated Faraday current collector cup and the through-hole. The current measurement for each combination of lens conditions is measured on the Faraday cup by the picoammeter. Then, the software translates the stage to center the beam in the through-hole and the beam area is determined through machine-vision algorithms. This series of measurements builds a profile of the the relationship between the intensity/brightness and the beam area. This enables the software to extrapolate the beam area as the intensity/brightness setting is adjusted during an experiment regardless of the field of view. Values for cumulative dose and dose rate are calculated using these beam current and beam area measurements and a dose calibration file is generated. This process essentially defines a dose "fingerprint" for the TEM and its individual lens conditions. Once the dose is calibrated for the TEM, the user is able to operate normally and freely adjust the magnification and intensity with no loss of dose information or manual note taking17. After calibration is complete, the dose calibration holder is removed, allowing the sample to be inserted as normal. The calibration process for both the TEM and STEM modes normally takes less than 10 min.
After calibrating the dose conditions, a commercially purchased zeolite nanoparticle (ZSM-5) sample was imaged under high dose rate conditions to determine the threshold (cumulative) dose at which the sample is too damaged to provide structural information. The ZSM-5 nanoparticles were suspended in ethanol and dropcast on a conventional copper TEM grid. They were imaged continuously at 300 kV in TEM mode using a spot size of 3 and a 100 µm condenser aperture. The dose rate read by the MVS software under high dose rate conditions was 519 e–/Å2·s. Nanoparticles in the field of view were imaged continously until the peaks in the FFT disappeared, indicating degradation of the crystalline structure, as shown in Figure 3A–C and Supplementary File 3. Overlays (which can be added during a live experiment or afterward in the analysis software) were applied to the TEM images to show the date and time, dose rate, maximum (cumulative) dose, and magnification. The dose rate was kept constant during experiments, with the cumulative dose (max dose) increasing as a function of time. The FFT peaks began to disappear after 42 s of continuous imaging (Figure 3B). At 1 min and 20 s and a cumulative dose of ~60,000 e–/Å2, the FFT peaks had completely disappeared (Figure 3C).
To show that this calibration method generates quantitative dose measurements that can be applied to other microscopes operating under different settings, the same calibration process and zeolite degradation experiment was conducted using a 200 kV cold field emission gun (FEG) TEM and a spot size of 1. This microscope was calibrated using the same procedure described in Method 1, and the same experiment described in Method 2 was performed using the new spot size and aperture settings. The beam settings were adjusted so that the difference in the applied dose rate between the two experiments was negligible (499 e–/Å2·s vs. 519 e–/Å2·s). As shown in Figure 3D–F and summarized in Table 1, the FFT spots fully disappear after 1 min and 50 s of continuous imaging and a cumulative dose of 58,230 e–/Å2, which aligns with the values obtained in the first experiment.
An example of how the MVS software can benefit in situ experiments was shown by performing a heating experiment. A representative nanocatalyst sample, Au/FeOx (synthesized following a published procedure19), was selected as an example system because it undergoes dynamic morphological and structural changes at high temperatures. This temperature-induced mobility makes it challenging to keep the ROI centered within the field of view due to the sample's own movement and thermal expansion of the sample suport itself during temperature changes18. With the Drift Correct and Focus Assist features enabled, the sample was imaged over a period of ~30 s at 800 °C. At elevated temperatures, the gold nanoparticles within the Au/FeOx migrated along the surface of the iron oxide support and sintered to form larger particles, as shown in Figure 4 and as a movie in Supplementary File 7. Figure 5 shows a series of TEM snapshots (Figure 5A–F) of a porous region within an Au/FeOx nanocatalyst, recorded at various time points (Figure 5G) during an in situ heating experiment. The coordinated drift value of the ROI was automatically calculated by the software. The coordinated drift and temperature values of the images over the course of the series is shown graphically in Figure 5G. As expected, the coordinated drift of the sample increases as the temperature profile increases, from a rate of ~9 nm/min to ~62 nm/min, and begins to decrease toward leveling off as the temperature is held constant. Despite this high rate of drift, and changes to the sample's morphology, high resolution images are easily obtained during temperature ramping, revealing movement within the porous region, as shown in Supplementary File 8. Refer to Supplementary File 9 for download instructions and computer specifications.
Figure 2: Electron dose calibration and tracking. (A) Dose is calibrated using a dedicated sample holder that contains a current collector positioned at the sample plane for beam current measurements. (B) Illustration of the features of the tip design: Left: Faraday cup; Middle: fiducial hole; Right: through hole (C). The applied electron dose can be visualized in the software using color-coded maps to denote different dose exposures within an image. Please click here to view a larger version of this figure.
Figure 3: Electron dose induced degradation of zeolite (ZSM-5) nanoparticles. (A–C) Snapshots taken over a 1 min and 20 s period showing degradation data obtained with a 300 kV FEG and a measured dose rate of 519 e–/Å2·s; the zeolite degrades within 1 min and 20 s. (D–E) Snapshots taken over a 1 min and 50 s time period showing degradation data obtained with a 200 kV cold FEG TEM and an electron dose rate of 499 e–/Å2·s; the insets show the FFT spot fading over time. The scale bar is 60 nm. Please click here to view a larger version of this figure.
Figure 4: AXON synchronicity applies machine-vision algorithms to track and stabilize dynamically evolving samples. Metadata generated during the experiment can be plotted along the timeline, allowing the user to quickly pair an image with its associated metadata as they scroll through the image series generated during the experiment. (A–H) Images of a nanocatalyst sample (Au/FeOx) at 800 °C recorded over a period of 28 s both with (A–D) and without (E–H) the dose map overlay. Red areas in the overlay indicate regions of high cumulative dose exposure, and yellow areas indicate regions of lower exposure. Highlighting an individual pixel indicates the cumulative dose for that pixel. White arrows in panels E–H indicate two particles that merge during the experiment, and the orange arrow indicates the trajectory of a moving gold particle. (I) The experiment timeline generated by the analysis software for the image series shown in A–H. The orange dots at the top of the timeline denote raw (non-digitally corrected) images and the blue dots denote drift corrected images. The orange vertical bars indicate the points on the timeline corresponding to the images shown panels A–H. The scale bar is 40 nm. Please click here to view a larger version of this figure.
Figure 5: TEM snapshots of a porous region within an Au/FeOx nanocatalyst at various time points. The MVS software stabilizes and centers the sample even during high drift rates, such as those that occur during a temperature ramp through the application of stage, beam shift, and digital corrections, as indicated by machine-vision algorithms. (A–F) TEM snapshots of a porous region within an Au/FeOx nanocatalyst, recorded at various (G) time points during an in situ heating experiment. The drift rate of the ROI is automatically calculated and recorded during an experiment by the MVS software. As plotted in (G), as the temperature profile is changed (the blue line), the drift rate (orange line) increases as the temperature increases and decreases as the temperature is held constant. Please click here to view a larger version of this figure.
Microscope Type | 300 kV FEG TEM | 200 kV Cold FEG TEM |
Spot Size/Condenser 2 Aperture | 3/100 µm | 1/100 µm |
Dose Rate | 519 e–/A2•s1 | 499 e–/A2•s1 |
Loss of Structure Measured by FFT (Accumulated Dose) |
60,270 e–/A2 | 58,230 e–/A2 |
Table 1: Summary comparison of zeolite degradation results obtained from different microscopes.
Supplementary File 1: Screenshot of the MVS software interface with the dose management tab open. Please click here to download this File.
Supplementary File 2: MVS software database file of the beam-induced zeolite degradation experiment. This viewing/analysis software is available to download for free. Please see Supplementary File 9 for download instructions and computer specifications. Please click here to download this File.
Supplementary File 3: Movie of the beam induced zeolite degradation. Please click here to download this File.
Supplementary File 4: CSV file 1 (zeolite degradation: raw data [mechanical correction only]) Please click here to download this File.
Supplementary File 5: CSV file (zeolite degradation: drift corrected [mechanical + digital correction]) Please click here to download this File.
Supplementary File 6: MVS software database file nanocatalyst in situ heating experiment. Please click here to download this File.
Supplementary File 7: Movie of the nanocatalyst at 800 °C with dose overlays. Please click here to download this File.
Supplementary File 8: Movie of the nanocatalyst during a temperature ramp with coordinated drift values. Please click here to download this File.
Supplementary File 9: Instructions for downloading the free analysis software. Please click here to download this File.
The interpretation of TEM experimental results is often contingent on many inter-connected experimental parameters, such as microscope settings, imaging conditions, and in the case of operando or in situ experiments, changes to the environment or stimuli1,23. Accurate analysis of large TEM datasets, over which these parameters may be continuously modified, requires significant attention from the operator to accurately record each condition and setting for each image in a lab journal or other external documentation source. As TEM datasets grow in size and complexity, manual recordkeeping becomes unmanageable, and key information may be missed or inaccurately recorded. The MVS software described here consolidates the metadata generated during an experiment from the microscope, the detector/camera, and other systems (such as in situ sample holders) and aligns them with their respective images.
In addition to metadata consolidation, the software applies machine-vision algorithms to track and stabilize the field of view through a combination of spatial, beam, and digital corrections using its Drift Correct and Focus Assist functions. When the Drift Correct function is engaged, a cross-correlation 'template' image is generated using the first image pulled into the MVS software. The template is then compared to incoming images to calculate the direction and magnitude of the sample drift or movement. With this information, the MVS software automatically applies the necessary corrections to keep the image features in the same place by adjusting at least one of three parameters: stage location, beam or image shift, and digital image correction. The Focus Assist function utilizes a combination of algorithms to assign a focus value, called the focus score to each image, and those scores are compared to determine the magnitude and direction of defocus adjustment to apply to keep the sample in focus. In STEM imaging mode, the MVS software attempts to maximize contrast through a proprietary version of normalized variance to assign the focus score. In TEM mode, a radial sum of intensity is calculated in the FFT and used to calculate the focus score. Limitations to the MVS software's ability to optimize the focus occur when it cannot accurately calculate the correct focus score for an image. This typically occurs when the microscope is misaligned or the sample is significantly out of focus during calibration, preventing the software from correctly calculating the correct starting focus score value. The MVS software can have difficulty calculating the focus score for samples with well-defined lattice fringes, as the lattice fringes in the FFT can 'overwhelm' the focus scoring algorithm; thus, if a sample moves out of focus, the focus score may not accurately reflect the change in focus. Conversely, working at low magnifications or with a sample that has a low FFT signal can also make it challenging to calculate a good focus score. To mitigate these difficulties, the MVS software contains a number of additional algorithms that can be selected by the user for calculating the focus score if the default settings are unsuitable for the sample. These must be tested and applied on a case-by-case basis to determine the best algorithms for a given experiment.
Morphological changes in the sample structure over time are accounted for using a template morphing factor. This filter is tunable by the operator, so that registration algorithms account for morphological changes over time. Additionally, the software monitors the continuous image, microscope settings, and camera or detector settings to automatically update the template when triggered by changes in sample structure and after any operator-induced changes to the microscope, camera, or detector parameters. As shown in Figure 4, Figure 5, Supplementary File 7, and Supplementary File 8, the MVS software provides effective, immediate stabilization, allowing high resolution imaging of dynamically moving or changing samples. Although the software is capable of controlling very high rates of drift or sample movement, such as those that occur when applying a heating ramp during an in situ experiment, there are limitations to the maximum stage corrections or beam shifts that the software can control if the sample is moving or drifting very rapidly. This limit is a function of the image update rate, field of view size, and drift rate. For a given field of view and image update rate, there is a maximum drift rate that can be corrected, and if the physical movements cannot keep up, then the process may end or become unstable. From the registration templates generated when features such as Drift Correct are applied, additional calculated metadata can be generated. For instance, Match Correlation is a numerical record of the extent of change between templates in a series and is used to identify points in an experimental timeline in which the sample changed. A high match correlation value corresponds to a sample that has undergone changes to its morphology, and a low match correlation value corresponds to a sample whose structure remains relatively static. Match correlation is particularly valuable for in situ studies as it can be plotted graphically, enabling the user to quickly pinpoint images in the series corresponding to significant sample change. It is important, however, to understand that high match correlations values can also correspond to changes in imaging conditions, such as moving the stage or changing the magnification, if these actions are performed while the Drift Correction function remains active.
The calibration workflow presented here utilizes a unique calibration holder and a semi-automated calibration routine to accurately calibrate the beam under a variety of lens conditions with minimal operator intervention. The dose calibration routine is accessed through the MVS software installed on the TEM. The MVS software automatically reads the relevant microscope settings to save all measurements to reference for later experiments. On some TEMs, it is not possible to read the aperture or monochromator settings, and these must be entered into the MVS software settings by the operator during calibrations and during use. There are reminders built into the software to help keep these operator input settings updated by following the program prompts. The development of a holder with a built-in current collector, rather than relying on one integrated elsewhere in the microscope column, is a deliberate design choice. This enables the current collector to be positioned at the same plane as a sample, eliminating errors in the current measurement caused by beam deflection or differences in the absorption of electrons by apertures at different beam positions. The MVS software follows an automated routine to measure the beam current and area for any combination of lens conditions. The software can then correlate these measured calibrations with the camera or screen current and extrapolate any changes in magnification etc. to the beam area during the experiment. Once generated, these calibration files can be used immediately and are automatically saved for later use if the software detects the same settings being used during a future session. Although the longevity of the calibration file varies from microscope to microscope, the authors have found that they are able to use the same calibration files for several months without observing substantial changes to the current values. There are built-in routines monitoring the emission profile of guns to help keep these calibrations relevant, especially on cold FEG emission guns.
Normalization of dose measurements between microscopes and automated tracking of a sample's beam exposure are critical functions of the MVS software, as they allow quantitative comparisons of dose conditions between experiments to be performed on different microscope systems. Dose induced degradation of a zeolite sample (ZSM-5), obtained during identical experiments using different microscopes, results in complete disappearance of the FFT spots after a maximum cumulative or threshold electron dose (~60.000 e–/Å2 when applying a dose rate of ~500 e–/Å2·s) for both setups. These comparative results demonstrate that the dose software facilitates reproducible, quantitative dose measurements. The small difference in the cumulative dose at which full FFT spot disappearance is observed for each experiment is likely a result of the different acceleration voltages employed by the two microscopes, with lower acceleration voltages resulting in more radiation damage pathways, and higher acceleration voltages typically resulting in more knock-on damage24. Literature results for the critical dose of ZSM-5 nanoparticles range from 9,000-14,000 e–/Å2 using the first FFT spot disappearances, rather than the complete disappearance of all the FFT spots25,26. In our results, the first FFT spot disappearance corresponds to a cumulative dose of around 25,000 e–/Å2. Previous studies relied on current measurements obtained using a phosphor screen, which is well documented to underestimate beam current measurements when compared to a Faraday cup15. The determined critical dose can vary by a factor of two or more, depending on which FFT peak is used to track the dose. This indicates that the higher spatial frequencies degrade first, and can result in different values depending on the zone access used during the measurements (our results focused on FFT spots from the entire zeolite crystal, rather than specific structural features)25,26. These differences in techniques and current calibration account for the difference in values between the two experiments reported in our results and previous literature studies.
Although the electron dose interactions are a significant factor in many TEM experiments, in situ and specifically liquid-EM studies are particularly sensitive to its effects. Radiolysis of liquids by the electron beam results in a cascade of chemically reactive species which can interact with the sample, complicating the analysis. Both the dose rate or fluence used during a liquid-EM experiment and the cumulative dose can have an influence on the concentration of radical species generated due to liquid radiolysis27,28. Thus, collecting and recording both cumulative dose and dose rate metadata throughout an experiment allows direct correlation between images and a sample's dose history, and is a more accurate way to elucidate and control the impact of the electron beam in these experiments. Although not covered in this protocol, an example of the utility of the dose management features for liquid-EM is shown in Figure 6.
Figure 6: Beam-induced growth of gold nanoparticles during an in situ liquid-EM experiment. (A) Low-magnification STEM overview of the resulting particle growth with a color overlay of the cumulative dose map across the region. Red areas in the overlay indicate regions of high cumulative dose exposure and yellow areas indicate regions of lower exposure. Highlighting an individual pixel with the cursor or drawing a box over an area using the included drawing tools indicates the cumulative dose for that pixel or area. The scale bar is 2 µm. (B,C) Higher magnification STEM images of the areas indicated by the orange boxes (b,c) in A. Area b, exposed to a higher cumulative dose (10.811 e–/Å2) contains larger particles than those found in area c, which was exposed to a lower cumulative dose (0.032 e–/Å2). Please click here to view a larger version of this figure.
The enriched dose rate and cumulative dose metadata simplifies the analysis of dose-dependent nanomaterial growth and degradation pathways. Figure 6 shows the beam-induced reduction of a solution of gold auric chloride (HAuCl3) ions in water during liquid-EM experiments. From the color dose map overlay in Figure 6A, it is easy to visualize that the cumulative electron dose influences the resulting size and shape of the nanoparticles29,30,31,32. The low magnification STEM overview shows regions exposed to a high (red) and low (yellow) cumulative dose. The particles in the region exposed to higher doses are larger than those in the regions exposed to lower cumulative doses. Because the dose metadata is directly embedded in each image at the pixel level, the complex effects of electron dose in liquid-EM experiments can now be systematically analyzed in a way that was never-before achievable.
In this protocol, we have demonstrated that MVS software provides a comprehensive solution for calibrating, monitoring, and tracking both the electron dose and the total dose delivered to a sample on a pixel-by-pixel basis. This ability unlocks a new paradigm for imaging dose-sensitive samples and understanding the electron beam interactions. It is particularly exciting for liquid-EM experiments, as it will allow for a more effective interrogation into the role that electron dose plays and improve experimental reproducibility. It is our hope that this new framework will allow the accurate collection of dose rate and accumulated dose information, facilitate sharing this data with the community for a more accurate interpretation of TEM results, and advance scientific collaboration and data sharing by enabling FAIR principal reporting and analysis.
The authors have nothing to disclose.
This work was performed in part at the Analytical Instrumentation Facility (AIF) at North Carolina State University, which is supported by the State of North Carolina and the National Science Foundation (award number ECCS-2025064). The AIF is a member of the North Carolina Research Triangle Nanotechnology Network (RTNN), a site in the National Nanotechnology Coordinated Infrastructure (NNCI). The authors would like to thank Damien Alloyeau, CNRS Research Director at the University Paris Cité, for providing the 200 kV CFEG zeolite dose threshold study results.
ARM200F CFEG | JEOL | Transmission Electron Microscope (200 kV) | |
AXON DOSE Calibration Holder | Protochips, Inc. | AXA-FC-TFS | Dose calibration and management hardware package for ThermoFisher ScientificTEM |
AXON DOSE Software: Version 10.6.5.3 | Protochips, Inc. | AX-MOD-DOSE-01-1YR | Dose calibration and management software |
AXON Studio Software: Version 10.6.5.3 | Protochips, Inc. | No Part Number. Available to download at success.protochips.com |
Offline analysis software for AXON datasets. A free copy of the AXON Studio software is available for down load at: success.protochips.com |
AXON Synchronicity Core | Protochips, Inc. | AXON-CORE | Hardware component of the synchronization software. |
AXON Synchronicity Software: Version 10.6.5.3 | Protochips, Inc. | AX-MOD-SYNCPRO-01-1YR | Synchronization software |
Fusion In-Situ Heating E-chip | Protochips, Inc. | E-FHDC-VO-10 | Sample Support E-chip with carbon film. Used with in situ heating system |
Fusion Select In Situ Heating System | Protochips, Inc. | FFAD-6200-EXP | In-situ MEMs heating system for ThermoFisher Scientific TEM. |
Gold(III) chloride (50% gold basis) hydrate 50790 | Sigma Aldrich | 27988-77-8 | Used to prepare Au/FeOx nanocatalyst. Coprecipitation synthesis procedure followed in C. Sze et al. Materials Letters. 36 (1–4), 11–16 (1998) |
Iron (III) Oxide 310050 (Fe2O3) | Sigma Aldrich | 1309-37-1 | Used to prepare Au/FeOx nanocatalyst. Coprecipitation synthesis procedure followed in C. Sze et al. Materials Letters. 36 (1–4), 11–16 (1998) |
Titan ChemiSTEM | ThermoFisher Scientific | Transmission Electron Microscope (300 kV) | |
Zeolite ZSM-5 | Zeolyst | CBV 8014 | Nanocatalyst sample: 80 SiO2/Al2O3 Mole Ratio |