Arturo
Ponce
a,
Jeffery A.
Aguilar
bc,
Jess
Tate
d and
Miguel José
Yacamán
*e
aDepartment of Physics and Astronomy, The University of Texas at San Antonio, San Antonio, Texas 78249, USA
bIdaho National Laboratory, Nuclear Science and Technology Division, Idaho Falls, Idaho 83415, USA
cLockheed Martin Space, Advanced Technology Center, Palo Alto, California 94304, USA
dUniversity of Utah, Scientific Computing Imaging Institute, Department of Electrical and Computer Engineering, Salt Lake City, Utah, USA
eDepartment of Applied Physics and Materials Science, Center for Materials Interfaces in Research and Applications, Northern Arizona University, Flagstaff, AZ, USA. E-mail: Miguel.Yacaman@nau.edu
First published on 16th November 2020
Nanoparticles and metallic clusters continue to make a remarkable impact on novel and emerging technologies. In recent years, there have been impressive advances in the controlled synthesis of clusters and their advanced characterization. One of the most common ways to determine the structures of nanoparticles and clusters is by means of X-ray diffraction methods. However, this requires the clusters to crystallize in a similar way to those used in protein studies, which is not possible in many cases. Novel methods based on electron diffraction have been used to efficiently study individual nanoparticles and clusters and these can overcome the obstacles commonly encountered during X-ray diffraction methods without the need for large crystals. These novel methodologies have improved with advances in electron microscopy instrumentation and electron detection. Here, we review advanced methodologies for characterizing metallic nanoparticles and clusters using a variety of electron diffraction procedures. These include selected area electron diffraction, nanobeam diffraction, coherent electron diffraction, precession electron diffraction, scanning transmission electron microcopy diffraction, and high throughput data analytics, which leverage deep learning to reduce the propensity for data errors and translate nanometer and atomic scale measurements into material data.
X-ray diffraction is produced by single scattering events (kinematical scattering). Electrons on the other hand interact with matter 104 times more than X-ray diffraction. Therefore, electron diffraction patterns contain a lot more information. However, a complication arises from the multiple scattering events that are present in electron diffraction, leading to dynamical effects. In the electron–matter interactions, shown in Fig. 2, k and k′, the incident and diffracted wavevectors satisfy the Laue condition. The difference vector k − k' = G, is the change owing to diffraction and represents an arbitrary point in the reciprocal space. The scattered beam satisfies the Bragg condition as |k| = |k'| = 2π/λ, with λ representing the wavelength. The multiple diffractions shown in Fig. 2 can fall into the allowed and forbidden ghkl positions, which are not allowed using the extinction rules calculated from the structure factor and makes elucidation of the crystal difficult, even for very thin crystals.15 The result is that the intensity of the spots is not equal to Fh2, in which Fh is the structure factor.15,16 In the case of a large diffraction this can be overcome using precession diffraction,17 as we will discuss in the following sections. However, for the case of a metallic cluster, with only a limited number of atoms, the situation is more complicated because the atomic arrays are not necessarily located in conventional crystallographic directions.
Fig. 3 shows the atomic planes on the cluster Au146 as reported by Vergara et al.18,19Fig. 3a is oriented along the [111] direction and Fig. 3b is oriented along the [10] direction (both shown as fcc directions). As can be seen, the atoms are not aligned in well-defined columns projected along both directions (some of them are indicated by the arrows). In this way, electrons traveling through a cluster will suffer multiple scatterings and will register these small atomic variations. The resulting diffraction pattern is directly related to the cluster structure. This can also be rephrased, meaning that the Bragg law cannot be used in the case of clusters. The Bragg law requires scattering in at least 10 atomic rows in order to produce coherent interference of the electron waves.
Fig. 3 Atomic order in two low index directions (in fcc notation) for the cluster Au144 (a) along the [111] direction and (b) view along the [110] direction view along the atomic distribution “seen” by the electron beam is not one of atomic columns oriented in an ordered manner. This will result in a complicated electron diffraction pattern.19 |
As the number of atoms increases the diffraction pattern will become more defined. In the case of nanoparticles that are greater than 5 nm in size, the diffraction pattern already shows features as size streaks which are well known for bulk crystals. Despite the difficulties it is possible to calculate the diffraction pattern of clusters considering a structural model and using a modified version of the multislice method,20 which does not require atomic potential periodicity. An important aspect to be emphasized is that X-ray diffraction implies an average of all the present structures; therefore, individual variations are lost. Even with the best separation methods available it cannot be assumed that all the clusters are identical. On the other hand, electron diffraction is a localized technique and if the spot size is controlled it is possible to obtain individual cluster patterns and test for structural variations. If the clusters are placed on a carbon grid for transmission electron microscopy (TEM) examination, 108 nanoparticles per cm2 are typically and estimated to be present. It is possible to obtain a huge amount of data, which allows researchers to employ machine learning methods for structural determination by using a database of the crystallographic information.
The number of atoms in the nth shell of an icosahedron can be obtained by 10n2 + 2, here n is the cluster number. A common metal cluster is the 13-atom icosahedron (n = 1). The structure has one central atom and 12 surrounding atoms, 20 faces, 12 vertices and 30 edges. For subsequent numbers, the number of atoms adopts the form ni = ni−1 + (ni2 + 2); for example, n4 = 147 + (42 + 2) = 309. The sequence shown in Fig. 4 illustrates the cluster number and the estimated diameter, for cluster n = 21 one will obtain 33153 atoms and a nanoparticle of 11.504 nm, the structures were modeled in VESTA software.22 The transition from a cluster to a nanoparticle occurs when a plasmonic effect starts to appear. Clusters exhibit quantized properties as the quantum effects are dominant, this defines the unique properties of the specific cluster number. Clusters are unstable without the protection of their surfaces, which is given by ligands attached to their surfaces. For instance, the Au144(thiolate)60 cluster is stabilized by a thiolate group, 2 phenylethanethiolate.23
Beam sensitive samples, such as organic materials or ligand protected metallic clusters, require a much lower dose of electron beam radiation to avoid damaging the sample.24 There have been many developments that have improved the high resolution of microscopes at low dose configurations. One of these is the introduction of highly sensitive sensors, which allows the detection of single electron events.25,26 Low dose beam radiation can also be used in addition to other techniques that allow a wide range of new information that can be attained from the specimen. Electron diffraction methods at low dose configurations are another alternative to obtain the crystallography of biological and sensitive samples. Another methodology is phase retrieval in electron holography at low doses as a systematic approach to reduce the electron beam current in the sample.27–29 Detection is a very important aspect in low dose radiation and illumination cannot be visualized with binoculars using low doses. According to Buban, et al.,30 catalysts are believed to cause damage at the order of 100 e− Å−2, biological samples with sugar embedded specimens require doses of <20 e− Å−2, and biological samples kept under liquid nitrogen require doses of <5 e− Å−2. Many of these advances enabled progress in the methods used for increasing the high-resolution imaging methods using low dose configurations. For STEM, using a probe-corrected microscope, the diameter of the electron beam (∼1.0 Å) can resolve individual columns, but the current density increases substantially and deteriorates sensitive materials, such as the protected ligands of the clusters. To measure the number of electrons interacting with the specimen, one needs to use a Faraday cup to collect the electric current produced by the electron beam, which is an accurate device used to measure the electric current in the specimen region. Fig. 5a shows the experimental set up of the Faraday cup attached to a JEOL 2010F microscope and Fig. 5b shows an image of the electron beam collected at a magnification of 800 K using a complementary metal oxide semiconductor (CMOS) camera (TVIPS). When the Faraday cup is employed the number of electrons per area can be directly estimated. However, if the current density is measured on the screen the magnification must be considered, for example pA cm−2 (1 A = 1 C s−1 = 6.24 × 1018 electrons per s). Fig. 5b was collected using the minimum illumination possible by forcing the condenser lens voltage up to 8.06 V, the diameter of the region of illumination is shown in the intensity profile shown in Fig. 5c.
In the microscope used, the current registered using the ammeter was 35 pA (diameter of the beam ∼ 55 nm), which corresponds to 920 electrons per Å2 per second. When the number of electrons is measured using the screen plate of the microscope (2.2 pA cm−2 at a magnification of 800 K times, 880 electrons per Å2 are registered), the number of electrons is about 40 electrons per Å2 less than the value obtained using the Faraday cup. The conversion used for the calculation is:31
2.2 pA cm−2 × 6241500 e− pA−1 × 1 s per frame × 1 × 10−16 cm2 Å−2 × 8000002 = 878 e− Å−2 s−1 |
If the same current density is shown on the screen, but the diameter is reduced to 2.5 nm, the number of electrons is about two orders of magnitude higher (∼4.4 × 105 electrons per Å2 per s). The current density can also be modified using different apertures of the condenser lens.
Using STEM, the current density increases exponentially. Current densities measured using a JEOL ARM200F with a probe corrector are shown in Fig. 6a. The electric current values were obtained using the same Faraday cup as previously described. The aperture of the condenser lens used was set to 20 μm and the extraction voltage A2 was held constant. The curve shown in Fig. 6a was obtained by reducing the extraction voltage A1. The images shown in Fig. 6a–e were recorded using a high angle annular dark field detector (HAADF) in the STEM mode using standard emission in the microscope (A1 = 3.14 kV, A2 = 7.05 kV and a current measured of 4.9 pA). The HAADF-STEM images correspond to gold clusters of approximately 3.8 nm (Fig. 6b) and approximately 1.6 nm (Fig. 6d), both ligand-protected. When the field of view is reduced to approximately 9 × 9 nm, the bigger cluster is more stable to the electron dose (Fig. 6c), while the smaller cluster deteriorates (Fig. 6e). Using the currents measured for standard emission and a probe size of around 1 Å, the electron dose is approximately 4 × 107 electrons per Å2. The electron dose measured from the curve in Fig. 6a is approximately 7 × 106 electrons per Å2. In the measurements performed using the TEM mode, we considered the electron dose frame per second (fps) or fractions of seconds (usually 0.5 fps), which is relatively low speed compared with ultra-fast acquisition.32 In the STEM mode, the parameter that is used to control the electron dose is the dwell time, which is the time in which the electron beam is retained per pixel. In the STEM mode, there is a compromise between the dwell time and electron dose used to study a few atoms in a cluster with atomic resolution. When the knock on is significant the surface of the nanoparticle looks irregular and some atoms are dispersed outside the clusters, as shown in Fig. 6e. The damage produced by the emission of the Auger electrons can be significant. The Auger effect is produced by the filling of inner atomic shell vacancies by an electron in higher energy levels. The excess of energy is transfer to an outer shell electron, which is then emitted out of the atoms. The energy of the Auger electron can be released on the cluster or nanoparticle in the form of heat, this effect was analyzed by Williams33 to explain the shape fluctuations on the nanoparticles. Let us consider an Auger ionization event in a gold cluster. Every event produces 2 keV with a range of approximately 1.5 nm, which deposits approximately 0.3–0.4 eV per atom. For instance, if the electron dose is 104 electrons per Å2 per second in the Au144 cluster, 72 Auger events per second are generated. This will deliver 22.5 eV in the cluster every second. The clusters are placed on a carbon grid for observation in the TEM. As the ligand is an insulator there will be an increase in temperature on the cluster inducing radiation damage. For bigger nanoparticles, without the presence of ligands, part of the heat will be released to the substrate and the effect will be negligible.
The semi-convergence angle is directly associated with the probe size, at large convergence angles the convergent beam electron diffraction (CBED) disks are formed. The D-STEM mode generates CBED patterns, which are adjusted to obtain diffraction patterns with spots instead of modifying the condenser lens excitation value and the excitation voltage of the adaptor lenses (ADL) of the hexapole of a corrected electron optical system (CEOS) corrector. In this process, the beam is aligned by the beam tilt and beam shift deflectors. Fig. 7a shows the model of the pentagonal nanoparticle used in Fig. 7b, collected using a large convergence angle (Fig. 7c) and after the separation and reduction of the disks, the reflections are obtained (see Fig. 7d). The decahedron was used for practical purposes to illustrate the change from the large to the low convergence angle without deterioration of the sample. The consequence of the compensation can be simulated in a pentagonal particle (Fig. 7a) oriented near the zone axis of the experimental particle. The conditions for the simulations are a semi-convergence angle of 3 mrad (Fig. 7e), which is reduced to 0.5 mrad for quasi-parallel illumination, as shown in Fig. 7f. Simulations were performed using the java electron microscopy software package.36 Under these illumination conditions, the electron beam is not precisely a convergent beam, but a quasi-parallel illumination, in which the electron path is forced to a localized area in the nanometric scale with a parallel illumination at the same time.
For protected metallic clusters the electron beam irradiation is more critical owing to the high sensitivity of the ligands. To avoid damage, faster dwell times are employed before collection of the diffraction patterns. Fig. 8 shows a set of images to elucidate the structure of the cluster Au144SR(60). Fig. 8a shows a probe-corrected HAADF-STEM image and Fig. 8b shows the fast Fourier transform (FFT). Fig. 8c shows a simulated image of the metallic cluster (using simulaTEM37) and its diffraction pattern (Fig. 8d). Fig. 8e shows the HAADF-STEM image after adjustments for D-STEM, as shown in Fig. 8f. The position of the beam from which the diffraction pattern is obtained is indicated in Fig. 8e. The diffraction pattern was collected under quasi-parallel illumination. The analysis of the diffraction patterns and atomic resolution images provides structural characterization of the individual metallic clusters. A novel perspective on the diffraction methods used under the STEM mode has been recently demonstrated using cryo-electron ptychography,28 which has been employed for sensitive materials for low-dose phase retrieval. Ptychography is an interesting method, in which electron microscopy is explored either in the real space or reciprocal space. In real space, ptychography is analogous to off-axis electron holography, one of the complementary methods used for phase retrieval and applied to sensitive specimens.27,29,38
Fig. 8 An Au144SR(60) cluster recorded using (a) a HAADF-STEM image23 (FFT image shown in (b)) and (c) a simulated image (with the simulated diffraction pattern shown in (d)), and (e) the HAADF-STEM image adjusted via (f) D-STEM. |
Unlike the two alternative diffraction methods, electron and neutron diffraction, the analyses of electron diffraction are carried out in isolated clusters or nanoparticles, which makes the challenge more important given the high intensity of the electrons and the dynamic scattering, as previously explained. Similar to the two alternate techniques, data collection must be acquired in a few seconds or a fraction of a second. Even when the development of electron detectors is one step behind with respect to X-rays it is clear to see the complexity of identifying a single cluster owing to the multiple variables and the problem becomes analogous to the many body problem, not because we need to detect individual electrons that have deviated from the specimen, but the information from the wavefunction to the exit of the sample and the use of probabilistic methods is prevalent.
A systematic indexing and crystal orientation mapping applied to TEM has been developed41,44 and combined with precession electron diffraction. This technique has become a useful tool to obtain crystal orientations and phase maps in relative short times.45 The principle consists of forming a small probe to be scanned through the area of interest on the sample, obtaining and recording an electron diffraction pattern at each step of the scanned area with an ultrafast (200 fps) external CCD camera. Every acquired electron diffraction pattern is stored in a computer to be later compared to pre-calculated templates; the diffraction pattern is indexed using cross-correlation to select the best match. The indexing result of the whole set of diffraction patterns can then be displayed as a phase or an orientation map of the scanned area.46 When using precession, the effective focused beam size on the specimen will suffer from beam broadening owing to spherical aberration for the non-axial trajectories, and this will be more noticeable when increasing the precession angle. At the end, the spatial resolution of the orientation/phase map will depend on the effective beam size and on the scanning step chosen. On the other hand, the angular resolution obtained in the orientation maps will depend on the angular grid used for the generation of the templates. As the spot diffraction patterns are not sensitive to crystal tilts of less than 1°, values are usually given between 0.5° and 1°. Though there is the possibility of selecting a smaller sample value by increasing the number of generated templates so that between a given template and the closest one there is 0.2–0.5°.44 To avoid duplicities in the orientation assignation it is necessary to use precession angles lower than 1°. This must be taken into consideration when choosing the precession angle for phase or orientation mapping. Hence, the crystal orientation and phase mapping consist of two main steps: the fast acquisitions of spot patterns and the reliable orientation identification. This brings the necessity of additional hardware equipment that must be used with the microscope and software to carry out the analysis. The degree of matching between an experimental diffraction pattern and a calculated one is given by the following equation:44
In which, the pattern is represented by the intensity function P(x,y) while every template i is given by the function Ti(x,y). The highest Q value corresponds to the solution. In this way, the quality of the pattern matching can be evaluated by the assigned pixel values of the index maps. Additionally, a reliability index value is determined between the two highest optimum solutions Q1 and Q2 of the matching: R = 100(1 − Q2/Q1). A reliability index value will be low when more than one orientation or phase is contained in a diffraction spot pattern. This value is assigned to each pixel corresponding to an indexed diffraction pattern, in this way a reliability map can be generated. A lower value will correspond to a darker pixel and a higher value will correspond to a brighter pixel. The range will depend on the maximum reliability value calculated. To reconstruct a bright field image of the object, the average intensity is calculated in a disc that surrounds the transmitted beam from the recorded diffraction pattern (Fig. 10). The inner part of the transmitted beam saturates, leaving the contrast information in the outer part. Therefore, the virtual aperture needs to be larger than the transmitted beam. In this virtual bright field STEM mode, it is the beam diameter that delimits the virtual bright field image resolution.46 In a similar way, the virtual aperture may be displaced on one of the spots of the diffraction pattern and form a virtual dark field image.
Fig. 10 A schematic representation of the virtual bright field reconstruction. A virtual aperture is used to select only the transmitted beam and this is then plotted on the image. This is equivalent to introducing an aperture in the beam path (adapted with permission from ref. 47). |
An example of the crystal orientation mapping is shown in Fig. 11 in which the gold pentagonal nanoparticle is orientated along the observation axis z (zone axis). The orientation map with respect to z is colored in green, showing an orientation of [110] for the whole nanoparticle. The index map shows dark areas along the twin boundaries of the particle owing to the double spot feature in the diffraction pattern. This is also observed in the reliability map along the twin boundaries of the nanoparticle. In Fig. 11e–g, the orientation maps have been combined with the index map, and this feature allows the twin boundaries to be distinguished. Crystal orientation maps, with respect to x and y, show a degree of rotation between each tetrahedron, two pairs of them have a similar orientation. The PED pattern acquisition conditions were as follows: NBD mode with a 0.8 nm spot size, 20 μm aperture, precession angle of 0.5° at 50 Hz, and scanning with a step size of 1 nm.
Structural defects such as grain boundaries, dislocations and twins can be visualized by using correlation coefficient mapping, which consists of computing the differences between neighboring diffraction patterns in the scanned area of the scanning electron diffraction patterns.48 A set of particles has been used to highlight the presence of twin boundaries. In Fig. 12 the crystal orientation map of regular polyhedral particles is shown, as well as its virtual bright field image (Fig. 12b). The corresponding correlation contour maps clearly exhibit the inner contrasts that correspond to the multiple twin boundaries contained within the nanoparticles. In contrast, for non-twinned particles contours appear only at the edges of the particle and there is no contrast in the center of the nanoparticles marked with arrows in Fig. 12c. This evidence has been used to eliminate the possibility of twins in the [110] direction, cutting the particle into two. To reconstruct a virtual bright-field image from the diffraction patterns, a virtual aperture is placed over the transmitted beam of the recorded diffraction patterns. Then, the average intensity is calculated leaving out the contrast information from the diffraction spots. In this sense the image formed is a STEM type bright-field image of the object.
Fig. 12 (a) Crystal orientation mapping of a set of particles observed along the z-axis; (b) a virtual bright field image; (c) a correlation map showing twin planes, where the particles indicated by arrows do not show twins; and (d) the color key for the cubic crystal orientation map.49 |
We present two examples of gold nanoparticles: a rectangular particle obtained by thermal evaporation (Fig. 13A)51 and a pentagonal shape (Fig. 13B) with multiple facets in the surface.52 The streaks on the diffraction patterns are directly related to the crystallography of the facets.53 The probe diameter used for the rectangular particle was set to 40 nm. The pentagonal is very large and in order to obtain a complete diffraction pattern a probe size of 660 nm was used. This gives an example of the electron diffraction used to identify surface faceting in nanoparticles. In both cases the nanoprobe illumination with a quasi-parallel illumination produces the coherent diffraction patterns of each particle.
Fig. 13 (A) A TEM image of a rectangular evaporated gold nanoparticle.51 (A′) A coherent electron diffraction pattern using a 40 nm beam probe to cover the particle and produce streaks in the reflections (B) A scanning electron micrograph with its respective EDS mapping for (Ag) silver and (Au) gold, and crystal orientation mapping in the three axes, x, y, z, of the pentagonal Au@Ag particle. (B′) A coherent electron diffraction pattern using a 660 nm beam probe to cover the particle and produce streaks in the reflections; the TEM micrograph is shown in the inset. |
The distances of the first nearest neighbors are not affected by the size of the particle; only by an increase in the number of peaks for bigger particles. The number of neighbors is directly related to the coordination numbers of the particle. The experimental set up was a combination of the precession unit manufactured by Nanomegas and the low temperature using a cold stage. The precession was operated at 100 Hz and a precession angle of 2°. The azimuthal intensity profile was extracted using DiffTools V5 (ref. 60) in a digital micrograph. The pair distribution function of the sample is shown in Fig. 14d (no precession) and Fig. 14e (precession activated) and these were extracted using the SUePDF program.61 The ePDFs are compared with the theoretical PDF and it is noticeable that an improvement in the precession ePDF is observed at the second nearest neighbor and the last two peaks in the g(r). The example shown in Fig. 14 demonstrates the effectiveness of ePDF on the metallic nanoparticles, but so far, the internal structure that could be affected by structural defects is not measured and we cannot quantify how accurate the measurement is.
The next step is quantitative comparison with different types of particles, regular fcc and multiply twinned domains. We have considered three different cases, which were identified in the HRTEM images: the icosahedron (Ih) (Fig. 15a), truncated octahedron (TOh) (Fig. 15b) and decahedron (Dh) (Fig. 15c). The models of these structures have been simulated using a python-based code,62 and jmol software was used for visualization.63 Cluster structure models were built for the case of clusters with Ih symmetry with 2869 atoms, clusters with a truncated fcc symmetry with the shape of an octahedron (TOh) with 2899 atoms, and clusters with decagonal symmetry (Dh) with 2869 atoms. For the truncated octahedron model using the Wulff construction, the surface potentials were used, as detailed in a previous publication.64 In this analysis, the subtraction of the amorphous carbon film (free of nanoparticles) was applied by collecting electron diffraction patterns of a set of particles and the carbon film (∼10 nm). Both diffraction patterns, carbon film and nanoparticles, were captured under the same illumination conditions (area of diffraction, camera length, precession, and electron dose). The fitting between experimental and simulated PDF functions was performed using DiffPy-CMI, a python-based program.65Fig. 15a′–c′ shows the ePDF fit analysis using these three structures and the differences. The fitting provides a percentage error between the models and experimental ePDFs that is measured by the least-square residuum Rw (residual error),66 which were measured as Ih, Rw ∼ 36%, TOh, Rw ∼ 24%, and Dh, Rw ∼ 22%.
Fig. 15 HRTEM images of the identified NPs: (a) Ih, (b) TOh, and (c) Dh and the corresponding structural models used. PDF fit analysis in comparison with different structural models: (a′) Ih, Rw ∼ 36%, (b′) TOh, Rw ∼ 24%, and (c′) Dh, Rw ∼ 22% (adapted from ref. 56 with permission). |
The high Q region may contain information that is dominated by noise. The truncation of the experimental data produces ripples, especially around strong peaks; these unphysical peaks can be easily misinterpreted as extra structural features. The fit range and Qmax used in all the diffraction patterns were 2–15 (Å), and 20 (Å−1), respectively. Cryogenic conditions (liquid N2) resulted in an intensity profile that contains more signals at a higher Q. Resolution damping (Qdamp) and the atomic displacement parameter are two quantities that improved from the precession being off to the precession being turned on.56 The results obtained herein using the improved PED are comparable with the results obtained using high energy X-ray sources.67 An article published by Banerjee et al. demonstrated the evaluation of X-ray PDF data applied to metallic nanoparticles by using the cluster-mining approach.68 In this approach, the residual error is adjusted through a cluster-screen map with the structure models of the nanoparticles and their maximum number of atoms, which results in a generalized methodology to determine the structures rather than the individual fitting of experimental data and the possible structural motifs. This approach can be implemented for low electron dose illumination and liquid nitrogen temperature conditions to obtain the ePDF and applied to ligand-protected metallic clusters, in which singularity in the properties is directly related to the crystalline structure.
In order to process the large data set of electron diffraction patterns, algorithm-powered, human-guided data exploration and characterization creates a powerful symbiosis between researchers and their tools. The breadth of data collected simultaneously in the latest generation of STEM is useful for exploring nanoparticles and their intrinsic subtleties presents opportunities for advancing synthesis and model development. Enabling these advances is the ability to explore high spatial, temporal, and energetic domains. This includes imaging, diffraction, and spectroscopy in the exploration, development, and integration of these tools with multimodal data analytics and the statistics associated with many machine and deep learning approaches. Natively, this includes compressive, regressive, and classification routines that enable researchers to go beyond data collection and burdensome post data analysis into near-autonomous automation and materials-informed process control.
Arguably, the most useful information gained using STEM is identifying the structure of the underlying materials, including specific atomic arrangements and relationships, derived from high-resolution imaging, spectroscopy, and diffraction-based techniques. Beyond single imaging, spectroscopy, or advanced diffraction methods, precession-based electron diffraction, compressive imaging, and multidimensional imaging, for example, four-dimensional microscopy, have emerged to extend the capability for combined analytical work.70–77 These same methods have led to the expressed urgency for translating crystallographic information and deviations from massive datasets in support of basic and applied materials challenges. With a propensity to generate large datasets addressing data proliferation amongst all these platforms, it is paramount to guide the synthesis, and underlying strategies for harvesting highly functionalized nanoparticles are critical. The breadth of simultaneously collected data in the latest generation of scanning transmission electron microscopes presents numerous opportunities for expanding the collective efficiency, and the analysis of nanostructured, and confined material systems.78–80 The native resolution of many modern microscopes varies within each microscope from approximately 0.50 to over 2 angstroms. Recent advances leveraging deep learning have made it possible to analyze human-intractable diffraction datasets and perform complex imaging tasks, including segmentation and classification.81 This includes various material systems ranging from conventional metals and oxides to resolving the chemical evolution at complex interfaces and junctions.82 However, deep learning and augmented analysis for decoupling nanoscale effects have not yet disrupted the performance of classifying and segmenting data from either highly temporally or spatially resolved datasets obtained upon the advent of four-dimensional microscopy. In practical terms, four-dimensional microscopy is not limited by the native resolution of the microscope, but rather the ability to relay and process information in the context of materials science. Researchers have addressed multimodal microscopy from diffraction-focused techniques based on separating the elastic and inelastic portions associated with fundamental scattering. In Fig. 17, each pixel represents a single electron diffraction pattern, containing both central elastic and inelastic portions, in which reflections are located at the (x,y) position of the reciprocal space and each pattern is collected at another (x′,y′) position in the region of the analysis, as shown in the diffraction patterns shown in Fig. 17.
Fig. 18 represents a smaller multidimensional diffraction dataset, in which the model developed by Aguiar et al. is used to convert each pattern into a crystal family prediction at each pixel. The strength associated with each prediction is reported without a priori or ab initio-based knowledge.83,84 By processing each pattern, the probability and prominence between crystal families reflects the underlying structural changes at each hyper pixel, between the presence of a nanoparticle and the underlying grid. Isolating areas prominently containing the particle and the grid, Fig. 18b and c reflect the underlying predicted space group distribution for cubic and trigonal, in which each of these are the primary components in the hyper pixelated diffraction dataset.
It should be further noted that based on the predictive crystal model from the electron diffraction patterns alone can be extended to larger datasets, including for example in Fig. 19a, in which identifying the underlying family, point, and space group distribution is required at this scale. It should be noted that each sub-pixelated electron diffraction pattern exemplified in Fig. 19b is classified for 3 to 6 peak combinations, forming a distribution and multiple predictions per point. With an expressed need to quickly evaluate the data, the model translates each pattern in Fig. 19c into a prediction for the crystal family, point group, and space group. This follows the ability to translate data as shown in Fig. 19d over specific pixels, rows, or columns, as configured by the user. The data reported here are only simple examples of the many potential avenues for which the model has been applied and now provides a larger community with a predictive and scalable tool for translating raw structural data from either high-resolution atomic-scale images or diffraction into predictive structural phase information, not limited by specific models or prior expertise.
Leveraging the advances to develop a computer vision and artificial intelligence engine for translating crystallographic and structural data now presents the opportunity for automation and augmentation of synthesis and control over nanostructured and nanoscale materials. Deep-learning models such as the one reported, have now been developed to circumvent classification, segmentation, and compression challenges. A limited number of these machine or deep-learning models have been proposed and have demonstrated sub-image sampling in image segmentation and inpainting over the fast to slow temporal regimes, allowing adaptive event tracking and augmentation over current microscope imaging, diffraction, and spectroscopic feeds. The main application being in situ microscopy, in which studying processes such as self-assembly, molecular organization, and catalysis, can be improved by the development of improved physics-based models by eliminating superfluous assumptions. Our temporal understanding associated with these processes is limited to a holistic understanding that is tied to the underlying fundamentals, including the effects of temperature, solution supersaturation, interfacial kinetics, and activation potential. The barrier to independent crystallographic structural determination has mainly been addressed. Now, the challenge is in translating the body of materials knowledge from the current databases into advanced and adaptive physics-informed workflows that are not limited to high-resolution electron microscopes and diffractometers used to study the nanoscale phenomenon.
This journal is © The Royal Society of Chemistry 2021 |