Yuto
Yotsumoto
,
Yusaku
Nakajima
,
Ryusei
Takamoto
,
Yasuo
Takeichi
and
Kanta
Ono
*
Department of Applied Physics, Osaka University, Osaka, Japan. E-mail: yuto_yotsumoto@ap.eng.osaka-u.ac.jp; ono@ap.eng.osaka-u.ac.jp
First published on 14th October 2024
The automation of materials research is essential for accelerating scientific discovery. Powder X-ray diffraction (PXRD) plays a crucial role in analyzing crystal structures and quantifying phase compositions in materials science. However, current methods face challenges in reproducibility and efficiency. To address these issues, we developed an autonomous robotic experimentation (ARE) system for PXRD that integrates the entire process from sample preparation to data analysis. This system combines a robotic arm for precise sample preparation with machine learning-based techniques for automated data analysis. Our approach consistently produced high-quality samples with reduced background noise, achieving accuracy comparable to manual preparation techniques. We also investigated the relationship between sample quantity and analysis accuracy, demonstrating the system's ability to obtain reliable results with significantly reduced sample amounts. This work advances laboratory automation capabilities and contributes to the development of autonomous materials discovery and optimization processes. By addressing key challenges in PXRD automation, our research enables more efficient and reproducible materials characterization methodologies.
High-throughput experimental studies involving the creation of large sample libraries and their rapid characterization using automated or parallelized techniques have become increasingly important in material discovery and optimization.29–31
To address these challenges and advance materials science, we have developed an autonomous robotic experimentation (ARE) system for PXRD that integrates all processes of the PXRD experiments. The ARE system combines a robotic arm for precise powder sample preparation with machine learning techniques for automated XRD data analysis, enabling a highly automated workflow from sample handling to result interpretation. This system achieves high-precision measurements and analysis using significantly smaller sample quantities and implements automation without requiring extensive modifications to existing PXRD equipment. As a result, the ARE system facilitates easier adoption in research laboratories. It enhances the consistency of sample preparation processes and contributes to improved reproducibility of measurement results. These features enable efficient high-throughput materials research. Furthermore, by combining this system with robot-assisted material synthesis and materials informatics-based design, a powerful data-driven approach to accelerate material discovery and optimization becomes possible.
In summary, our contributions are as follows:
(1) We developed an autonomous experimentation system for PXRD that integrates the entire workflow from sample preparation to data analysis; compared to manual methods, our system achieved high precision and reliability in sample preparation.
(2) We demonstrated the ability of precise robotic sample preparation to obtain low-background patterns, especially at low angles.
(3) We investigated the effect of the sample quantity on the accuracy and consistency of quantitative analysis using our autonomous system; thus, reliable results could be obtained with significantly reduced sample amounts than those used in manual preparation methods.
(4) We validated the autonomous system with different mixture ratios and showed its accuracy in quantifying phase compositions.
The remainder of this paper is organized as follows. In Section 2, the development of an autonomous PXRD system that incorporates a robotic arm for sample handling and preparation is presented. In Section 3, a detailed description of the experimental workflow of PXRD is provided, and the key steps involved in the process are outlined. In Section 4, the automation of quantitative XRD data analysis is discussed. In Section 5, the results obtained from the autonomous PXRD system are shown, and a detailed discussion of the implications of these findings for material characterization and discovery is provided. The section also addresses the system's current limitations and future prospects. Finally, in Section 6, the paper is concluded, and future research directions are proposed.
The main components of the ARE system are as follows:
(1) The 6-axis robotic arm (DENSO, COBOTTA) with a multifunctional end effector for sample preparation and handling (Fig. 2a).
(2) A detachable protective cover made of paper, used to protect the soft gel attachment on the robotic arm's end effector from contamination. The robotic arm's automated movements enable the cover to be attached before sample preparation and detached after use. This ensures a clean environment for each sample without human intervention.
(3) An XRD instrument (Rigaku, MiniFlex 600-C) is equipped with a single-axis actuator to control the door. The single-axis actuator enables the automatic opening and closing of the doors of the XRD instrument.
(4) A sample holder featuring a frosted glass surface and embedded magnets (Fig. 2b). This design supports the powder sample, facilitates automated handling, and contributes to high-quality XRD measurements.
(5) A drawer-based sample hotel serves as a storage unit for multiple sample holders and has 20 tiers to accommodate up to 40 samples in total.
(6) A sample preparation station is used for processing powder samples into an optimized form for XRD analysis; this features an integrated pull-out funnel for precise centering of the powder within the holder.
The end effector of the robotic arm is a key component of our system and shown in detail in Fig. 2a. The end effector was fabricated using a 3D printer (Formlabs, Form 3+), which enabled the precise customization of its design. As illustrated, the end effector integrates three attachments: a claw for drawer manipulation, a metal plate for magnetic coupling with the sample holder, and a soft gel for surface flattening. This design allows for sample preparation, loading, and unloading, as well as the opening and closing of drawers, without changing attachments. The end effector includes a soft gel for sample surface flattening, protected by a cover that is automatically attached before and detached after sample preparation by the robotic arm's movements, preventing cross-contamination between samples. Due to this integrated design, the efficiency and autonomy of the system is improved. The use of soft gel attachment on the end effector for sample preparation is likely a key factor to attain low-background patterns. The gel enables the gentle and uniform pressing of the powder sample; this results in a smooth and even surface that minimizes the background noise.
To further optimize the automation process, a single-axis actuator is incorporated to control the doors of the XRD instrument. This eliminates the need for the robotic arm to perform the door opening and closing tasks, simplifies the overall workflow and reduces the risk of interference between the arm and the instrument.
Fig. 2b shows our sample holder, which is an essential component of the system. The sample holder's central area is made of frosted glass, which serves two purposes: (1) supports the powder sample and prevents the sample from falling, and (2) aids in the reduction of the background noise in the XRD measurements. The frosted surface effectively balances the sample retention with minimal contribution to background intensity; this aspect is particularly useful for the accurate analysis in the low-angle regions. The outer frame of the sample holder contains embedded magnets for secure attachment to the metal plate of the end effector during transfer and manipulation. This design enables the stable and precise sample handling throughout the automated process, from preparation to measurement, and preserves the sample integrity and XRD data quality.
By integrating these components, the ARE system automates much of the XRD sample preparation and measurement process. This automation aims to reduce human errors, enhance consistency in sample preparation, and potentially increase sample throughput.
Due to its modular design, the autonomous PXRD system can be readily adapted to other analytical methods and sample synthesis processes. The robotic arm, sample hotel, and other components of the system, such as the sample preparation station and the control software, can be easily integrated with other characterization techniques. For example, the sample preparation station can be modified to accommodate specific requirements for techniques such as Raman spectroscopy, while the control software can be adapted to coordinate the operation of multiple instruments; thus, multimodal analysis of the samples is possible. Furthermore, the automated workflow can be extended to include additional sample synthesis steps, such as weighing and mixing of the precursor materials; this creates a fully autonomous material discovery pipeline. Due to its flexibility and adaptability, the autonomous PXRD system is a valuable tool for accelerating material research and discovery across a wide range of applications.
Step 1: the researcher sends a command to the control PC specifying the sample information and measurement parameters.
Step 2: the control PC processes the command and sends instructions to the robotic arm and the XRD instrument.
Step 3: the robotic arm (Universal Robots, UR5e) mixes and grinds the powder sample to ensure homogeneity, as described in our previous work32,33 (Fig. 3a).
Step 4: the robotic arm retrieves the specified sample holder from the sample hotel and transfers it to the sample preparation station (Fig. 3b).
Step 5: the ground powder is filled into the sample holder placed at the sample preparation station. While the robotic arm is technically capable of performing this step autonomously, in this study, it was done manually to measure the precise amount of powder used (Fig. 3c).
Step 6: the robotic arm uses soft gel attached to the end effector to gently flatten the surface of the powder sample (Fig. 3d).
Step 7: the XRD instrument automatically opens its door using a single-axis actuator, and the robotic arm loads the prepared sample into the instrument (Fig. 3e).
Step 8: the XRD instrument closes its door, and the measurement software is automatically controlled to start the measurement according to the specified parameters.
Step 9: after the measurement is complete, the XRD instrument sends the raw data (XRD pattern) to a workstation, and the robotic arm retrieves the sample from the XRD instrument and returns it to the sample hotel (Fig. 3f).
Step 10: the workstation automatically analyzes the XRD pattern using an automated Rietveld analysis method; the pattern is converted into weight fractions of its constituent phases.
Step 11: the analyzed results are sent back to the researcher, and the automated PXRD experiment is complete.
The automation of the XRD measurement software is achieved using PyAutoGUI, a Python library that controls mouse and keyboard inputs. This approach allows for the operation of proprietary software without direct API access, enabling the seamless integration of the XRD instrument into the autonomous workflow.
To address these challenges, we previously developed an automated Rietveld refinement method called Blackbox Optimization Rietveld (BBO-Rietveld).34 BBO-Rietveld treats parameter optimization in Rietveld refinement as a blackbox optimization problem, utilizing Bayesian optimization, specifically the Tree-structured Parzen Estimator (TPE) algorithm, to efficiently explore the high-dimensional parameter space. Conventional Rietveld refinement requires optimizing multiple parameters while considering their interactions and physical constraints, a process that heavily relies on the judgment of experienced experts. This process is not merely random parameter optimization but rather an exploration of physically meaningful structural models. In contrast, BBO-Rietveld adopts an approach focused on minimizing the weighted profile R-factor (Rwp), achieving efficient exploration without relying on expert heuristics. This method can obtain highly reproducible results that do not depend on the operator's experience. Furthermore, by systematically exploring a wide parameter space, it has the potential to discover optimal solutions that might have been overlooked by conventional methods. However, BBO-Rietveld also has its challenges. The most critical point is that, being an essentially statistical approach, it may propose solutions that are physically or chemically meaningless. For example, models with unrealistically short interatomic distances or structurally impossible configurations might be proposed as solutions if they result in a low Rwp. Therefore, experts need to carefully evaluate the physical validity of the obtained results.
Furthermore, the BBO-Rietveld method can address the issue of preferred orientation, which is a common problem in Bragg–Brentano geometry. By including orientation parameters in the optimization process, it can automatically adjust for the effects of preferred orientation that may occur in compressed samples. However, in cases of severe preferred orientation, expert interpretation of the results and additional sample preparation techniques may be necessary.
BBO-Rietveld integrates the Python-based Rietveld refinement software GSAS-II35 with the hyperparameter optimization framework Optuna.36 We have incorporated this system into our autonomous PXRD setup, enabling automated data analysis and enhancing the efficiency of crystal structure determination. Moreover, BBO-Rietveld's computational efficiency can be further improved through parallelization; in our previous work, we demonstrated the ability to complete 200 refinement trials within one hour on a standard workstation.34
When using the BBO-Rietveld method, it is necessary to input crystal structure information of potential substances in the sample beforehand. Typically, this information is obtained from crystallographic databases and used as initial structural models. The selection of initial structural models is a critical step that requires careful consideration by experts based on the sample's chemical composition and expected phases. Looking ahead, we aim to develop systems that can automatically generate initial structural models and apply to a wider range of unknown materials by integrating methods such as deep learning. For example, combining recently proposed deep neural networks like CrystalNet37 with BBO-Rietveld could lead to the construction of a more comprehensive automated analysis pipeline. However, these methods are still in their early stages and require further validation for application to complex real-world systems.
The automation of measurement data analysis using BBO-Rietveld has the potential to enhance the efficiency of materials science research. This method can reduce human bias and variability, thereby improving the reproducibility and consistency of analyses. However, while BBO-Rietveld is effective for analyzing substances with known crystal structures, it faces limitations when dealing with unknown structures or complex multiphase systems. For novel materials or intricate systems, expert verification and interpretation of results remain indispensable. Deep knowledge of crystallography and materials science continues to be crucial for selecting initial structural models, evaluating the physical validity of obtained results, and interpreting the final structural models. Moreover, PXRD data often presents a uniqueness problem, where different structural models may exhibit similarly good fits. To address this issue in complex samples, complementary techniques such as spectroscopy, neutron diffraction, or simulations may be necessary.
Therefore, automated systems including BBO-Rietveld should be positioned as tools to support expert judgment and improve the efficiency of routine analyses for known materials, rather than as replacements for human expertise in crystallography and materials science. These systems aim to assist experts in focusing on more complex and creative problem-solving tasks.
The first experiment, described in Section 5.1, focused on assessing the precision of the robotic arm in sample preparation and its impact on the accuracy of quantitative XRD analysis. The goal was to determine whether the automated system could achieve results comparable to or better than those of the manual sample preparation methods in terms of reproducibility, consistency, and reliability.
The second experiment, detailed in Section 5.2, investigated the effect of the sample quantity on the accuracy and precision of the quantitative XRD analysis. By preparing samples with varying amounts of material using the robotic arm, we aimed to identify the minimum sample quantity needed to obtain reliable anatase content results with a target standard deviation (SD) of less than 1% for the replicate measurements.
Finally, the third experiment, presented in Section 5.3, validated the autonomous system's performance using samples with different mixture ratios of anatase and rutile TiO2. The purpose of this experiment was to demonstrate the system's accuracy in quantifying the phase compositions across a range of sample compositions; this aspect is essential for high-throughput material discovery and optimization.
Through these three experiments, we aimed to comprehensively evaluate the capabilities, limitations, and potential of the autonomous PXRD system for advancing material research and accelerating the discovery of new materials with desirable properties.
We used a robotic arm to prepare samples containing precise quantities of titanium dioxide (TiO2) in its anatase and rutile phases. Fig. 4 shows the samples prepared by manual operation and the robotic arm. The anatase reagent (Kojundo Chemical Laboratory, 99% purity) did not contain any detectable rutile impurities; however, the rutile reagent (Kojundo Chemical Laboratory, 99.99% purity, 2 μm particle size, >90% reutilization rate) contained approximately 2.8% anatase as an impurity. To determine the impurity levels, samples containing only the individual reagents were prepared and analyzed using the BBO-Rietveld method prior to the main experiment. Equal amounts of the two reagents were mixed; this resulted in samples with anatase and rutile weight fractions of approximately 51.4% and 48.6%, respectively. Each sample prepared by the robotic arm weighed 80.0 mg, while samples prepared by human operators weighed approximately 300 mg. To ensure consistency, the robotic arm's repeatability was evaluated across multiple experiments. The resulting data were analyzed via the BBO-Rietveld method.
![]() | ||
Fig. 4 Photographs of the TiO2 samples prepared by manual operation and the robotic arm in different quantities. |
Fig. 5 shows a comparison of the XRD patterns and Rietveld refinement results for the samples prepared by the robotic arm and manual operation. The good agreement between the measured and calculated patterns, along with the small residuals, demonstrates the high quality of the samples prepared by both methods. The robotic arm-prepared samples show low background intensity at low angles, addressing a common challenge in automated sample preparation methods. This achievement can be attributed to the robotic arm's precise control in Step 6; this involves gently pressing the powder to create a smooth surface, effectively minimizing the unwanted background signals that often hinder accurate analysis in the low-angle region. The comparable background levels between the robotic arm-prepared samples and those prepared by skilled human operators confirm the effectiveness of the automated sample preparation technique in producing high-quality samples suitable for a wide range of materials, including those with important structural features at low angles.
![]() | ||
Fig. 5 Comparison of the XRD patterns and Rietveld refinement results for samples prepared by manual operation and the robotic arm (80 mg). |
Table 1 lists the average anatase content and standard deviation for samples prepared by two human operators and the robotic arm. The results demonstrate the variability in the sample preparation between different human operators, as indicated by the differences in the average anatase content and standard deviation. Although the standard deviation of the robotic arm is slightly larger than that of the human operators, it is still sufficiently low; these results indicate that the automated sample preparation can achieve a level of consistency comparable to that of human operators. Thus, automated sample preparation has the potential to reduce human-induced variability.
Method | Average anatase content (%) | SD (%) |
---|---|---|
Operator 1 | 52.4 | 0.4 |
Operator 2 | 52.2 | 0.1 |
Robotic arm | 51.6 | 0.7 |
The reliability and standardization potential of the robotic arm show the importance of integrating automated sample preparation with automated XRD measurements and data analysis for the future of material science research.
Fig. 6 shows the XRD patterns of the different quantities of the TiO2 samples (3 mg, 5 mg, 10 mg, 20 mg, 40 mg, and 80 mg) prepared by the robotic arm. Based on these patterns, although the peak intensities decrease as the sample quantity decreases, the overall shapes of the patterns are maintained, and the background intensities remain sufficiently low; these results show the consistency of the automated sample preparation method.
Fig. 7 shows the quantitative analysis results for the anatase content of the TiO2 samples. Each data point is the average anatase content from the five samples at each sample quantity, and the error bars represent the standard deviation. The results indicate that as the sample quantity decreases, increased variability is observed in the estimated anatase content between the samples, as shown by the larger error bars. A slight increase in the average anatase content from the expected 51.4% was observed as the sample quantity decreased, rising from 51.6% for 80 mg samples to 52.5% for 3 mg samples. The standard deviation also changed, ranging from 0.5% to 0.7% for samples between 80 mg and 20 mg, and increasing to about 0.9% for samples of 10 mg or less.
These changes can be attributed to two main factors. First, the decrease in diffraction intensity as the sample quantity decreases. Analysis of the average maximum intensity of the diffraction patterns shows a reduction from about 2900 counts for 80 mg samples to about 1700 counts for 3 mg samples. This approximately 40% decrease in intensity directly affects the statistical precision of the measurements. Second, the effect of sample inhomogeneity becomes more pronounced with smaller sample quantities, where local compositional variations can have a greater impact on the overall measurement results.
However, even at the minimum sample quantity of 3.0 mg, which is the lowest amount our system can prepare, the standard deviation of the anatase content was found to be 0.9%, indicating that quantitative results with the desired precision can be obtained. The systematic shift in the average values for smaller sample quantities warrants further investigation to determine whether it is due to the reduction in diffraction intensity, sample inhomogeneity, or other factors.
When proper sample preparation and analysis techniques are employed, reliable quantitative data can be obtained even with small sample quantities. This finding is significant considering that manual sample preparation typically involves using sample quantities of approximately 300 mg. Our system was able to automatically prepare the samples with sufficient accuracy and precision for the quantitative analysis using only 1% of the sample quantity traditionally used in manual preparation. By minimizing the sample quantity, the amount of material needed for synthesis can be reduced, potentially leading to shorter synthesis times and more efficient use of resources. As a result, high-throughput material characterization workflows can become more efficient, enabling the rapid analysis of a larger number of samples.
The optimization of the sample quantity, along with other key parameters, is essential for the development of efficient and reliable autonomous XRD systems for material discovery and optimization. Future research will focus on a more detailed investigation of the relationship between sample quantity and measurement precision, as well as optimization methods to obtain accurate results with small sample quantities. For example, extending measurement times to improve statistical precision or developing new sample preparation methods to enhance sample homogeneity could be considered.
Table 2 provides a summary of the quantitative analysis results for the anatase content in the TiO2 samples with different mixture ratios. The average anatase contents for the 9:
1 and 7
:
3 mixtures were found to be 89.8% and 70.9%, respectively. These values were in good agreement with the expected anatase content based on the prepared mixture ratios and demonstrated the accuracy of the autonomous system in quantifying the phase compositions. Moreover, the low standard deviations (1.1% for 9
:
1 and 0.7% for 7
:
3) of the anatase content for each mixture ratio highlight the high precision and reproducibility of the sample preparation and measurement processes performed by the autonomous system.
Mixture ratio (anatase![]() ![]() |
Average anatase content (%) | SD (%) |
---|---|---|
9![]() ![]() |
89.8 | 1.1 |
7![]() ![]() |
70.9 | 0.7 |
These results further validate the effectiveness of the autonomous PXRD system in accurately and precisely characterizing materials with different phase compositions, even when using small sample quantities. This capability is beneficial for high-throughput material discovery and optimization, where the ability to reliably analyze a large number of samples with varied compositions is essential.
To address these limitations and achieve full automation, future research could focus on enhancing the automation capabilities in sample preparation. Specifically, the introduction of robotic weighing systems or automated dispensers is expected to enable precise and consistent control of sample quantities. We are also considering expanding the system's functionality to include reagent pre-preparation, particularly the weighing process.
Recent advances in robotic manipulation, such as the development of solid dispensing techniques using dual-arm robotic systems,38 suggest the feasibility of automating complex tasks in materials research. Incorporating such technologies into our autonomous PXRD system may lead to more comprehensive automation of the materials research process.
Future research necessitates an examination of the system's applicability to a wider range of materials. This includes optimizing sample preparation protocols for materials with various physical properties. For instance, improvements in end-effector design or the development of new sample preparation techniques may be considered to accommodate materials with different characteristics, such as highly viscous materials or extremely light powders.
Additionally, evaluating the system's performance with multiphase systems and materials of complex composition presents an important challenge. Through these studies, we anticipate expanding the system's applicability and further enhancing the efficiency of high-throughput experiments in materials science.
However, fundamental ideas such as the air cylinder mechanism for door operation and the automation of GUI operations using the PyAutoGUI library are considered applicable to various instruments. Future developments may explore the design of more flexible and adaptable systems based on these universal elements.
Specifically, adopting a modularized design approach and developing interfaces that can easily adapt to different instrument models could be considered. Additionally, the development of systems that utilize machine learning techniques to automatically learn the characteristics of new devices and optimize operational parameters is proposed as a future research direction.
These improvements may lead to the wider adoption of our autonomous PXRD system in various research environments and industrial applications. By enhancing adaptability to different instruments, it may contribute to the standardization and efficiency of materials research workflows, potentially accelerating the overall material development process.
Our contributions include the following:
(1) We developed a system that integrates the entire workflow from sample preparation to data analysis, achieving high precision and reliability in sample preparation.
(2) We demonstrated the ability for the attainment of low-background patterns, particularly at low angles, which is essential for characterizing materials with important structural features in this region.
(3) We investigated the effect of the sample quantity on the accuracy and consistency of the quantitative analysis, minimized the amount of sample needed, and maintained reliable results. By reducing the needed sample quantity, our system enables high-throughput experimentation and more efficient use of resources.
(4) We validated the system with different mixture ratios and demonstrated its accuracy in quantifying the phase compositions; this is essential for high-throughput material discovery and optimization. The robustness of our system across different sample compositions highlights its adaptability and potential for application in a wide range of experiments and material systems.
While our system represents a significant advancement, it still has limitations. These include the need for manual sample loading and optimization for a specific XRD instrument model. Future work will focus on extending automation to include weighing and mixing of reagents, adapting the system to various PXRD instruments, and expanding its applicability to a wider range of materials. Additionally, we aim to enhance data analysis automation by integrating deep learning methods for initial model generation with our BBO-Rietveld refinement technique. By addressing these challenges, we aim to achieve a fully closed-loop material research process, potentially accelerating material discovery and optimization. However, expert oversight will remain crucial, especially for novel structures or complex materials. Our work lays the foundation for advanced autonomous systems in materials research, contributing to more efficient high-throughput experimentation in materials science.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4dd00190g |
This journal is © The Royal Society of Chemistry 2024 |