Lei
Han
*a,
Rui
Wang
a,
Yupeng
Dong
a,
Xun
Zhang
a,
Chenggen
Wu
a and
Xiaoguang
Zhao
b
aKey Laboratory of MEMS of the Ministry of Education, Southeast University, Nanjing, 210096, China. E-mail: hanlei@seu.edu.cn
bDepartment of Precision Instruments, Tsinghua University, Beijing, 100084, China
First published on 5th October 2022
Biomimetic properties allow soft robots to complexly interact with the environment. As the bridge between the robot and the operating object, the gripping hand is an important organ for its connection with the outside world, which requires the ability to provide feedback from the grasped object, similar to the human sensory and nervous system. In this work, to cope with the difficulty of integrating complex sensing and communication systems into flexible soft grippers, we propose a GO/PI composite bilayer film-based gripper with two types of tactile sensors and a LC passive wireless transmission module to obtain the grip information and transmit it to the processor. The bilayer film structure demonstrates good photothermal driving performance. Pressure and material sensors are located at the tips of the gripper's fingers to acquire tactile information which is wirelessly transmitted to the processor for analysis via the LC circuit. The grasping and feedback of the gripper are presented through an intelligent display system, realizing the wireless interconnection between the robot terminal and processing system, exhibiting broad application potential.
The structure design, preparation, and application of novel materials and grasping movements of the flexible gripper have been extensively studied. Few studies focus on multi-tactile sensing between the gripper and the operating object and there is also a lack of research on the transmission and interaction of tactile sensing information. Relevant tactile sensing research studies mostly concentrate on the direction of large and rigid bionic grippers.35 Due to the size of the large-scale bionic gripper, the driving method is generally electric drive, and the detection method is usually wired sensing measurement, which limits its application in confined spaces and harsh environments.
In this article, we propose an integration of an intelligent flexible gripper with two types of tactile sensors and a LC passive wireless circuit to obtain and transmit tactile information. The grasping movements of the proposed gripper are realized by a graphene oxide/polyimide (GO/PI) composite bilayer film. Due to the difference in thermal expansion coefficients of GO and PI, the bilayer film bends toward the GO side under infrared light (IR) irradiation to achieve grasping. The tactile sensors located at the fingertips can realize the accurate measurement of the grasping force and the precise identification of the target object materials. In addition, the gripper can also communicate with the processor to realize the intelligent integrated display of tactile sensor information.
A pair of sensors with interdigital capacitance is used to distinguish different materials, and the other pair of sensors is made of a sandwich structure to detect pressure, where the inter-dielectric layer is a three-dimensional porous structure GO foam with good dielectric properties. Two pairs of sensors are symmetrically distributed on the finger tips of the cruciform gripper, as shown in the inset of Fig. 1b. The description of the electrode structure and dimensions is provided in Note S4.†Fig. 1c shows the structure of the entire gripper system. Two parallel-connected sandwich-structured sensitive capacitors are connected in parallel with a planar spiral inductor on the PCB to form an LC circuit. When the gripper robot grasps objects, the distance between the upper and lower electrodes decreases due to the pressure, which makes the capacitance value larger, and leads to a shift in the resonant frequency of the LC circuit that indicates the pressure value. The details of capacitive sensing are given in Note S2.† In the same way, the two interdigitated sensitive capacitors are connected in parallel with another planar spiral inductor on the PCB to form another LC circuit. When the gripper robot grasps objects of different materials, a corresponding change in the relative dielectric constant varies the interdigital capacitor, which is reflected in the resonant frequency (Note S3†).
Fig. 1d shows the fabrication process of the GO/PI composite bilayer film. The GO film is prepared by vacuum filtration, then completely peeled off from the filter paper and cut by irradiating the GO film with a focused high-power density laser beam to form the corresponding pattern. Next, the adhesive PI film (purchased from RICROWN TECHNOLOGY) is bonded to the patterned GO film, resulting in a GO/PI composite bilayer film. The interdigital electrodes for the material sensor are directly fabricated on the GO film side of the GO/PI bilayer film as shown in Fig. 1e. It consists of one group of interdigital structures and causes the initial capacitance that varies with the test material. Fig. 1f is a schematic diagram of the preparation process of the GO-based pressure sensor. First, patterned electrodes are realized on the GO film side of the prepared GO/PI bilayer film. Then, the preparation of the foam dielectric layer includes drop-coating a high-concentration GO solution on the electrodes, freezing and vacuum drying. Finally, the upper electrode structure of the pressure sensor is prepared on the GO foam, and the overall structure is assembled.
Fig. 2c shows the optical and SEM image of the GO foam which exhibits an ultra-light three-dimensional porous structure, which is formed because the GO sheets are squeezed by the continuously generated ice crystals during the freezing process and crosslinked with each other under the intermolecular forces. After sublimation of the ice crystal, the remaining space is filled with air. The size of air holes and the density of GO foam can be adjusted by changing the concentration of GO dispersion. The top-right and bottom-right SEM images of Fig. 2c show the GO foam before and after compression. It can be observed that the internal structure of the GO foam is fluffy and porous without compression. Most of the space is filled with air, and the average diameter of the hole structure is roughly on the order of tens of microns. When the GO foam is compressed by external pressure, the air in the foam is squeezed out, resulting in a tight structure, which demonstrates the sensitivity of the GO foam as a pressure sensor. Fig. 2d and e show the Raman spectra of the GO film and GO foam, respectively. According to the Raman spectrum of the GO film, the G peak of GO is at around 1587 cm−1, which reflects the symmetry of the graphitic structure, while the D peak of GO is at around 1352 cm−1, representing the disorder of the inner sheet of GO. The reason is that the introduction of oxygen-containing functional groups in the oxidation process destroys the original regular electron arrangement structure of graphene. The transformation of sp2 to sp3 causes damage to some CC bonds and introduces a large number of defects, which are expressed in the enhancement of the D peak and the broadening of the G peak in the Raman spectrum. From the Raman spectrum of the GO foam, it is demonstrated that the Raman peak of the prepared GO foam is very close to that of the GO film, except that the GO foam has more bimodal burrs which may be due to the numerous hole structures in the GO foam. The structural composition of the sandwich-structured pressure sensor is characterized in Fig. 2f. The thin GO/PI composite bilayer film is used as the substrate, and the patterned electrode based on conductive tape is fabricated on the substrate, which is covered by the GO foam. On top of the GO foam is the other layer of pattered electrodes based on conductive tape.
In order to clarify the photothermal driving principle of the gripper, the temperature change of the gripper under the irradiation of IR is detected by a visual thermometric thermal imager, as displayed in the second and the fourth lines of Fig. 3a. It is implicated that under the irradiation of IR, the temperature of the gripper is much higher than that of the surrounding environment. Because the IR is irradiated vertically from the top of the gripper, heat is evenly distributed across the gripper. When the IR is removed, the temperature of the gripper gradually decreases with time, and the temperature of the fingers decreases faster than that of other parts of the gripper. Finally, the temperature of the gripper returns to the initial temperature, corresponding to the straight state of the gripper. By analysing the temperature distribution of the gripper corresponding to the bending state, it can be confirmed that the bending movement of the gripper is induced by light-induced heat.
In order to study the influence of IR power density on the bending movement of the soft gripper, the gripper is placed under IR with 5 different power densities. The bending angle in Fig. 3b and c is defined in Fig. S1.† According to Fig. 3b, under the irradiation of IR with different power densities, the maximum bending angle and the time taken to reach that are different with the gripper unloaded. At the straight state, the gripper bends quickly under the irradiation of IR, which is manifested as a large slope of the curve in the initial stage. With the continuous irradiation of IR, the fingers of the gripper still bend at a slower speed compared to the initial stage. After stabilization, the gripper reaches the maximum bending angle. In addition, the higher power density of the IR costs less time to reach the same bending angle, leading to a faster response speed. Therefore, under the irradiation of IR with a higher power density, the gripper reaches the maximum bending angle state faster, and then enters a stable state. 15 cycles of repetition experiments are conducted to verify the reliability of the gripper motion. The results are shown in Fig. S4.†
Further study on the response performance when the gripper grasps the object is conducted. Fig. 3c shows the variation of the bending angle with time when the gripper grasps the ball under the IR irradiation of 5 different power densities. Under the irradiation of IR, the response performance of the gripper grasping the ball is different from that of unloaded, especially the maximum bending angle and the time cost under the same power density. For example, under the IR irradiation of 0.3056 W cm−2 power density, the time to reach the maximum bending angle is about 6 seconds with the gripper unloaded, while it becomes 105 seconds with the ball grasped. In addition, the maximum bending angle that the gripper finally achieves under different power densities also becomes smaller than the unloaded state, which tends to be near the same angle of 90°. Higher power density induces a faster response speed of the gripper, which costs a shorter time to reach the maximum bending angle and enter the stable state. The longer time to reach the maximum bending angle when grasping the ball is due to that the ball blocks the IR irradiation, which results in a slow rise of temperature in the part that plays a crucial role in the entire grasping movement. Thus, it is necessary for a long time to gradually increase the temperature of obscured parts through heat transfer in order to achieve the maximum bending state. As for the irradiation of IR with different power densities when grasping the ball, the maximum bending angle of the grasping hand tends to be near the same angle, which just meets the requirements of holding the ball.
Fig. 4b shows the resonant frequency shift of the gripper's pressure sensor with pressure, the scatters of which correspond to the measurement IR power density in Fig. 4a. The sensitivity of the pressure sensor is 52.7 kHz mN−1. Under the irradiation of IR, the shift in the resonant frequency of the gripper in this paper can reach 22.1 MHz. At the same time, in order to test whether the pressure sensing of the gripper is repeatable, the gripper is tested 15 times under the IR with 8 power densities, as recorded in Fig. 4c. The shift of resonant frequency remains stable after the test, which indicates that the driving performance and the pressure sensing performance show high repeatability and reliability. In addition, hysteresis as an important index to evaluate the stability of the sensor is measured. The power density of the IR continuously increases to the maximum, and then gradually recovers to the initial state. The corresponding resonant frequency and S11 value are recorded in Fig. 4d. It can be observed that over a cycle of measurements, only the value of S11 shows hysteresis, while the resonant frequency remained stable, which reflects the accuracy response to the pressure, indicating that the pressure sensor of the gripper exhibits high stability. Furthermore, we tested the response of the pressure sensor without objects. As shown in Note S6 and Fig. S8a,† the gripper has only a small shift that can be ignored.
Under the irradiation of 8 different IR power densities, the material distinction performance of the gripper is tested. Fig. 5a shows the S11 test result of the material sensor of the gripper with a 16 mm wood ball. When no external IR excitation is applied on the gripper, the LC circuit is in the initial state with 2.15 GHz of resonant frequency and −22.84 dB of the corresponding S11 value. After applying IR excitation to the gripper, the gripper bends and grasps the ball. The contact area between a pair of interdigital electrodes on the fingers and the ball gradually increases. As the contact grows closer, the relative dielectric constant between the interdigital electrodes gradually approaches that of the ball from the initial value, which changes the interdigital capacitance value and leads to the shift of the resonant frequency. As the IR power density increases, the resonant frequency shifts to the left. When the power density is 0.3056 W cm−2, the resonant frequency is 851.6 MHz, and the corresponding S11 value becomes −18.94 dB. Under the same IR excitation, the resonant frequency shift of the material sensor is lower than that of the pressure sensing, which is due to that the change in relative permittivity has a relatively small effect on the capacitance value of the interdigitated electrodes. After a significant shift, the change in frequency gradually diminishes with the increase of the IR power density, the reason for which is that the contact area between the interdigitated electrodes on grasping fingers and the ball does not change obviously, resulting in a small change in capacitance.
In order to test the performance of the gripper to distinguish materials, plastic, glass, wood, and metal balls with a diameter of 16 mm are placed under the IR excitation of 8 power densities to monitor the performance of the gripper's material sensor. As captured in Fig. 5b, the gripper begins to distinguish materials after the power density grows to a certain level. Under the same power density, the shift of resonant frequencies corresponding to grasping the plastic, glass, and wood balls increases in turn. However, the resonant peak suddenly disappears once the gripper comes into contact with the metal ball, which is due to that the conducting metal generates a short between the interdigital electrodes. On the other hand, it is observed that with the increase of power density, the resonant frequency shift corresponding to each material gradually increases, inducing that the shift of resonant frequencies corresponding to balls of different materials at higher power density and lower power density appears to overlap. For example, the resonant frequency shift of wood under 0.1203 W cm−2 power density is 6.63 MHz, which is the same as the resonant frequency shift of plastic under 0.2790 W cm−2 power density. To avoid a miscalculation, the material sensor of the gripper should be tested under the same IR excitation.
Fig. 5c shows the relationship between the power density and the resonant frequency of the wood ball, which reflects the influence of the power density on the gripper’s ability to distinguish materials. After reaching the minimum threshold power density for testing, the resonant frequency changes greatly with the increase of the power density. With the further increase of the power density, the resonant frequency begins to change slowly, and the maximum shift of resonant frequency is 9.75 MHz. 15 repeated tests are carried out on the gripper with the wood ball, as demonstrated in Fig. 5d. Both the driving of the gripper robot and the function of distinguishing materials have certain stability, indicating the excellent repeatability and reliability of the gripper.
Fig. 5e depicts the hysteresis curve of the gripper’s distinction of wood material. It is indicated that although the S11 value at the resonant frequency of the material sensor under the same IR power density is different during the cycle test, the resonant frequency has little change. The maximum hysteresis value appears under the IR excitation with a power density of 0.2790 W cm−2, which is only 0.94%. The material sensor of the gripper has good stability.
IR excitation with a power density of 0.1698 W cm−2 is applied to the balls with different diameters and materials, to study the effect of the size of the ball on the material distinguishing function as shown in Fig. 5f. It is observed that the size of the diameter has little effect on the material distinction, which will not generate misjudgement. It can be proved that the gripper has high tolerance for grasping objects. In addition, the material sensor without objects is tested and the result is recorded in Fig. S8b.† A reverse shift of resonant frequency can be observed, which could be predicted by the structure, and does not affect the performance of the sensor, as analysed in Note S6.†
We compared this with previous grippers on the following aspects: material, whether it is flexible, whether it has sensing capabilities, and whether the sensing information can be transmitted wirelessly, as shown in Table 1. We have also compared the studies on tactile sensors to date in Note S7 and Table S3,† which shows that there is no solution that is fully applicable to soft grippers. As a result, we first successfully integrated wireless sensors into a soft gripper, giving the gripper the ability to feel and transmit information without being tied to an electrical connection, which makes the application of soft grippers more promising.
Materials | Flexible or rigid | Sensors | Wireless | |
---|---|---|---|---|
26 | Hydrogel | Flexible | No | — |
10 | GO/BOPP | Flexible | No | — |
30 | GO/rGO | Flexible | No | — |
34 | SRGO/PI | Flexible | No | — |
15 | Hydrogel | Flexible | No | — |
32 | PEDOT–PDMS | Flexible | No | — |
31 | GO–PDMS | Flexible | No | — |
36 | Ti3C2Tx/polymer | Flexible | No | — |
35 | — | Rigid | Thermal-conductivity | No |
Pressure | ||||
Temperature | ||||
37 | rGO–BOPP | Flexible | Strain | No |
This work | GO/PI | Flexible | Pressure | Yes |
Material |
Footnote |
† Electronic supplementary information (ESI) available. See https://doi.org/10.1039/d2na00208f |
This journal is © The Royal Society of Chemistry 2022 |