Sungjun
Kim
a,
Jia
Chen
b,
Ying-Chen
Chen
c,
Min-Hwi
Kim
d,
Hyungjin
Kim
d,
Min-Woo
Kwon
d,
Sungmin
Hwang
d,
Muhammad
Ismail
a,
Yi
Li
b,
Xiang-Shui
Miao
b,
Yao-Feng
Chang
*e and
Byung-Gook
Park
*d
aSchool of Electronics Engineering, Chungbuk National University, Cheongju 28644, South Korea
bSchool of Optical and Electronic Information & Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
cMicroelectronics Research Center, University of Texas at Austin, Austin, Texas 78758, USA
dInter-university Semiconductor Research Center (ISRC) and the Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, South Korea. E-mail: bgpark@snu.ac.kr
eIntel Corporation, Hillsboro, USA. E-mail: yfchang@utexas.edu
First published on 27th November 2018
We studied the pseudo-homeothermic synaptic behaviors by integrating complimentary metal–oxide–semiconductor-compatible materials (hafnium oxide, aluminum oxide, and silicon substrate). A wide range of temperatures, from 25 °C up to 145 °C, in neuronal dynamics was achieved owing to the homeothermic properties and the possibility of spike-induced synaptic behaviors was demonstrated, both presenting critical milestones for the use of emerging memristor-type neuromorphic computing systems in the near future. Biological synaptic behaviors, such as long-term potentiation, long-term depression, and spike-timing-dependent plasticity, are developed systematically, and comprehensive neural network analysis is used for temperature changes and to conform spike-induced neuronal dynamics, providing a new research regime of neurocomputing for potentially harsh environments to overcome the self-heating issue in neuromorphic chips.
To mimic neuronal activities in a human brain following a homeothermic organism, or even over-performance within various temperature environments similar to poikilotherms, the temperature change in neuronal dynamics needs to be investigated at the memristor synapse, which would help researchers to understand the use of emerging memristor-type neuromorphic computing systems, and to improve their performance through material- and device-level engineering. Although evidence suggests that changes in the brain temperature could have profound effects on neural activity and functions, our knowledge of brain temperature, its normal and pathological fluctuations, and the mechanisms underlying brain thermal homeostasis is very limited. Here, complementary metal–oxide–semiconductor (CMOS) friendly synapse memristors (Ni/HfOx/n++Si) have been explored to imitate the temperature variation in neuronal dynamics. Although the use of silicon bottom electrode tends to increase the operating voltage, the operating current tends to decrease.22 Moreover, a memristor using a silicon substrate as the bottom electrode has the advantage of self-rectifying without an additional selector.46 This characteristic can be applied to the memristor even when operating a synapse array. In this work, potential pseudo-homeothermic synapse activity and neural network functionality was evaluated by recognition accuracy with a wide range of temperature changes in neuronal dynamics and functionality due to the fact that homoeothermic material properties are achieved compared to typical synapse memristors (Ni/HfOx/p++Si). The synaptic behaviors, including long-term potentiation (LTP), long-term depression (LTD), and spike-timing-dependent plasticity (STDP) of HfOx-based RRAM devices, were demonstrated considering various temperature ranges, including the human body temperature. Finally, the influences of temperature and AlOy layer insertion were confirmed through pattern recognition in a neural network simulation.
Fig. 2a–c show the resistive switching properties of three HfOx-based memristor devices. Two different resistive switching characteristics could be observed from the I–V curves. A Ni/HfOx/p++Si device that exhibits abrupt set and reset switching follows a typical filamentary model, as shown in Fig. 2a. A forming and set process to produce a conducting filament occurs near approximately 3.5 V, and a reset is initiated to rupture the conducting filament around −1 V. On the contrary, the Ni/HfOx/n++Si device exhibits typical interface-type switching, as shown in Fig. 2b. This device has the advantage that there is no need to apply an external current limit. In the literature, filamentary-type and interface-type switching are reported simultaneously in HfOx-based RRAM.49–55Table 1 compares previously reported resistive switching parameters in HfOx-based memristor devices, including filamentary and interface types. HfOx-based RRAM exhibits resistance switching characteristics in various stacks. The switching thickness is 3 nm to 20 nm and the HfOx film deposition method varies, including chemical vapor deposition (CVD), atomic layer deposition (ALD), and sputtering methods. In terms of mass production, electrodes, such as Si and TiN, are preferred over noble metals, such as Pt and Au. CVD- or ALD-based HfOx films are more suitable for high-density 3D stacking.
Device stack | Deposition method | Switching polarity | Switching type | SET | RESET | RESET current | On/off ratio |
---|---|---|---|---|---|---|---|
Ti/HfO2:Al/Pt49 | PVD | Bipolar | Filamentary | Abrupt | Gradual | <3 mA | >20 |
Ti/HfO2/Al2O3/TiN50 | ALD | Bipolar | Filamentary | Abrupt | Gradual | <200 μA | <100 |
TiN/HfO2/TiN51 | ALD | Unipolar | Filamentary | Abrupt | Abrupt | <200 μA | <20 |
Au/HfO2/Pt52 | MOCVD | Unipolar | Filamentary | Abrupt | Abrupt | <50 mA | >104 |
Al/AlOx/HfOx/Pt53 | ALD | Bipolar | Filamentary | Abrupt | Gradual | <2 mA | <103 |
Pt/HfOx/TiN54 | RMBE | Bipolar | Interface | Gradual | Gradual | <1 mA | <5 |
TE/HfOx/SiOy/Si55 | N/A | Bipolar | Interface | Gradual | Gradual | <1 μA | <50 |
Ni/HfOx/AlOy/n++-Si [This work] | ALD | Bipolar | Interface | Gradual | Gradual | <5 μA | <20 |
HfOx-based RRAM shows both unipolar and bipolar switching. For unipolar switching, the conducting filaments are ruptured by Joule heating with high current at reset switching. However, in bipolar operation, it is possible to rupture the conducting filaments at a lower current, which is induced by the drift of the oxygen vacancies under a low electric field. The filamentary-type switching has a higher low-resistance state (LRS) current and larger on/off ratios than the interface type. Similar to HfOx RRAM, other material systems, such as Ti/TiO2/SiOx/n++Si and Pt/ZnO/Pt devices, have been found to exhibit both filamentary- and interface-type switching.56,57 For synapse applications, a gradual resistance change is essential during set and reset operations. In a set operation, abrupt switching is commonly observed in filamentary types. In this case, it is difficult to implement multiple levels owing to a large change in conductance with the applied voltage. Self-compliance by series resistance can cause multiple conductance jumps to occur. However, in this case, it is also difficult to achieve cycle-to-cycle reproducibility for multi-levels. A progressive set, which is observed in the interface type, is optimized for synaptic devices because it ensures fine-tuning for resistance or conductance states. Reset switching can be also generated in various ways. For the filament type, the conductance essentially changes abruptly or by several step-by-step changes. However, the interface type shows a progressive decrease in the conductance.
Fig. 2c shows the I–V characteristics of a Ni/HfOx/AlOy/n++Si device. The insertion of an Al2O3 layer with a large bandgap (∼9 eV) with insulating properties can lower the LRS and HRS currents.29 In addition, Al2O3, which has a higher dielectric constant (∼9) than SiO2 (3.9), can more effectively eliminate the remaining oxygen vacancies, owing to its higher thermal conductivity, especially for lower HRS current by using a deep reset. It should be noted that this is one of the practical ways to increase the low on/off ratio of interface-type memristors. Fig. 2d shows the current change as a function of temperature in the LRS and HRS for the three devices. The extraction activation energy (EA) of the Ni/HfOx/p++Si device showing the filament type is very different between the LRS (35 meV) and HRS (210 meV). This is associated with the formation of conducting filaments in the LRS, which dominates the main conductance. The increasing current with increasing temperature indicates that the filament has a semiconducting property. We can exclude the intense penetration of strong Ni through HfOx or strong oxygen deficiency inside the HfOx film. Both metallic and semiconducting filaments are reported in the literature for the temperature dependence of LRS. This can be influenced by the current level by compliance or overshoot and the stack combination. However, for Ni/HfOx/n++Si and Ni/HfOx/AlOy/n++Si devices showing interface-type switching, the current change with temperature has a more consistent range (EA: 77–156 meV) regardless of whether the device is in the LRS or HRS. Fig. 3e shows ln(I/V) vs. V1/2 for the three devices in the HRS and LRS to confirm the Poole–Frenkel emission model,58 and to obtain the effective trap depth below the conduction band (CB) through that relationship. The low-voltage region follows the Poole–Frenkel model well, but the tunneling dominates in the high-voltage region. For the interface type, the lower the current is, the longer regime the Poole–Frenkel model is maintained. The fitting results are good in all regimes before the reset occurs, because the LRS current of the Ni/HfOx/p++Si device is high. Fig. 2f shows the effective trap depth depending on the square root of the voltage in the HRS and LRS of the three devices. Here, the value at which the trend line and the y-axis meet is the height of the barrier. It is noted that the LRS and HRS in the interface type show little difference in trap barrier. Unlike the filamentary model, for the interface type, the oxygen vacancies are densely packed on the surface, and only part of the high concentration on the surface is changed by the applied bias.
To investigate the pseudo-homeothermic biological model applicable to the memristors according to the two different switching types shown above, the temperature dependence in the devices was closely examined. As Ni/HfOx/p++Si exhibits filamentary switching, the reset switching does not occur at high temperature (85 °C). This results in excessive overshoot during the forming process, which makes it difficult to rupture the large conductive filaments upon reset switching (ESI, Fig. S2†). This characteristic is similar to that of a poikilotherm, such as reptiles, that changes its internal temperature characteristics according to the external environment. That is, according to the external voltage, the memristor shows different characteristics. Essentially, the filamentary type exhibits a random distribution with respect to the previous switching history, making it difficult to obtain a specific I–V characteristic depending on the temperature.
Fig. 3a–d show DC I–V characteristics by controlling the set and reset stop voltages at various temperatures (25 °C, 37 °C, 85 °C, and 145 °C) for the Ni/HfOx/AlOy/n++Si devices. The current at the positive voltage shows a larger change than that at the negative voltage. Therefore, when current sensing is performed at a positive voltage, a large amount of conductance can be obtained in a wider range. Also, as the temperature rises, the characteristic showing a gradual current change is maintained, but a larger range of conductance change is induced. Fig. 3e shows the switching operation including set and reset switching at different temperatures (25 °C, 37 °C, 85 °C, and 145 °C) for Ni/HfOx/AlOy/n++Si devices. The LRS current tends to increase with increasing temperature. However, the HRS current does not show a constant tendency depending on the temperature, because a strong reset occurs at high temperature. In addition, the devices can have multiple conductance states because they show a greater resistance change when the set process occurs at higher temperature. This can be confirmed by observing the dynamic conductance, which is the derivative of the DC I–V curve (dI/dV) in Fig. 3f. It is difficult to obtain the I–V characteristic with respect to a consistent temperature for the Ni/HfOx/p++Si device exhibiting the filamentary property, because the scattering is severe during the switching operation. On the other hand, pseudo-homeothermic memristors (Ni/HfOx/n++Si and Ni/HfOx/AlOy/n++Si devices) have the advantage of achieving similar characteristics, irrespective of the external environmental temperature, especially for achieving high synaptic behavior even in harsh environments with high temperatures. The above results show that Ni/HfOx/n++Si (homeothermic memristors) with the interface type tends to conduct using deeper traps than Ni/HfOx/p++Si in the LRS. More changes in the absolute amount of the current in the LRS are not important in homeothermic memristors compared to for the poikilotherm memristors. In the case of poikilotherm-type memristors, nonuniform characteristics with temperature changes are not suitable for application to synaptic devices.
To analyze the synaptic properties of the fabricated HfOx-based memristor devices, consecutive pulses were applied to the three devices. When a pulse of magnitude 4.5 V was applied to the Ni/HfOx/p++Si device showing the filamentary property for 100 μs, the conductance increased sharply and there was no additional increment (ESI, Fig. S3a†). Then, when a −2.5 V/100 μs pulse was applied, the conductance abruptly decreased again and the current decreased gradually when the same additional pulses were applied. This behavior is well matched with the results obtained for the I–V characteristic with a DC sweep. On the contrary, the Ni/HfOx/n++Si device showed a gradual conductance change for a higher pulse amplitude. The conductance increased for 50 identical pulses of 8 V/100 μs and then decreased for a pulse of −5 V/100 μs (ESI, Fig. S3b†). The conductance change was approximately 25% of the initial conductance. For the Ni/HfOx/AlOy/n++Si device, the conductance level was reduced by a factor of 100 or more, suggesting that the operating power can be significantly reduced (Fig. 4a). The change in conductance was larger, but the conductance noise became worse, which was due to a reduction in the conducting defects. It is noted that the linearity of LTP was improved in the AlOy-inserted device. The AlOy with a higher dynamic dielectric constant (∼10) affects the distribution of the voltage across the HfOx layer. This may prevent sudden changes in conductance at the beginning by blocking the concentration of the electric field in the HfOx layer. Next, we investigated the LTP and LTD behaviors with respect to temperature for the Ni/HfOx/n++Si and Ni/HfOx/AlOy/n++Si devices. LTP and LTD were observed for the Ni/HfOx/n++Si device with the higher temperatures of 37 °C, 85 °C, and 145 °C (ESI, Fig. S4a–S4c†). A pulse of the same condition (LTP: 8 V/100 μs, LTD: −5 V/100 μs) was applied at different temperatures. As the temperature increased, the value of the conductance at the starting point increased, as did the degree of change in conductance. Fig. 4b–d show LTP and LTD of the Ni/HfOx/AlOy/n++Si device following the homeothermic model with temperatures of 37 °C, 85 °C, and 145 °C. Even at high temperatures, the synaptic properties at room temperature were maintained.
Fig. 4 LTP and LTD at different temperatures (a) 25 °C, (b) 37 °C, (c) 85 °C, (d) 145 °C for Ni/HfOx/AlOy/n++Si. |
Furthermore, to estimate the characteristics of different LTP and LTD with temperature effects working as a pattern recognition network, a three-layer neuron network simulation based on a back-propagation (BP) algorithm with the benchmark of the handwriting (MNIST) dataset was performed. The input layer consisted of 784 neurons, which represented 28 × 28 pixels of each character image from MNIST. The neuron number of the hidden layer was 64, and that of the output layer was 10, which represented the numbers 0–9 (Inset of Fig. 5a). Then, each neuron was connected to every neuron in the next layer through synapses. The experimental LTP and LTD properties of the synaptic devices were used to fit as a function of synaptic weight (W) with respect to the input pulse numbers. During the training process, the feedback error of synaptic weight obtained from the BP algorithm was modulated with the function. Then, the deviation between the output and the ideal signal was minimized, which relied on the linearity and accuracy of the experimental resistance tuning. Fig. 5a shows the recognition rate of the Ni/HfOx/AlOy/n++Si devices for different temperatures. The accuracy of the Ni/HfOx/AlOy/n++Si device was generally substantially higher than that of the Ni/HfOx/n++Si device. Especially, the maximum recognition rate of 90.55% was achieved at 37 °C for the Ni/HfOx/AlOy/n++Si device, and the recognition rate did not decrease significantly even when the temperature increased. It is noted that the effect of AlOy layer insertion was to ensure improved accuracy as well as low-power operation (Fig. 5b). The variation was somewhat related to the current level. We improved the recognition rate by changing the pulse condition for each temperature although the recognition accuracy was not perfect due to the nonlinear nature of the memristor (ESI, Fig. S5†).59 In the Ni/HfOx/AlOy/n++Si device, the current increased as the temperature increased, and the variation decreased, as shown in the inset.
Fig. 5 Neural network simulation: (a) accuracy as a function of epoch for Ni/HfOx/AlOy/n++Si device. (b) Accuracy with different temperatures for Ni/HfOx/AlOy/n++Si devices. |
Finally, we demonstrated STDP as the Hebbian learning rule for the Ni/HfOx/AlOy/n++Si device with different temperatures. To implement STDP, it was necessary to fine-tune the time interval of the pre-spike and post-spike, and to adjust the pulse amplitude. The amplitude of the pulse was carefully designed to emulate the pre-spike and post-spike in Fig. 6a. The pulses with smaller amplitude were applied at high temperatures, because it is possible to change the synaptic strength to be larger even if the magnitude of the overlapped pulse is small, as in Fig. 6b. The smaller the difference between the two spike timings, the greater the magnitude of the superimposed pulses applied across the device, leading to a larger conductance change.
Fig. 6 STDP characteristics: (a) pulse scheme for STDP (b) STDP-like curves: conductance change as a function of spike timing. |
Footnote |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c8nr06694a |
This journal is © The Royal Society of Chemistry 2019 |