Xiaojian
Zhu‡
,
Chao
Du‡
,
YeonJoo
Jeong
and
Wei D.
Lu
*
Department of Electrical Engineering and Computer Science, the University of Michigan, Ann Arbor, Michigan 48109, USA. E-mail: wluee@eecs.umich.edu
First published on 22nd November 2016
Recent studies have shown that nanoionic-based memristors can offer rich internal dynamics during ion movement that enables these solid-state devices to emulate various synaptic functions in biological systems naturally. The experimental observations can be explained within the 2nd-order memristor theoretical framework, which states that the device conductance (weight) can be determined by multiple internal state variables that can be modulated at different time scales and lead to different activity-dependent synaptic behaviors. Here, we show experimentally that not only the synaptic weight, but also synaptic plasticity (i.e. polarity and the rate of weight change) depends on the history of the input activities. This “plasticity of plasticity” resembles metaplasticity effects observed in biological systems, which have been found to facilitate neuron competition and stability. Specifically, we show that the memristor device may exhibit the same apparent weight (conductance) after experiencing different history of activities, but when subjected to additional, identical stimulation conditions, the device will however exhibit very different responses including the polarity and rate of weight (conductance) change. These findings serve to further our knowledge of fundamental physical mechanisms in memristors, and help advance adaptive artificial neuromorphic systems based on these emerging devices.
In biological systems, synaptic plasticity, the ability to change the connectivity and strength between neuron cells based on the input activity, forms the physical basis of learning and memory. In nanoionic-based memristors, the synaptic weight is represented by the conductance of the device and synaptic plasticity is demonstrated by the device's ability to change its conductance when stimulated with different input signals. Physically, the conductance change is realized by electrically controlled ion migration and related formation/annihilation of conductive filaments.2,13,14 Mathematically, these effects can be explained in the memristor theoretical framework by the following equations:15
I = G(w, V)V | (1) |
(2) |
In this study, we highlight the fact that eqn (2) also implies that not only the weight, but also the polarity and rate of the weight change depend on the history of activities (through the w term on the right side of eqn (2)) and cannot be determined by the present inputs alone. This “plasticity of plasticity”,16 termed metaplasticity in neuroscience studies, highlights the importance of previous history of activities on subsequent synaptic plasticity.16–18 For example, in the CA1 region of the hippocampus, it has been observed that the long-term potentiation (LTP) of the synapse can be successfully induced by high frequency spike stimulation. However, this process can be inhibited if an additional low frequency spike stimulation was applied earlier that did not change the synaptic efficacy directly.19 From a macroscopic point of view, metaplasticity is important to learning and memory, since it functions as an internal modulator that dynamically regulates the synaptic plasticity according to its previous activities and maintains the synaptic efficacy within a dynamic range.
We show that memristors can exhibit general features of metaplasticity, by utilizing the different configurations of the filament geometry to record the history of activities and control subsequent filament evolution dynamics. Different pre-programming conditions (history of activities) including pulse trains with different pulse numbers, frequencies and amplitudes can lead to the same memristor conductance (synaptic weight), but result in very different weight changes including differences in the polarity (i.e. potentiation or depression) and the rate of the weight change when subjected to additional, identical stimulation conditions.
These observations are consistent with earlier studies on 2nd-order memristor effects.10–12 Here w can be described by a set of (more than one) state variables such as the filament length, width and location, all of which are history dependent through their own specific dynamic eqn (2). As a result, the synaptic plasticity cannot be predicted simply through the knowledge of only one parameter (i.e. the present conductance). This work further supports the notion that memristors may not only emulate synaptic function emphatically, but also offer interesting internal dynamics that allow them to implement complex synaptic functions faithfully.
In the following, we show that the different configurations of the internal filament geometry in these devices can be used to emulate metaplasticity, i.e. synaptic plasticity that depends on the previous activity, instead of just the present synaptic weight and the simulation pattern.
We first demonstrate different plasticity behaviors at the same weight (conductance), depending on whether the device has been pre-programmed with a simple, single voltage pulse. As shown in Fig. 1d, the device was initially programmed to S3. The device conductance was then monitored by a constant read bias voltage (0.3 V). When subjected to a single pre-programming pulse (2.2 V, 0.5 μs) at time t = 1 μs, the device conductance was found to first increase then decrease. Afterwards, the device conductance returned to the initial value (∼0.1 mS). As a result, the pre-programming pulse stimulation becomes untraceable by simply measuring the device conductance. The device was then subjected to a series of stimulation pulses (0.9 V, 0.5 μs). The dependence of the device conductance (measured with a read pulse (0.3 V, 5 μs) after each stimulation pulse) on the number of applied stimulation pulses is shown in Fig. 1e. Here the device showed a weak response to the pulse stimulation. On the other hand in a control experiment, the device, initially switched to S3 with the same initial conductance value but did not experience the pre-programming pulse, showed a continuous increase of the conductance with the number of stimulation pulses (Fig. 1e). This behavior is similar to the potentiation of synapse in biological systems. After 100 stimulation pulses, the device conductance in the control experiment was found to reach a saturation level of ∼0.3 mS, corresponding to a 200% increase in the conductance.
The observed difference in the two cases can be attributed to the differences of the filament geometry configuration. In the control experiment without the pre-programming pulse, the device retained the filament geometry at S3 (with a depletion gap near the BE). Subsequent positive pulses lead to the drift of VOs accumulated near the TE towards the BE and filling of the depletion gap, resulting in an increase of the device conductance. In contrast, the pre-programming pulse in Fig. 1d switched the device from S3 to S1, creating an opposite filament geometry with a depletion gap near the TE. The subsequent pulses cannot induce further significant conductance changes since the VOs near the TE were fully depleted already. This experiment clearly demonstrates that the filament geometry can record the memristor's history of activity and affect its plasticity, while such a capability will be missed by simply measuring the synaptic weight (memristor conductance).
One typical feature of metaplasticity is the activity-dependent polarity of synaptic plasticity, that is, the device can exhibit either potentiation or depression depending on the history of activity. We first demonstrate the modulation of the polarity of plasticity by subjecting the device to different numbers of pre-programming pulses (before plasticity measurements). Fig. 2a shows the evolution of conductance of a device at S3 with the number of programming pulses (1.2 V, 0.5 μs). It can be seen that the conductance first increased quickly and then the increase slowed down with the increased pulse number, corresponding to the growth of the initial length of the VO filament followed by expansion of the filament diameter near the TaOy/BE interface.23,24 When the pulse number reached a critical value (Nc, ∼300), the device conductance began to decrease instead, suggesting the depletion of VOs near the TE and creation of a depletion gap near the TE/Ta2O5−x interface. Note that the overall transition of conductance change is more gradual during the conductance decreasing region than that in the increasing region, and such behavior was also observed during the opposite transition from S1 to S3 (Fig. S2†). This can be explained by the fact that during the filament growth, the VO drift and diffusion flow in the same direction and accelerate the VO movement, whereas during the filament rupture the VO drift and diffusion flow in opposite directions and thus decrease the net VO migration.25 The non-monotonic change of the device conductance with the pulse number suggests that the device can either exhibit potentiation or depression, depending on whether the previously applied (pre-programming) pulse number is larger or smaller than Nc. This hypothesis is verified by the results shown in Fig. 2b. After switching from S3 to state A by 5 pulses (1.2 V, 0.5 μs) and state B by 921 pulses, the device conductance in both states is nearly identical, ∼1.5 mS. However, the device exhibits opposite plasticity behaviors, i.e., potentiation in case A and depression in case B when subjected to the same stimulation pulses (1.1 V, 0.5 μs) (Fig. 2b). Equivalently, pre-programming the device using a single short (wide) pulse can also result in either potentiation or depression behavior of the device later on (Fig. S3†). These results suggest the pulse number (or width)-dependent metaplasticity in our memristive device.
The dependence of plasticity polarity was further demonstrated by using different pre-programming pulse frequencies in the memristive device. First we note that the device shows a frequency-dependent response to the pre-programming pulses. As shown in Fig. S4,† the device, starting from the initial S3 state, when subjected to 100 programming pulses (1.2 V, 100 ns) at different frequencies (6.7 MHz, 6.3 MHz, 5.9 MHz, 5.6 MHz, 5.3 MHz and 5.0 MHz) shows a higher final conductance at a higher pulse frequency. This frequency dependence can be attributed to the dynamic effects of Joule heating during filament growth, as first discussed in ref. 10. If the pulse frequency is high, the local temperature elevated by the previous pulse does not fully decay and will accelerate the migration of VOs during the subsequent pulses.10 The effect of pulse frequency becomes more pronounced when more pulses are applied, as shown in Fig. 2c. As expected, with a higher frequency, fewer pulses were needed to switch the device to the same conductance value. The critical pulse number Nc, at which the conductance starts to decrease with the applied pulses, also shows a strong frequency dependence, as shown in Fig. 2d. When the device is brought to the same conductance with different (pre-programming) pulse frequencies, different plasticity behaviors are also observed. Fig. 2e shows that pre-programming the device using 1350 pulses with a frequency of 6.7 MHz and 5.0 MHz can both lead to almost the same device conductance value (∼1.65 mS), whereas the subsequent stimulation pulses (1.1 V, 0.5 μs) induced depression in the former but potentiation in the latter (Fig. 2f) since 1300 is >Nc in the 6.7 MHz case (∼350) but <Nc in the 5.0 MHz case (∼7850), thus highlighting the strong effect of the previous pulse frequency on the subsequent polarity of plasticity.
The modulation of the polarity of plasticity demonstrated here is intrinsically based on the CRS effect, such that two different internal filament geometry configurations can offer the same conductance value but with depletion gaps at opposite electrode interfaces. This allows the device conductance to either increase or decrease under the same pulse stimulation conditions, depending on which state the device has been previously set to.
Another important feature of metaplasticity is that the degree of plasticity can be significantly different, depending on the previous activities. In ionic memristors, the velocity of the ion migration exponentially depends on the local electric field,14,26,27 which is in turn affected by the existing filament and the electrode structure28 and suggests the possibility to modulate plasticity by controlling the internal filament geometry. To demonstrate this effect, we pre-programmed the device conductance to the same value (∼1.2 mS) during the filament formation process, using pulses with different amplitudes, as shown in Fig. 3a. As expected, fewer pulses are needed for pulses with higher amplitudes, as shown in Fig. 3b. Afterwards, the device is subjected to the same stimulation pulses (1.0 V, 0.5 μs), and its conductance is monitored, as shown in Fig. 3c. It can be seen that a larger conductance change occurs if the device was pre-programmed by higher amplitude pulses. This effect is more clearly shown in Fig. 3d, highlighting the effect of the pre-programming pulse amplitude on the device's response to subsequent, identical stimulation conditions.
Generally speaking, the filament shape is determined by both the drift (along the electric field direction and exponentially depends on the electric field) and diffusion (along the VO concentration gradient direction and independent of the electric field) of VOs. As a result, different filament geometries can be obtained, depending on the amplitude of the applied electric bias, as have been verified by previous simulation and experimental studies.29,30 Under a small bias voltage, ion drift is suppressed and the effect of (isotropic) ion diffusion is enhanced, leading to the expansion of the filament in the lateral direction and the formation of a wide filament. On the other hand, under a high bias voltage the fast drift of ions along the electric field direction will dominate, leading to the formation of a narrower filament. As a result, to reach the same conductance value, filaments in devices programmed by high amplitude pulses tend to be narrower but longer than those in devices switched by low amplitude pulses, resulting in the formation of a thinner but narrower gap between the filament tip and the electrode. Therefore, when being subjected to additional stimulation pulses, the thinner depletion gap creates a higher local electric field and will induce a faster and more pronounced ion migration and filament growth, as observed in Fig. 3c and d.
To verify this hypothesis, we performed numerical simulations based on a coupled ionic drift/diffusion model.25Fig. 3e A0 and B0 show the 2D maps of VO concentration distribution for two cases A and B, having a thin and narrow gap (A) and a thick and wide gap (B), respectively. The VO concentrations in the two devices were such that they lead to the same conductance value. Under a bias voltage of 0.93 V, the electric field in the narrow gap case (plotted along the line C–D in A0) is found to be much higher than that in B (plotted along the line E–F in B0), as shown in Fig. 3f. Evolution of the 2D maps of the VO distribution in the two devices after applying 0.93 V for 0.5 μs (A1/B1), 1.0 μs (A2/B2) and 1.5 μs (A3/B3) is shown in Fig. 3e. Significantly higher VO concentrations were found in the depletion gap of device A, in contrast to that of device B. The conductance changes were also measured from the simulation for the two cases, shown in Fig. 3g, showing the higher degree of plasticity in device A and consistent with the experimental results.
Control of the degree of plasticity was also achieved by using different pulse amplitudes in the pre-programming stage during the filament rupture process. Fig. 4a–d show that different pre-programming pulses can reduce the device conductance to the same conductance value but lead to different degrees of plasticity when the device is subjected to subsequent identical stimulation pulses. It is known that the filament rupture process in memristors usually involves the thermal dissipation of the filament along the lateral direction that decreases the filament diameter, followed by the migration of ions along the electric field direction that creates the depletion gap.23 High amplitude pulses could induce a pronounced Joule heating effect and thus higher temperature elevation to facilitate ion migration. In this situation, significant dissipation of VOs during the filament rupture process can lead to the formation of a highly insulating gap filled with a low concentration of residual VOs.31 On the other hand, low amplitude pulses are likely to result in the formation of a less insulating gap filled with a higher concentration of residual VOs.32 To reach the same conductance, the width of the gap with a lower VO concentration must be narrower. As a result, under the same stimulation pulse the relatively higher electric field in the narrower gap case will lead to a higher degree of plasticity. This hypothesis is further demonstrated by the simulation results shown in Fig. 4e–g. The evolution of the 2D maps of the VO distribution in the two devices after applying 1.0 V for 0.5 μs (A1/B1), 1.0 μs (A2/B2) and 1.5 μs (A3/B3) is shown in Fig. 4e. The VOs were found to gradually migrate downward in both the gaps, leading to the continued formation of a VO depletion gap near the TE. Nevertheless, time dependent quantitative evolution of the conductance change ratio in the two devices shown in Fig. 4f confirms the higher degree of plasticity in device A, consistent with our experimental results. We note that the possible migration behaviours of Ta5+ ions,22 along with those of VOs, are worthy of further studies since the involvement of different kinds of ions that offer dynamics at different time scales will allow the memristors to better emulate synaptic functions naturally.10–12
Footnotes |
† Electronic supplementary information (ESI) available. See DOI: 10.1039/c6nr08024c |
‡ These authors contributed equally to this work. |
This journal is © The Royal Society of Chemistry 2017 |