Yadu Ram
Panthi
ab,
Ambika
Pandey
ab,
Adriana
Šturcová
a,
Drahomír
Výprachtický
a,
Stephen H.
Foulger
cd and
Jiří
Pfleger
*a
aInstitute of Macromolecular Chemistry, Czech Academy of Sciences, Heyrovského nám. 2, 16200, Prague 6, Czech Republic. E-mail: pfleger@imc.cas.cz
bFaculty of Mathematics and Physics, Charles University, Ke Karlovu 3, Prague 2, Czech Republic
cCenter for Optical Materials Science and Engineering Technology (COMSET), Department of Materials Science and Engineering, Clemson University, Clemson, SC 29634, USA
dDepartment of Bioengineering, Clemson University, Clemson, SC 29634, USA
First published on 1st July 2024
Synaptic plasticity, denoting the variable strength of communication between adjacent neurons, represents a fundamental property of nervous systems that governs learning/forgetting and information storage in memory. It is shown here that a memristor with a poly [N-(3-(9H-carbazole-9-yl) propyl)methacrylamide] (PCaPMA) active layer, sandwiched between ITO and Au or Al electrodes, can emulate such a function. Its resistance, stimulated by a series of low amplitude voltage pulses, can gradually increase or decrease depending on the polarity, number, and frequency of stimulation pulses. Such behaviour is analogous to the potentiation and depression of neuronal synapses. A variety of synaptic functions, including short- and long-term plasticity, paired-pulse facilitation/depression (PPF/D), spike-timing-dependent plasticity (STDP), and associative learning, have been comprehensively explored on the millisecond timescale and the results suggest the possibility of linking device functions to biological synapse processes. The reported electrical properties have been attributed to a combination of several mechanisms, such as voltage-induced conformation changes, trapping/detrapping of charge carriers at localized sites, and redox phenomena. The results suggest the potential use of this device for applications in artificial intelligence and neuromorphic computing.
Being inspired by these neural activities inside the brain, the concept of neuromorphic computing has been introduced by Mead9 and further researched by neuro- and computer scientists aiming to emulate biological systems in the neuromorphic algorithms necessary for artificial intelligence (AI). The need for a large volume of data storage and the incorporation of the Internet of Things requires high-performance memory and processing units that can be realized only by emulating the spiking neural networks (SNNs). SNNs represent an energy- and time-efficient alternative to the traditional von Neumann architecture where the circuit complexity and scalability are creating big hurdles.10
A memristor, usually a two-terminal electronic component with nonlinear electrical properties, holds great promise for creating these SNNs.11–13 Its two terminals – top and bottom electrodes – can be imagined to be an axon and a dendrite of a neuron, with the active layer functioning similarly to the neuronal synapse. Its history-dependent electrical conductance changes stimulated by varying numbers or frequency of electric potential spikes can emulate synaptic plasticity.14,15 The continuous rise in conductance corresponds to the synaptic strength “enhancement” while a decrease denotes the “suppression”. Moreover, SNNs can be easily formed by a vertical stacking of memristors in a 3D array. Such system can efficiently process information directly without any supporting hardware and it is able to mimic associative learning and memorizing akin to the brain.16 The processing can be dependent on the magnitude of input signals such as pressure or electric, optical and magnetic pulses.17
The memristive effect relies on several factors including functional material used, selection of proper electrode material, and electrode-active layer interfacial properties. With the active layer made of metal oxide or insulating polymers, the multilevel conductance is achieved by a formation of conducting filaments that is caused by the redistribution of oxygen or metal ions in the layer.18–21 In organic semiconductors or hybrid systems like organic–metal complexes, various voltage-induced electronic or ionic-electronic effects, such as a formation of charge transfer complexes, conformational- or redox-induced electronic redistribution, or phase changes, can cause these resistive alterations.12,17,22–24 Enhancing switching speed could improve the efficiency and operational capacity particularly in applications like neuromorphic or stochastic computing, although these new computing approaches are less demanding from the point of view of hardware operational capacity. Depending on the working principle, the response of these devices could be made faster, for instance, by selecting materials with lower resistivity, limiting the dimensions of the device, increasing the charge carrier or ionic mobility, using materials with faster chain dynamics, or employing well-designed charge-injecting electrodes.19,25 Device integration into electronic circuits and adaptive control are also very important.26
The easy manufacturing and the structure–property versatility of organic materials make them highly attractive, especially for cost-effective and flexible wearable electronics, allowing precise tuning of electrical properties via chemical or morphological tailoring.27
Due to their voltage-dependent conductivity and hysteresis in the current–voltage characteristics, carbazole-based polymers, containing the charge transporting carbazole group either as a side group or in the polymer backbone, have demonstrated their promises as a suitable material for resistive-random access memory (ReRAM). Their conductivity changes have been assigned to several mechanisms, such as conformational changes of carbazole,23,28,29 redox reactions,30,31 or charge carrier trapping/detrapping.32,33 The multilevel conductivity can be controlled by changing their redox state during electrochemical doping. S.H. Foulger et al.,28 for example, compared the electrical characteristics of a conjugated polymer having dithieno[3,2-b:20,30-d]pyrrole in the polymer backbone, with and without carbazolyl moiety in the sidechain, observing the memristive properties only in the polymer containing carbazole group. Carbazole can be oxidized by electrochemical doping, losing one lone-pair electron, forming a polaron and changing the energy levels of the molecules significantly. Increasing the bias, delocalized bipolarons can be formed while the reorientation of the carbazole units facilitates more favourable pathways for charge carrier transport, consequently increasing the conductance of the layer.28,34 Employing such conjugated aromatic functional units like carbazole gain therefore increasing interest in the development of organic memristors.35
In this study, we investigated the synaptic-like behavior of poly-[N-(3-(9H-carbazol-9-yl)propyl)methacrylamide] (PCaPMA) polymer in solid-state thin films, sandwiched between indium-doped tin oxide (ITO) as a bottom electrode (BE) and gold (Au) or aluminium (Al) as a top electrode (TE). In our previous study, we reported on a resistive memory device with the active layer made of PCaPMA, which shows bistable resistive switching and nonvolatile electronic memory behaviour with a long persistence time exceeding several hours. It operates within a voltage range of ±5 V and demonstrates a good current ON/OFF ratio ranging from 102 to 104, essential for practical applications in non-volatile memory devices.33 However, when sandwiched with Au TE, multimodal resistance changes have been manifested, likely arising from Schottky barrier adjustment at the electrode/polymer interface. The synthesis of PCaPMA was inspired by the previous extensive study of a series of similar polymers that incorporated carbazole group linked to the polymer backbone by alkyl chains of various lengths.36,37 In PCaPMA, the incorporation of the amide group enabled a stabilization of the mutual alignment of carbazoles after voltage-induced switching by hydrogen bonds. This physical network also enhanced the polymer thermal stability.
Here, we present the ability of this device to mimic neuronal functionality of associative learning and memorizing by changing its resistance systematically in response to the sequence of voltage trigger pulses, and transitioning from the short-term to long-term memory effects. This study opens a new avenue for its application in analog memristive devices able to mimic the neurosynaptic behaviour. PCaPMA provides a promising opportunity of carbazole-based polymers to be utilized in both digital and analog memristive applications. Compared to inorganic materials and low molecular weight materials this polymer obviously offers a better processability, namely the possibility of solution-casting or printing, which is a significant advantage for many applications.33
For spectro-electrochemical measurements, a sandwich structure ITO|PCaPMA|gel electrolyte|ITO was fabricated as shown in Fig. S1 (ESI†). The gel electrolyte filled the space between the electrodes determined by a 150 μm thick spacer located around the perimeter of the substrate. The active layer was prepared by spin casting the polymer solution with a concentration of 33 mg mL−1. The gel electrolyte was prepared by stepwise adding lithium perchlorate (LiClO4) and PMMA, 10 g each, into 55 mL of polypropylene carbonate under continuous stirring. The mixture was then stirred for about 5 hours using a magnetic stirrer until a clear solution was obtained. The samples were assembled carefully avoiding air bubbles. The UV-vis spectra were recorded on a PerkinElmer Lambda 950 spectrophotometer (Shelton, USA), after the voltage had been applied for a period of 10 s to allow the redox process within the layer to be completed. Fluorescence spectra were measured on an FS5 Fluorimeter (Edinburgh Instruments, UK). First, the spectra were recorded at multiple excitation and emission wavelengths, and then excitation at 333 nm, i.e. within the carbazole absorption band, was used for in situ measurements under applied voltage. Ambient-pressure Raman spectra were obtained using a Renishaw QONTOR Raman microspectrometer equipped with a solid-state or diode laser providing an excitation line of 488 nm and 532 nm, respectively. The polymer was measured either in a powder form or as a solid-state thin film incorporated in the glass|ITO|PCaPMA|Al structure for the observation of possible spectral changes induced by the applied voltage. Each spectrum was obtained either as a single scan or as a summation of several individual scans; typically, 5 to 10 scans at various positions were measured to ensure a reasonable S/N ratio. During the in situ measurements, the scattered light was recorded from the ITO side of the sample sandwiched within the electrode cross-section area of approx. 0.15 mm2.
Comparison of powder and thin film spectra showed that all the bands present in thin film spectra also appear in powder spectra. For the thin film, one-scan spectra were acquired at five to fifteen different locations within the ITO|PCaPMA|Al device under each applied voltage. Excellent spectral reproducibility was confirmed for the band positions, relative intensities, and luminescent background, which is highly relevant for the in situ Raman spectra analysis presented below.
PCaPMA spin-cast from chlorobenzene solution forms relatively homogenous films, with surface roughness in the order of several nanometres. Even in extremely thin film (∼30 nm), the roughness was below 3 nm when scanned by AFM at 0.5 Hz over the surface of the layer cast on ITO (Fig. 1B and Fig. S2, ESI†). No pinholes were detected when measured over multiple regions; the bright spots originate from dust particles.
The device exhibits high reproducibility of conductance changes over 150 measured cycles. These measurements were conducted at room temperature in an ambient environment, without any observed degradation of electrical characteristics during multiple cycles (Fig. 2) A continuous conductance increase was observed until its saturation value. Similar behaviour was observed on devices with Al TE, but the conductance changes were smaller (Fig. S4, ESI†). It is the analogy of usual properties known for long-term potentiation, indicating the saturation of learning and blocking new learning.8 Subsequently, pulses of reversed polarity cause the current to be decreased, similar to LTD in a neural synapse. These potentiation and depression sequences were repeated over 150 cycles and no marked deviation from the above-described behaviour was observed. Moreover, similar finding of analog changes in device conductance was observed during 20 repeated scans in which the voltage swept from 0 to ± 0.5 V and then reversed back to 0 V at a rate of 0.5 V s−1, as shown in Fig. S3 (ESI†). These properties underscore the potential of memristors to emulate the cognitive information processing as observed in the brain.22,42,43
In Fig. S5A (ESI†) three subsequent potentiation/depression cycles for devices of four different thicknesses of the active layers are shown. These measurements employed a standard pulse setup with 100 potentiation-only and 100 depression-only pulses in each cycle. As expected, the measured current decreased with the increasing thickness but, with the exception of the thinnest devices where the saturation was less pronounced, the trends of all P/D cycles were very similar. The statistical distributions of relative changes of conductance between two limiting saturation values of P/D cycles acquired on 70 randomly selected samples having the same four thicknesses are shown in Fig. S5B (ESI†). It can be seen that majority of the samples show the conductivity increase by potentiation between 50 to 75% of the initial value. With increasing thickness, the relative changes become less in average, being only between 25 to 50% for the devices with 142 nm thick active layer. Detailed thickness-dependent changes and their statistical distribution in reproducibility are summarized in Fig. S5 (ESI†).
The conductance changes under different numbers of trigger pulses are shown in Fig. S6 (ESI†). The device prominently followed the same course of evolution for each run repeated after a prolonged time-gap. The degree of alteration in conductance typically diminishes after each trigger pulse, however only a minimal change was observed after 80–100 triggers, suggesting a tendency toward synaptic saturation. For various number of trigger pulses used in a single potentiation cycle ranging between 10 and 1000, the conductance channel modulation was increased with increase in pulse numbers. After 500 consecutive potentiation trigger pulses, the device exhibited nearly negligible potentiation with an increased signal noise, indicative of synaptic saturation. However, some increase in conductance is still observable even with 1000 trigger pulses (Fig. S6, ESI†). Similarly, in Fig. S7 (ESI†), when the frequency of trigger spikes exceeds 3 Hz, long-term potentiation began to saturate. This indicates the trend of the device towards learning and saturation. All data shown in Fig. 3 and Fig. S7 (ESI†) point to a similarity with biological synapses: trigger pulses with a longer pulse width or higher amplitudes have a bigger effect, whereas increasing the delay time results in a smaller response.
Fig. 4 Progression of conductance changes during stimulation by trigger pulses at different frequencies: 0.1 Hz (left), implying a time interval between two subsequent triggers Δt = 10 s, and 3.3 Hz (right), i.e. Δt = 300 ms. Following each trigger pulse, the current was monitored using 10 successive reading pulses. The inset shows a diagram of learning and memory retention during the rehearsal process as adapted from ref. 5. |
After the relaxation interval of 10 s, during which no trigger pulse was applied, the conductance sharply dropped down, mimicking STM, yet it did not entirely revert to the original state. The excitation over four subsequent cycles caused a similar increase in conductance as in the preceding cycle but with initial current level shifting to higher values, thus illustrating the LTM. By applying trains of pulses with opposite polarity, the reversed process was observed, imitating short- term and long-term forgetting (STF/LTF). It is illustrated that the repetition of potentiation only or depression only cycles creates stronger or weaker connection, respectively, similar as observed in biological species. Utilization of this effect, SNNs can extensively contribute to the development in artificial intelligence, namely in associative learning and training. For example, the repeated triggering of these signals in a certain time frame trains the device to enable its classical conditioning by pairing the neutral stimulus to conditioned stimulus, as described by Pavlov in the experiment with his dog.46–48 In our device, such pairing with the voltage pulses was also achieved (Fig. S8, ESI†). Although the signals used in our study were mostly higher compared to biological systems, it can be seen from Fig. 3A that the effects are observable also at lower signal amplitudes but the S/N ratio is much lower.
(1) |
The dependence of the PPF/D index on the time interval between trigger pulses Δt is shown in Fig. 5A. Before each PPF/D measurement, the sample was left to relax for 5 min without any excitation. Decreasing the interval between pulses enhanced the memory effect of the pre-spiking pulse on the subsequent one.
Fig. 5 (A) The dependence of PPF (red symbols) and PPD (blue symbols) on randomly varying inter-spike time interval Δt. Red and blue lines – double exponential fits according to eqn (2). (B) Dependence of the synaptic weight ΔW calculated according to eqn (3) on the time interval Δt between the pre- and post-synaptic spikes for two different time delays: tdelay = 10 ms (black squares), and tdelay = 100 ms (red circles) and full lines – fits calculated using eqn (4). Inset: Schematic showing the sequences of pre-synaptic (red) and post-synaptic (blue) pulse pairs. |
The obtained values were then fitted using the double exponential function, following the equation:
PPF/D index = C0 + C1e−Δt/τ1 + C2e−Δt/τ2 | (2) |
Stimulation | Scaling factors (%) | Relaxation time (ms) | |||
---|---|---|---|---|---|
C 0 | C 1 | C 2 | τ 1 | τ 2 | |
PPF | 1.2 | 9.0 | 2.9 | 79 | 730 |
PPD | 0.5 | −7.0 | −3.5 | 35 | 280 |
Additionally, spike-timing dependent plasticity (STDP) shows the plasticity features of inter-neuronal connections, based on the sequence and temporal separation between pre-synaptic and post-synaptic spikes.51–54 When the pre-synaptic spike precedes the post-synaptic spike (positive time delay, Δt > 0), the synaptic weight increases, resulting in the potentiation, LTP. Conversely, when the order is reversed (Δt < 0), the synaptic weight diminishes, leading to the depression, LTD.54 STDP is also an activity-driven mechanism that constitutes an important principle of competitive Hebbian learning, serving as a basis of for cognitive learning.55 STDP of the studied structure is documented in Fig. 5B. Here, a couple of trigger pulse doublets (square waves, amplitude 500 mV, pulse duration 20 ms separated by 10 ms) were applied to Au and ITO electrodes, representing the pre-synaptic and post-synaptic neurons, respectively, (inset of Fig. 5B), similarly as reported by C–S. Yang et al.56 The conductance change was then monitored after two distinct time delays (tdelay = 10 ms and 100 ms) for both spike pair orders. As in the PPF/D, each STDP measurement was carried out with random sampling that consisted of 45 sequences with randomly selected time intervals Δt ranging from 0 to 200 ms, as illustrated by the scheme in the inset of Fig. 5B. Between each subsequent STDP assessment, the device was allowed to relax for 5 min to avoid any history-dependent current response from the preceding measurement. An increase in conductance (ΔG > 0) was observed for Δt > 0 indicating the strengthening of the synaptic connection, and a weakening of the synapse (i.e. reduction in its conductance, ΔG < 0) was achieved for Δt < 0. The relative synaptic weight change (weighting factor, ΔW) is then calculated using eqn (3):51
(3) |
I 1 and I2 denote current after and before pre- and post-spikingpairs. The experimentally measured weighting factors are fitted using the equation:
(4) |
Spikes order | Time delay, tdelay (ms) | Asymptotic value, W0 | Scaling factor, A+/− | Relaxation time, τ+/− (ms) |
---|---|---|---|---|
Pre-Post (Δt > 0) | 10 | 0.012 | 0.07 | 190 |
100 | 0.005 | 0.30 | 160 | |
Post-Pre (Δt < 0) | 10 | 0.008 | 0.03 | 180 |
100 | −0.002 | 0.02 | 27 |
Fig. S10 (ESI†) shows the representative band diagram of the ITO|PCaPMA|Au or Al devices indicating the adjustment of the energy barrier at the metal–organic interface. With the HOMO level of the PCaPMA, EHOMO = −5.23 eV, and the work function of gold (5.1 eV),63 smaller Schottky barrier of only 0.13 eV makes Au electrode a better injecting contact, in contrast to aluminium. PCaPMA also contains localized states in the bulk with the potential depth φt,33 which act as charge trapping centres. These trapping sites get occupied by carriers injected from the electrode, continuously capturing charges within their characteristic time scales. The current decay in the triggered device, when monitored after a prolonged time in the timescale of tens to hundreds of milliseconds range, suggests the release of previously trapped carriers from the shallow traps with depth less than 0.9 eV.64 With the increasing frequency of triggering, i.e. under faster stimulation, the charges fill the localized levels continuously, increasing the device conductance throughout a longer timescale. Reversing the polarity, these trapped carriers are released resulting in decreased conductivity. This charging/discharging is continued until the saturation is reached.
Fig. 6 (A) UV-vis spectra of the ITO|PCaPMA|electrolyte|ITO device recorded under different applied voltage. (Red and blue curves with +V and −V, respectively, and inset as the zoomed spectra in NIR region). (B) Schematic of redox reaction and voltage-induced conformation of carbazole units similarly as in ref. 31. |
When the device with the thicker PCaPMA layer (550 nm) was in the ON state and excitation laser light of 488 nm was applied (Fig. S11, ESI†), a broad luminescence band was detected with its maximum shifting between 700–800 cm−1 (equivalent to 510 nm in fluorescence spectra shown in Fig. S13, ESI†). The intensity of the newly present luminescence was dependent on several parameters – including the applied electric field and its duration, as well as the intensity and duration of the Raman excitation, and significantly decreased when the device was returned to the OFF state. Similarly, the application of an electric field caused reversible changes in in situ voltage-dependent fluorescence emission spectra measured under excitation at 333 nm (Fig. S13, ESI†), confirming the impact of the applied field observed by Raman spectroscopy. This band peaking at 510 nm, albeit weak, was also observable and persisted in the fluorescence spectra of the layer under excitation with 488 nm light. However, no emission was observed under a similar applied electric field but without light excitation, suggesting that electroluminescence as an origin of this emission can be excluded.
Under Raman excitation of the device with the thinner (175 nm) PCaPMA layer by laser light 532 nm, another new broad structureless emission band centred around 2500 cm−1 appeared, exhibiting increased intensity under positive bias and diminishing reversibly and completely when the device was returned to the OFF state. Although the origin of this band remains unclear and was not observed by fluorimetry, it is likely attributed to phosphorescence or to the emission from impurity sites.67
The two luminescence phenomena associated with the fluorescence band in the device with a thicker layer, and the probable phosphorescence phenomenon observed in the device with the thinner layer might arise from dynamic changes in trapping site occupation, which provides further support for our previous conclusion that the trapping/detrapping process underlies the resistive switching mechanism of the memory device.33
The tendency of carbazole functional units to undergo conformational changes and redox reactions governs the resistance changes in the system. The manipulation of trapping sites occupation, along with the improved injection from the contact that enhances charge carrier injection also supports the suggested underlying mechanism. The device meets the fundamental requirements of the synapse, addressing both short-term and long-term plasticity, as demonstrated by PPF/D and STDP characteristics. It shows the potential of memristors with PCaPMA active layer for application in neuromorphic computing and eventually for use in AI systems.
Footnote |
† Electronic supplementary information (ESI) available. See DOI: https://doi.org/10.1039/d4ma00399c |
This journal is © The Royal Society of Chemistry 2024 |