Deeksha
Sharma
ab,
Dheemahi
Rao
ab and
Bivas
Saha
*abc
aChemistry and Physics of Materials Unit, Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore 560064, India. E-mail: bsaha@jncasr.ac.in; bivas.mat@gmail.com
bInternational Centre for Materials Science, Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore 560064, India
cSchool of Advanced Materials (SAMat), Jawaharlal Nehru Centre for Advanced Scientific Research, Bangalore 560064, India
First published on 15th February 2023
Modern computational technology based on the von Neumann architecture physically partitions memory and the central processing unit, resulting in fundamental speed limitations and high energy consumption. On the other hand, the human brain is an extraordinary multifunctional organ composed of more than a billion neurons capable of simultaneously thinking, processing, and storing information. Neurons are interconnected with synapses that control information flow from pre-synaptic-to-post-synaptic neurons. Therefore, emulating synaptic functionalities and developing neuromorphic computational architecture has recently attracted much interest. Due to their high-speed, large bandwidth, and no interconnect-related power loss, photonic (all-optical) synapses can overcome the existing hurdles with electronic synapses. Here, we show an artificial photonic synapse by utilizing the well-established reversible, high-contrast photochromic organic compound, spiropyran, stimulated by optical pulses. Optical transmission of spiropyran significantly changes during spiropyran–merocyanine isomerization driven by UV-visible optical pulses. Such changes are equivalent to the biological synapses’ inhibitory and excitatory synaptic actions. The slow relaxation to the initial state is considered as synaptic plasticity responsible for learning and memory formation. Short-term memory (STM), long-term memory (LTM), and transition from the STM to the LTM are demonstrated in all-optical synapses by modulating the stimuli's strength. The solvatochromic properties of spiropyran are further utilized to augment memory in synapses. Our work shows that photochromic organic compounds are excellent hosts for artificial photonic synapses and can be implemented in neuromorphic applications.
New conceptsAll optical synapses with photochromic organic compounds. Traditional computation based on von Neumann architecture is limited by time and energy consumption due to data transfer between the storage and the processing units. The von Neumann architecture is also inefficient in solving unstructured, probabilistic, and real-time problems. To address these challenges, a new brain-inspired neuromorphic computational architecture is required. Due to their high-speed, large bandwidth, and no interconnect-related power loss, photonic (all-optical) synapses can overcome the existing hurdles with electronic synapses. In this work, we show an artificial photonic synapse by utilizing the well-established reversible, high-contrast photochromic organic compound, spiropyran, stimulated by optical pulses. Our work shows that photochromic organic compounds are excellent hosts for artificial photonic synapses and can be implemented in neuromorphic applications. |
Compared to the present technology, the human brain is one of the most efficient processors that can sense, process, and store information simultaneously. It is nearly ten times more energy-efficient than a personal computer and exhibits self-learning capability.5 Such excellent functionalities in the brain arise from more than a billion neurons interconnected with a trillion synapses.6 Triggered by external stimuli, an action potential (information) travels down an axon of the pre-synaptic neuron to the post-synaptic neuron through the synaptic cleft.7 This complex physiochemical process polarizes/depolarizes the membrane potential, which will be retained in the synapse as memory. Such in-memory computing ability of the human central nervous system enables it to perform complex operations such as learning, memorizing, thinking, solving probabilistic and stochastic programs, etc., much more efficiently.8 Therefore, emulating the functionalities of the brain and the development of a neuromorphic system remains one of the most extraordinary challenges in the modern scientific and technological era.
Since synapses are the main building blocks of the nervous system,9 one of the crucial challenges of brain-inspired computing technology is to emulate synaptic functionalities. Over the last few decades, neuromorphic circuits have been successfully implemented in complementary-metal-oxide-semiconductor (CMOS) chips, such as the TrueNorth chip from IBM,10 the Loihi chip from Intel,11etc. However, such systems are incredibly power-hungry12 and require numerous operations to execute fundamental tasks such as voice and image recognition. With the demonstration of memristors by HP labs in 2008,13 significant efforts have been made to develop neuromorphic-based hardware systems.14,15 Artificial synapses16 made up of phase change materials,17,18 nanoionics,19,20 magnetic tunnel junctions21,22 and transistors23–25 have been heavily studied over the last five-to-ten years. Basic synaptic functionalities such as short-term memory (STM),26 long-term memory (LTM),27 frequency-selective optical filtering, frequency-dependent potentiation and depression, Hebbian learning, and logic-gate operations are well demonstrated. However, most synapse-like hardware is electronic, where external electrical pulses control the current flow. As a result, they suffer from resistance-capacitance (RC) delays, exhibit low bandwidth, and consume high power.28
To circumvent these challenges with the electronic synapse, optoelectronic artificial synapses have been developed utilizing photo-responsive materials such as metal oxides,29 organic materials,30 perovskites,31 and 2D materials,32 including graphene,33 h-BN,34 MoS2,35,36 and WSe2.37 In these optoelectronic synapses, current flow between electrodes is controlled by optical stimuli. However, due to their inherent electronic nature, the optoelectronic synapses also suffer drawbacks such as RC delays, low sensitivity, etc. The artificial synapse with the filamentary memory phenomenon is one of the electronic synapses where an electric current leads to the formation of a conductive channel providing a path for the migration of ions, also termed a low resistance state. When the voltage polarity changes, the filament breaks, leading to a high resistance memory state responsible for the synaptic behavior.38 On the other hand, in all-optical artificial synapses, the information flow between two ends of the device and the gate stimuli that control it are optical and it doesn’t involve changes in the resistance for synaptic functionalities. This could provide an ideal solution to the existing challenges of synapse design.39,40 With photons as both information carriers and stimuli, all-optical synapses exhibit high speed without suffering from RC-delays.41 In addition, such synapses exhibit a larger bandwidth (frequency range of operation) and no interconnect-related power loss. Photonic synapses based on gallium lanthanum oxysulphide (GLSO) fiber8,42 and gallium sulfur telluride (GST)43 phase change material have been shown over the last few years. The data transmission and brain-like activity in the form of plasticity44 are elucidated in GLSO microfibers using photo-darkening functionality. Similarly, a photonic integrated circuit approach in Ge2Sb2Te5 and Si3N4 waveguide is used to obtain the desired synaptic weight. Though these demonstrations of all-optical synapses have heralded a new era of low-power, high-speed photonic neuromorphic systems, they usually require complex lasers and waveguides. At times, they are also wavelength selective, which limits their practical utility. Therefore, photonic synapses that don’t need a complex laser system, with minimal fabrication and operation, will significantly benefit this budding research field.
This work elucidates a photonic synapse using a simple photochromic organic chemical, spiropyran. Spiropyran is a family of photochromic organic compounds well-known for its lucid photo-responsivity,45,46 out of which the 1′,3′-dihydro-1′3′3′-trimethyl-6-nitrospiro [2H-1-benzopyran-2,2′-(2H)-indole] derivative has been used in this work. This molecule has chromene and indoline moieties perpendicularly joined at the spiro-junction.46 The molecule undergoes a photochromic isomerization reaction between the closed-ring spiropyran and open-ring merocyanine forms by breaking the C–O bond distinguished by their characteristic colors.47 However, the C–O bond in spiropyran is weak, unstable, and highly depends on the environment. In a polar environment like methanol, due to the low solubility of spiropyran, only a few molecules are dissolved and converted to merocyanine, resulting in a light pink solution which is the equilibrium state. When a UV light pulse is irradiated, energy from the 365 nm pulse breaks the rest of spiropyran's C–O bonds, resulting in increased merocyanine isomers and deeper intensity. On visible light (400–800 nm) illumination, the merocyanine isomers convert back to spiropyran, decreasing the color's intensity and increasing transmission. If the light is irradiated for a longer time, then enough merocyanine reverts to spiropyran resulting in a colorless solution. The relaxation to the equilibrium state on removing optical pulses is considered synaptic plasticity and is varied by the optical pulses’ strength and the solvent's polarity.
In biological neurons, the electrical signal propagation from a pre-synaptic neuron to a post-synaptic neuron is controlled by the synaptic strength modulated by the stimuli's nature31 (see Fig. 1(a)). The action potential generated by the external stimuli controls the neurotransmitter release in the synaptic cleft from the pre-synaptic neuron and the transmissibility of the receptors at the post-synaptic neuron. The synapse can either pass on the signal to the next neuron (excitatory) or block the signal (inhibitory) based on its role in the physiological process and simultaneously deform, creating a memory.
An equivalent setup to emulate synaptic activities in an all-optical artificial synapse is shown in Fig. 1(b). Spiropyran solution in methanol is placed in front of a light source serving as a pre-synaptic neuron, while a spectrophotometer collects the transmission spectra resembling a post-synaptic neuron. Variation in synaptic weight is analogous to the changes in the optical transmission through the spiropyran solution caused by visible (400–850 nm) and UV (365 nm) pulses acting as stimuli. Fig. 1(c) shows the structural and color changes associated with the isomerization by varying light wavelengths.
As discussed, the solution state varies with incident light having an optical transmission spectrum, as shown in Fig. 2(a). The transmission spectrum has a minimum of 527.5 nm (λmin). The transmittance at λmin is the measure of isomer concentration and is taken as a reference for mimicking the synaptic activity. In the dark, the solution has a transmission intensity close to 55% (green curve in Fig. 2(a))14 because of both spiropyran and merocyanine isomers.48 Some of the spiropyran spontaneously forms merocyanine in polar solvents (ΔG < 0),49 resulting in a pink solution. On UV irradiation, it changes to a dark pink state (more number of merocyanine) with transmittance reduced to 20% (blue transmission curve Fig. 2(a)). The amplified intense color correlates to the spiropyran molecules converting to merocyanine obtaining energy from the UV light. Irradiation with visible light shifts the equilibrium towards a colorless closed spiropyran with an approximate transmission intensity of 91% (red transmission curve 2a). The ring opening and closing with UV and visible light irradiation are validated by the 1H NMR spectra shown in the ESI.† The switching between the isomers50 is highly repetitive and reproducible with pulses of corresponding light sources, as shown in Fig. 2(b); with 50 visible pulses of 15 s each, the solution transitions from a colored to a highly transparent one. The UV pulses with the exact count and width bring the system back to the lowest transmission state. The repeatability of this transmission cycle indicates this system's quantum switching ability, stability, and reliability for mimicking neuromorphic functionalities.
Transmission change at λmin with a single optical pulse relative to the intermediate state (solution in the darkness) is observed for replicating the excitatory and inhibitory synaptic activity. On shining a visible pulse to the intermediate state, the transmittance shifts to a higher value, as shown in Fig. 3(a). As soon as the pulse is removed, this high transmission state gradually undergoes thermal relaxation46 to its initial state without any stimuli. The system returns to an intermediate state when left in the dark (inset in Fig. 3(a)), with the modified form persisting for almost 3.3 hours. In addition, a UV pulse lowers the transmission intensity, and the occurring change is observed to be retained in the system for more than 4 hours (see Fig. 3(b)). The solution becomes dark pink when irradiated with UV light and relaxes back to the intermediate state shown in the inset image of Fig. 3(b). The increasing and decreasing transmission behavior with a visible pulse and UV pulse are equivalent to the excitatory and inhibitory synaptic functions, respectively. The time duration for the pulse-driven change to reach the intermediate state is analogous to the synaptic plasticity forming the system's memory. The longer the time taken to get the initial transmission value, the more the plasticity will be, and hence the memory. It is important to note that unlike in the previous demonstration of GLSO photonic synapses, where an optical bias with pre-assigned intensity is applied to introduce the intermediate state, the intermediate state obtained in this work is an intrinsic nature of the system arising from the solute–solvent interactions. Similarly, the memory in the spiropyran-based photonic synapse demonstrated here lasts for several hours compared to the GLSO photonic synapses, where it survives only for a few minutes.
A short-term change produced by a pulse in the synaptic strength leads to short-term memory (STM), where the applied change stays for only a few seconds. Long-term memory (LTM) is achieved when the stimuli are strong enough to retain the difference for up to a few minutes or hours.51 The STM to LTM transition can be studied by changing the stimuli's exposure duration, number, frequency, or intensity.52 In this work, the STM-to-LTM conversion is shown by varying the time and number of stimuli pulses. In an excitatory synapse, the percentage transmission changes by altering the pulse duration from 1 minute to 3 minutes, signifying a modified synaptic weight (Fig. 4(a)). Higher transmission intensity indicates a higher spiropyran concentration in the solution. This, in turn, increases the time for the molecules to relax back to their intermediate equilibrium state. Thus, with increased pulse duration, synaptic plasticity also increases. Similar results can also be seen in the case of inhibitory synapses (Fig. 4(c)). In this case, the lowered transmission intensity is due to merocyanine isomers that relax to equilibrium once the radiation is removed. In the case of changing number of pulses, transmission increases (decreases) for the excitatory (inhibitory) optical signal (Fig. 4(b) and (d)), which highlights the transition. Thus, the STM-to-LTM alteration is achieved in excitatory and inhibitory synapses with increasing duration and count of optical pulses.
Along with the changes in stimuli properties, solvent polarity also enhances the plasticity of the studied synapse. The polarity of the solvent affects the ground state and excited state energy levels of merocyanine, leading to varied colors of the intermediate state.53 In non-polar solvents, the isomerization reaction is a non-spontaneous process that requires UV irradiation. The merocyanine in that case appears blue due to shifted energy band positions (details in ESI†). This solvatochromic effect is utilized to vary the synaptic plasticity. Equimolar solutions of spiropyran in methanol, ethanol, and isopropyl alcohol (IPA) are studied (see Fig. 5(a)).
The solvent polarity increases in the order of isopropyl alcohol (IPA), ethanol, and methanol. With increasing polarity, λmin and the transmission value at λmin decreases. The blueshift in λmin is due to expanding merocyanine bandgap, while the lower transmission values are because of more converted merocyanine. The intermediate color of the solution in IPA, ethanol, and methanol is shown in the inset of Fig. 5(a), where the pink color is intense in methanol (the solvent with the highest polarity studied here). Since the transmission of the intermediate state is different for every solvent, the relative change of transmittance upon irradiation with visible and UV pulses also varies. The excitatory synaptic activity with 60 s visible pulse and inhibitory synaptic activity with 15 s UV pulse are presented in Fig. 5(c) and (d), respectively. The synaptic plasticity increases in the order of IPA, ethanol, and methanol, consistent with increasing polarity. Since plasticity is directly associated with memory, increasing the solvent polarity improves memory (Fig. 5(b)) in excitatory and inhibitory photonic synapses. Furthermore, to improve the response time of all-optical artificial synapses, the intensity of light and concentration of the solution can be changed. Not only this, changing the nature of the solvent and the substituents in the spiropyran can also affect the response time. The molecular environment changes the activation energy required for C–O bond cleavage, changing the overall rate and other properties.
Also, the power consumption for an all-optical artificial synapse can be determined by calculating the energy of the optical pulse (E) per unit area (A) for an exposure time (t) of 1 s.
So, the power consumptions for the excitatory (visible pulse) and inhibitory (UV pulse) synapses are 0.1 mW cm−2 and 0.4 mW cm−2, respectively. However, this power consumption can be reduced by minimizing the optical pulse energy, device size, and exposure time.
To facilitate the integration of the spiropyran-based photonic synapse with solid-state devices, further experiments are performed by dispersing spiropyran in poly(methyl methacrylate) (PMMA) polymer and spin coating it onto quartz substrates. The results (presented in ESI†) confirm the switching of isomers with light irradiation, highlighting the method's utility for solid-state devices.
In conclusion, we demonstrate an all-optical artificial synapse using a reversible, high-contrast photochromic compound, spiropyran. The photochromic and solvatochromic properties of spiropyran are utilized to mimic biological synaptic activities. The quantal changes in transmittance during spiropyran–merocyanine isomerization cycles with visible and UV pulses are equated to memory and learning. Excitatory and inhibitory synaptic activities are emulated with visible and UV pulses. Short-term memory (STM), long-term memory (LTM), and transition from STM-to-LTM necessary for cognition development is achieved by controlling the duration and the number of stimulating excitations. Solvatochromism is also exploited to enhance the plasticity of such synapses. This study demonstrates the utility of spiropyran as a suitable candidate for all-optical artificial synapses and elucidates photochromic compounds as excellent hosts for photonic synapses for brain-inspired computing.
Footnote |
† Electronic supplementary information (ESI) available: The impact of UV and visible light pulses on the transmission spectra, NMR spectra, spiropyran-to-merocyanine conversion in the spiropyran polymer composite, transmission spectra of the polymer with demonstrating an inhibitory synapse, and proposed neural network. See DOI: https://doi.org/10.1039/d2nh00532h |
This journal is © The Royal Society of Chemistry 2023 |