text:
Annually, an estimated 1.7 million Americans sustain a traumatic brain injury (TBI) due to traffic accidents, falls, assaults and sports participation, said the study's senior author H¨¹lya Bay¦Ér, M.D., associate professor, Department of Critical Care Medicine, University of Pittsburgh School of Medicine. She added that 52,000 of those injured die, and 85,000 are left with significant disability.
"We don't yet have a specific therapy for TBI, but can provide only supportive care to try to ease symptoms," Dr. Bay¦Ér said. "Our study drug shows promise as a neuroprotective agent that might help address this important public health problem."
For the study, the research team conducted a global assessment of all the phospholipids in rat brain cells. This revealed that damage from TBI was nonrandom and mostly involved cardiolipin, a phospholipid that is found in the membranes that form mitochondria, the cell's powerhouse. They noted that in the healthy animal, only 10 of the 190 cardiolipin species were modified by oxygen, but after a brain injury, the number of oxidized species rose many-fold.
The researchers then developed an agent, called XJB-5-131, which can cross the blood-brain barrier and prevent the oxidation of cardiolipin. Using an established research model of severe TBI, the agent or a placebo was injected into the bloodstream of rats five minutes and again 24 hours after head injury.
In the weeks that followed, treated animals performed akin to normal on tests of balance, agility and motor coordination, learning, and object recognition, while placebo-treated animals showed significant impairment. The results indicate that blocking cardiolipin oxidation by XJB-5-131 protected the brain from cell death.
"The primary head injury might not be that serious," Dr. Bay¦Ér noted. "But that initial injury can set into motion secondary cellular and molecular events that cause more damage to the brain and that ultimately determine the outcome for the patient."
She added that a targeted oxidation-blocker might also be beneficial in the treatment of other neurological disorders, such as Parkinson's disease, amyotrophic lateral sclerosis, or ALS, and stroke.
Co-authors of the paper include lead author Jing Ji, Ph.D., of the University of Pittsburgh's departments of Critical Care Medicine and Environmental and Occupational Health, the Center for Free Radical and Anti-oxidant Health, and the Safar Center for Resuscitation Research; Patrick M. Kochanek, M.D., of the Department of Critical Care Medicine and the Safar Center; Peter Wipf, Ph.D., of the Department of Chemistry; Valerian E. Kagan, Ph.D., of the Department of Environmental and Occupational Health and the Center for Free Radical and Anti-oxidant Health; Anthony E. Kline, Ph.D., of the Department of Physical Medicine and Rehabilitation, as well as other Pitt researchers from the departments of Pediatrics and Neurological Surgery and of the Center for Neuroscience; as well as Noxygen Science Transfer and Diagnostics GmbH, Elzach, Germany.
The study was funded by National Institutes of Health grants NS061817, NS060005, NS076511, HL070755, ES020693, and U19AIO68021, the National Institute for Occupational Safety and Health, and the U.S. Army.
About the University of Pittsburgh School of Medicine
As one of the nation's leading academic centers for biomedical research, the University of Pittsburgh School of Medicine integrates advanced technology with basic science across a broad range of disciplines in a continuous quest to harness the power of new knowledge and improve the human condition. Driven mainly by the School of Medicine and its affiliates, Pitt has ranked among the top 10 recipients of funding from the National Institutes of Health since 1997. In rankings recently released by the National Science Foundation, Pitt ranked fifth among all American universities in total federal science and engineering research and development support.
Likewise, the School of Medicine is equally committed to advancing the quality and strength of its medical and graduate education programs, for which it is recognized as an innovative leader, and to training highly skilled, compassionate clinicians and creative scientists well-equipped to engage in world-class research. The School of Medicine is the academic partner of UPMC, which has collaborated with the University to raise the standard of medical excellence in Pittsburgh and to position health care as a driving force behind the region's economy. For more information about the School of Medicine, see www.medschool.pitt.edu.
Electrical 'switch' in brain's capillary network monitors activity and controls blood flow
27.03.2017 | Larner College of Medicine at the University of Vermont
Laser activated gold pyramids could deliver drugs, DNA into cells without harm
24.03.2017 | Harvard John A. Paulson School of Engineering and Applied Sciences
Astronomers from Bonn and Tautenburg in Thuringia (Germany) used the 100-m radio telescope at Effelsberg to observe several galaxy clusters. At the edges of these large accumulations of dark matter, stellar systems (galaxies), hot gas, and charged particles, they found magnetic fields that are exceptionally ordered over distances of many million light years. This makes them the most extended magnetic fields in the universe known so far.
The results will be published on March 22 in the journal „Astronomy & Astrophysics“.
Galaxy clusters are the largest gravitationally bound structures in the universe. With a typical extent of about 10 million light years, i.e. 100 times the...
Researchers at the Goethe University Frankfurt, together with partners from the University of Tübingen in Germany and Queen Mary University as well as Francis Crick Institute from London (UK) have developed a novel technology to decipher the secret ubiquitin code.
Ubiquitin is a small protein that can be linked to other cellular proteins, thereby controlling and modulating their functions. The attachment occurs in many...
In the eternal search for next generation high-efficiency solar cells and LEDs, scientists at Los Alamos National Laboratory and their partners are creating...
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are less stable. Now researchers at the Technical University of Munich (TUM) have, for the first time ever, produced a composite material combining silicon nanosheets and a polymer that is both UV-resistant and easy to process. This brings the scientists a significant step closer to industrial applications like flexible displays and photosensors.
Silicon nanosheets are thin, two-dimensional layers with exceptional optoelectronic properties very similar to those of graphene. Albeit, the nanosheets are...
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to simulate these confined natural conditions in artificial vesicles for the first time. As reported in the academic journal Small, the results are offering better insight into the development of nanoreactors and artificial organelles.
Enzymes behave differently in a test tube compared with the molecular scrum of a living cell. Chemists from the University of Basel have now been able to...
20.03.2017 | Event News
14.03.2017 | Event News
07.03.2017 | Event News
27.03.2017 | Earth Sciences
27.03.2017 | Life Sciences
27.03.2017 | Life Sciences


text:
What is the scientific term for brain?
The cerebrum, consisting of the cerebral hemispheres, forms the largest part of the brain and overlies the other brain structures. The outer region of the hemispheres, the cerebral cortex, is grey matter, consisting of cortical layers of neurons.
Join Alexa Answers
Help make Alexa smarter and share your knowledge with the worldLEARN MORE

domain: medical


Speaking of FOX Sports 1, the channel is teaming up with FOX Sports Radio to offer coverage of the 2014 NFL Draft beginning Thursday, May 8 live from Radio City Music Hall. Charissa Thompson anchors alongside Jay Glazer and analysts Mike Garafolo, Joel Klatt, Donovan McNabb and Peter Schrager with updates, opinion and analysis on picks, trades and other news. In addition, Glazer will appear on FOX Sports Radio with anchor Don Bell for live broadcasts during the Draft’s first three rounds on Thursday, May 8, from 8p-12am and Friday from 6-10p.
Della Reese, the breakout jazz/gospel singer whose TV credits include talk show Della and Touched By an Angel, died last night at age 86. “I know heaven has a brand new angel this day,” said Reese’s Touched By an Angel co-star, Roma Downey.
Nashville’s 6th season will be its last. “After more than 120 episodes of unforgettable television, we believe that creatively it is time for the series to come to a triumphant close,” said Kevin Beggs, chairman of producer Lionsgate Television Group. Nashville, which moved from ABC for season 5, ranks as CMT’s highest-rated and most-watched show […]
George Clooney is headed back the small screen. The ER alum will star in and direct a 6-episode series for Paramount Television and Anonymous Content, based on the Joseph Heller novel Catch-22.
AT&T is nearing a deal to acquire a full stake Otter Media, its joint digital video venture with the Chernin Group, according to a new report from Digiday. Otter Media – whose properties include Fullscreen, Crunchyroll, Hello Sunshine, and Gunpowder & Sky – was first formed in 2014. Since its inception, it’s been a purely […]
Dana Walden, the co-chair and CEO of Fox Television Group, has joined Hulu’s board of directors. Two other Fox execs already were already serving on the board: Peter Rice, the President of 21st Century Fox, and Brian Sullivan, the President and COO of Fox Networks Group’s Digital Consumer Group. 21st Century Fox currently owns a […]


Jazz Està Morto: Azimüth
Azimüth was born out of the bossa nova and jazz scenes in Rio de Janeiro in the 1960’s. Keyboard player and bandleader Jose Roberto Bertrami (RIP), drummer Ivan ‘Mamao’ Conti and bass player Alex Malheiros met during that time and recorded an album called ‘O Trio’ in 1968 under the name ‘Projeto 3’. ‘Projeto 3’ changed their name to ‘Azimuth’ after backing the recording of ‘O Fabuloso Fittipaldi’ for Marcos Valle in the early ’70’s – ‘Azimuth’ is a track title from that album. Their first recording under the new name was a four-track EP for Polydor in 1975. This was followed by their first full-length self-titled LP for Som Livre also in 1975. ‘Agua Nao Come Mosca’ came in 1977 and was also released outside Brazil – in the USA and Japan – by Atlantic Records. In 1979 they released ‘Light As A Feather’ for legendary US jazz label Milestone – it became one of the best-selling records of the year and features the all-time classic disco/fusion dancer ‘Jazz Carnival’. This isn’t our first time bringing the trio to Los Angeles. Back in ’08 we co presented an event with mochilla, with the generous contribution of Spaceland and VTech, we brought them to the Echoplex and in 09’ we copresented and produced Arthur Verocai’s “Timeless” concert (with mochilla) and brought Azymuth as part of the rhythm section. This time, we bring them back without Bertrami (RIP), but very much in tact.
We are so glad that Adrian, Ali, and ArtDontSleep brought us back gems from Brazil to share with us and the rest of Los Angeles. First surprise was the famous Brazilian Jazz funk trio Azymuth and they reminded us just how amazing music is worldwide and just how much it connects us all.
There was so much nostalgia and history behind Azymuth! We had the great honor and privilege of hosting them last night for the first ever #jazzestàmorto series. The Lodge Room was filled with richness, people from different walks of life to be apart of a historic LA moment. Thank you for the energy and #Azymuth for giving us two encores. We can still hear and feel the sounds of #JazzCarnival making everyone move to those Brazilian beats.
Next up, João Donato, and we have an incredibly special ensemble of LA musicians built around the maestro!


text:
Long-term memories are likely stored in the synaptic weights of neuronal networks in the brain. The storage capacity of such networks depends on the degree of plasticity of their synapses. Highly plastic synapses allow for strong memories, but these are quickly overwritten. On the other hand, less labile synapses result in long-lasting but weak memories. Here we show that the trade-off between memory strength and memory lifetime can be overcome by partitioning the memory system into multiple regions characterized by different levels of synaptic plasticity and transferring memory information from the more to less plastic region. The improvement in memory lifetime is proportional to the number of memory regions, and the initial memory strength can be orders of magnitude larger than in a non-partitioned memory system. This model provides a fundamental computational reason for memory consolidation processes at the systems level.
Memory is critical to virtually all aspects of behavior, which may explain why memory is such a complex phenomenon involving numerous interacting mechanisms that operate across multiple brain regions. Many of these mechanisms cooperate to transform initially fragile memories into more permanent ones (memory consolidation). The process of memory consolidation starts at the level of individual synaptic connections, but it ultimately involves circuit reorganization in multiple brain regions. We show that there is a computational advantage in partitioning memory systems into subsystems that operate on different timescales. Individual subsystems cannot both store large amounts of information about new memories, and, at the same time, preserve older memories for long periods of time. Subsystems with highly plastic synapses (fast subsystems) are good at storing new memories but bad at retaining old ones, whereas subsystems with less plastic synapses (slow subsystems) can preserve old memories but cannot store detailed new memories. Here we propose a model of a multi-stage memory system that exhibits the good features of both its fast and its slow subsystems. Our model incorporates some of the important design principles of any memory system and allows us to interpret in a new way what we know about brain memory.
Citation: Roxin A, Fusi S (2013) Efficient Partitioning of Memory Systems and Its Importance for Memory Consolidation. PLoS Comput Biol 9(7): e1003146. https://doi.org/10.1371/journal.pcbi.1003146
Editor: Jeff Beck, Duke University, United States of America
Received: February 18, 2013; Accepted: June 3, 2013; Published: July 25, 2013
Copyright: © 2013 Roxin, Fusi. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by DARPA grant SyNAPSE, the Gatsby Foundation, the Kavli Foundation, the Swartz Foundation and NIH grant NIH-2R01 MH58754. AR acknowledges a Ramon y Cajal grant RYC-2011-08755. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Memories are stored and retained through a series of complex, highly coupled processes that operate on different timescales. In particular, it is widely believed that after the initial encoding of a sensory-motor experience, a series of molecular, cellular, and system-level alterations lead to the stabilization of an initial memory representation (memory consolidation). Some of these alterations occur at the level of local synapses, while others involve the reorganization and consolidation of different types of memories in different brain areas. Studies of patient HM revealed that medial temporal lobe lesions severely impair the ability to consolidate new memories, whereas temporally remote memories remain intact . These results and more recent work (see e.g. ) suggest that there may be distinct memory systems, and that memories, or some of their components, are temporarily stored in the medial temporal lobe and then transferred to other areas of the cortex. Is there any fundamental computational reason for transferring memories from one area to another? Here we consider memory models consisting of several stages, with each stage representing a region of cortex characterized by a particular level of synaptic plasticity. Memories are continuously transferred from regions with more labile synapses to regions with reduced but longer-lasting synaptic modifications. Here we refer to each region as a stage in the memory transfer process. We find that such a multi-stage memory model significantly outperforms single-stage models, both in terms of the memory lifetimes and the strength of the stored memory. In particular, memory lifetimes are extended by a factor that is proportional to the number of memory stages.
In a memory system that is continually receiving and storing new information, synaptic strengths representing old memories must be protected from being overwritten during the storage of new information. Failure to provide such protection results in memory lifetimes that are catastrophically low, scaling only logarithmically with the number of synapses –. On the other hand, protecting old memories too rigidly causes memory traces of new information to be extremely weak, being represented by a small number of synapses. This is one of the aspects of the classic plasticity-rigidity dilemma (see also –). Synapses that are highly plastic are good at storing new memories but poor at retaining old ones. Less plastic synapses are good at preserving memories, but poor at storing new ones.
A possible solution to this dilemma is to introduce complexity into synaptic modification in the form of metaplasticity, by which the degree of plasticity at a single synapse changes depending on the history of previous synaptic modifications. Such complex synapses are endowed with mechanisms operating on many timescales, leading to a power-law decay of the memory traces, as is widely observed in experiments on forgetting , . Furthermore, complex synapses can vastly outperform previous models due to an efficient interaction between these mechanisms . We now show that allowing for a diversity of timescales can also greatly enhance memory performance at the systems level, even if individual synapses themselves are not complex. We do this by considering memory systems that are partitioned into different regions, the stages mentioned above, characterized by different degrees of synaptic plasticity. In other words, we extend the previous idea of considering multiple timescales at single synapses to multiple timescales of plasticity across different cortical areas.
To determine how best to partition such a memory system, we take the point of view of an engineer who is given a large population of synapses, each characterized by a specific degree of plasticity. Because we want to focus on mechanisms of memory consolidation at the systems level, we use a simple binary model in which synaptic efficacies take two possible values, weak and strong. Previous work has shown that binary synapses are representative of a much wider class of more realistic synaptic models . It seems likely that the mechanisms for storing new memories exploit structural aspects and similarities with previously stored information (see e.g. semantic memories). In our work, we are interested in different mechanisms responsible for storing new information that has already been preprocessed in this way and is thus incompressible. For this reason, we restrict consideration to memories that are unstructured (random) and do not have any correlation with previously stored information (uncorrelated). After constructing multi-state models, we estimate and compare their memory performance both in terms of memory lifetime and the overall strength of their memory traces.
The importance of synaptic heterogeneity
We first analyzed a homogeneous model (single partition), in which all the synapses have the same learning rate (see Fig. 1). We consider a situation in which new uncorrelated memories are stored at a constant rate. Synapses are assumed to be stable in the absence of any overwriting due to the learning of new memories. Each memory is stored by modifying a randomly selected subset of synapses. As the synapses are assumed to be bistable, we reduce all the complex processes leading to long term modifications to the probability that a synapse makes a transition to a different state. As memories are random and uncorrelated, the synaptic transitions induced by different memories will be stochastic and independent.
a. Upper left: Each synapse is updated stochastically in response to a plasticity event, and encodes one bit of information of one specific memory because it has only two states. For this reason, we can assign a color to each synapse which represents the memory that is stored. Lower left: Memories are encoded by subjecting synapses to a pattern of plasticity events, here illustrated by different colors. These patterns, and hence the memories, are random and uncorrelated. The strength of a memory is defined as the correlation between the pattern of synaptic weights and the event being tracked. The degradation of encoded memories is due to the learning of new memories. Only four memories are explicitly tracked in this example: red, green, blue, gray. Those synapses whose state is correlated with previous memories are colored black. Right: Synaptic updating is stochastic in the model leading to variability in the signal for different realizations given the same sequence of events (dotted lines). A mean-field description of the stochastic dynamics captures signal strength averaged over many realizations. We measure the signal-to-noise ratio (SNR) which is the signal relative to fluctuations in the overlap of uncorrelated memories. b. There is a trade-off between the initial SNR and the memory lifetime: A large initial SNR can be achieved if the probability of a synapse changing state is high (), although the decay is rapid, i.e. the memory lifetime scales as , where is the total number of synapses. Long lifetimes can be achieved for small although the initial SNR is weak. Memory lifetime can be as large as , when . SNR vs time curves are shown for and and . c. In a heterogeneous population of synapses in which many qs are present, one can partially overcome the trade-off (black line). The initial SNR scales as , where is the learning rate corresponding to the slowest population. The memory lifetime scales as . Here there are 50 different qs, where and synapses of each type. .
To track a particular memory we take the point of view of an ideal observer who has access to the values of the strengths of all the synapses relevant to a particular memory trace (see also ). Of course in the brain the readout is implemented by complex neural circuitry, and the estimates of the strength of the memory trace based on the ideal observer approach provide us with an upper bound of the memory performance. However, given the remarkable memory capacity of biological systems, it is not unreasonable to assume that specialized circuits exist which can perform a nearly optimal readout, and we will describe later a neural circuit that replicates the performance of an ideal observer.
More quantitatively, to track a memory, we observe the state of an ensemble of synapses and calculate the memory signal, defined as the correlation between the state of the ensemble at a time and the pattern of synaptic modifications induced by the event of interest at time . Specifically, we can formalize this model description by assigning the value to a potentiated synapse and to a depressed one. Similarly, a plasticity event is assigned a value if it is potentiating and if depressing. We then define a vector of length , where is the state of synapse at time . Similarly, the memories are also vectors of length , , where is the plasticity event to which synapse is subjected at time . If we choose to track the memory presented at time , then we define the memory trace as the signal at time , which is just the dot product of two vectors, . The signal itself is a stochastic variable, since the updating of the synaptic states is stochastic. This means that if one runs several simulations presenting exactly the same memories, the signal will be different each time, see right hand side of Fig. 1a. The mean signal, understood as the signal averaged over many realizations of the Markov process, can be computed analytically. For the homogeneous model, a continuous-time approximation to the mean signal takes the simple form of an exponential, , where is the total number of synapses and is the learning rate, see Methods and Text S1 for details. We must compare this mean signal to the size of fluctuations in the model, i.e the noise.
The memory noise is given by the size of fluctuations in the overlap between uncorrelated patterns, which here is approximately , see Text S1 for details. Therefore, the signal-to-noise ratio . One can track a particular memory only until it has grown so weak it cannot be discerned from any other random memory. Memory lifetime, which is one measure of the memory performance, is then simply defined as the maximum time over which a memory can be detected. More quantitatively it is the maximum time over which the SNR is larger than 1. The scaling properties of the memory performance that we will derive do not depend on the specific critical SNR value that is chosen. Moreover, it is known that the scaling properties derived from the SNR are conserved in more realistic models of memory storage and memory retrieval with integrate-and-fire neurons and spike driven synaptic dynamics (see e.g. ).
As we mentioned, the dynamics of the Markov model we consider are stochastic. Therefore, throughout the paper, we will discuss results from stochastic models for which we have derived corresponding mean-field descriptions. Fig. 1b shows the mean-field result for two extreme cases when all synapses have the same degree of plasticity. If the synapses are fast and the transition probability is high (), then the memory is very vivid immediately after it is stored and the amount of information stored per memory is large, as indicated by the large initial SNR (). However the memory is quickly overwritten as new memories are stored. In particular, the memory lifetime scales as which is extremely inefficient: doubling the lifetime requires squaring the number of synapses.
It is possible to extend lifetimes by reducing the learning rate, and in particular by letting the learning rate scale with the number of synapses. For the smallest that still allows one to store sufficient information per memory (i.e. that allows for an initial SNR∼1), , the memory lifetimes are extended by a factor that is proportional to . This trade-off between memory lifetime and initial SNR (i.e. the amount of information stored per memory) cannot be circumvented through the addition of a large number of synaptic states without fine-tuning the balance of potentiation and depression .
These shortcomings can be partially overcome by allowing for heterogeneity in the transition probabilities within an ensemble of synapses. Specifically, if there are equally sized groups of synapses, each with a different transition probability (), then the most plastic ones will provide a strong initial SNR while the least plastic ones will ensure long lifetimes. Intermediate time-scales are needed to bridge the gap between the extreme values. In Fig. 1c we plot the SNR as a function of time. Transition probabilities are taken to be of the form , where is the fastest learning rate, is the slowest learning rate and . Time is expressed in terms of the number of uncorrelated memories on the lower axis, and we choose an arbitrary rate of new uncorrelated memories (one per hour) to give an idea of the different orders of magnitudes of the timescales that are at play (from hours to years). This model, which we call the heterogeneous model is already an interesting compromise in terms of memory performance: as we increase the number of synapses, if the slowest learning rate is scaled as , then both the initial SNR and the memory lifetime scale advantageously with the number of synapses (). Moreover, the model has the desirable property that the memory decay is a power law over a wide range of timescales, as observed in several experiments on forgetting .
The importance of memory transfer
In the heterogeneous model, the synapses operate on different timescales independently from each other. We now show that the performance can be significantly improved by introducing a feed-forward structure of interactions from the most plastic group to the least plastic group of synapses. How is this possible? While the least plastic synapses can retain memories for long times, their memory trace is weak. However, this memory trace can be boosted through periodic rewriting of already-stored memories. If a memory is still present in one of the groups of synapses (called hereafter a ‘memory stage’), the stored information can be used to rewrite the memory in the downstream stages, even long after the occurrence of the event that created the memory.
It is important to notice that not all types of rewriting can significantly improve all the aspects of the memory performance. For example, if all memories are simply reactivated the same number of times, then the overall learning rate changes, so that the initial memory trace becomes stronger, but the memory lifetimes are reduced by the same factor. Rather, an alternative strategy is to reactivate and rewrite a combination of multiple memories, one which has a stronger correlation with recent memories and a weaker correlation with the remote ones.
We have built a model, which we will call the memory transfer model, that implements this idea. We consider synapses divided into interacting stages. We assume that all the stages have the same size and that synapse in stage can influence a counterpart synapse in stage . In particular, synapses in the first stage undergo stochastic event-driven transitions as before (Fig. 2a). They therefore encode each new memory as it is presented. On the other hand, synapses in downstream stages update their state stochastically after each memory is encoded in the first stage.
a. Upper left: In the model, the state of each synapse in stage one is updated stochastically in response to the occurrence of plasticity events. The synapses of downstream stages update their state according to the state of upstream stages. Lower left: Memories are encoded by subjecting the synapses in stage 1 of stages to a pattern of plasticity events, here illustrated by different colors. The correlation of synaptic states with a memory is initially zero in downstream stages, and builds up over time through feed-forward interactions. Right: The consolidation model always outperforms the heterogeneous model without interactions at sufficiently long times. Here a two-stage model is illustrated. The dashed line is the SNR of the second stage in the heterogeneous model. See text for details. b. The memory wave: the memory trace (from Eq. 1) in the consolidation model travels as a localized pulse from stage to stage (starting from , in fast learning stages, presumably localized in the medial temporal lobe, and ending at , in slow learning stages). Here and . Stage has a learning rate and . New memories are encoded at a rate of one per hour.
Specifically, at time , a memory of length consisting of a random pattern of potentiating () and depressing () events is presented to the synapses in stage one, which have synaptic state . Synapse is subjected either to a potentiating () or to a depressing () event with probability 1/2, and is updated with a probability as in the previous models. Therefore, the updating for synapses in stage 1 is identical to that for ensemble 1 in the synaptic model with heterogeneous transition probabilities which we discussed previously. Now, however, we assume that a synapse in stage 2 is influenced by the state of synapse in stage 1 in the following way. If synapse in stage 1 is in a potentiated (depressed) state at time ( or respectively), then synapse in stage 2 will potentiate (depress) at time with probability . The update rule for synapses in stage 3 proceeds analogously, but depends now on the state of synapses in stage 2, and so on.
In other words, after each memory is stored, a random portion of the synaptic matrix of each stage is copied to the downstream stages with a probability that progressively decreases. We will show later that this process of “synaptic copying” can actually be mediated by neuronal activity which resembles the observed replay activity –. Transition probabilities of the different memory stages are the same as in the heterogeneous model: . We will follow the SNR for a particular memory by measuring the correlation of the synaptic states in each stage with the event of interest.
Once again, we can derive a mean-field description of the stochastic dynamics. The upshot is that the mean signal in stage obeys the differential equationwhich expresses clearly how the signal in stage is driven by that in stage . This is precisely the mechanism behind the improvement of memory performance compared to the heterogenous model without interactions. The memory trace in the first stage decays exponentially as new memories are encoded, as in the homogeneous case (see Fig. 2a). Memory traces in downstream stages start from zero, increase as the synaptic states are propagated, and eventually decay once again to zero. Information about all the stored memories is transferred between stages because the synapses that are “copied” are correlated to all the memories that are still represented at the particular memory stage. The most plastic stages retain the memories for a limited time, but during this time they transfer them to less plastic stages. This explains why the memory traces of downstream stages are non-monotonic functions of time: at stage , the memory trace keeps increasing as long as the information about the tracked memory is still retained in stage . The memory trace in the second stage is already greater than that of an equivalent heterogeneous model with independent synaptic groups (Fig. 2a). This effect is enhanced as more stages are added.
The memory trace takes the form of a localized pulse that propagates at an exponentially decreasing rate (Fig. 2b). It begins as a sharply peaked function in the fast learning stages but slowly spreads outward as it propagates toward the slow learning stages. This indicates that although the memory is initially encoded only in the first stage (presumably located in the medial temporal lobe), at later times it is distributed across multiple stages. Nonetheless, it has a well defined peak, meaning that at intermediate times the memory is most strongly represented in the synaptic structure of intermediate networks.
An analytical formula for the pulse can be derived, see Methods and Text S1, which allows us to calculate the SNR and memory lifetimes (Fig. 3). Now, when reading out the signal from several stages of the memory transfer model, we must take into account the fact that the noise will be correlated. This was not the case for the heterogeneous model without interactions. In fact, if we consider a naive readout which includes all stages, the noise will increase weakly with the number of stages. On the other hand, if we only read out the combination of stages which maximizes the SNR, one can show that the noise is independent of and very close to the uncorrelated case. In fact, this readout is equivalent to reading out only those groups whose SNR exceeds a fixed threshold, which could be learned, see Text S1 for more details.
a. The SNR for two values of for a fixed number of synapses (solid lines: consolidation model, dotted lines: heterogeneous model without interactions). The initial SNR for both models scales as . It then decays as power law () and finally as an exponential for for the heterogeneous model and for for the consolidation model. Three measures of interest are shown in the inset and in the bottom two panels. Inset: crossing time between the SNR of the heterogeneous model and the SNR of the consolidation model as a function of . The heterogeneous model is better than the consolidation model only for very recent memories (stored in the last hours, compared to memory lifetimes of years). b. The SNR scales as in the consolidation model when the SNR decay is approximately a power law (symbols: simulations, line: analytics). The SNR at indicated times is plotted as a function of for three different values of . c. Lifetimes (i.e. time at which SNR = 1) in the consolidation model scale approximately as ( is the fastest learning rate and is the slowest). The memory lifetime is plotted vs for three different values of . synapses evenly divided into stages. Stage has a learning rate .
Fig. 3a shows the SNR for memories in the heterogeneous model (dashed lines) and the memory transfer model (solid lines) for a fixed number of synapses and different numbers of groups . The curves are computed using the optimal readout described above, for which noise correlations are negligible. Both the SNR for intermediate times and the overall lifetime of memories increase with increasing in the memory transfer model. The increase in SNR is proportional to , see Fig. 3b, while the lifetime is approximately linear in for large enough , see Fig. 3c. While the initial SNR is reduced compared to the heterogeneous model (by a factor proportional to ), it overtakes the SNR of the heterogeneous model already at very short times (inset of Fig. 3a).
Importantly, the memory transfer model also maintains the propitious scaling seen in the heterogeneous model of the SNR and memory lifetime with the number of synapses . Specifically, if the slowest learning rate is scaled as , then the very initial SNR scales as (but almost immediately after the memory storage it scales as ) and the lifetime as . Hence the lifetime is extended by a factor that is approximately with respect to the memory lifetime of both the heterogeneous model and the cascade synaptic model  in which the memory consolidation process occurs entirely at the level of individual complex synapses. The improvement looks modest on a logarithmic scale, as in Fig. 3a, however it becomes clear that it is a significant amelioration when the actual timescales are considered. In the example of Fig. 3a the memory lifetime extends from three years for the heterogeneous model, to more than thirty years for the memory transfer model. As the memory lifetime extends, the initial signal to noise ratio decreases compared to the heterogeneous model (but not compared to the cascade model, for which it decreases as , where is the number of levels of the cascade, or in other words, the complexity of the synapse). However, the reduction is small, and after a few memories the memory transfer model already outperforms the heterogeneous model. In the example of Fig. 3 the heterogeneous model has a larger SNR only for times of the order of hours. This time interval should be compared to the memory lifetime which is of the order of decades.
Neuronal implementation and the role of replay activity
The consolidation model we have described involves effective interactions between synapses that must be mediated by neuronal activity. We now show that it is possible to build a neuronal model that implements these interactions. We consider a model of identical stages, each one consisting of recurrently connected McCulloch-Pitts neurons (the total number of plastic synapses is ). Neurons in each stage are connected by non-plastic synapses to the corresponding neurons in the next stage (feed-forward connections). See Fig. 4a for a scheme of the network architecture. The model operates in two different modes: encoding and transfer. Importantly, we must now be more careful concerning our definition of time. The unit of time we have used up until now was simply that of the encoding of a memory, i.e. one time step equals one memory. Now we have two different time scales: the encoding time scale and the neuronal time scale. The encoding time scale is just the same as before, i.e. it is the time between learning new memories. The neuronal time scale is much faster. Specifically, in the neuronal model we encode a new memory and then stimulate the neurons to drive the transfer of patterns of synaptic weights. The time-step used in the Hebbian learning process when a memory is encoded, as well as the time-step used during this transfer process is a neuronal time scale, perhaps from milliseconds to hundreds of milliseconds. The time between memory encodings, on the other hand, might be on the order of minutes or hours, for example.
a A schematic representation of the neural network architecture. Here we show stage 1 and 2, but the other memory stages are wired in the same way. Neurons are represented by triangles and synaptic connections by circles. The axons are red, purple and orange, and the dendritic trees are black. Each neuron connects to all the neurons in the same stage (recurrent connections, orange) and to the corresponding neuron in the downstream stage (feed-forward connections, purple). The recurrent connections are plastic whereas the feed-forward connections are fixed. b,c memory encoding: a pattern of activity is imposed in the first stage only and synapses are updated stochastically according to a Hebbian rule. Specifically, if both the pre and the post-synaptic neurons are simultaneously active (b, the activity is schematically represented by trains of spikes), the synapse is potentiated. If the pre-synaptic neuron is active and the post-synaptic neuron is inactive, the synapse is depressed (c).
During encoding, a subset of neurons in the first stage is activated by the event that creates the memory and the recurrent synapses are updated according to a Hebbian rule, see Fig. 4b,c. Specifically, one half of the neurons are randomly chosen to be activated (), while the remaining neurons are inactive (), where is the state of the neuron in stage . A synapse is then potentiated () with a probability if and is depressed () with probability if , where is a binary synapse from neuron to neuron in stage . Consistent with the previous analysis, we assume that the neuronal patterns of activity representing the memories are random and uncorrelated. No plasticity occurs in the synapses of neurons in downstream stages during encoding.
During transfer, a random fraction of neurons in each stage is activated at one time step, and the network response then occurs on the following time-step due to recurrent excitatory inputs. Specifically, at time , for all neurons which have been activated in stage , and otherwise . At time the recurrent input to a neuron in stage due to this activation is . If then and otherwise , where is a threshold. At time all neurons are silenced, i.e. and then the process is repeated times. The initially activated neurons at time are completely random and in general they will not be correlated with the neuronal representations of the stored memories. However, the neuronal response at time will be greatly affected by the recurrent synaptic connections. For this reason, the activity during the response will be partially correlated with the memories stored in the upstream stages, similar to what happens in observed replay activity (see e.g. –).
During transfer, the activated neurons project to counterpart neurons in the downstream stage. Crucially, we assume here that the long-range connections from the upstream stage to the downstream one are up-regulated relative to the recurrent connections in the downstream stage. In this way, the downstream state is “taught” by the upstream one. In the brain this may occur due to various mechanisms which include neuromodulatory effects and other gating mechanisms that modulate the effective couplings between brain regions. Cholinergic tone, in particular, has been shown to selectively modulate hippocampal and some recurrent cortical synapses (see ) as well as thalamocortical synapses . Recent studies have also shown that the interactions between cortical and subcortical networks could be regulated by changing the degree of synchronization between the rhythmic activity of different brain areas (see e.g. ).
In our model we assumed that, due to strong feedforward connections, whenever we have . The pattern of activation in stage therefore follows that of stage during the transfer process. Importantly plasticity only occurs in the recurrent synapses of the downstream stage , i.e. stage is ‘teaching’ stage . For illustration we first consider a simple learning rule which can perfectly copy synapses from stage to stage , but only for the special case of , i.e. single-neuron stimulation. Following this, we will consider a learning rule which provides for accurate but not perfect copying of synapses but which is valid for any .
Fig. 5 shows a schematic of the transfer process when . In this simplest case, only one presynaptic synapse per neuron is activated. To successfully transfer this synapse to the downstream stage a simple rule can be applied. First, the threshold is set so that . If there is a presynaptic spike () followed by a postsynaptic spike (), then potentiate () with a probability equal to the intrinsic learning rate of the synapses, . If there is no postsynaptic spike () then the corresponding synapse should be depressed (). This leads to perfect transfer.
Synapses are here transferred from stage 1 to stage 2, the same mechanism applies to any other two consecutive stages. During the transfer process the feed-forward connections are up-regulated, and the recurrent connection of the target stage are down-regulated. The process starts with the stimulation of a fraction of randomly chosen neurons in stage 1 (a). The activity of the neuron is schematically represented by a train of spikes. The axon branches of the activated neurons (in this example only one neuron is activated) are highlighted. (b) the spontaneous activation of neuron 1, causes the activation of the corresponding neuron in stage 2 and of the stage 1 neurons that are most strongly connected. The process of relaxation has started. (c) the recurrently connected neurons of stage 1 which are activated, excite and activate the corresponding neurons in stage 2. As a result of the consecutive activation of the two highlighted neurons in stage 2, the synapse pointed by an arrow is potentiated, ending up in the same state as the corresponding synapse in stage 1. The strength of one synapse in stage 1 has been successfully copied to the corresponding synapse in stage 2.
In general and therefore it is not possible to perfectly separate inputs with a single threshold. Nevertheless, a learning rule which can accurately copy the synapses in this general case is the following. Consider two thresholds , which are ‘low’ and ‘high’ respectively. On any given transfer (there are of them per stage) is set to one of these two thresholds with probability . If then if and , then set with a probability . In words, this says that if despite the high threshold, the presynaptic activity succeeded in eliciting postsynaptic activity, then the synapses in stage must have been strong, therefore one should potentiate the corresponding synapses in stage . Similarly if then if and , then set with a probability . In words, this says that if despite the low threshold, the presynaptic activity did not succeed in eliciting postsynaptic activity, then the synapses in stage must have been weak, therefore one should depress the corresponding synapses in stage . For this learning rule to work, both stages and must be privy to the value of the threshold. Therefore, there must be some global (at least common to these two stages) signal available. This could be achieved via a dynamical brain state with long-range spatial correlations. For example, globally synchronous up-state and down-state transitions , which are known to occur during so-called slow-wave sleep would be ideally suited to shift neuronal thresholds. Alternatively, theta oscillations have been shown to be coherent between hippocampus and prefrontal cortex in awake behaving rodents during working memory  and learning tasks  and would also be suited to serve as a global signal for synaptic plasticity.
We have stated that this second learning rule involving two thresholds can lead to accurate learning in the general case. Concretely, we can completely characterize the transfer process between any two stages via two quantities: the transfer rate , which is the fraction of synapses transferred after replays of the transfer process, and the accuracy of transfer which is the fraction of transferred synapses which were correctly transferred. Both of these quantities depend on the stimulation fraction and the threshold and can be calculated analytically, see Methods. In short, the stimulation of neurons during the transfer process leads to a unimodal input distribution which is approximately Gaussian for . The transfer rate is proportional to the area in the tails of this distribution above the high threshold and below the low threshold, while the accuracy is the fraction of this area which is due only to strong synapses (above the high threshold) or to weak synapses (below the low threshold). It is easy to see that as the thresholds are moved away from the mean into the tails the transfer rate will decrease while the accuracy will increase. There is therefore a speed-accuracy tradeoff in the transfer process.
Additionally, the transfer process can be implemented even if we relax the assumption of strong one-to-one feedforward connections and allow for random feedforward projections, see Text S1. In this case a two-threshold rule is still needed to obtain performance above chance level, although an analytical description is no longer straightforward.
The neuronal implementation of the transfer process reveals an important fact: the probability of correctly updating a synapse does not depend solely on its intrinsic learning rate, but rather on the details of the transfer process itself. In our simple model, the transfer rate is where is a factor which depends on the threshold of the learning process relative to the distribution of inputs and is the intrinsic learning rate of the synapses in the downstream stage. Additionally, since the likelihood of a correct transfer is , the rate of correct transfers is , while there is also a “corruption” rate equal to which is the probability of an incorrect transfer. Obviously, if a given fraction of synapses is to be transferred correctly, the best strategy is to make as close to one as possible and increase accordingly. In the limit the neuronal model is exactly equivalent to the mean-field model we studied earlier with the transfer rate playing the role of the learning rate. For a modified mean-field model with a “corruption” term can be derived, see Text S1 for details. Fig. 6 illustrates that the neuronal implementation quantitatively reproduces the behavior of the synaptic mean-field model. Specifically, the transfer rate can be modified by changing the number of transfers , as shown in Fig. 6a. In this case, although the intrinsic synaptic properties have not changed at all, learning and forgetting occur twice as fast if is doubled. The combined SNR of ten stages with 1000 all-to-all connected neurons each averaged over ten realizations (symbols) is compared to the mean-field model (line) in Fig. 6. In this case, the parameters of the neuronal model have been chosen such that the transfer rates are equal to , and .
a. The effective learning rate of a downstream synapse depends on the transfer process itself. Increasing the number of transfer repetitions increases this rate leading to faster learning and faster forgetting. Shown is SNR of each of the first two stages. Symbols are averages of ten simulations, lines are from the mean-field model, see Methods. Here , , , and which gives and when . b. The neuronal model is well described by the mean-field synaptic model. There are 10 stages, each with all-to-all connected neurons. Parameters are chosen such that transfer rates are . The solid line is for a in the mean-field model. Shown is the combined SNR for all 10 stages.
In conclusion, we showed that there is a clear computational advantage in partitioning a memory system into distinct stages, and in transferring memories from fast to slow stages. Memory lifetimes are extended by a factor that is proportional to the number of stages, without sacrificing the amount of information stored per memory. For the same memory lifetimes, the initial memory strength can be orders of magnitude larger than in non-partitioned homogeneous memory systems. In the Results we focused on the differences between the heterogeneous and the memory system model. In Fig. S15 in Text S1 we show that the SNR of the memory transfer model (multistage model) is always larger than the SNR of homogeneous model for any learning rate. This is true also when one considers that homogeneous models can potentially store more information than the memory transfer model. Indeed, in the homogeneous model all synapses can be modified at the time of memory storage, not only the synapses of the first stage. However, the main limitation of homogeneous models with extended memory lifetimes comes from the tiny initial SNR. If one reduces the amount of information stored per memory to match the information stored in the memory transfer model, it is possible to extend an already long memory lifetime but the initial SNR reduces even further (see Text S1 for more details).
Our result complements previous studies (see e.g. , , ) on memory consolidation that show the importance of partitioning memory systems when new semantic memories are inserted into a body of knowledge. Two-stage memory models were shown to be fundamentally important to avoid catastrophic forgetting. These studies focused mostly on “memory reorganization”, as they presuppose that the memories are highly organized and correlated. We have solved a different class of problems that plague realistic memory models even when all the problems related to memory reorganization were solved. The problems are related to the storage of the memory component that contains only incompressible information, as in the case of random and uncorrelated memories. These problems are not related to the structure of the memories and to their similarity with previously stored information, but rather they arise from the assumption that synaptic efficacies vary in a limited range. We showed here that this problem, discovered two decades ago  and partially solved by metaplasticity , can also be solved efficiently at the systems level by transferring memories from one sub-system to another.
Our neuronal model provides a novel interpretation of replay activity. Indeed, we showed that in order to improve memory performance, synapses should be copied from one stage to another. The copying process occurs via the generation of neuronal activity, that reflects the structure of the recurrent synaptic connections to be copied. The synaptic structure, and hence the neuronal activity, is actually correlated with all past memories, although most strongly with recent ones. Therefore while this activity could be mistaken for passive replay of an individual memory, it actually provides a snapshot of all the information contained in the upstream memory stage. There is already experimental evidence that replay activity is not a mere passive replay . Our interpretation also implies that the statistics of “replay” activity should change more quickly in fast learning stages like the medial temporal lobe, than in slow learning stages like pre-frontal cortex or some other areas of the cortex .
Our analysis also reveals a speed-accuracy trade off that is likely to be shared by a large class of neuronal models that implement memory transfer: the faster the memories are transferred (i.e. when a large number of synapses are transferred per “replay” and hence a small number of repetitions is needed), the higher the error in the process of synaptic copying (Fig. 6a). Accuracy is achieved only when the number of synapses transferred per “replay” is small and is sufficiently large. This consideration leads to a few requirements that seem to be met by biological systems. In particular, in order to have a large , it is important that the transfer phases are brief, if the animal is performing a task. This implies that the synaptic mechanisms for modifying the synapses in the downstream stages should operate on short timescales, as in the case of Spike Timing Dependent Plasticity (STDP) (see e.g. ). Alternatively, the transfer can occur during prolonged intervals in which the memory system is off-line and does not receive new stimuli (e.g. during sleep).
Although we have focused on the transfer of memories in our model, the neuronal model can additionally be used to read out memories. Specifically, the neuronal response of any stage (or several stages) to a previously encoded pattern is larger than to a novel pattern. This is true as long as the SNR, as we have used it in this paper i.e. synaptic overlap, is sufficiently large. This difference in neuronal response can be used by a read-out circuit to distinguish between learned and novel patterns, see Text S1 for a detailed implementation.
Our theory led to two important results which generate testable predictions. The results are: 1) the memory performance increases linearly with the number of memory stages, and 2) the memory trace should vary in a non-monotonic fashion in most of the memory stages. The first suggests that long-term memory systems are likely to be more structured than previously thought, although we cannot estimate here what the number of partitions should be, given the simplicity of the model. Some degree of partitioning has already been observed: for example graded retrograde amnesia extends over one or two years in humans with damage to area CA1 of the hippocampus, but can extend to over a decade if the entire hippocampus is damaged . Systematic lesion studies in animals should reveal further partitioning in the hippocampal-cortical pathway for consolidation of episodic memories.
A second prediction is related, since once the partitions have been identified, our work suggests that most stages should exhibit non-monotonic memory traces, although on different time-scales. In fact, a recent imaging study with humans revealed non-monotonic BOLD activation as a function of the age of memories that subjects recalled . Furthermore the non-monotonicity was observed only in cortical areas and not in hippocampus. Here multi-unit electrophysiology in animals would be desirable to obtain high signal-to-noise ratios for measuring the memory traces. An analysis such as the one proposed by , , in which spiking activity in rats during sleep was correlated with waking activity, should enable us to estimate the strength of a memory trace. We expect that the memory trace is a non-monotonic function of time in most memory areas. The initial trace is usually small or zero, it then increases because of the information transferred from the upstream memory stages, and it finally decreases as a consequence of the acquisition of new memories. The timescales of the rising phase should reflect the dynamics of the upstream memory stages, whereas the decay is more related to the inherent dynamical properties of the memory stage under consideration. Therefore, the position of the peak of the memory trace and the timescale of the decay give important indications on the position of the neural circuit in the memory stream and on the distribution of parameters for the different memory stages. The statistics of neural activity during memory transfer (replay activity) should reflect the synaptic connections and in particular it should contain a superposition of a few memory traces in the fast systems, and an increasingly larger number of traces in the slower systems. The statistics of the correlations with different memories should change rapidly in the fast systems, and more slowly in the slow systems (e.g. in the hippocampus the changes between two consecutive sleeping sessions should be larger than in cortical areas where longer-term memories are stored).
To obtain experimental evidence for these two sets of predictions, it is important to record neural activity for prolonged times, in general long enough to cover all the timescales of the neural and synaptic processes that characterize a particular brain area. This is important both to determine the time development of the memory traces and to understand the details of the neural dynamics responsible for memory transfer.
To estimate the SNR, one can analyze the recorded spike trains during rest and NREM sleep, when memory transfer is expected to occur. We believe that the strength of memory reactivation is related to our SNR. The analysis proposed in ,  should allow us to estimate the templates of memories that are reactivated during one particular epoch (the templates are the eigenvectors of the covariance matrix that contains the correlations between the firing rates of different neurons). The time development of the memory trace can be then studied by projecting the activity of a different epoch on the eigenvectors. The projections are a measure of the memory reactivation strength and they should be approximately a nonlinear monotonic function of the memory signal. This analysis not only would determine whether the memory trace is a non-monotonic function of time but it would also allow us to estimate the parameters that characterize its shape in different brain areas.
The memory model studied here is a simple abstraction of complex biological systems which illustrates important general principles. Among the numerous simplifications that we made, there are three that deserve additional discussion. The first one is about the representations of the random memories and the second one is about the synaptic dynamics.
The first simplification is that we implicitly assumed that the memory representations are dense, as all synapses are potentially modified every time a new memory is stored. In the brain these representations are likely to be sparse, especially in the early stages of the memory transfer model, which probably correspond to areas in the medial temporal lobe. Sparseness is known to be important for increasing memory capacity , ,  and one may legitimately wonder why we did not consider more realistic sparse representations. However, in our simplified model sparser random representations are equivalent to lower learning rates if the average number of potentiations and depressions are kept balanced. If is the average fraction of synapses that are modified in the first stage (coding level), then all qs of the model should be scaled by the same factor . This does not change the scaling properties that we studied, except for a simple rescaling of times (the x-axis of the plots should be transformed as ) and SNR (SNR→SNR·). In conclusion, sparseness is certainly an important factor and we are sure that it plays a role in the memory consolidation processes of the biological brain. However here we focused on mechanisms that are independent from the coding level and hence we did not discuss in detail the effects of sparseness, which have been extensively studied elsewhere , , .
The second simplification that merits a further discussion is that the model synapses studied here have a single time-scale associated with each of them. Our model can be extended to include synaptic complexity as in . In fact, allowing for multiple time-scales at the level of the single synapse should lessen the number of stages needed for a given level of performance. Specifically, time-scales spanning the several orders of magnitude needed for high SNR and long memory lifetimes can be achieved through a combination of consolidation processes both at the single synapse, and between spatially distinct brain areas.
Here we include a brief description of the models and formulas used to generate the figures. For a detailed and comprehensive description of the models please refer to Text S1.
Simple models of synaptic memory storage
The homogeneous and heterogeneous synaptic models are comprised of stochastically updated binary synapses which evolve in discrete time. In the homogeneous case all synapses have the same learning rate , while in the latter case there are groups of synapses each. Each group has a learning rate . At each time step all synapses are subjected to a potentiation or depression with equal probability. The N-bit word of potentiations and depressions constitutes the memory to be encoded. The memory signal at time , is the correlation of the synaptic states with a particular N-bit memory, and we use superscript to denote evolution in discrete time. The signal-to-noise ratio (SNR) is approximately (and is bounded below by) the signal divided by , see Text S1 for more details.
To compare with these Markov models one can derive a mean-field description which captures the memory signal averaged over many realizations of the stochastic dynamics. This is done by considering the probability that a given synapse is in a given state as a function of time. Specifically, the probability of a single synapse with learning rate to be in the potentiated state at time is justwhere and .
In the case of the homogeneous synaptic model there are synapses with the same learning rate. The expected value of the signal averaged over realizations is thenand so the expected signal-to-noise ratio isWe can approximate the finite-time equation for with a continuous ordinary differential equation which, using the definition of SNR givesthe solution of which is . This equation is used to plot the curves in Fig. 1b. The heterogeneous case is analogous withwhere is the expected signal at time in stage . This equation is used to plot the solid curve in Fig. 1c. The SNR in the heterogeneous model can be increased by reading out only some of the groups at any one point in time, as opposed to all of them. This optimal readout is used to plot the dashed curves in the top panel of Fig. 3.
The memory transfer model
Once again we assume there are a total of synapses divided equally amongst stages. Synapses in stage have learning rate and hence the fastest learning rate is and slowest is . Synapses in stage 1 are updated every time step in an identical fashion to those in group 1 of the heterogeneous model above. Synapses in downstream stages however, update according to the state of counterpart synapses in the upstream stage. Specifically, if a synapse in stage is potentiated (depressed) at time , then synapse in stage potentiates (depresses) at time with probability . As before, the signal at time in stage is written . This fully defines the stochastic model.
As before we can derive a mean-field description of the stochastic dynamics. In this case, the probability of a given synapse in stage 1 to be in a potentiated state at time is as in the simple models. The probability of a given synapse in stage begin in a potentiated state can be writtensee Text S1 for details. These equations reflect the fact that only synapses in stage 1 are updated due to the presentation of random, uncorrelated memories, while synapses in downstream stages are updated only due to the state of synapses in the preceding stage. The expected signal in stage is given by .
The continuous time approximation to the mean-field dynamics is given by the set of equationswith initial conditions , for and we write for the expected signal. These equations are used to plot the curves in Fig. 2a and the solid curves in the top panel of Fig. 3. For sufficiently large we can furthermore recast this system of ODEs as a PDEwhere the spatial variable . An asymptotic solution to this equation valid for , and taking now the SNR, is(1)see Text S1 for details. This equation is used to plot the pulse solution shown in Fig. 2b. An optimal SNR, in which only some of the stages are read out, can be calculated based on Eq. 1 and is(2)which is valid for intermediate times where the SNR is powerlaw in form. This equation is used to plot the curves in Fig. 3 bottom left. Using Eqs. 1 and 2 one can calculate the lifetime of memories as(3)if the SNR of the pulse is above one before reaching the last stage or(4)is the SNR drops below one already before reaching the last stage. Eqs. 3 and 4 are used to plot the solid curves in Fig. 3 bottom right.
Neuronal implementation of the memory transfer model
There are stages. Each stage is made up of all-to-all coupled McCulloch-Pitts neurons. Each one of the synapses (no self-coupling) can take on one of two non-zero values. Specifically, the synapse from neuron to neuron , where . Furthermore, there are one-to-one connections from a neuron in stage to a neuron in stage . The model operates in two distinct modes: Encoding and Transfer.
All memories are encoded only in stage 1. Specifically, one half of the neurons are randomly chosen to be activated ( if ), while the remaining neurons are inactive ( if ). A synapse is then potentiated to with a probability if and is depressed with probability if .
A fraction of randomly chosen neurons in stage is activated at time . Because of the powerful feedforward connections, the same subset of neurons is activated in stage . The recurrent connectivity may lead to postsynaptic activation in stage 1 neurons. Each neuron receives an inputat time where if neuron was activated and otherwise. The input is a random variable which for is approximately Gaussian distributed with expected mean and varianceIf , where is the neuronal threshold, then neuron is activated at time . Again, because of the powerful feedforward connections, the same subset of neurons in stage 2 is activated. We take to be the same for all neurons and assume that it can take one of two values with equal likelihood during each replay.
For a transfer process with stimulations of a fraction of neurons, the fraction of synapses updated in the downstream stage, or the transfer rate , is a function of the area of the input distribution above (below) (). If the thresholds are placed equidistant from the mean , thenIf the fraction of synapses transferred is small then , which is the formula given in the text. Of those synapses which are updated, only some will be updated correctly. This is equal to the fraction of potentiated (depressed) synapses contributing to the total input above (below) (), and is(5)Finally, the mean-field model describing the memory signal in each stage in the neuronal model is the same as in Eqs. 1-1 where the learning rate is now the transfer rate times the fraction of correct transfers , and there is an additional decay term due to incorrect transfers of the form for . This mean-field model is used to make the solid curves in Fig. 6, whereas the symbols are from the full, Markov model with McCulloch-Pitts neurons.
Additional model information.
We are grateful to Larry Abbott, Francesco Battaglia, Randy Bruno, Sandro Romani, Giulio Tononi, and John Wixted for many useful comments on the manuscript and for interesting discussions.
Conceived and designed the experiments: AR SF. Analyzed the data: AR SF. Wrote the paper: AR SF. Developed the model: AR SF.
- 1. Scoville WB, Milner B (1957) Loss of recent memory after bilateral hippocampal lesions. J Neurol Neurosurg Psychiatr 20: 11–21.
- 2. Squire LR, Wixted JT (2011) The cognitive neuroscience of human memory since H.M. Annu Rev Neurosci 34: 259–288.
- 3. Amit DJ, Fusi S (1994) Learning in neural networks with material synapses. Neural Computation 6: 957–982.
- 4. Fusi S (2002) Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biological Cybernetics 17: 305–317.
- 5. Fusi S, Abbott LF (2007) Limits on the memory storage capacity of bounded synapses. Nat Neurosci 10: 485–493.
- 6. Mc Closkey M, Cohen NJ (1989) Catastrophic interference in connectionist networks: the sequential learning problem. G H Bower (ed) The Psychology of Learning and Motivation 24: 109–164.
Carpenter G, Grossberg S (1991) Pattern Recognition by Self-Organizing Neural Networks. MIT Press.
- 8. McClelland JL, McNaughton BL, O'Reilly RC (1995) Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102: 419–457.
- 9. Wixted JT, Ebbesen EB (1991) On the form of forgetting. Psychological Science 2: 409–415.
- 10. Wixted JT, Ebbesen EB (1997) Genuine power curves in forgetting: a quantitative analysis of individual subject forgetting functions. Mem Cognit 25: 731–739.
- 11. Fusi S, Drew PJ, Abbott LF (2005) Cascade models of synaptically stored memories. Neuron 45: 599–611.
- 12. Amit DJ, Mongillo G (2003) Spike-driven synaptic dynamics generating working memory states. Neural Comput 15: 565–596.
- 13. Wixted JT (2004) On Common Ground: Jost's (1897) law of forgetting and Ribot's (1881) law of retrograde amnesia. Psychol Rev 111: 864–879.
- 14. Kudrimoti HS, Barnes CA, McNaughton BL (1999) Reactivation of hippocampal cell assemblies: effects of behavioral state, experience, and EEG dynamics. J Neurosci 19: 4090–4101.
- 15. Lee AK, Wilson MA (2002) Memory of sequential experience in the hippocampus during slow wave sleep. Neuron 36: 1183–1194.
- 16. Foster DJ, Wilson MA (2006) Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440: 680–683.
- 17. Diba K, Buzsaki G (2007) Forward and reverse hippocampal place-cell sequences during ripples. Nat Neurosci 10: 1241–1242.
- 18. Ji D, Wilson MA (2007) Coordinated memory replay in the visual cortex and hippocampus during sleep. Nat Neurosci 10: 100–107.
- 19. O'Neill J, Pleydell-Bouverie B, Dupret D, Csicsvari J (2010) Play it again: reactivation of waking experience and memory. Trends Neurosci 33: 220–229.
- 20. Hasselmo ME (2006) The role of acetylcholine in learning and memory. Curr Opin Neurobiol 16: 710–715.
- 21. Blundon JA, Bayazitov IT, Zakharenko SS (2011) Presynaptic gating of postsynaptically expressed plasticity at mature thalamocortical synapses. J Neurosci 30: 16012–16025.
- 22. Miller EK, Buschman TJ (2013) Cortical circuits for the control of attention. Curr Opin Neurobiol 23: 216–222.
- 23. Steriade M, Nuez A, Amzica F (1993) A novel slow (<1 hz) oscillation of neocortical neurons in vivo: depolarizing and hyperpolarizing components. J Neurosci 13: 3252–3265.
- 24. Hyman JM, Zilli EA, Paley AM, Hasselmo ME (2010) Working memory performance correlates with prefrontal-hippocampal theta interactions but not with prefrontal neuron firing rates. Front Integr Neurosci 4: 2
- 25. Benchenane K, Peyrache A, Khamassi M, Tierney PL, Gioanni Y, et al. (2010) Coherent theta os-cillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning. Neuron 66: 921–936.
- 26. Kli S, Dayan P (2004) Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions. Nat Neurosci 7: 286–294.
- 27. Battaglia FP, Pennartz CMA (2011) The construction of semantic memory: grammar-based rep-resentations learned from relational episodic information. Front Comput Neurosci 5: 36.
- 28. Gupta AS, van der Meer MA, Touretzky DS, Redish AD (2010) Hippocampal replay is not a simple function of experience. Neuron 65: 695–705.
- 29. Bi GQ, Poo MM (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18: 10464–10472.
- 30. Squire LR (1992) Memory and the Hippocampus: A synthesis from findings with rates, monkeys and humans. Psychol Rev 99(2): 195–231.
- 31. Smith CN, Squire LR (2009) Medial temporal lobe activity during retrieval of semantic memory is related to the age of the memory. J Neurosci 29: 930–938.
- 32. Peyrache A, Khamassi M, Benchenane K, Wiener SI, Battaglia FP (2009) Replay of rule-learning related neural patterns in the prefrontal cortex during sleep. Nat Neurosci 12: 919–926.
- 33. Peyrache A, Benchenane K, Khamassi M, Wiener SI, Battaglia FP (2010) Principal component analysis of ensemble recordings reveals cell assemblies at high temporal resolution. J Comput Neurosci 29: 309–325.
- 34. Willshaw DJ, Buneman OP, Longuet-Higgins HC (1969) Non-holographic associative memory. Nature 222: 960–962.
- 35. Tsodyks MV, Feigel'man MV (1988) The enhanced storage capacity in neural networks with low activity level. Europhysics Letters (EPL) 6: 101–105.

domain: psychology


text:
All > Technology > Records Management
- determination that records possess value in documenting the history of an organization and are thus worthy of permanent preservation
See also administrative value, evidential value, fiscal value, intrinsic value, legal value, and value.
ARMA - Cite This Source - This Definition
- The usefulness of records for historical research concerning the agency of origin or for information about persons, places, events or things. See also research value.
State of California - Cite This Source - This Definition
- the usefulness of a record for the purpose of understanding history. See evidential value, informational value, intrinsic value.
Tennessee State Library and Archives - Cite This Source - This Definition
- In appraisal, the value that documents the history of an organization. Sometimes referred to as archival, continuing, or enduring value. Secondary Historical Value does not document the history of an organization, but recognizes a record containing information that is useful for conducting historical research.
State of Utah - Cite This Source - This Definition
- administrative value, archival value, commercial value, enduring value, evidential value, fiscal value, Information, informational value, Intrinsic value, legal value, long-term record, market value, monetary value, oral history, permanent record, permanent value, research value, shelf life, transitory record, Value

domain: history


text:
Baltimore Truck Accident Lawyers: Fatal Tesla AccidentNovember 9, 2016
Earlier this year, while testing the autopilot feature on a Tesla S sedan, an occupant was fatally injured when the car failed to brake before it turned in front of a semitrailer. The car hit the truck, ran under the trailer, and then veered off the road and into a power pole. The car accident has sparked an ongoing debate about the safety of self-driving technologies, and their future in commercial trucking.
Trucking companies have been investing time and money into developing autonomous commercial vehicles, including Daimler Trucks, Peterbilt, and Volvo. Tesla founder, Elon Musk, is also getting in on the action with plans to introduce electric, self-driving trucks. In a blog posted on Tesla’s website, Musk stated that as the technology grows, all Tesla vehicles will have self-driving capabilities. The heavy-duty electric trucks, which are currently in the early stages of development, will be introduced next year, according to Musk.
While the technology has come a long way in recent years, there are still concerns about how and under what circumstances the driver should be prepared to take over if the self-driving technology disengages. According to Musk, the autopilot is an assist feature, so even though the car has taken over a certain level of control over the driving, it is the driver’s responsibility to remain engaged, with their hands on the steering wheel at all times. A spokesman for the Insurance Institute for Highway Safety also warns that, even when a self-driving feature is engaged, the driver must remain vigilant when behind the wheel.
New Regulatory Guidelines
According to Transportation Secretary Anthony Foxx, it is just a matter of time before autonomous vehicles are on the roads, so it is crucial that there are regulations and guidelines that address the unique nature of these vehicles. Safety has to be the driving force behind all regulatory guidelines.
While no one has any intention of putting these vehicles on the road before they are ready, there are some who believe that we cannot afford to wait until the vehicle has been perfected. Both Musk and National Highway Traffic Safety Administrator Mark Rosekind believe that the number of highway fatalities from truck accidents will be significantly reduced with the introduction of automated vehicles. Rosekind pointed out that close to 94 percent of highway fatalities are due to human error, including driving while intoxicated, speeding or texting while driving. Automated vehicles have the potential to prevent 19 out of every 20 crashes, according to Rosekind.
Safety advocacy groups like Public Citizen, the Center for Auto Safety, and Consumer Watchdog call for more testing and stricter safety standards before introducing the “robot car technology” to the public.
Baltimore Car Accident Lawyers at LeViness, Tolzman & Hamilton Represent Victims of Autonomous Vehicle Technology Car Accidents
If you or a loved one have been seriously injured or killed in a car or truck accident, contact the dedicated Baltimore car accident lawyers at LeViness, Tolzman & Hamilton as soon as possible. We will thoroughly investigate your case and determine who is at fault. We will work tirelessly until we secure the maximum compensation for your injuries. For a free case review, call us today at 800-547-4LAW (4529) or contact us online.
Our offices are located in Baltimore, Columbia, Glen Burnie and Towson, allowing us to represent injured accident victims and their families throughout Maryland, including those in Anne Arundel County, Carroll County, Harford County, Howard County, Montgomery County, Maryland’s Western Counties, Southern Maryland, and the Eastern Shore, as well as the communities of Catonsville, Essex, Halethorpe, Middle River, Rosedale, Gwynn Oak, Brooklandville, Dundalk, Pikesville, Parkville, Nottingham, Windsor Mill, Lutherville, Timonium, Sparrows Point, Ridgewood, and Elkridge.

domain: news


text:
Register for items of all different price points. Some of your guests like to give theme gifts. For example, a pasta fork along with a pasta dish set rather than just a set of kitchen tools. Same price but more memorable.
Get the latest Inspiring Kitchen news sent directly to your inbox!
Looking for a healthy snack? Have you ever tried puffed millet? I just discovered these delicious and good for you treats made from a just launched brand called Tea Squares. They come in three flavors: Acai Blueberry Tea, Citrus Green Tea Matcha and Madagascar Vanilla. They are made with almonds, pepitas, fruits and other ingredients along with the tea. So good. They are in Whole Foods already or check their website. #teasquares #tea #snacks #healthysnacks #vegetarian #inspiringkitchen @ Chicago, Illinois
You can not tell from this picture how many delicious ingredients are in this salad from Pizzeria Bebu but it was so good. This Little Gem salad is made with fava beans, English peas, pecorino, pistachios, and topped with a Meyer lemon vinaigrette. Loved it. Light and flavorful. Perfect spring or summer salad as a meal or as a side with pizza. This new restaurant is doing very creative things. Go check them out. Good wine list too. #pizzeriabebu #salad #littlegem #favabeans #englishpeas #pistachio #inspiringkitchen
It's taco Tuesday which means I have to share my favorite dish from my trip to Loreto, Mexico and the Villa Del Palmar. These shrimp tacos are seasoned simply and grilled perfectly. A little lime juice and guacamole and lunch is served. Yum! Need a Margarita now. #tacotuesday #shrimptacos #vdplfam #villadelpalmarl #inspiringkitchen
Maggiano's is now serving brunch! Like these lemony ricotta pancakes with blueberries that are light and flavorful. Grab your friends, order some coffee (or Italian Bloody Mary's) and some of the wonderful brunch dishes and start your day off right! #Maggbrunch #Pancakes #brunch #maggianos #inspiringkitchen @ Maggiano's Little Italy Clark & Grand
If you are a homemade caramel lover, try Becky's Blissful Bakery caramels. She offers Dark Chocolate Sea Salt, Beer and Pretzel, Salted Whiskey Caramels and Cold Brew Caramels. Just the right amount of sweetness and chewiness in each bite. Check them out on beckysblissfulbakery.com. #caramels #homemadecandy #candy #inspiringkitchen
If you have ever had a dish that literally makes you stop talking and just savor the bite then you will understand why I loved this pizza. Newly opened Pizzeria Bebu with their gas heated brick ovens created this masterpiece of a pizza. Called the Ode to Rubirosa and made with vodka sauce, nutless pesto, and fresh mozzarella, you too will be speechless on your first bite. The just chewy and crispy crust balances out the sauce, cheese and pesto perfectly. This is no ordinary pizza joint. Their wine pairings are spot on. Like the Bernard Moreau Passetoutgrains. Check out my insta stories for more of the types of pizza they offer. We had 6 different kinds! Some meat and some vegetarian. A perfect place to hang out with friends or carry out if more convenient. But a must visit! #pizzeriabebu #feedmepizza #inspiringkitchen
How yummy do these colorful cupcakes look? Spring colors for our table. I'm partial to that purple one in the corner. Thanks, Sweet Mandy B, for the treats. If you are looking for beautiful cakes and cookies, check them out. Your family and guests will thank you! #cupcakes #sweetmandybs #inspiringkitchen

domain: food


Jobe Materials, L.P. provides the highest quality ready mixed concrete products and service to its customers and brings years of experience and expertise in performance driven mix designs. We have supplied high specification concrete and concrete paving mix for many large projects for the Texas Department of Transportation, Ft. Bliss, New Mexico Department of Transportation, and the U.S. Army Corps of Engineers.
All concrete plants are well maintained and adhere to strict standards to ensure reliability and efficiency. With central mix and dry batch plants in both stationary and mobile configurations, we are able to provide our products via delivery or on site to meet our customers’ needs.
Our concrete testing laboratory is certified by the U.S. Army Corps of Engineers and our personnel are ACI certified to ensure the quality of our product.
Jobe Materials, L.P. provides ready-mix concrete, HMAC, aggregates, and precast/prestressed products and concrete girders for various types of projects such as:
Need help figuring out how much concrete you need? Use our calculators for estimations and quantity calculations:


|Previous Section||Index||Home Page|
The Second Church Estates Commissioner (Sir Stuart Bell): The commissioners' landholdings total approximately 122,000 acres, and they were valued at £317 million in December 2004. They form part of a property portfolio valued at £1.3 billion in December 2004.
Given the hon. Gentleman's earlier remarks, may I take this opportunity to repeat my congratulations to the incoming Archbishop of York, who will be made to feel most welcome in the district?
24 Oct 2005 : Column 20
Sir Stuart Bell: As the hon. Lady knows, the Church Commissioners publish their annual accounts every year, and those accounts include all the information to which she has referred. If any particular item is not included in those reports, I will be happy to send her the information in the post, if I can find it.
Mr. Andy Reed (Loughborough) (Lab/Co-op): I am sure that my hon. Friend is aware of the increasing pressures on clergy. In my own benefice, for example, we have three churches, but no vicar. My hon. Friend has mentioned £317 million of land property. Can he guarantee Church members in struggling benefices, and in my benefice in particular, that the Church Commissioners are getting value for the land that they are maintaining, that they are ensuring that existing clergy are put into post in places where they are needed, and that the pension pot, the maintenance of which is vital for the recruitment of clergy both now and in the future, is being adequately topped up?
Sir Stuart Bell: I am grateful to my hon. Friend. As he knows, we passed a pension measure some years ago that transferred the burden of pensions to the diocese, but of course we maintain a responsibility to those who were in post at the time. It is a changing scene in terms of land values, dioceses and parishes. Where there are weaknesses we seek to rectify them, and where we can be positive we seek to be so. It is a major matter. The commissioners' assets are £4.3 billion, which require oversight. Any point that is made on the Floor of the House is carefully taken into account, as will be that raised by my hon. Friend.
John Bercow (Buckingham) (Con): Does the hon. Gentleman agree that the juxtaposition of huge landholdings with patently inadequate pension provision for retired clergy persons is a standing disgrace and an indictment of the commissioners?
Sir Stuart Bell: If I may refer back to my law practice, the two are not mutually exclusive, so we can link them together if the hon. Gentleman so wishes. However, each one is a separate problem and must be dealt with separately.
Mr. Speaker: We now come to the main businessOpposition day, eighth allotted day, on the Government's handling of decisions relating to Railtrack[Interruption.] Order. Perhaps the hon. Member for Stockport (Ann Coffey) could keep quiet.
I remind the House that last week the matter of the evidence of the right hon. Member for North Tyneside (Mr. Byers) to the Transport Sub-Committee was referred to the Committee on Standards and Privileges, so Members should not refer in this debate to matters that will fall to be judged by that Committee.
That this House deplores the lack of openness and transparency of the Chancellor of the Exchequer and Ministers at the Department for Transport, Local Government and the Regions in their plan to restructure Railtrack; questions the Government's propriety in the method by which they sought an Administration Order for Railtrack; condemns their attempted intimidation of the Rail Regulator; abhors their cavalier and dismissive contempt for Railtrack shareholders; criticises the conduct of the Chancellor of the Exchequer's special adviser for usurping the proper role of Ministers; notes that the Government's approach to the entire project was dictated by the Chancellor; and considers this episode an example of disgraceful impropriety in the formation of policy and the execution of government decisions.
Thank you, Mr. Speaker. I think that the House will respect the fact that the right hon. Member for North Tyneside (Mr. Byers) has chosen to come to this debate, although that sits in stark contrast with the obvious absence of the Chancellor of the Exchequer, who is mentioned in the motion.
This debate is about one thing and one thing onlythe conduct of new Labour in Government. It is about the way in which the decencies and proprieties of how we are governed have been bypassed, corrupted and polluted. It is about the erosion of independence in the civil service, the abuse of power by Ministers, the arrogance of unelected advisers, and the institutionalised contempt displayed by new Labour to the power and authority of Parliament.
This debate is about how the sorry episode of Railtrack's demise illustrates all the faults that I have listed, and it is about why the Government are so profoundly culpable for what they did. Today's
24 Oct 2005 : Column 22
debateas we understand your ruling, Mr. Speakeris not about matters that are being considered by the Standards and Privileges Committee. We are acutely aware of the important dividing line that separates the issues that we are focusing on and the issues being considered by that Committee. We will be extremely careful, Mr. Speaker, not to trespass on the accusations against the right hon. Member for North Tyneside that will be considered by the Committee. There is no need to do so; the guilt of this Government is palpable and can be proved without any such reference.
Nor is this debate about the Railtrack shareholders' case against the Government. As the judge made clear, he was required to adjudicate only on the one specific charge of misfeasancean accusation that presented a very high legal hurdle, namely, that the then Secretary of State had acted with targeted malice. Far from vindicating the Government in all respects, as they try to claim, the court case merely excused them from that one extreme and specific charge. The judge was not asked to undertake a review of the Government's conduct, nor to express any opinion on their actions more generally. As the judge categorically made clear, that is the duty of this House; a duty that we now face.
"This case . . . has aroused intense political interest but, Your Lordship, it is not a political tribunal, or even in this case a court of judicial review, and the question therefore is not whether this decision was wise or careful or fair or reasonable or procedurally sound, it is simply whether it was malicious."
All of us in the House face a testa test of moral probity. We can choose simply to follow the party line or we can exercise our conscience on this matter of justice and take the necessary steps to remove from our Government those whose standards have fallen so grievously low. This House is the place for the redress of grievance. That is what we must now do. As the chairman of the shareholders action group said after the court case:
Despite the Government's amendment, the debate is not about the merits and demerits of how Railtrack is or was owned. We are not here to discuss the intricacies and rights and wrongs of who owns the railways. Any attempt to turn the debate into one about who should own the railways, or even to say that Railtrack was failing to perform well, would be utterly outside the debate's intended remit. Any such attempt would be a diversion from the focus of the motion, which is entirely to do with the Government's conduct.
24 Oct 2005 : Column 23
The debate and the action that must follow from it are entirely about the corruption of the proper process of government by the then Department for Transport, Local Government, and the Regions, the absent Chancellor of the Exchequer, the Treasury and even the Prime Minister.
|Next Section||Index||Home Page|


text:
Patriarch Kirill of the Russian Orthodox Church is a powerful reactionary figure in the country's toxic political scene, which has welded a tale of thwarted imperial destiny to a thin-skinned fundamentalist theology that can't bear the slightest sign of mockery; he's blamed ISIS on secularism and Pride parades and says that marriage equality literally heralds the imminent apocalypse.
So there's a lot of context behind this photo of Kirill spraying holy water on sensitive Russian government computer systems to fight the Wcry ransomware worm (coating computers with holy liquids is an Orthodox thing, sometimes necessitating the use of paint-rollers to reach out-of-way machines) (to be fair, there's also Donald Trump's bizarre fantasies about using pig-blood-dipped bullets to execute his religious enemies).
As Hemant Mehta at the Friendly Atheist points out, the real nexus of this photo is the government official with the "you've got to be kidding me" expression, who exists in a power-structure that requires solemn professions of belief in this powerful weirdo's dumb rituals (including, but not limited to, spraying electronic devices with water, and not because a computer that has been rendered inoperable due to electrical faults is incidentally and thoroughly immune to malware). It bears an eerie similarity to the unguarded facial expressions of Vice President Michael Pence as he does his daily impression of a dashboard bobble-head, nodding convulsively as Trump says things that everyone in the room knows to be horribly wrong, uninformed, and dangerous.
Russian Orthodox Leader Sprays Holy Water on Government Computers to Stop WannaCry Attack
[Hemant Mehta/Friendly Atheist]
In PrinTracker: Fingerprinting 3D Printers using Commodity Scanners (Scihub mirror), a paper to be presented at the ACM SIGSAC Conference on Computer and Communications Security conference in Toronto this month, a group of U Buffalo and Northeastern researchers present a model for uniquely identifying which 3D printer produced a given manufactured object, which may allow […]
Circuitmess's fully funded Makerphone kickstarter is raising money to produce open source hardware smartphone kits to teach kids (and grownups) everything from soldering to programming.
Apple invited consumer technology reporters to an event scheduled for next Tuesday, October 30, at New York’s Brooklyn Academy of Music, Howard Gilman Opera House. The late-October event will presumably feature something different from the September iPhone-centered event.
Speed reading isn’t just an innate skill possessed by a lucky few. Anyone can learn to speed read, and the benefits are endless. The brain can process more information than most people have time to soak up, but you can make that time now with the 2018 Award-Winning Speed Reading Bundle. The first half of […]
Sure, you could use the same old PowerPoint templates for your next business presentation. It’s not like you have bosses or investors to impress. Oh wait, you do? Time to augment that slideshow with Slideshop – the presentation tool that can individualize your pitch while saving you time. Compatible with PowerPoint, Keynote and Google Slides, […]
Multinational companies have used the no-nonsense methodologies of Six Sigma and Lean Six Sigma to oil a smooth-running operation for years. What is it? Six Sigma (and its offshoot, Lean Six Sigma) apply the principles of science to business, teaching managers to methodically target waste, maximize output and streamline the flow from producer to consumer. […]