Computational neurobiology

Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience...

Theoretical accounts of the N400 are divided as to whether the amplitude of the N400 response to a stimulus reflects the extent to which the stimulus was predicted, the extent to which the stimulus is semantically similar to its preceding context, or both. We use state-of-the-art machine learning tools to investigate which of these three accounts is best supported by the evidence. GPT-3, a neural language model trained to compute the conditional probability of any word based on the words that precede it, was used to operationalize contextual predictability...

Artificial neural networks have emerged as computationally plausible models of human language processing. A major criticism of these models is that the amount of training data they receive far exceeds that of humans during language learning. Here, we use two complementary approaches to ask how the models' ability to capture human fMRI responses to sentences is affected by the amount of training data. First, we evaluate GPT-2 models trained on 1 million, 10 million, 100 million, or 1 billion words against an fMRI benchmark...

No abstract text is available yet for this article.

In computational neurolinguistics, it has been demonstrated that hierarchical models such as recurrent neural network grammars (RNNGs), which jointly generate word sequences and their syntactic structures via the syntactic composition, better explained human brain activity than sequential models such as long short-term memory networks (LSTMs). However, the vanilla RNNG has employed the top-down parsing strategy, which has been pointed out in the psycholinguistics literature as suboptimal especially for head-final/left-branching languages, and alternatively the left-corner parsing strategy has been proposed as the psychologically plausible parsing strategy...

The language faculty is physically realized in the neurobiological infrastructure of the human brain. Despite significant efforts, an integrated understanding of this system remains a formidable challenge. What is missing from most theoretical accounts is a specification of the neural mechanisms that implement language function. Computational models that have been put forward generally lack an explicit neurobiological foundation. We propose a neurobiologically informed causal modeling approach which offers a framework for how to bridge this gap...

Recent research has shown that the internal dynamics of an artificial neural network model of sentence comprehension displayed a similar pattern to the amplitude of the N400 in several conditions known to modulate this event-related potential. These results led Rabovsky et al. (2018) to suggest that the N400 might reflect change in an implicit predictive representation of meaning corresponding to semantic prediction error. This explanation stands as an alternative to the hypothesis that the N400 reflects lexical prediction error as estimated by word surprisal (Frank et al...

Language models based on artificial neural networks increasingly capture key aspects of how humans process sentences. Most notably, model-based surprisals predict event-related potentials such as N400 amplitudes during parsing. Assuming that these models represent realistic estimates of human linguistic experience, their success in modeling language processing raises the possibility that the human processing system relies on no other principles than the general architecture of language models and on sufficient linguistic input...

Representations from artificial neural network (ANN) language models have been shown to predict human brain activity in the language network. To understand what aspects of linguistic stimuli contribute to ANN-to-brain similarity, we used an fMRI data set of responses to n = 627 naturalistic English sentences (Pereira et al., 2018) and systematically manipulated the stimuli for which ANN representations were extracted. In particular, we (i) perturbed sentences' word order, (ii) removed different subsets of words, or (iii) replaced sentences with other sentences of varying semantic similarity...

Real-world categories often contain exceptions that disobey the perceptual regularities followed by other members. Prominent psychological and neurobiological theories indicate that exception learning relies on the flexible modulation of object representations, but the specific representational shifts key to learning remain poorly understood. Here, we leveraged behavioral and computational approaches to elucidate the representational dynamics during the acquisition of exceptions that violate established regularity knowledge...

From deciding which meal to prepare for our guests to trading-off the pro-environmental effects of climate protection measures against their economic costs, we often must consider the consequences of our actions for the well-being of others (welfare). Vexingly, the tastes and views of others can vary widely. To maximize welfare according to the utilitarian philosophical tradition, decision makers facing conflicting preferences of others should choose the option that maximizes the sum of subjective value (utility) of the entire group...

Sudden phase changes are related to cortical phase transitions, which likely change in frequency and spatial distribution as epileptogenic activity evolves. A 100 s long section of micro-ECoG data obtained before and during a seizure was selected and analyzed. In addition, nine other short-duration epileptic events were also examined. The data was collected at 420 Hz, imported into MATLAB, downsampled to 200 Hz, and filtered in the 1-50 Hz band. The Hilbert transform was applied to compute the analytic phase, which was then unwrapped, and detrended to look for sudden phase changes...

Training neural networks to perform different tasks is relevant across various disciplines. In particular, Recurrent Neural Networks (RNNs) are of great interest in Computational Neuroscience. Open-source frameworks dedicated to Machine Learning, such as Tensorflow and Keras have produced significant changes in the development of technologies that we currently use. This work contributes by comprehensively investigating and describing the application of RNNs for temporal processing through a study of a 3-bit Flip Flop memory implementation...

Major Depressive Disorder (MDD) is a widespread psychiatric condition that affects a significant portion of the global population. The classification and diagnosis of MDD is crucial for effective treatment. Traditional methods, based on clinical assessment, are subjective and rely on healthcare professionals' expertise. Recently, there's growing interest in using Resting-State Functional Magnetic Resonance Imaging (rs-fMRI) to objectively understand MDD's neurobiology, complementing traditional diagnostics...

Contingency Management (CM) is a psychological treatment that aims to change behavior with financial incentives. In substance use disorders (SUDs), deployment of CM has been enriched by longstanding discussions around the cost-effectiveness of prized-based and voucher-based approaches. In prize-based CM, participants earn draws to win prizes, including small incentives to reduce costs, and the number of draws escalates depending on the duration of maintenance of abstinence. In voucher-based CM, participants receive a predetermined voucher amount based on specific substance test results...

A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker's intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints...

Arousal level is thought to be a key determinant of variability in cognitive performance. In a recent study, Beerendonk, Mejías et al. show that peak performance in decision-making tasks is reached at moderate levels of arousal. They also propose a neurobiologically informed computational model that can explain the inverted-U-shaped relationship.

Parkinson's disease (PD) is a neurodegenerative disorder that affects millions of individuals globally. It is characterized by the loss of dopaminergic neurons in Substantia Nigra pars compacta (SNc) and striatum. Neuroimaging techniques such as single-photon emission computed tomography (SPECT), positron emission tomography (PET), and magnetic resonance imaging (MRI) help diagnosing PD. In this study, the focus was on developing technetium-99 m ([99m Tc]Tc) radiolabeled drug delivery systems using plant-derived compounds for the diagnosis of PD...

To reach the energy efficiency and the computing capability of biological neural networks, novel hardware systems and paradigms are required where the information needs to be processed in both spatial and temporal domains. Resistive switching memory (RRAM) devices appear as key enablers for the implementation of large-scale neuromorphic computing systems with high energy efficiency and extended scalability. Demonstrating a full set of spatiotemporal primitives with RRAM-based circuits remains an open challenge...

Stress is a crucial factor affecting social decision-making. However, its impacts on the behavioral and neural processes of females' unfairness decision-making remain unclear. Combining computational modeling and functional near-infrared spectroscopy (fNIRS), this study attempted to illuminate the neurocomputational signature of unfairness decision-making in females. We also considered the effect of trait stress coping styles. Forty-four healthy young females (20.98 ± 2.89 years) were randomly assigned to the stress group ( n = 21) and the control group ( n = 23)...