Publications

Abstract

This review provides a comprehensive understanding of regularization theory from different perspectives, emphasizing smoothness and simplicity principles. Using the tools of operator theory and Fourier analysis, it is shown that the solution of the classical Tikhonov regularization problem can be derived from the regularized functional defined by a linear differential (integral) operator in the spatial (Fourier) domain. State-of-the-art research relevant to the regularization theory is reviewed, covering Occam's razor, minimum length description, Bayesian theory, pruning algorithms, informational (entropy) theory, statistical learning theory, and equivalent regularization. The universal principle of regularization in terms of Kolmogorov complexity is discussed. Finally, some prospective studies on regularization theory and beyond are suggested.

Abstract

This paper explores the use of particle filters, rooted in Bayesian estimation, as a device for tracking statistical variations in the channel matrix of a narrowband multiple-input, multiple-output (MIMO) wireless channel. The motivation is to permit the receiver to acquire channel state information through a semiblind strategy and thereby improve the receiver performance of the wireless communication system. To that end, the paper compares the particle filter as well as an improved version of the particle filter using gradient information, to the conventional Kalman filter and mixture Kalman filter with two metrics in mind: receiver performance curves and computational complexity. The comparisons, also including differential phase modulation, are carried out using real-life recorded MIMO wireless data.

Abstract

This paper addresses stochastic correlative learning as the basis for a broadly defined class of statistical learning algorithms known collectively as the algorithm of pattern extraction (ALOPEX) family. Starting with the neurobiologically motivated Hebb's rule, the two conventional forms of the ALOPEX algorithm are derived, followed by a modified variant designed to improve the convergence speed. We next describe two more elaborate versions of the ALOPEX algorithm, which incorporate particle filtering that exemplifies a form of Monte Carlo simulation, to exchange computational complexity for an improved convergence and tracking behavior. In support of the different forms of the ALOPEX algorithm developed herein, we present three different experiments using synthetic and real-life data on binocular fusion of stereo images, on-line prediction, and system identification.

Abstract

This review presents an overview of a challenging problem in auditory perception, the cocktail party phenomenon, the delineation of which goes back to a classic paper by Cherry in 1953. In this review, we address the following issues: (1) human auditory scene analysis, which is a general process carried out by the auditory system of a human listener; (2) insight into auditory perception, which is derived from Marr's vision theory; (3) computational auditory scene analysis, which focuses on specific approaches aimed at solving the machine cocktail party problem; (4) active audition, the proposal for which is motivated by analogy with active vision, and (5) discussion of brain theory and independent component analysis, on the one hand, and correlative neural firing, on the other.

Abstract

Segregation of sensory inputs into separate objects is a central aspect of perception and arises in all sensory modalities. The figure-ground segregation problem requires identifying an object of interest in a complex scene, in many cases given binaural auditory or binocular visual observations. The computations required for visual and auditory figure-ground segregation share many common features and can be cast within a unified framework. Sensory perception can be viewed as a problem of optimizing information transmission. Here we suggest a stochastic correlative firing mechanism and an associative learning rule for figure-ground segregation in several classic sensory perception tasks, including the cocktail party problem in binaural hearing, binocular fusion of stereo images, and Gestalt grouping in motion perception.

Abstract

We propose a novel model-based hearing compensation strategy and gradient-free optimization procedure for a learning-based hearing aid design. Motivated by physiological data and normal and impaired auditory nerve models, a hearing compensation strategy is cast as a neural coding problem, and a Neurocompensator is designed to compensate for the hearing loss and enhance the speech. With the goal of learning the Neurocompensator parameters, we use a gradient-free optimization procedure, an improved version of the ALOPEX that we have developed, to learn the unknown parameters of the Neurocompensator. We present our methodology, learning procedure, and experimental results in detail; discussion is also given regarding the unsupervised learning and optimization methods.

Abstract

OBJECTIVE: The objective of this study is th development and evaluation of efficient neurophysiological signal statistics, which may assess the driver's alertness level and serve as potential indicators of sleepiness in the design of an on-board countermeasure system. METHODS: Multichannel EEG, EOG, EMG, and ECG were recorded from sleep-deprived subjects exposed to real field driving conditions. A number of severe driving errors occurred during the experiments. The analysis was performed in two main dimensions: the macroscopic analysis that estimates the on-going temporal evolution of physiological measurements during the driving task, and the microscopic event analysis that focuses on the physiological measurements' alterations just before, during, and after the driving errors. Two independent neurophysiologists visually interpreted the measurements. The EEG data were analyzed by using both linear and non-linear analysis tools. RESULTS: We observed the occurrence of brief paroxysmal bursts of alpha activity and an increased synchrony among EEG channels before the driving errors. The alpha relative band ratio (RBR) significantly increased, and the Cross Approximate Entropy that quantifies the synchrony among channels also significantly decreased before the driving errors. Quantitative EEG analysis revealed significant variations of RBR by driving time in the frequency bands of delta, alpha, beta, and gamma. Most of the estimated EEG statistics, such as the Shannon Entropy, Kullback-Leibler Entropy, Coherence, and Cross-Approximate Entropy, were significantly affected by driving time. We also observed an alteration of eyes blinking duration by increased driving time and a significant increase of eye blinks' number and duration before driving errors. CONCLUSIONS: EEG and EOG are promising neurophysiological indicators of driver sleepiness and have the potential of monitoring sleepiness in occupational settings incorporated in a sleepiness countermeasure device. SIGNIFICANCE: The occurrence of brief paroxysmal bursts of alpha activity before severe driving errors is described in detail for the first time. Clear evidence is presented that eye-blinking statistics are sensitive to the driver's sleepiness and should be considered in the design of an efficient and driver-friendly sleepiness detection countermeasure device.

Abstract

This article is devoted to statistical modeling and analysis of electrocorticogram (ECoG) signals induced by painful cutaneous laser stimuli, which were recorded from implanted electrodes in awake humans. Specifically, with statistical tools of factor analysis and independent component analysis, the pain-induced laser-evoked potentials (LEPs) were extracted and investigated under different controlled conditions. With the help of wavelet analysis, quantitative and qualitative analyses were conducted regarding the LEPs' attributes of power, amplitude, and latency, in both averaging and single-trial experiments. Statistical hypothesis tests were also applied in various experimental setups. Experimental results reported herein also confirm previous findings in the neurophysiology literature. In addition, single-trial analysis has also revealed many new observations that might be interesting to the neuroscientists or clinical neurophysiologists. These promising results show convincing validation that advanced signal processing and statistical analysis may open new avenues for future studies of such ECoG or other relevant biomedical recordings.

Abstract

Electroencephalogram (EEG) is often used in the confirmatory test for brain death diagnosis in clinical practice. Because EEG recording and monitoring is relatively safe for the patients in deep coma, it is believed to be valuable for either reducing the risk of brain death diagnosis (while comparing other tests such as the apnea) or preventing mistaken diagnosis. The objective of this paper is to study several statistical methods for quantitative EEG analysis in order to help bedside or ambulatory monitoring or diagnosis. We apply signal processing and quantitative statistical analysis for the EEG recordings of 32 adult patients. For EEG signal processing, independent component analysis (ICA) was applied to separate the independent source components, followed by Fourier and time-frequency analysis. For quantitative EEG analysis, we apply several statistical complexity measures to the EEG signals and evaluate the differences between two groups of patients: the subjects in deep coma, and the subjects who were categorized as brain death. We report statistically significant differences of quantitative statistics with real-life EEG recordings in such a clinical study, and we also present interpretation and discussions on the preliminary experimental results.

Abstract

UP and DOWN states, the periodic fluctuations between increased and decreased spiking activity of a neuronal population, are a fundamental feature of cortical circuits. Understanding UP-DOWN state dynamics is important for understanding how these circuits represent and transmit information in the brain. To date, limited work has been done on characterizing the stochastic properties of UP-DOWN state dynamics. We present a set of Markov and semi-Markov discrete- and continuous-time probability models for estimating UP and DOWN states from multiunit neural spiking activity. We model multiunit neural spiking activity as a stochastic point process, modulated by the hidden (UP and DOWN) states and the ensemble spiking history. We estimate jointly the hidden states and the model parameters by maximum likelihood using an expectation-maximization (EM) algorithm and a Monte Carlo EM algorithm that uses reversible-jump Markov chain Monte Carlo sampling in the E-step. We apply our models and algorithms in the analysis of both simulated multiunit spiking activity and actual multi- unit spiking activity recorded from primary somatosensory cortex in a behaving rat during slow-wave sleep. Our approach provides a statistical characterization of UP-DOWN state dynamics that can serve as a basis for verifying and refining mechanistic descriptions of this process.

Abstract

Tracking the autonomic control and respiratory sinus arrhythmia (RSA) from electrocardiogram and respiratory measurements is an important problem in cardiovascular control. We propose a point process adaptive filter algorithm based on an inverse Gaussian model to track heart beat intervals that incorporates respiratory measurements as a covariate and provides an analytic form for computing a dynamic estimate of RSA gain. We use Kolmogorov-Smirnov tests and autocorrelation function analyses to assess model goodness-of-fit. We illustrate the properties of the new dynamic estimate of RSA in the analysis of simulated heart beat data and actual heart beat data recorded from subjects in a four-state postural study of heart beat dynamics: control, sympathetic blockade, parasympathetic blockade, and combined sympathetic and parasympathetic blockade. In addition to giving an accurate description of the heart beat data, our adaptive filter algorithm confirms established findings pointing at a vagally mediated RSA, and it provides a new dynamic RSA estimate that can be used to track cardiovascular control between and within a broad range of postural, pharmacological and age conditions. Our paradigm suggests a possible framework for designing a device for ambulatory monitoring and assessment of autonomic control in both laboratory research and clinical practice.

Abstract

Human heartbeat intervals are known to have nonlinear and nonstationary dynamics. In this paper, we propose a model of R-R interval dynamics based on a nonlinear Volterra-Wiener expansion within a point process framework. Inclusion of second-order nonlinearities into the heartbeat model allows us to estimate instantaneous heart rate (HR) and heart rate variability (HRV) indexes, as well as the dynamic bispectrum characterizing higher order statistics of the nonstationary non-gaussian time series. The proposed point process probability heartbeat interval model was tested with synthetic simulations and two experimental heartbeat interval datasets. Results show that our model is useful in characterizing and tracking the inherent nonlinearity of heartbeat dynamics. As a feature, the fine temporal resolution allows us to compute instantaneous nonlinearity indexes, thus sidestepping the uneven spacing problem. In comparison to other nonlinear modeling approaches, the point process probability model is useful in revealing nonlinear heartbeat dynamics at a fine timescale and with only short duration recordings.

Abstract

The ability to accurately infer functional connectivity between ensemble neurons using experimentally acquired spike train data is currently an important research objective in computational neuroscience. Point process generalized linear models and maximum likelihood estimation have been proposed as effective methods for the identification of spiking dependency between neurons. However, unfavorable experimental conditions occasionally results in insufficient data collection due to factors such as low neuronal firing rates or brief recording periods, and in these cases, the standard maximum likelihood estimate becomes unreliable. The present studies compares the performance of different statistical inference procedures when applied to the estimation of functional connectivity in neuronal assemblies with sparse spiking data. Four inference methods were compared: maximum likelihood estimation, penalized maximum likelihood estimation, using either l(2) or l(1) regularization, and hierarchical Bayesian estimation based on a variational Bayes algorithm. Algorithmic performances were compared using well-established goodness-of-fit measures in benchmark simulation studies, and the hierarchical Bayesian approach performed favorably when compared with the other algorithms, and this approach was then successfully applied to real spiking data recorded from the cat motor cortex. The identification of spiking dependencies in physiologically acquired data was encouraging, since their sparse nature would have previously precluded them from successful analysis using traditional methods.

Abstract

In this article, we present a point process method to assess dynamic baroreflex sensitivity (BRS) by estimating the baroreflex gain as focal component of a simplified closed-loop model of the cardiovascular system. Specifically, an inverse Gaussian probability distribution is used to model the heartbeat interval, whereas the instantaneous mean is identified by linear and bilinear bivariate regressions on both the previous R-R intervals (RR) and blood pressure (BP) beat-to-beat measures. The instantaneous baroreflex gain is estimated as the feedback branch of the loop with a point-process filter, while the RR-->BP feedforward transfer function representing heart contractility and vasculature effects is simultaneously estimated by a recursive least-squares filter. These two closed-loop gains provide a direct assessment of baroreflex control of heart rate (HR). In addition, the dynamic coherence, cross bispectrum, and their power ratio can also be estimated. All statistical indices provide a valuable quantitative assessment of the interaction between heartbeat dynamics and hemodynamics. To illustrate the application, we have applied the proposed point process model to experimental recordings from 11 healthy subjects in order to monitor cardiovascular regulation under propofol anesthesia. We present quantitative results during transient periods, as well as statistical analyses on steady-state epochs before and after propofol administration. Our findings validate the ability of the algorithm to provide a reliable and fast-tracking assessment of BRS, and show a clear overall reduction in baroreflex gain from the baseline period to the start of propofol anesthesia, confirming that instantaneous evaluation of arterial baroreflex control of HR may yield important implications in clinical practice, particularly during anesthesia and in postoperative care.

Abstract

Multichannel electroencephalography (EEG) offers a non-invasive tool to explore spatio-temporal dynamics of brain activity. With EEG recordings consisting of multiple trials, traditional signal processing approaches that ignore inter-trial variability in the data may fail to accurately estimate the underlying spatio-temporal brain patterns. Moreover, precise characterization of such inter-trial variability per se can be of high scientific value in establishing the relationship between brain activity and behavior. In this paper, a statistical modeling framework is introduced for learning spatio-temporal decompositions of multiple-trial EEG data recorded under two contrasting experimental conditions. By modeling the variance of source signals as random variables varying across trials, the proposed two-stage hierarchical Bayesian model is able to capture inter-trial amplitude variability in the data in a sparse way where a parsimonious representation of the data can be obtained. A variational Bayesian (VB) algorithm is developed for statistical inference of the hierarchical model. The efficacy of the proposed modeling framework is validated with the analysis of both synthetic and real EEG data. In the simulation study we show that even at low signal-to-noise ratios our approach is able to recover with high precision the underlying spatio-temporal patterns and the dynamics of source amplitude across trials; on two brain-computer interface (BCI) data sets we show that our VB algorithm can extract physiologically meaningful spatio-temporal patterns and make more accurate predictions than other two widely used algorithms: the common spatial patterns (CSP) algorithm and the Infomax algorithm for independent component analysis (ICA). The results demonstrate that our statistical modeling framework can serve as a powerful tool for extracting brain patterns, characterizing trial-to-trial brain dynamics, and decoding brain states by exploiting useful structures in the data.

Abstract

Neurons in the Primary Motor Cortex (MI) are known to form functional ensembles with one another in order to produce voluntary movement. Neural network changes during skill learning are thought to be involved in improved fluency and accuracy of motor tasks. Unforced errors during skilled tasks provide an avenue to study network connections related to motor learning. In order to investigate network activity in MI, microwires were implanted in the MI of cats trained to perform a reaching task. Spike trains from eight groups of simultaneously recorded cells (95 neurons in total) were acquired. A point process generalized linear model (GLM) was developed to assess simultaneously recorded cells for functional connectivity during reaching attempts where unforced errors or no errors were made. Whilst the same groups of neurons were often functionally connected regardless of trial success, functional connectivity between neurons was significantly different at fine time scales when the outcome of task performance changed. Furthermore, connections were shown to be significantly more robust across multiple latencies during successful trials of task performance. The results of this study indicate that reach-related neurons in MI form dynamic spiking dependencies whose temporal features are highly sensitive to unforced movement errors.

Abstract

Hippocampal population codes play an important role in representation of spatial environment and spatial navigation. Uncovering the internal representation of hippocampal population codes will help understand neural mechanisms of the hippocampus. For instance, uncovering the patterns represented by rat hippocampus (CA1) pyramidal cells during periods of either navigation or sleep has been an active research topic over the past decades. However, previous approaches to analyze or decode firing patterns of population neurons all assume the knowledge of the place fields, which are estimated from training data a priori. The question still remains unclear how can we extract information from population neuronal responses either without a priori knowledge or in the presence of finite sampling constraint. Finding the answer to this question would leverage our ability to examine the population neuronal codes under different experimental conditions. Using rat hippocampus as a model system, we attempt to uncover the hidden "spatial topology" represented by the hippocampal population codes. We develop a hidden Markov model (HMM) and a variational Bayesian (VB) inference algorithm to achieve this computational goal, and we apply the analysis to extensive simulation and experimental data. Our empirical results show promising direction for discovering structural patterns of ensemble spike activity during periods of active navigation. This study would also provide useful insights for future exploratory data analysis of population neuronal codes during periods of sleep.

Abstract

Respiratory sinus arrhythmia (RSA) is largely mediated by the autonomic nervous system through its modulating influence on the heart beats. We propose a robust algorithm for quantifying instantaneous RSA as applied to heart beat intervals and respiratory recordings under dynamic breathing patterns. The blood volume pressure derived heart beat series (pulse intervals, PIs) are modeled as an inverse gaussian point process, with the instantaneous mean PI modeled as a bivariate regression incorporating both past PIs and respiration values observed at the beats. A point process maximum likelihood algorithm is used to estimate the model parameters, and instantaneous RSA is estimated via a frequency domain transfer function evaluated at instantaneous respiratory frequency where high coherence between respiration and PIs is observed. The model is statistically validated using Kolmogorov-Smirnov (KS) goodness-of-fit analysis, as well as independence tests. The algorithm is applied to subjects engaged in meditative practice, with distinctive dynamics in the respiration patterns elicited as a result. The presented analysis confirms the ability of the algorithm to track important changes in cardiorespiratory interactions elicited during meditation, otherwise not evidenced in control resting states, reporting statistically significant increase in RSA gain as measured by our paradigm.

Abstract

In recent years, time-varying inhomogeneous point process models have been introduced for assessment of instantaneous heartbeat dynamics as well as specific cardiovascular control mechanisms and hemodynamics. Assessment of the model's statistics is established through the Wiener-Volterra theory and a multivariate autoregressive (AR) structure. A variety of instantaneous cardiovascular metrics, such as heart rate (HR), heart rate variability (HRV), respiratory sinus arrhythmia (RSA), and baroreceptor-cardiac reflex (baroreflex) sensitivity (BRS), are derived within a parametric framework and instantaneously updated with adaptive and local maximum likelihood estimation algorithms. Inclusion of second-order non-linearities, with subsequent bispectral quantification in the frequency domain, further allows for definition of instantaneous metrics of non-linearity. We here present a comprehensive review of the devised methods as applied to experimental recordings from healthy subjects during propofol anesthesia. Collective results reveal interesting dynamic trends across the different pharmacological interventions operated within each anesthesia session, confirming the ability of the algorithm to track important changes in cardiorespiratory elicited interactions, and pointing at our mathematical approach as a promising monitoring tool for an accurate, non-invasive assessment in clinical practice. We also discuss the limitations and other alternative modeling strategies of our point process approach.

Abstract

The moving bar experiment is a classic paradigm for characterizing the receptive field (RF) properties of neurons in primary visual cortex (V1). Current approaches for analyzing neural spiking activity recorded from these experiments do not take into account the point-process nature of these data and the circular geometry of the stimulus presentation. We present a novel analysis approach to mapping V1 receptive fields that combines point-process generalized linear models (PPGLM) with tomographic reconstruction computed by filtered-back projection. We use the method to map the RF sizes and orientations of 251 V1 neurons recorded from two macaque monkeys during a moving bar experiment. Our cross-validated goodness-of-fit analyses show that the PPGLM provides a more accurate characterization of spike train data than analyses based on rate functions computed by the methods of spike-triggered averages or first-order Wiener-Volterra kernel. Our analysis leads to a new definition of RF size as the spatial area over which the spiking activity is significantly greater than baseline activity. Our approach yields larger RF sizes and sharper orientation tuning estimates. The tomographic reconstruction paradigm further suggests an efficient approach to choosing the number of directions and the number of trials per direction in designing moving bar experiments. Our results demonstrate that standard tomographic principles for image reconstruction can be adapted to characterize V1 RFs and that two fundamental properties, size and orientation, may be substantially different from what is currently reported.

Abstract

Abstract

Neural spike train analysis is an important task in computational neuroscience which aims to understand neural mechanisms and gain insights into neural circuits. With the advancement of multielectrode recording and imaging technologies, it has become increasingly demanding to develop statistical tools for analyzing large neuronal ensemble spike activity. Here we present a tutorial overview of Bayesian methods and their representative applications in neural spike train analysis, at both single neuron and population levels. On the theoretical side, we focus on various approximate Bayesian inference techniques as applied to latent state and parameter estimation. On the application side, the topics include spike sorting, tuning curve estimation, neural encoding and decoding, deconvolution of spike trains from calcium imaging signals, and inference of neuronal functional connectivity and synchrony. Some research challenges and opportunities for neural spike train analysis are discussed.

Abstract

A fundamental task in neuroscience is to understand how neural ensembles represent information. Population decoding is a useful tool to extract information from neuronal populations based on the ensemble spiking activity. We propose a novel Bayesian decoding paradigm to decode unsorted spikes in the rat hippocampus. Our approach uses a direct mapping between spike waveform features and covariates of interest and avoids accumulation of spike sorting errors. Our decoding paradigm is nonparametric, encoding model-free for representing stimuli, and extracts information from all available spikes and their waveform features. We apply the proposed Bayesian decoding algorithm to a position reconstruction task for freely behaving rats based on tetrode recordings of rat hippocampal neuronal activity. Our detailed decoding analyses demonstrate that our approach is efficient and better utilizes the available information in the nonsortable hash than the standard sorting-based decoding algorithm. Our approach can be adapted to an online encoding/decoding framework for applications that require real-time decoding, such as brain-machine interfaces.

Abstract

Pyramidal cells in the rodent hippocampus often exhibit clear spatial tuning in navigation. Although it has been long suggested that pyramidal cell activity may underlie a topological code rather than a topographic code, it remains unclear whether an abstract spatial topology can be encoded in the ensemble spiking activity of hippocampal place cells. Using a statistical approach developed previously, we investigate this question and related issues in greater detail. We recorded ensembles of hippocampal neurons as rodents freely foraged in one- and two-dimensional spatial environments and used a "decode-to-uncover" strategy to examine the temporally structured patterns embedded in the ensemble spiking activity in the absence of observed spatial correlates during periods of rodent navigation or awake immobility. Specifically, the spatial environment was represented by a finite discrete state space. Trajectories across spatial locations ("states") were associated with consistent hippocampal ensemble spiking patterns, which were characterized by a state transition matrix. From this state transition matrix, we inferred a topology graph that defined the connectivity in the state space. In both one- and two-dimensional environments, the extracted behavior patterns from the rodent hippocampal population codes were compared against randomly shuffled spike data. In contrast to a topographic code, our results support the efficiency of topological coding in the presence of sparse sample size and fuzzy space mapping. This computational approach allows us to quantify the variability of ensemble spiking activity, examine hippocampal population codes during off-line states, and quantify the topological complexity of the environment.

Abstract

Behavioral state is known to influence interactions between thalamus and cortex, which are important for sensation, action, and cognition. The thalamic reticular nucleus (TRN) is hypothesized to regulate thalamo-cortical interactions, but the underlying functional architecture of this process and its state dependence are unknown. By combining the first TRN ensemble recording with psychophysics and connectivity-based optogenetic tagging, we found reticular circuits to be composed of distinct subnetworks. While activity of limbic-projecting TRN neurons positively correlates with arousal, sensory-projecting neurons participate in spindles and show elevated synchrony by slow waves during sleep. Sensory-projecting neurons are suppressed by attentional states, demonstrating that their gating of thalamo-cortical interactions is matched to behavioral state. Bidirectional manipulation of attentional performance was achieved through subnetwork-specific optogenetic stimulation. Together, our findings provide evidence for differential inhibition of thalamic nuclei across brain states, where the TRN separately controls external sensory and internal limbic processing facilitating normal cognitive function. .

Abstract

Common spatial patterns (CSP) is a well-known spatial filtering algorithm for multichannel electroencephalogram (EEG) analysis. In this paper, we cast the CSP algorithm in a probabilistic modeling setting. Specifically, probabilistic CSP (P-CSP) is proposed as a generic EEG spatio-temporal modeling framework that subsumes the CSP and regularized CSP algorithms. The proposed framework enables us to resolve the overfitting issue of CSP in a principled manner. We derive statistical inference algorithms that can alleviate the issue of local optima. In particular, an efficient algorithm based on eigendecomposition is developed for maximum a posteriori (MAP) estimation in the case of isotropic noise. For more general cases, a variational algorithm is developed for group-wise sparse Bayesian learning for the P-CSP model and for automatically determining the model size. The two proposed algorithms are validated on a simulated data set. Their practical efficacy is also demonstrated by successful applications to single-trial classifications of three motor imagery EEG data sets and by the spatio-temporal pattern analysis of one EEG data set recorded in a Stroop color naming task.

Abstract

Cognition is a complex and dynamic process. It is an essential goal to estimate latent attentional states based on behavioral measures in many sequences of behavioral tasks. Here, we propose a probabilistic modeling and inference framework for estimating the attentional state using simultaneous binary and continuous behavioral measures. The proposed model extends the standard hidden Markov model (HMM) by explicitly modeling the state duration distribution, which yields a special example of the hidden semi-Markov model (HSMM). We validate our methods using computer simulations and experimental data. In computer simulations, we systematically investigate the impacts of model mismatch and the latency distribution. For the experimental data collected from a rodent visual detection task, we validate the results with predictive log-likelihood. Our work is useful for many behavioral neuroscience experiments, where the common goal is to infer the discrete (binary or multinomial) state sequences from multiple behavioral measures.

Abstract

The correlation between sleep integrity and attentional performance is normally interpreted as poor sleep causing impaired attention. Here, we provide an alternative explanation for this correlation: common thalamic circuits regulate sensory processing across sleep and attention, and their disruption may lead to correlated dysfunction. Using multi-electrode recordings in mice, we find that rate and rhythmicity of thalamic reticular nucleus (TRN) neurons are predictive of their functional organization in sleep and suggestive of their participation in sensory processing across states. Surprisingly, TRN neurons associated with spindles in sleep are also associated with alpha oscillations during attention. As such, we propose that common thalamic circuit principles regulate sensory processing in a state-invariant manner and that in certain disorders, targeting these circuits may be a more viable therapeutic strategy than considering individual states in isolation.

Abstract

Electroencephalography (EEG) and magnetoencephalography (MEG) are the most common noninvasive brain-imaging techniques for monitoring electrical brain activity and inferring brain function. The central goal of EEG/MEG analysis is to extract informative brain spatiotemporal?spectral patterns or to infer functional connectivity between different brain areas, which is directly useful for neuroscience or clinical investigations. Due to its potentially complex nature [such as nonstationarity, high dimensionality, subject variability, and low signal-to-noise ratio (SNR)], EEG/MEG signal processing poses some great challenges for researchers. These challenges can be addressed in a principled manner via Bayesian machine learning (BML). BML is an emerging field that integrates Bayesian statistics, variational methods, and machine-learning techniques to solve various problems from regression, prediction, outlier detection, feature extraction, and classification. BML has recently gained increasing attention and widespread successes in signal processing and big-data analytics, such as in source reconstruction, compressed sensing, and information fusion. To review recent advances and to foster new research ideas, we provide a tutorial on several important emerging BML research topics in EEG/MEG signal processing and present representative examples in EEG/MEG applications.

Abstract

BACKGROUND: Rodent hippocampal population codes represent important spatial information about the environment during navigation. Computational methods have been developed to uncover the neural representation of spatial topology embedded in rodent hippocampal ensemble spike activity. NEW METHOD: We extend our previous work and propose a novel Bayesian nonparametric approach to infer rat hippocampal population codes during spatial navigation. To tackle the model selection problem, we leverage a Bayesian nonparametric model. Specifically, we apply a hierarchical Dirichlet process-hidden Markov model (HDP-HMM) using two Bayesian inference methods, one based on Markov chain Monte Carlo (MCMC) and the other based on variational Bayes (VB). RESULTS: The effectiveness of our Bayesian approaches is demonstrated on recordings from a freely behaving rat navigating in an open field environment. COMPARISON WITH EXISTING METHODS: The HDP-HMM outperforms the finite-state HMM in both simulated and experimental data. For HPD-HMM, the MCMC-based inference with Hamiltonian Monte Carlo (HMC) hyperparameter sampling is flexible and efficient, and outperforms VB and MCMC approaches with hyperparameters set by empirical Bayes. CONCLUSION: The Bayesian nonparametric HDP-HMM method can efficiently perform model selection and identify model parameters, which can used for modeling latent-state neuronal population dynamics.

Abstract

Pyramidal neurons recorded from the rat hippocampus and entorhinal cortex, such as place and grid cells, have diverse receptive fields, which are either unimodal or multimodal. Spiking activity from these cells encodes information about the spatial position of a freely foraging rat. At fine timescales, a neuron's spike activity also depends significantly on its own spike history. However, due to limitations of current parametric modeling approaches, it remains a challenge to estimate complex, multimodal neuronal receptive fields while incorporating spike history dependence. Furthermore, efforts to decode the rat's trajectory in one- or two-dimensional space from hippocampal ensemble spiking activity have mainly focused on spike history-independent neuronal encoding models. In this letter, we address these two important issues by extending a recently introduced nonparametric neural encoding framework that allows modeling both complex spatial receptive fields and spike history dependencies. Using this extended nonparametric approach, we develop novel algorithms for decoding a rat's trajectory based on recordings of hippocampal place cells and entorhinal grid cells. Results show that both encoding and decoding models derived from our new method performed significantly better than state-of-the-art encoding and decoding models on 6 minutes of test data. In addition, our model's performance remains invariant to the apparent modality of the neuron's receptive field.

Abstract

Pyramidal neurons in the rodent hippocampus exhibit spatial tuning during spatial navigation, and they are reactivated in specific temporal order during sharp-wave ripples observed in quiet wakefulness or slow wave sleep. However, analyzing representations of sleep-associated hippocampal ensemble spike activity remains a great challenge. In contrast to wake, during sleep there is a complete absence of animal behavior, and the ensemble spike activity is sparse (low occurrence) and fragmental in time. To examine important issues encountered in sleep data analysis, we constructed synthetic sleep-like hippocampal spike data (short epochs, sparse and sporadic firing, compressed timescale) for detailed investigations. Based upon two Bayesian population-decoding methods (one receptive field-based, and the other not), we systematically investigated their representation power and detection reliability. Notably, the receptive-field-free decoding method was found to be well-tuned for hippocampal ensemble spike data in slow wave sleep (SWS), even in the absence of prior behavioral measure or ground truth. Our results showed that in addition to the sample length, bin size, and firing rate, number of active hippocampal pyramidal neurons are critical for reliable representation of the space as well as for detection of spatiotemporal reactivated patterns in SWS or quiet wakefulness.

Abstract

Parametric maximum likelihood (ML) estimators of probability density functions (pdfs) are widely used today because they are efficient to compute and have several nice properties such as consistency, fast convergence rates, and asymptotic normality. However, data is often complex making parametrization of the pdf difficult, and nonparametric estimation is required. Popular nonparametric methods, such as kernel density estimation (KDE), produce consistent estimators but are not ML and have slower convergence rates than parametric ML estimators. Further, these nonparametric methods do not share the other desirable properties of parametric ML estimators. This paper introduces a nonparametric ML estimator that assumes that the square-root of the underlying pdf is band-limited (BL) and hence “smooth”. The BLML estimator is computed and shown to be consistent. Although convergence rates are not theoretically derived, the BLML estimator exhibits faster convergence rates than state-of-the-art nonparametric methods in simulations. Further, algorithms to compute the BLML estimator with lesser computational complexity than that of KDE methods are presented. The efficacy of the BLML estimator is shown by applying it to (i) density tail estimation and (ii) density estimation of complex neuronal receptive fields where it outperforms state-of-the-art methods used in neuroscience.

Abstract

The role of neural signal processing has become increasingly important in the field of neuroscience with the increase of complexity and scale in neural recordings. In neuroscience, neural signal processing is aimed to extract information from neural signals for the purpose of understanding how the brain represents and transmits information through neuronal ensembles. In neural engineering, neural signal processing is aimed to read out neural signals to send neurofeedback to the brain or computer devices that assist or facilitate brain-machine communications. Here we provide a short review of neural signal processing on important principles and state-of-the-art research. Through representative examples, we illustrate how statistical signal processing can be applied to many diverse neuroscience applications.

Abstract

Objective. Pain is defined as an unpleasant sensory and emotional experience associated with actual or potential tissue damage, or described in terms of such damage. Current pain research mostly focuses on molecular and synaptic changes at the spinal and peripheral levels. However, a complete understanding of pain mechanisms requires the physiological study of the neocortex. Our goal is to apply a neural decoding approach to read out the onset of acute thermal pain signals, which can be used for brain–machine interface. Approach. We used micro wire arrays to record ensemble neuronal activities from the primary somatosensory cortex (S1) and anterior cingulate cortex (ACC) in freely behaving rats. We further investigated neural codes for acute thermal pain at both single-cell and population levels. To detect the onset of acute thermal pain signals, we developed a novel latent state-space framework to decipher the sorted or unsorted S1 and ACC ensemble spike activities, which reveal information about the onset of pain signals. Main results. The state space analysis allows us to uncover a latent state process that drives the observed ensemble spike activity, and to further detect the 'neuronal threshold' for acute thermal pain on a single-trial basis. Our method achieved good detection performance in sensitivity and specificity. In addition, our results suggested that an optimal strategy for detecting the onset of acute thermal pain signals may be based on combined evidence from S1 and ACC population codes. Significance. Our study is the first to detect the onset of acute pain signals based on neuronal ensemble spike activity. It is important from a mechanistic viewpoint as it relates to the significance of S1 and ACC activities in the regulation of the acute pain onset.

Abstract

A hallmark feature of chronic pain is its ability to impact other sensory and affective experiences. It is notably associated with hypersensitivity at the site of tissue injury. It is less clear, however, if chronic pain can also induce a generalized site-nonspecific enhancement in the aversive response to nociceptive inputs. Here, we showed that chronic pain in one limb in rats increased the aversive response to acute pain stimuli in the opposite limb, as assessed by conditioned place aversion. Interestingly, neural activities in the anterior cingulate cortex (ACC) correlated with noxious intensities, and optogenetic modulation of ACC neurons showed bidirectional control of the aversive response to acute pain. Chronic pain, however, altered acute pain intensity representation in the ACC to increase the aversive response to noxious stimuli at anatomically unrelated sites. Thus, chronic pain can disrupt cortical circuitry to enhance the aversive experience in a generalized anatomically nonspecific manner.

Abstract

Memories of experiences are stored in the cerebral cortex. Sleep is critical for the consolidation of hippocampal memory of wake experiences into the neocortex. Understanding representations of neural codes of hippocampal-neocortical networks during sleep would reveal important circuit mechanisms in memory consolidation and provide novel insights into memory and dreams. Although sleep-associated ensemble spike activity has been investigated, identifying the content of memory in sleep remains challenging. Here we revisit important experimental findings on sleep-associated memory (i.e., neural activity patterns in sleep that reflect memory processing) and review computational approaches to the analysis of sleep-associated neural codes (SANCs). We focus on two analysis paradigms for sleep-associated memory and propose a new unsupervised learning framework ('memory first, meaning later') for unbiased assessment of SANCs.

Abstract

Diverse environmental and biological systems interact to influence individual differences in response to environmental stress. Understanding the nature of these complex relationships can enhance the development of methods to (1) identify risk, (2) classify individuals as healthy or ill, (3) understand mechanisms of change, and (4) develop effective treatments. The Research Domain Criteria initiative provides a theoretical framework to understand health and illness as the product of multiple interrelated systems but does not provide a framework to characterize or statistically evaluate such complex relationships. Characterizing and statistically evaluating models that integrate multiple levels (e.g. synapses, genes, and envir- onmental factors) as they relate to outcomes that are free from prior diagnostic benchmarks represent a challenge requiring new computational tools that are capable to capture complex relationships and identify clinically relevant populations. In the current review, we will summarize machine learning methods that can achieve these goals.

Abstract

Sequential change-point detection from time series data is a common problem in many neuroscience applications, such as seizure detection, anomaly detection, and pain detection. In our previous work (Chen et al., 2017, J. Neural Eng.), we have developed a latent state space model, known as Poisson linear dynamical system (PLDS), for detecting abrupt changes in neuronal ensemble spike activity. In online brain-machine interface (BMI) applications, a recursive filtering algorithm is used to track the changes in the latent variable. However, previous methods have restricted to Gaussian dynamical noise and have used Gaussian approximation for the Poisson likelihood. To improve the detection speed, we introduce non-Gaussian dynamical noise for modeling a stochastic jump process in the latent state space. To efficiently estimate the state posterior that accommodates non-Gaussian noise and non-Gaussian likelihood, we propose particle filtering and smoothing algorithms for the change-point detection problem. To speed up the computation, we implement the proposed particle filtering algorithms using advanced GPU (graphic processing unit) computing technology. We validate our algorithms using both computer simulations and experimental data for acute pain detection. Finally, we discuss several important practical issues in the context of real-time closed-loop BMI applications.

Abstract

It has been suggested that reactivation of previously acquired experiences or stored information in declarative memories in the hippocampus and neocortex contributes to memory consolidation and learning. Understanding memory consolidation depends crucially on the development of robust statistical methods for assessing memory reactivation. To date, several statistical methods have seen established for assessing memory reactivation based on bursts of ensemble neural spiking activity during off-line states. Using population-decoding methods, we propose a new statistical metric known as the “weighted distance correlation” to assess hippocampal memory reactivation (i.e., “spatial memory replay”) during quiet wakefulness and slow wave sleep. The new metric can be combined with an unsupervised population decoding analysis such that it can detect statistical dependency beyond linearity in the memory traces and is invariant to latent state labeling. We validate the new metric using two rat hippocampal recordings in spatial navigation tasks. Our proposed analysis framework may have a broader impact on assessing memory reactivations in other brain regions under different behavioral tasks.

Abstract

Brain-machine interfaces (BMIs) have been widely used to study basic and translational neuroscience questions. In real-time closed-loop neuroscience applications, many practical issues arise, such as trial-by-trial variability, and spike sorting noise or multi-unit activity. In this paper, we propose a new framework for change-point detection based on ensembles of independent detectors in the context of BMI application for detecting acute pain signals. Motivated from unsupervised ensemble learning, our proposed "ensembles of change-point detectors" (ECPDs) integrate multiple decisions from independent detectors, which may be derived based on data recorded from different trials, or data recorded from different brain regions, or data of different modalities. By integrating more information, the ECPDs are aimed to improve the detection accuracy (in terms of true positive and true negative rates) and to achieve an optimal trade-off of sensitivity and specificity. We validate our method using computer simulations and experimental recordings from freely behaving rats. Our results have shown superior and robust performance of ECPDS in detecting the onset of acute pain signals based on neuronal population spike activity from single or multiple brain regions.

Abstract

Acute pain evokes protective neural and behavioral responses. Chronic pain, however, disrupts normal nociceptive processing. The prefrontal cortex (PFC) is known to exert top-down regulation of sensory inputs; unfortunately, how individual PFC neurons respond to an acute pain signal is not well characterized. We found that neurons in the prelimbic region of the PFC increased firing rates of the neurons after noxious stimulations in free-moving rats. Chronic pain, however, suppressed both basal spontaneous and pain-evoked firing rates. Furthermore, we identified a linear correlation between basal and evoked firing rates of PFC neurons, whereby a decrease in basal firing leads to a nearly 2-fold reduction in pain-evoked response in chronic pain states. In contrast, enhancing basal PFC activity with low-frequency optogenetic stimulation scaled up prefrontal outputs to inhibit pain. These results demonstrate a cortical gain control system for nociceptive regulation and establish scaling up prefrontal outputs as an effective neuromodulation strategy to inhibit pain.

Abstract

Pain is a complex sensory and affective experience. Through its anticipation, animals can learn to avoid pain. Much is known about passive avoidance during a painful event; however, less is known about active pain avoidance. The anterior cingulate cortex (ACC) is a critical hub for affective pain processing. However, there is currently no mechanism that links ACC activities at the cellular level with behavioral anticipation or avoidance. Here we asked whether distinct populations of neurons in the ACC can encode information for pain anticipation. We used tetrodes to record from ACC neurons during a conditioning assay to train rats to avoid pain. We found that in rats that successfully avoid acute pain episodes, neurons that responded to pain shifted their firing rates to an earlier time, whereas neurons that responded to the anticipation of pain increased their firing rates prior to noxious stimulation. Furthermore, we found a selected group of neurons that shifted their firing from a pain-tuned response to an anticipatory response. Unsupervised learning analysis of ensemble spike activity indicates that temporal spiking patterns of ACC neurons can indeed predict the onset of pain avoidance. These results suggest rate and temporal coding schemes in the ACC for pain avoidance.

Abstract

Pain is a complex sensory and affective experience. The current definition for pain relies on verbal reports in clinical settings and behavioral assays in animal models. These definitions can be subjective and do not take into consideration signals in the neural system. Local field potentials (LFPs) represent summed electrical currents from multiple neurons in a defined brain area. Although single neuronal spike activity has been shown to modulate the acute pain, it is not yet clear how ensemble activities in the form of LFPs can be used to decode the precise timing and intensity of pain. The anterior cingulate cortex (ACC) is known to play a role in the affective-aversive component of pain in human and animal studies. Few studies, however, have examined how neural activities in the ACC can be used to interpret or predict acute noxious inputs. Here, we recorded in vivo extracellular activity in the ACC from freely behaving rats after stimulus with non-noxious, low-intensity noxious, and high-intensity noxious stimuli, both in the absence and chronic pain. Using a supervised machine learning classifier with selected LFP features, we predicted the intensity and the onset of acute nociceptive signals with high degree of precision. These results suggest the potential to use LFPs to decode acute pain.

Abstract

A core pathologic feature of chronic pain is enhanced affective response to normal nociceptive inputs. This abnormality in pain affect is driven by disrupted aversive processing, due to maladaptive plasticity within the cerebral cortex. We show that a single dose of ketamine can reduce hyperactivity of neurons in the anterior cingulate cortex to selectively inhibit pain aversion over prolonged duration, and can thus be a novel treatment for chronic pain.

Abstract

Uncovering spatial representations from large-scale ensemble spike activity in specific brain circuits provides valuable feedback in closed-loop experiments. We develop a GPU-powered population-decoding system for ultrafast reconstruction of spatial positions from rodent’s unsorted spatiotemporal spiking patterns, during run behavior or sleep. In comparison with an optimized quad-core CPU implementation, our approach achieves a ~20-50 fold speedup in eight tested rat hippocampal, cortical and thalamic ensemble recordings, with real-time decoding speed (~fraction of millisecond per spike) and scalability up to thousands of channels. By accommodating parallel shuffling in real time (computation time less than 15 ms), our approach enables assessment of the statistical significance of online-decoded ‘memory replay’ candidates during quiet wakefulness or sleep. This open-source software toolkit supports the decoding of spatial correlates or content-triggered experimental manipulation in closed-loop neuroscience experiments.

Abstract

Objective. The orofacial primary motor cortex (MIo) plays a critical role in controlling tongue and jaw movements during oral motor functions, such as chewing, swallowing and speech. However, the neural mechanisms of MIo during naturalistic feeding are still poorly understood. There is a strong need for a systematic study of motor cortical dynamics during feeding behavior. Approach. To investigate the neural dynamics and variability of MIo neuronal activity during naturalistic feeding, we used chronically implanted micro-electrode arrays to simultaneously recorded ensembles of neuronal activity in MIo of two monkeys (Macaca mulatta) while eating various types of food. We developed a Bayesian nonparametric latent variable model to reveal latent structures of neuronal population activity of MIo and identify the complex mapping between MIo ensemble spike activity and high-dimensional kinematics. Main results. Rhythmic neuronal firing patterns and oscillatory dynamics are evident in single-unit activity. At the population level, we uncovered the neural dynamics of rhythmic chewing, and quantified the neural variability at multiple timescales (complete feeding sequences, chewing sequence stages, chewing gape cycle phases) across food types. Our approach accommodates time-warping of chewing sequences and automatic model selection, and maps the latent states to chewing behaviors at fine timescales. Significance. Our work shows that neural representations of MIo ensembles display spatiotemporal patterns in chewing gape cycles at different chew sequence stages, and these patterns vary in a stage-dependent manner. Unsupervised learning and decoding analysis may reveal the link between complex MIo spatiotemporal patterns and chewing kinematics.

Abstract

Objective. Sleep spindles have been implicated in memory consolidation and synaptic plasticity during NREM sleep. Detection accuracy and latency in automatic spindle detection are critical for real-time applications. Approach. Here we propose a novel deep learning strategy (SpindleNet) to detect sleep spindles based on a single EEG channel. While the majority of spindle detection methods are used for off-line applications, our method is well suited for online applications. Main results. Compared with other spindle detection methods, SpindleNet achieves superior detection accuracy and speed, as demonstrated in two publicly available expert-validated EEG sleep spindle datasets. Our real-time detection of spindle onset achieves detection latencies of 150-350 ms (~2-3 spindle cycles) and retains excellent performance under low EEG sampling frequencies and low signal-to-noise ratios. SpindleNet has good generalization across different sleep datasets from various subject groups of different ages and species. Significance. SpindleNet is ultra-fast and scalable to multichannel EEG recordings, with an accuracy level comparable to human experts, making it appealing for long-term sleep monitoring and closed-loop neuroscience experiments.

Abstract

Background: Based on associations between sleep spindles, cognition, and sleep-dependent memory processing,here we evaluated potential relationships between levels of CSF Aβ42, P-tau, and T-tau with sleep spindle densityand other biophysical properties of sleep spindles in a sample of cognitively normal elderly individuals. Methods: One-night in-lab nocturnal polysomnography (NPSG) and morning to early afternoon CSF collection were performed to measure CSF Aβ42, P-tau and T-tau. Seven days of actigraphy were collected to assess habitualtotal sleep time. Results: Spindle density during NREM stage 2 (N2) sleep was negatively correlated with CSF Aβ42, P-tau and T-tau.From the three, CSF T-tau was the most significantly associated with spindle density, after adjusting for age, sex andApoE4. Spindle duration, count and fast spindle density were also negatively correlated with T-tau levels. Sleep duration and other measures of sleep quality were not correlated with spindle characteristics and did not modifythe associations between sleep spindle characteristics and the CSF biomarkers of AD. Conclusions: Reduced spindles during N2 sleep may represent an early dysfunction related to tau, possiblyreflecting axonal damage or altered neuronal tau secretion, rendering it a potentially novel biomarker for earlyneuronal dysfunction. Given their putative role in memory consolidation and neuroplasticity, sleep spindles mayrepresent a mechanism by which tau impairs memory consolidation, as well as a possible target for therapeuticinterventions in cognitive decline.

Abstract

Pain is a complex multidimensional experience encompassing sensory-discriminative, affective-motivational and cognitive-emotional components mediated by different neural mechanisms. Investigations of neurophysiological signals from simultaneous recordings of two or more cortical circuits may reveal important circuit mechanisms on cortical pain processing. The anterior cingulate cortex (ACC) and primary somatosensory cortex (S1) represent two most important cortical circuits related to sensory and affective processing of pain. Here, we recorded in vivo extracellular activity of the ACC and S1 simultaneously from male adult Sprague-Dale rats (n=5), while repetitive noxious laser stimulations were delivered to animal's hindpaw during pain experiments. We identified spontaneous pain-like events based on stereotyped pain behaviors in rats. We further conducted systematic analyses of spike and local field potential (LFP) recordings from both ACC and S1 during evoked and spontaneous pain episodes. From LFP recordings, we found stronger phase-amplitude coupling (theta phase vs. gamma amplitude) in the S1 than the ACC (n=10 sessions), in both evoked (p=0.058) and spontaneous pain-like behaviors (p=0.017, paired signed rank test). In addition, pain-modulated ACC and S1 neuronal firing correlated with the amplitude of stimulus-induced event-related potentials (ERPs) during evoked pain episodes. We further designed statistical and machine learning methods to detect pain signals by integrating ACC and S1 ensemble spikes and LFPs. Together, these results reveal differential coding roles between the ACC and S1 in cortical pain processing, as well as point to distinct neural mechanisms between evoked and putative spontaneous pain at both LFP and cellular levels.

Abstract

Propagation of neural activity in spatially structured neuronal networks has been observed in awake, anesthetized and sleeping brains. However, it remains unclear how traveling waves are coordinated temporally across recurrently connected brain structures, and how network connectivity affects spatiotemporal neural activity. Here we develop a computational model of a two-dimensional thalamocortical network that enables us to investigate traveling wave characteristics in space-time. We show that thalamocortical and intracortical network connectivity, excitation/inhibition balance, thalamocortical/corticothalamic delay can independently or jointly change the spatiotemporal patterns (radial, planar and rotating waves) and characteristics (speed, direction and frequency) of cortical and thalamic traveling waves. Simulations of our model further predict that increased thalamic inhibition induces slower cortical wave frequency, and enhanced cortical excitation increases cortical wave speed and oscillation frequencies. Overall, the model study provides not only theoretical insight into the basis for spatiotemporal wave patterns, but also experimental predictions that potentially control these dynamics.

Abstract

Pain is a complex, multidimensional experience that involves dynamic interactions between sensory-discriminative and affective-emotional processes. Pain experiences have a high degree of variability depending on their context and prior anticipation. Viewing pain perception as a perceptual inference problem, we propose a predictive coding paradigm to characterize evoked and non-evoked pain. We record the local field potentials (LFPs) from the primary somatosensory cortex (S1) and the anterior cingulate cortex (ACC) of freely behaving rats—two regions known to encode the sensory-discriminative and affective-emotional aspects of pain, respectively. We further use predictive coding to investigate the temporal coordination of oscillatory activity between the S1 and ACC. Specifically, we develop a phenomenological predictive coding model to describe the macroscopic dynamics of bottom-up and top-down activity. Supported by recent experimental data, we also develop a biophysical neural mass model to describe the mesoscopic neural dynamics in the S1 and ACC populations, in both naive and chronic pain-treated animals. Our proposed predictive coding models not only replicate important experimental findings, but also provide new prediction about the impact of the model parameters on the physiological or behavioral read-out—thereby yielding mechanistic insight into the uncertainty of expectation, placebo or nocebo effect, and chronic pain.

Abstract

Objective. The primary somatosensory cortex (S1) and the anterior cingulate cortex (ACC) are two of the most important cortical brain regions encoding the sensory-discriminative and affective-emotional aspects of pain, respectively. However, the functional connectivity of these two areas during pain processing remains unclear. Developing methods to dissect the functional connectivity and directed information flow between cortical pain circuits can reveal insight into neural mechanisms of pain perception. Approach. We recorded multichannel local field potentials (LFPs) from the S1 and ACC in freely behaving rats under various conditions of pain stimulus (thermal versus mechanical) and pain state (naive versus chronic pain). We applied Granger causality (GC) analysis to the LFP recordings and inferred frequency-dependent GC statistics between the S1 and ACC. Main results. We found an increased information flow during noxious pain stimulus presentation in both S1-->ACC and ACC-->S1 directions, especially at theta and gamma frequency bands. Similar results were found for thermal and mechanical pain stimuli. The chronic pain state shares common observations, except for further elevated GC measures especially in the gamma band. Furthermore, time-varying GC analysis revealed a negative correlation between the direction-specific and frequency-dependent GC and animal's paw withdrawal latency. In addition, we used computer simulations to investigate the impact of model mismatch, noise, missing variables, and common input on the conditional GC estimate. We also compared the GC results with the transfer entropy (TE) estimates. Significance. Our results reveal functional connectivity and directed information flow between the S1 and ACC during various pain conditions. The dynamic GC analysis support the hypothesis of cortico-cortical information loop in pain perception, consistent with the computational predictive coding paradigm.

Abstract

Pain is known to disrupt sleep patterns, and disturbances in sleep can further worsen pain symptoms. Sleep spindles occur during slow wave sleep have established effects on sensory and affective processing in mammals. A number of chronic neuropsychiatric conditions, meanwhile, are known to alter sleep spindle density. The effect of persistent pain on sleep spindle waves, however, remains unknown, and studies of sleep spindles are challenging due to long period of monitoring and data analysis. Utilizing automated sleep spindle detection algorithms built on deep learning, we can monitor the effect of pain states on sleep spindle activity. In this study we show that in a chronic inflammatory pain model in rodents, there is a significant decrease in sleep spindle activity compared to controls. This suggests that sleep spindles may serve a role in the development of much-needed noninvasive and objective biomarkers for pain states. Methods to restore sleep spindles, meanwhile, is associated with decreased pain symptoms. These results suggest that sleep spindle density correlates highly with chronic pain and may thus be both a potential biomarker for chronic pain and a target for neuromodulaton therapy.

Abstract

Purpose: Biomarkers for disease specific survival (DSS) in early stage melanoma are needed to select patients for adjuvant immunotherapy and accelerate clinical trial design. We present a pathology-based computational method using a deep neural network architecture for DSS prediction. Experimental design: The model was trained on 108 patients from four institutions and tested on 104 patients from Yale School of Medicine (YSM). A receiver operating characteristic (ROC) curve was generated based on vote aggregation of individual image sequences, an optimized cutoff was selected, and the computational model was tested on a third independent population of 51 patients from Geisinger Health Systems (GHS). Results: Area under the curve (AUC) in the YSM patients was 0.905 (p < 0.0001). AUC in the GHS patients was 0.880 (p < 0.0001). Using the cutoff selected in the YSM cohort, the computational model predicted DSS in the GHS cohort based on Kaplan-Meier (KM) analysis (p < 0.0001). Conclusions: The novel method presented is applicable to digital images, obviating the need for sample shipment and manipulation and representing a practical advance over current genetic and IHC-based methods.

Abstract

Pain is an integrated sensory and affective experience. Cortical mechanisms of sensory and affective integration, however, remain poorly defined. Here we combine optogenetics with in vivo electrophysiology and computational analysis to investigate a direct projection from the primary somatosensory cortex (S1) to the anterior cingulate cortex (ACC) in awake, freely behaving rats. The S1 encodes the sensory information of pain, whereas ACC is a key area for processing the aversive component of pain. We show that although only a small fraction (< 9%) of ACC neurons receives direct S1 inputs, these neurons contribute substantially to the overall ACC response to pain. Furthermore, activation of S1 axon terminals in the ACC can recruit new ACC neurons to respond to noxious stimuli, as well as increase the spiking rates of individual pain-responsive neurons. At the behavioral level, optogenetic modulation of this cortico-cortical projection bidirectionally regulates pain aversion. Importantly, in the chronic pain state, the connectivity between these two cortical areas increases, as manifested by a higher percentage of ACC neurons that respond to S1 inputs and the magnified contribution of these neurons to the nociceptive response in the ACC. This increased cortico-cortical connectivity in turn causes enhanced aversive behavior associated with chronic pain. These results define a novel cortical circuit for sensory and affective integration; this circuit undergoes plasticity in the chronic pain state and may be targeted by non-addictive neuromodulatory therapies.

Abstract

A key challenge for treating neuropsychiatric diseases is to target pathological neural activities with high temporal resolution. Pain is a fundamental sensory-affective experience, and chronic pain, a disorder that affects one in three adults, comprises discrete symptomatic episodes of unpredictable timing and frequency. Non-adaptive, continuous treatments for pain, especially chronic pain, are associated with poor efficacy and untoward side effects including addiction. Brain-machine interface (BMI) offers a potential solution to this challenge. BMIs have been developed to detect and ablate epileptic events and to link cortical commands with prosthetic devices for motor control. Here we have engineered a BMI to uniquely modulate the sensory-affective experience in rats by coupling neural codes for nociception directly with therapeutic cortical stimulation in a closed-loop system. We record neural activities in the anterior cingulate cortex (ACC), a region that is critical for pain processing, in freely behaving rats, and decode the onset of evoked pain episodes in real time based on ensembles of online sorted spikes. We then couple this pain onset detection with optogenetic activation of the prelimbic prefrontal cortex (PFC), a region well-known to provide descending pain inhibition in rodents. Our closed-loop BMI not only effectively inhibits sensory and affective components of acute mechanical and thermal pain, but also detects and relieves sensory hypersensitivity and enhanced aversion associated with chronic pain. Furthermore, this system enables the identification and regulation of the tonic pain experience. Together, these findings support the closed-loop neuromodulation strategy for both pain therapy and the study of pain mechanisms. More generally, these results provide a blueprint for the development of BMIs to target neuropsychiatric disorders affecting the sensory and affective systems.

Abstract

Spatiotemporal patterns of large-scale spiking and field potentials of the rodent hippocampus encode spatial representations during maze runs, immobility, and sleep. Here, we show that multisite hippocampal field potential amplitude at ultra-high-frequency band (FPAuhf), a generalized form of multiunit activity, provides not only a fast and reliable reconstruction of the rodent's position when awake, but also a readout of replay content during sharp-wave ripples. This FPAuhf feature may serve as a robust real-time decoding strategy from large-scale recordings in closed-loop experiments. Furthermore, we develop unsupervised learning approaches to extract low-dimensional spatiotemporal FPAuhf features during run and ripple periods and to infer latent dynamical structures from lower-rank FPAuhf features. We also develop an optical flow-based method to identify propagating spatiotemporal LFP patterns from multisite array recordings, which can be used as a decoding application. Finally, we develop a prospective decoding strategy to predict an animal's future decision in goal-directed navigation.

Abstract

Large-scale fluorescence calcium imaging methods have become widely adopted for studies of long-term hippocampal and cortical neuronal dynamics. Pyramidal neurons of the rodent hippocampus show spatial tuning in freely foraging or head-fixed navigation tasks. Development of efficient neural decoding methods for reconstructing the animal's position in real or virtual environments can provide a fast readout of spatial representations in closed-loop neuroscience experiments. Here, we develop an efficient strategy to extract features from fluorescence calcium imaging traces and further decode the animal's position. We validate our spike inference-free decoding methods in multiple in vivo calcium imaging recordings of the mouse hippocampus based on both supervised and unsupervised decoding analyses. We systematically investigate the decoding performance of our proposed methods with respect to the number of neurons, imaging frame rate, and signal-to-noise ratio. Our proposed supervised decoding analysis is ultrafast and robust, and thereby appealing for real-time position decoding applications based on calcium imaging.

Abstract

Objective: Advances in human neuroimaging has provided opportunities to identify biomarkers for pain. Identifying the onset of pain signals and the characteristics of pain responses from distributed cortical circuits may reveal important cortical mechanisms of pain. Approach: We developed an unsupervised learning method for sequential detection of acute pain signals based on multichannel human EEG recordings. Following EEG source localization, we used a state-space model (SSM) to detect the onset of acute pain signals based on the localized regions of interest (ROIs). As a comparison, we also ran a batch supervised learning analysis based on a support vector machine (SVM) classifier. Results: We validated the SSM-based detection strategy using two human EEG datasets, including one public EEG recordings of 50 subjects. We found that the detection performance varied across subjects and detection methods. We also demonstrated the feasibility for cross-modality and cross-subject prediction of acute pain signals, and showed significantly better performance in our unsupervised SSM-based method than the supervised SVM method. Significance: Our preliminary results derived from unsupervised EEG-based decoding strategies have showed some promising results as well as challenges in human brain-machine interface (BMI) for pain diagnostic or neuromodulation.

Abstract

Translational models of fear conditioning and extinction have elucidated a core neural network involved in the learning, consolidation, and expression of conditioned fear and its extinction. Anxious or trauma-exposed brains are characterized by dysregulated neural activations within regions of this fear network. In this study, we examined how the functional MRI activations of 10 brain regions commonly activated during fear conditioning and extinction might distinguish anxious or trauma-exposed brains from controls. To achieve this, activations during four phases of a fear conditioning and extinction paradigm in 304 participants with or without a psychiatric diagnosis were studied. By training convolutional neural networks (CNNs) using task-specific brain activations, we reliably distinguished the anxious and trauma-exposed brains from controls. The performance of models decreased significantly when we trained our CNN using activations from task-irrelevant brain regions or from a brain network that is irrelevant to fear. Our results suggest that neuroimaging data analytics of task-induced brain activations within the fear network might provide novel prospects for development of brain-based psychiatric diagnosis.

Abstract

Objective. Automatic detection of interictal epileptiform discharges (IEDs, short as ``spikes'') from an epileptic brain can help predict seizure recurrence and support the diagnosis of epilepsy. Developing fast, reliable and robust detection methods for IEDs based on scalp or intracortical EEG may facilitate online seizure monitoring and closed-loop neurostimulation. Approach. We developed a new deep learning approach, which employs a long short-term memory (LSTM) network architecture (``IEDnet'') and an auxiliary classifier generative adversarial network (AC-GAN), to train on both expert-annotated and augmented spike events from intracranial electroencephalography (iEEG) recordings of epilepsy patients. We validated our IEDnet with two real-world iEEG datasets, and compared IEDnet with the support vector machine (SVM) and random forest (RF) classifiers on their detection performances. Main results. IEDnet achieved excellent cross-validated detection performances in terms of both sensitivity and specificity, and outperformed SVM and RF. Synthetic spike samples augmented by AC-GAN further improved the detection performance. In addition, the performance of IEDnet was robust with respect to the sampling frequency and noise. Furthermore, we also demonstrated the cross-institutional generalization ability of IEDnet while testing between two datasets. Significance. IEDnet achieves excellent detection performances in identifying interictal spikes. AC-GAN can produce augmented iEEG samples to improve supervised deep learning.

Abstract

Emerging technologies to acquire data at increasingly greater scales promise to transform discovery in systems neuroscience. However, current exponential growth in the scale of data acquisition is a double-edged sword. Scaling up data acquisition can speed up the cycle of discovery, but can also misinterpret the results or possibly slow down the cycle due to challenges presented by the curse of high-dimensional data. Active, adaptive, closed-loop experimental paradigms employ hardware and algorithms optimized to enable time-critical computation to provide feedback that interprets the observations and tests hypotheses, to actively update the stimulus or stimulation parameters. In this perspective, we review important concepts of active and adaptive experiments, and discuss how selectively constraining the dimensionality and optimizing strategies at different stages of discovery loop can help mitigate the curse of high-dimensional data. Active and adaptive closed-loop experimental paradigms can speed up discovery in spite of an exponentially increasing data scale, offering a roadmap to timely and iterative hypothesis revision and discovery in an era of exponential growth in neuroscience.

Abstract

Recurrent neural networks (RNNs) have been widely used to model sequential neural dynamics ("neural sequences") of cortical circuits in cognitive and motor tasks. Efforts to incorporate biological constraints and Dale's principle will help elucidate the neural representations and mechanisms of underlying circuits. We trained an excitatory-inhibitory RNN to learn neural sequences in a supervised manner and studied the representations and dynamic attractors of the trained network. The trained RNN was robust to trigger the sequence in response to various input signals and interpolated a time-warped input for sequence representation. Interestingly, a learned sequence can repeat periodically when the RNN evolved beyond the duration of a single sequence. The eigenspectrum of the learned recurrent connectivity matrix with growing or damping modes, together with the RNN's nonlinearity, were adequate to generate a limit cycle attractor. We further examined the stability of dynamic attractors while training the RNN to learn two sequences. Together, our results provide a general framework for understanding neural sequence representation in the excitatory-inhibitory RNN.

Abstract

Prefrontal cortical neurons play essential roles in performing rule-dependent tasks and working memory-based decision making. Motivated by PFC recordings of task-performing mice, we developed an excitatory–inhibitory spiking recurrent neural network (SRNN) to perform a rule-dependent two-alternative forced choice (2AFC) task. We imposed several important biological constraints onto the SRNN and adapted spike frequency adaptation (SFA) and SuperSpike gradient methods to train the SRNN efficiently. The trained SRNN produced emergent rule-specific tunings in single-unit representations, showing rule-dependent population dynamics that resembled experimentally observed data. Under various test conditions, we manipulated the SRNN parameters or configuration in computer simulations, and we investigated the impacts of rule-coding error, delay duration, recurrent weight connectivity and sparsity, and excitation/inhibition (E/I) balance on both task performance and neural representations. Overall, our modeling study provides a computational framework to understand neuronal representations at a fine timescale during working memory and cognitive control and provides new experimentally testable hypotheses in future experiments.

Abstract

The prefrontal cortex (PFC) plays a prominent role in performing flexible cognitive functions and working memory, yet the underlying computational principle remains poorly understood. Here, we trained a rate-based recurrent neural network (RNN) to explore how the context rules are encoded, maintained across seconds-long mnemonic delay, and subsequently used in a context-dependent decision-making task. The trained networks replicated key experimentally observed features in the PFC of rodent and monkey experiments, such as mixed selectivity, neuronal sequential activity, and rotation dynamics. To uncover the high-dimensional neural dynamical system, we further proposed a geometric framework to quantify and visualize population coding and sensory integration in a temporally defined manner. We employed dynamic epoch-wise principal component analysis (PCA) to define multiple task-specific subspaces and task-related axes, and computed the angles between task-related axes and these subspaces. In low-dimensional neural representations, the trained RNN first encoded the context cues in a cue-specific subspace, and then maintained the cue information with a stable low-activity state persisting during the delay epoch, and further formed line attractors for sensor integration through low-dimensional neural trajectories to guide decision-making. We demonstrated via intensive computer simulations that the geometric manifolds encoding the context information were robust to varying degrees of weight perturbation in both space and time. Overall, our analysis framework provides clear geometric interpretations and quantification of information coding, maintenance, and integration, yielding new insight into the computational mechanisms of context-dependent computation.

Abstract

Exploring the neural circuits of the extinction of conditioned fear is critical to advance our understanding of fear- and anxiety-related disorders. The field has focused on examining the role of various regions of the medial prefrontal cortex, insular cortex, hippocampus, and amygdala in conditioned fear and its extinction. The contribution of this 'fear network' to the conscious awareness of fear has recently been questioned. And as such, there is a need to examine higher/multiple cortical systems that might contribute to the conscious feeling of fear and anxiety. Herein, we studied functional connectivity patterns across the entire brain to examine the contribution of multiple networks to the acquisition of fear extinction learning and its retrieval. We conducted trial-by-trial analyses on data from 137 healthy participants who underwent a two-day fear conditioning and extinction paradigm in a functional magnetic resonance imaging (fMRI) scanner. We found that functional connectivity across a broad range of brain regions, many of which are part of the default mode, frontoparietal, and ventral attention networks, increased from early to late extinction learning only to a conditioned cue. The increased connectivity during extinction learning predicted the magnitude of extinction memory tested 24 h later. Together, these findings provide evidence supporting recent studies implicating distributed brain regions in learning, consolidation and expression of fear extinction memory in the human brain.

Abstract

Chronic pain alters cortical and subcortical plasticity, causing enhanced affective responses to peripheral nociceptive inputs. Previous studies have showed that ketamine had the potential to inhibit abnormally amplified affective responses of single neurons by suppressing hyperactivity in the anterior cingulate cortex (ACC). However, the mechanism of this enduring effect has yet to be understood at the network level. In this study, we recorded local field potentials from the ACC of freely moving rats. Animals were injected with complete Freund’s adjuvant (CFA) to induce persistent inflammatory pain. Mechanical pinprick stimulations were administered to the hind paw contralateral to the CFA injection. We found a significant increase in the high-gamma band (60-100 Hz) power after CFA injection. Comparing rats in the chronic pain state before and after ketamine injection, ketamine decreased the high-gamma band power back to baseline level of activity. In addition, ketamine had a sustained effect on the high-gamma band power lasting up to five days after a single dose administration. These results demonstrated the efficacy of ketamine in reversing maladaptive neuronal plasticity in the ACC induced by chronic pain.

Abstract

Chronic pain affects one in four adults, and effective non-sedating and non-addictive treatments are urgently needed. Chronic pain causes maladaptive changes in the cerebral cortex, which can lead to impaired endogenous nociceptive processing. However, it is not yet clear if drugs that restore endogenous cortical regulation could provide an effective therapeutic strategy for chronic pain. Here, we studied the nociceptive response of neurons in the prelimbic region of the prefrontal cortex (PL-PFC) in freely behaving rats using a spared nerve injury (SNI) model of chronic pain, and the impact of AMPAkines, a class of drugs that increase central glutamate signaling, on such response. We found that neurons in the PL-PFC increase their firing rates in response to noxious stimulations; chronic neuropathic pain, however, suppressed this important cortical pain response. Meanwhile, CX546, a well-known AMPAkine, restored the anti-nociceptive response of PL-PFC neurons in the chronic pain condition. In addition, both systemic administration and direct delivery of CX546 into the PL-PFC inhibited symptoms of chronic pain, whereas optogenetic inactivation of the PFC neurons or administration of AMPA receptor antagonists in the PL-PFC blocked the anti-nociceptive effects of CX546. These results indicate that restoration of the endogenous anti-nociceptive functions in the PL-PFC by pharmacological agents such as AMPAkines constitutes a successful strategy to treat chronic neuropathic pain.

Abstract

The prefrontal cortex (PFC) regulates a wide range of sensory experiences. Chronic pain is known to impair normal neural response, leading to enhanced aversion. However, it remains unknown how nociceptive responses in the cortex are processed at the population level and whether such processes are disrupted by chronic pain. Using in vivo endoscopic calcium imaging, we identify increased population activity in response to noxious stimuli and stable patterns of functional connectivity among neurons in the prelimbic (PL) PFC from freely behaving rats. Inflammatory pain disrupts functional connectivity of PFC neurons and reduces the overall nociceptive response. Interestingly, ketamine, a well-known neuromodulator, restores the functional connectivity among PL-PFC neurons in the inflammatory pain model to produce anti-aversive effects. These results suggest a dynamic resource allocation mechanism in the prefrontal representations of pain and indicate that population activity in the PFC critically regulates pain and serves as an important therapeutic target.

Abstract

Abstract

Pain is a dynamic, complex and multidimensional experience. The identification of pain from brain activity as neural readout may effectively provide a neural code for pain, and further provide useful information for pain diagnosis and treatment. Advances in neuroimaging and large-scale electrophysiology have enabled us to examine neural activity with improved spatial and temporal resolution, providing opportunities to decode pain in humans and freely behaving animals. This topical review provides a systematical overview of state-of-the-art methods for decoding pain from brain signals, with special emphasis on electrophysiological and neuroimaging modalities. We show how pain decoding analyses can help pain diagnosis and discovery of neurobiomarkers for chronic pain. Finally, we discuss the challenges in the research field and point to several important future research directions.

Abstract

Objective: Sudden unexpected death in epilepsy (SUDEP) is the leading cause of epilepsy-related mortality. Although lots of effort has been made in identifying clinical risk factors for SUDEP in the literature, there are few validated methods to predict individual SUDEP risk. Prolonged postictal EEG suppression (PGES) is a potential SUDEP biomarker, but its occurrence is infrequent and requires epilepsy monitoring unit admission. We use machine learning methods to examine SUDEP risk using interictal EEG and ECG recordings from SUDEP cases and matched living epilepsy controls. Methods: This multicenter, retrospective, cohort study examined interictal EEG and ECG recordings from 30 SUDEP cases and 58 age-matched living epilepsy patient controls. We trained machine learning models with interictal EEG and ECG features to predict the retrospective SUDEP risk for each patient. We assessed cross-validated classification accuracy and the area under the receiver operating characteristic (AUC) curve. Results: The logistic regression (LR) classifier produced the overall best performance, outperforming the support vector machine (SVM), random forest (RF), and convolutional neural network (CNN). Among the 30 patients with SUDEP [14 females; mean age (SD), 31 (8.47) years] and 58 living epilepsy controls [26 females (43%); mean age (SD) 31 (8.5) years], the LR model achieved the median AUC of 0.77 [interquartile range (IQR), 0.73-0.80] in five-fold cross-validation using interictal alpha and low gamma power ratio of the EEG and heart rate variability (HRV) features extracted from the ECG. The LR model achieved the mean AUC of 0.79 in leave-one-center-out prediction. Conclusions: Our results support that machine learning-driven models may quantify SUDEP risk for epilepsy patients, future refinements in our model may help predict individualized SUDEP risk and help clinicians correlate predictive scores with the clinical data. Low-cost and noninvasive interictal biomarkers of SUDEP risk may help clinicians to identify high-risk patients and initiate preventive strategies.

Abstract

Head direction (HD) cells form a fundamental component in the brain's spatial navigation system and are intricately linked to spatial memory and cognition. Although HD cells have been shown to act as an internal neuronal compass in various cortical and subcortical regions, the neural substrate of HD cells is incompletely understood. It is reported that HD cells in the somatosensory cortex comprise regular-spiking (RS, putative excitatory) and fast-spiking (FS, putative inhibitory) neurons. Surprisingly, somatosensory FS HD cells fire in bursts and display much sharper head-directionality than RS HD cells. These FS HD cells are nonconjunctive, rarely theta rhythmic, sparsely connected and enriched in layer 5. Moreover, sharply tuned FS HD cells, in contrast with RS HD cells, maintain stable tuning in darkness; FS HD cells’ coexistence with RS HD cells and angular head velocity (AHV) cells in a layer-specific fashion through the somatosensory cortex presents a previously unreported configuration of spatial representation in the neocortex. Together, these findings challenge the notion that FS interneurons are weakly tuned to sensory stimuli, and offer a local circuit organization relevant to the generation and transmission of HD signaling in the brain.

Abstract

Grid cells or grid-like responses have been reported in the rodent, bat and human brains during various spatial and non-spatial tasks. However, the functions of grid-like representations beyond the classical medial entorhinal cortex remain elusive. Based on accumulating evidence from recent rodent recordings and human fMRI data, we make speculative accounts regarding the mechanisms and functional significance of the sensory cortical grid cells and further make theory-driven predictions. We argue and reason the rationale why grid responses may be universal in the brain for a wide range of perceptual and cognitive tasks that involve locomotion and mental navigation. Computational modeling may provide an alternative and complementary means to investigate the grid code or grid-like map. We hope that the new discussion will lead to experimentally testable hypotheses and drive future experimental data collection.

Abstract

Spatially modulated grid cells have been recently found in the rat secondary visual cortex (V2) during active navigation. However, the computational mechanism and functional significance of V2 grid cells remain unknown. To address the knowledge gap, we train a biologically inspired excitatory-inhibitory recurrent neural network to perform a two-dimensional spatial navigation task with multisensory input. We find grid-like responses in both excitatory and inhibitory RNN units, which are robust with respect to spatial cues, dimensionality of visual input, and activation function. Population responses reveal a low-dimensional, torus-like manifold and attractor. We find a link between functional grid clusters with similar receptive fields and structured excitatory-to-excitatory connections. Additionally, multistable torus-like attractors emerged with increasing sparsity in inter- and intra-subnetwork connectivity. Finally, irregular grid patterns are found in recurrent neural network (RNN) units during a visual sequence recognition task. Together, our results suggest common computational mechanisms of V2 grid cells for spatial and non-spatial tasks.

Abstract

In light of the National Institute of Mental Health (NIMH)’s Research Domain Criteria (RDoC), the advent of functional neuroimaging, novel technologies and methods provide new opportunities to develop precise and personalized prognosis and diagnosis of mental disorders. Machine learning (ML) and artificial intelligence (AI) technologies are playing an increasingly critical role in the new era of precision psychiatry. Combining ML/AI with neuromodulation technologies can potentially provide explainable solutions in clinical practice and effective therapeutic treatment. Advanced wearable and mobile technologies also call for the new role of ML/AI for digital phenotyping in mobile mental health. In this review, we provide a comprehensive review of ML methodologies and applications by combining neuroimaging, neuromodulation, and advanced mobile technologies in psychiatry practice. We further review the role of ML in molecular phenotyping and cross-species biomarker identification in precision psychiatry. We also discuss explainable AI (XAI) and neuromodulation in a closed human-in-the-loop manner and highlight the ML potential in multi-media information extraction and multi-modal data fusion. Finally, we discuss conceptual and practical challenges in precision psychiatry and highlight ML opportunities in future research.

Abstract

Memory reactivations and replay, widely reported in the hippocampus and cortex across species, have been implicated in memory consolidation, planning, and spatial and skill learning. Technological advances in electrophysiology, calcium imaging, and human neuroimaging techniques have enabled neuroscientists to measure large-scale neural activity with increasing spatiotemporal resolution and have provided opportunities for developing robust analytic methods to identify memory replay. In this article, we first review a large body of historically important and representative memory replay studies from the animal and human literature. We then discuss our current understanding of memory replay functions in learning, planning, and memory consolidation and further discuss the progress in computational modeling that has contributed to these improvements. Next, we review past and present analytic methods for replay analyses and discuss their limitations and challenges. Finally, looking ahead, we discuss some promising analytic methods for detecting nonstereotypical, behaviorally nondecodable structures from large-scale neural recordings. We argue that seamless integration of multisite recordings, real-time replay decoding, and closed-loop manipulation experiments will be essential for delineating the role of memory replay in a wide range of cognitive and motor functions.

Abstract

Pain is driven by sensation and emotion, and in turn, it motivates decisions and actions. To fully appreciate the multidimensional nature of pain, we formulate the study of pain within a closed-loop framework of sensory-motor prediction. In this closed-loop cycle, prediction plays an important role, as the interaction between prediction and actual sensory experience shapes pain perception and subsequently, action. In this Perspective, we describe the roles of two prominent computational theories—Bayesian inference and reinforcement learning—in modeling adaptive pain behaviors. We show that prediction serves as a common theme between these two theories, and that each of these theories can explain unique aspects of the pain perception-action cycle. We discuss how these computational theories and models can improve our mechanistic understandings of pain-centered processes such as anticipation, attention, placebo hypoalgesia, and pain chronification.

Abstract

Predictive coding is a computational theory on describing how the brain perceives and acts, which has been widely adopted in sensory processing and motor control. Nociceptive and pain processing involves a large and distributed network of circuits. However, it is still unknown whether this distributed network is completely decentralized or requires networkwide coordination. Multiple lines of evidence from human and animal studies have suggested that the cingulate cortex and insula cortex (cingulate-insula network) are two major hubs in mediating information from sensory afferents and spinothalamic inputs, whereas subregions of cingulate and insula cortices have distinct projections and functional roles. In this mini-review, we propose an updated hierarchical predictive coding framework for pain perception and discuss its related computational, algorithmic, and implementation issues. We suggest active inference as a generalized predictive coding algorithm, and hierarchically organized traveling waves of independent neural oscillations as a plausible brain mechanism to integrate bottom-up and top-down information across distributed pain circuits.

Abstract

Importance: Sleep disorders are one of the most frequent comorbidities in children with autism spectrum disorder (ASD). However, the link between neurodevelopmental effects in ASD children with their underlying sleep microarchitecture is not well understood. An improved understanding of etiology of sleep difficulties and identification of sleep-associated biomarkers for children with ASD can improve the accuracy of clinical diagnosis. Objectives: To investigate whether machine learning models can identify biomarkers for children with ASD based on sleep EEG recordings. Design, setting, and participants: Sleep polysomnogram data were obtained from the Nationwide Children’ Health (NCH) Sleep DataBank. Children (ages: 8–16 yrs) with 149 autism and 197 age-matched controls without neurodevelopmental diagnosis were selected for analysis. An additional independent age-matched control group (n = 79) selected from the Childhood Adenotonsillectomy Trial (CHAT) was also used to validate the models. Furthermore, an independent smaller NCH cohort of younger infants and toddlers (age: 0.5–3 yr.; 38 autism and 75 controls) was used for additional validation. Main outcomes and measures: We computed periodic and non-periodic characteristics from sleep EEG recordings: sleep stages, spectral power, sleep spindle characteristics, and aperiodic signals. Machine learning models including the Logistic Regression (LR) classifier, Support Vector Machine (SVM), and Random Forest (RF) model were trained using these features. We determined the autism class based on the prediction score of the classifier. The area under the receiver operating characteristics curve (AUC), accuracy, sensitivity, and specificity were used to evaluate the model performance. Results: In the NCH study, RF outperformed two other models with a 10-fold cross-validated median AUC of 0.95 (interquartile range [IQR], [0.93, 0.98]). The LR and SVM models performed comparably across multiple metrics, with median AUC 0.80 [0.78, 0.85] and 0.83 [0.79, 0.87], respectively. In the CHAT study, three tested models have comparable AUC results: LR: 0.83 [0.76, 0.92], SVM: 0.87 [0.75, 1.00], and RF: 0.85 [0.75, 1.00]. Sleep spindle density, amplitude, spindle-slow oscillation (SSO) coupling, aperiodic signal’s spectral slope and intercept, as well as the percentage of REM sleep were found to be key discriminative features in the predictive models. Conclusion and relevance: Our results suggest that integration of EEG feature engineering and machine learning can identify sleep-based biomarkers for ASD children and produce good generalization in independent validation datasets. Microstructural EEG alterations may help reveal underlying pathophysiological mechanisms of autism that alter sleep quality and behaviors. Machine learning analysis may reveal new insight into the etiology and treatment of sleep difficulties in autism.

Abstract

In recent years, the field of neuroscience has gone through rapid experimental advances and a significant increase in the use of quantitative and computational methods. This growth has created a need for clearer analyses of the theory and modeling approaches used in the field. This issue is particularly complex in neuroscience because the field studies phenomena that cross a wide range of scales and often require consideration at varying degrees of abstraction, from precise biophysical interactions to the computations they implement. We argue that a pragmatic perspective of science, in which descriptive, mechanistic, and normative models and theories each play a distinct role in defining and bridging levels of abstraction, will facilitate neuroscientific practice. This analysis leads to methodological suggestions, including selecting a level of abstraction that is appropriate for a given problem, identifying transfer functions to connect models and data, and the use of models themselves as a form of experiment.

Abstract

Injuries of various types occur commonly in the lives of humans and other animals and lead to a pattern of persistent pain and recuperative behaviour that allows safe and effective recovery. In this Perspective, we propose a control-theoretic framework to explain the adaptive processes in the brain that drive physiological post-injury behaviour. We set out an evolutionary and ethological view on how animals respond to injury, illustrating how the behavioural state associated with persistent pain and recuperation may be just as important as phasic pain in ensuring survival. Adopting a normative approach, we suggest that the brain implements a continuous optimal inference of the current state of injury from diverse sensory and physiological signals. This drives the various effector control mechanisms of behavioural homeostasis, which span the modulation of ongoing motivation and perception to drive rest and hyper-protective behaviours. However, an inherent problem with this is that these protective behaviours may partially obscure information about whether injury has resolved. Such information restriction may seed a tendency to aberrantly or persistently infer injury, and may thus promote the transition to pathological chronic pain states.

Abstract

Neurons in the prefrontal cortex (PFC) can provide top-down regulation of sensory-affective experiences such as pain. Bottom-up modulation of sensory coding in the PFC, however, remains poorly understood. Here, we examined how oxytocin (OT) signaling from the hypothalamus regulates nociceptive coding in the PFC. In vivo time-lapse endoscopic calcium imaging in freely behaving rats showed that OT selectively enhanced population activity in the prelimbic PFC in response to nociceptive inputs. This population response resulted from the reduction of evoked GABAergic inhibition and manifested as elevated functional connectivity involving pain-responsive neurons. Direct inputs from OT-releasing neurons in the paraventricular nucleus (PVN) of the hypothalamus are crucial to maintaining this prefrontal nociceptive response. Activation of the prelimbic PFC by OT or direct optogenetic stimulation of oxytocinergic PVN projections reduced acute and chronic pain. These results suggest that oxytocinergic signaling in the PVN-PFC circuit constitutes a key mechanism to regulate cortical sensory processing.

Abstract

Sexual and aggressive behaviors are vital for species survival and individual reproductive success. Although many limbic regions have been found relevant to these behaviors, how social cues are represented across regions and how the network activity generates each behavior remains elusive. To answer these questions, we utilize multi-fiber photometry (MFP) to simultaneously record Ca2+ signals of estrogen receptor alpha (Esr1)-expressing cells from 13 limbic regions in male mice during mating and fighting. We find that conspecific sensory information and social action signals are widely distributed in the limbic system and can be decoded from the network activity. Cross-region correlation analysis reveals striking increases in the network functional connectivity during the social action initiation phase, whereas late copulation is accompanied by a "dissociated" network state. Based on the response patterns, we propose a mating-biased network (MBN) and an aggression-biased network (ABN) for mediating male sexual and aggressive behaviors, respectively.

Abstract

Machine learning is becoming an increasingly common component of routine data analyses in clinical research. The past decade in pain research has witnessed great advances in human neuroimaging and machine learning. With each finding, the pain research community takes one step closer to uncovering fundamental mechanisms underlying chronic pain and at the same time proposing neurophysiological biomarkers. However, it remains challenging to fully understand chronic pain due to its multidimensional representations within the brain. By utilizing cost-effective and non-invasive imaging techniques such as electroencephalography (EEG) and analyzing the resulting data with advanced analytic methods, we have the opportunity to better understand and identify specific neural mechanisms associated with the processing and perception of chronic pain. This narrative literature review summarizes studies from the last decade describing the utility of EEG as a potential biomarker for chronic pain by synergizing clinical and computational perspectives.

Abstract

Chronic pain negatively impacts a range of sensory and affective behaviors. Previous studies have shown that the presence of chronic pain not only causes hypersensitivity at the site of injury but may also be associated with pain-aversive experiences at anatomically unrelated sites. While animal studies have indicated that the cingulate and prefrontal cortices are involved in this generalized hyperalgesia, the mechanisms distinguishing increased sensitivity at the site of injury from a generalized sitenonspecific enhancement in the aversive response to nociceptive inputs are not well known. Here we compared measured pain responses to peripheral mechanical stimuli applied to a site of chronic pain and at a pain-free site in participants suffering from chronic lower back pain (n = 15) versus pain-free control participants (n = 15). As expected, participants with chronic pain endorsed enhanced pain with mechanical stimuli in both back and hand. We further analyzed electroencephalographic (EEG) recordings during these evoked pain episodes. Brain oscillations in theta and alpha bands in the medial orbitofrontal cortex (mOFC) were associated with localized hypersensitivity, while increased gamma oscillations in the anterior cingulate cortex (ACC) and increased theta oscillations in the dorsolateral prefrontal cortex (dlPFC) were associated with generalized hyperalgesia. These findings indicate that chronic pain may disrupt multiple cortical circuits to impact nociceptive processing.

Abstract

Background: The striatal-pallidal pathway plays an important role in cognitive control and modulation of behaviors. Globus pallidus interna (GPi), as a primary output structure, is crucial in modulating excitation and inhibition. Studies of GPi in psychiatric illnesses are lacking given the technical challenges of examining this small and functionally diverse subcortical structure. Methods: 71 medication-naïve first episode schizophrenia (FES) participants and 73 healthy controls (HC) were recruited at the Shanghai Mental Health Center. Clinical symptoms and imaging data were collected at baseline and, in a subset of patients, 8 weeks after initiating treatment. Resting-state functional connectivity of sub-regions of the GP were assessed using a novel mask that combines two atlases to create 8 ROIs in the GP. Results: Baseline imaging data from 63 FES patients and 55 HC met quality standards and were analyzed. FES patients exhibited less negative connectivity and increased positive connectivity between the right anterior GPi and several cortical and subcortical areas at baseline compared to HC (PFWE < 0.05). Positive functional connectivity between the right anterior GPi and several brain areas, including the right dorsal anterior cingulate gyrus, was associated with severity of positive symptoms (PFWE < 0.05) and predicted treatment response after 8 weeks (n = 28, adjusted R2 = 0.486, p < 0.001). Conclusions: Our results implicate striatal-pallidal-thalamic pathways in antipsychotic efficacy. If replicated, these findings may reflect failure of neurodevelopmental processes in adolescence and early adulthood that decrease functional connectivity as an index of failure of the limbic/associative GPi to appropriately inhibit irrelevant signals in psychosis.

Abstract

Pain is known to have sensory and affective components. The sensory pain component is encoded by neurons in the primary somatosensory cortex (S1), whereas the emotional or affective pain experience is in large part processed by neural activities in the anterior cingulate cortex (ACC). The timing of how a mechanical or thermal noxious stimulus triggers activation of peripheral pain fibers is well-known. However, the temporal processing of nociceptive inputs in the cortex remains little studied. Here, we took two approaches to examine how nociceptive inputs are processed by the S1 and ACC. We simultaneously recorded local field potentials in both regions, during the application of a brain-computer interface (BCI). First, we compared event related potentials in the S1 and ACC. Next, we used an algorithmic pain decoder enabled by machine-learning to detect the onset of pain which was used during the implementation of the BCI to automatically treat pain. We found that whereas mechanical pain triggered neural activity changes first in the S1, the S1 and ACC processed thermal pain with a reasonably similar time course. These results indicate that the temporal processing of nociceptive information in different regions of the cortex is likely important for the overall pain experience.

Abstract

Abstract

Abstract

Abstract

Abstract

Abstract

Abstract

Abstract

Abstract