Pre-start

Announcements

  • Homework 1 Questions "due" tonight. Any questions??
    • Problem 3
    • Office hours this afternoon 4-6 (please email me pseudoscience@rice.edu) and on Friday morning
    • Remember to note how many points you've earned if you believe you've demonstrated the objectives

Neural Signal Processing & Machine Learning

ELEC/BIOE 548 | ELEC 483

Fall 2022

Episode 8: Firing rates & spiking statistics

(and so we begin mathing!)

1

Introduction. Class & brains

2

Fundamental neurobiology. How do neurons fire? How/what do we record?

3

Modeling spike trains. First bit of analysis work and understanding firing properties of neurons.

5

Classification. Making machines learn. Which direction is a monkey trying to reach? Bayesian decoding.

4

Point processes. Continued modeling work of neurons.

6

Clustering/Mixture models. Making machines learn some more. Spike sorting.

Bi-weekly Schedule

7

Continuous decoding. Kalman filters. Machines continue to learn.

8

Spectral analysis? LFP interpretation in spectral domain. But also kinda in clustering.

Brain Signals!

  • How can we measure neural activity?

  • What info do neurons encode in trains of action potentials (“spike trains”)?

  • How can we model “statically” encoded information?

  • Estimation/”decoding”

  • How can we model/decode “dynamic” information? (filtering, Kalman, HMM)

  • Signal conditioning – “spike sorting” (PCA, Expectation-Maximization)

  • Beyond spike trains (LFP, EEG, imaging)

Neural Encoding vs Decoding

  • Neurons transmit information by firing sequences of spikes
  • Neural encoding – the map from stimulus to neural response. (hard)
    • Can measure how neurons respond to a wide variety of stimuli. Then construct models; attempt to predict responses to other stimuli.
    • We will discuss encoding next few lectures.
  • Neural decoding – the map from response to stimulus. (easy-ish)
    • Attempt to reconstruct a stimulus, or certain aspects of that stimulus, from the spike sequence it evokes
    • We will discuss decoding extensively in the rest of this course.

Neural Encoding

Why is characterizing the stimulus → response relationship hard?


Neural responses are “complex” and variable.

 

Neural Encoding

Characterizing the stimulus → response relationship is hard because

  • Spike sequences reflect both intrinsic neural dynamics and temporal characteristics of stimulus.

 

Neural Encoding

Characterizing the stimulus → response relationship is hard because

  • Identifying features of response that encode changes in stimulus is difficult, especially if stimulus changes on times scale of inter-spike interval.

Neural Encoding

Characterizing the stimulus → response relationship is hard because

  • Neural responses vary from trial-to-trial even when the same stimulus is presented repeatedly.

Why might there be variability in neural responses?

Neural Encoding

Why are neural responses variable???

  • Biophysical randomness (e.g., neurotransmitter release at presynaptic terminal, opening/closing of ion channels)
  • Arousal and attention
  • "Other" cognitive "junk"

Neural Encoding

  • Characterizing the stimulus ➞ response relationship is hard because neural responses are “complex” and variable.
  • Bottom line: modeling/predicting the exact timing of every spike is too hard
  • So… we can use a model for the probability that different spike sequences are evoked by a specific stimulus.

Neural Encoding

Population Codes

  • Stimulus features are encoded by the activities of large neural populations (e.g., b/millions).
  • To model population codes we must do more than just study the firing patterns of single neurons. Why?
    • Information can be represented in correlated activity!

Population Codes!

Correlation is complicated! How can we even begin to determine causality??

Population Codes!

How does a population of neurons (in motor cortex) encode, with spike times, where the arm will move next?


How is the actual arm movement encoded?

Spike Trains!

Choo Choo

  • Action potentials encode and convey information through their timing.
    • AP duration, amplitude and shape are highly stereotyped.
    • Neglecting the brief duration of the actual AP (~1 ms), we can characterize an AP sequence with a list of spike times, ti.

Firing Rates

  • The sequence of APs generated by a given stimulus varies from trial to trial.
  • Hence statistical / probabilistic approach.
  • Neural responses can be characterized by firing rates, rather than by specific spike sequences.

Firing Rates

  • Simple firing rate = # of spikes in a time window (units of spikes per second or Hz)

Firing Rates

  • What are we missing???
    • ​Aspects of neural responses that vary in time!

Time-Varying Firing Rates

Choo-choo(t)

Ways to approximate a time-varying firing rate from a spike train

Raw spike train

 

Counts in 100 ms windows (non-overlapping)

 

Counts in 100 ms windows (sliding window)

 

Convolution with Gaussian (what's a good sigma??)

 

Convolution with one-sided exponential (why is this more realistic for real time??)

Time-Varying Firing Rates

Challenges of choo-choo(t)

  • If we want high temporal resolution, bins must be made small but counts are then primarily zero or one

 

 

 

 

 

 

 

  • Firing rate estimation is sensitive to randomness ("noise") in spike generation. We would like to discard this random component

Trial-Averaged Firing Rates

choo-choo/(num(choo-choos))

Trial-Averaged Firing Rates

choo-choo/(num(choo-choos))

Trial-Averaged Firing Rates

choo-choo/(num(choo-choos))

Trial-Averaged Firing Rates

choo-choo/(num(choo-choos))

Sequences vs Rates

  • Spike-timing dependent plasticity (we'll pick up from here next time!)

ELEC548 Lec8

By Shayok Dutta

ELEC548 Lec8

  • 58