Part III: Computational Neuroscience | Chapter 1

Computational Models of Neurons

Integrate-and-fire neurons, the Hodgkin-Huxley model, cable theory, and network-level dynamics

From Biophysics to Computation

Computational neuroscience seeks mathematical descriptions of neural activity at multiple levels of abstraction. At one extreme, the Hodgkin-Huxley (HH) model captures the biophysical mechanisms of action potential generation with ionic channel kinetics. At the other, integrate-and-fire models strip neurons to their computational essence: summing inputs and firing when a threshold is crossed.

Between these extremes lie cable theory (describing signal propagation in dendrites), reduced models (Izhikevich, AdEx), and network models that capture emergent dynamics of interacting populations. Each level of description answers different questions and enables different insights.

1. Integrate-and-Fire Models

The leaky integrate-and-fire (LIF) neuron, introduced by Lapicque (1907), is the workhorse of computational neuroscience. It models the neuron as an RC circuit that integrates synaptic currents, firing an action potential when the membrane potential reaches threshold.

Derivation 1: LIF Neuron Dynamics and Firing Rate

The membrane potential $V(t)$ obeys:

$$\tau_m \frac{dV}{dt} = -(V - V_{\text{rest}}) + R_m I(t)$$

where $\tau_m = R_m C_m$ is the membrane time constant. When $V$ reaches threshold $V_{\text{th}}$, a spike is emitted and $V$ resets to $V_{\text{reset}}$. For constant current $I_0$, the voltage trajectory between spikes is:

$$V(t) = V_{\text{rest}} + R_m I_0 \left(1 - e^{-t/\tau_m}\right)$$

The interspike interval is the time to reach threshold from reset:

$$T_{\text{ISI}} = \tau_m \ln\left(\frac{R_m I_0 - V_{\text{reset}} + V_{\text{rest}}}{R_m I_0 - V_{\text{th}} + V_{\text{rest}}}\right)$$

The firing rate is $f = 1/T_{\text{ISI}}$, which exists only when$R_m I_0 > V_{\text{th}} - V_{\text{rest}}$ (suprathreshold). The f-I curve starts at zero and increases as $f \sim I_0$ for large currents, producing the characteristic concave shape observed in many neurons.

2. The Hodgkin-Huxley Model

The Hodgkin-Huxley model (1952) describes action potential generation through voltage-dependent sodium and potassium conductances. This biophysical model, developed from voltage-clamp experiments on the squid giant axon, earned Hodgkin and Huxley the Nobel Prize in 1963 and remains the gold standard for detailed neural modeling.

Derivation 2: HH Equations and Gating Variables

The membrane current equation is:

$$C_m \frac{dV}{dt} = -\bar{g}_{\text{Na}} m^3 h (V - E_{\text{Na}}) - \bar{g}_{\text{K}} n^4 (V - E_{\text{K}}) - g_L (V - E_L) + I_{\text{ext}}$$

The gating variables $m, h, n$ follow first-order kinetics:

$$\frac{dx}{dt} = \alpha_x(V)(1 - x) - \beta_x(V) x = \frac{x_\infty(V) - x}{\tau_x(V)}$$

where $x_\infty(V) = \alpha_x / (\alpha_x + \beta_x)$ and$\tau_x(V) = 1 / (\alpha_x + \beta_x)$. The action potential emerges from:

  • Fast Na$^+$ activation ($m$): rapid depolarization ($\tau_m \sim 0.1$ ms)
  • Slow Na$^+$ inactivation ($h$): terminates the upstroke ($\tau_h \sim 1$ ms)
  • Slow K$^+$ activation ($n$): repolarization ($\tau_n \sim 1$ ms)

The threshold for spike initiation occurs at a saddle-node bifurcation where the V-nullcline and n-nullcline intersect, typically near $V \approx -55$ mV. The refractory period arises from slow recovery of $h$ and $n$ after a spike.

3. Cable Theory

Dendrites are not isopotential — they are extended structures where signals propagate with attenuation. Cable theory, developed by Rall (1959), applies transmission line equations to describe how synaptic potentials spread along dendrites.

Derivation 3: The Cable Equation and Electrotonic Length

For a cylindrical dendrite with membrane resistance $r_m$ (per unit length), axial resistance $r_a$, and membrane capacitance $c_m$:

$$\lambda^2 \frac{\partial^2 V}{\partial x^2} = \tau_m \frac{\partial V}{\partial t} + V$$

where $\lambda = \sqrt{r_m / r_a}$ is the space constant and $\tau_m = r_m c_m$is the time constant. The steady-state solution for a point current injection at$x = 0$ in an infinite cable is:

$$V(x) = V_0 \, e^{-|x|/\lambda}$$

The electrotonic length $L = \ell / \lambda$ (where $\ell$ is physical length) determines how effectively distal synapses influence the soma. For a finite cable of electrotonic length $L$ with sealed ends, the input resistance is:

$$R_{\text{in}} = \frac{r_a \lambda}{\tanh(L)}$$

Typical cortical dendrites have $\lambda \approx 0.5\text{--}1$ mm and $L \approx 1\text{--}2$, meaning distal synapses are significantly attenuated (by a factor of $e^{-L}$). This attenuation can be counteracted by active dendritic conductances (NMDA spikes, Ca$^{2+}$ spikes), which are critical for dendritic computation.

4. Network Models

Networks of neurons exhibit emergent dynamics that cannot be predicted from single-neuron properties alone. The Wilson-Cowan model (1972) describes the mean-field dynamics of excitatory and inhibitory populations, capturing phenomena such as oscillations, bistability, and pattern formation.

Derivation 4: Wilson-Cowan Mean-Field Equations

The population firing rates of excitatory ($E$) and inhibitory ($I$) populations evolve as:

$$\tau_E \frac{dE}{dt} = -E + S_E(w_{EE} E - w_{EI} I + I_E^{\text{ext}})$$

$$\tau_I \frac{dI}{dt} = -I + S_I(w_{IE} E - w_{II} I + I_I^{\text{ext}})$$

where $S(x) = 1/(1 + e^{-a(x-\theta)})$ is the population transfer function. The system exhibits oscillations when the E-I loop has sufficient gain. Linearizing around the fixed point $(E^*, I^*)$:

$$\mathbf{J} = \begin{pmatrix} (-1 + w_{EE} S_E')/\tau_E & -w_{EI} S_E'/\tau_E \\ w_{IE} S_I'/\tau_I & (-1 - w_{II} S_I')/\tau_I \end{pmatrix}$$

Oscillations occur when the eigenvalues of $\mathbf{J}$ have imaginary parts, requiring $\text{tr}(\mathbf{J})^2 < 4\det(\mathbf{J})$. The oscillation frequency is $\omega = \sqrt{\det(\mathbf{J}) - (\text{tr}(\mathbf{J})/2)^2}$. This E-I balance mechanism generates gamma oscillations (30–80 Hz) observed in cortex.

Derivation 5: Balanced Networks and Irregular Firing

Van Vreeswijk and Sompolinsky (1996) showed that networks with strong excitation and inhibition self-organize into a balanced state. For a network of $N_E$ excitatory and $N_I$ inhibitory neurons, the mean input to an excitatory neuron is:

$$\mu_E = \sqrt{K}(J_{EE} r_E - J_{EI} r_I) + I_{\text{ext}}$$

where $K$ is the number of connections per neuron and $J$ are coupling strengths scaled as $J \sim 1/\sqrt{K}$. In the balanced state, excitation and inhibition nearly cancel: $\mu_E \sim O(1)$ despite each being $O(\sqrt{K})$. The input fluctuations drive firing:

$$\sigma_E^2 = K(J_{EE}^2 r_E + J_{EI}^2 r_I)$$

This produces irregular, Poisson-like firing ($\text{CV}_{\text{ISI}} \approx 1$) matching cortical recordings. The balanced state is self-organizing: if excitation increases, inhibition adjusts to restore balance, providing a mechanism for robust cortical operation.

5. Historical Development

  • 1907: Lapicque introduces the integrate-and-fire model, the first mathematical neuron model.
  • 1952: Hodgkin and Huxley publish their ionic conductance model of the squid giant axon (Nobel Prize, 1963).
  • 1959: Rall develops cable theory for dendrites, enabling analysis of synaptic integration in complex morphologies.
  • 1972: Wilson and Cowan derive mean-field equations for excitatory-inhibitory neural populations.
  • 1996: Van Vreeswijk and Sompolinsky discover the balanced state in random networks, explaining cortical irregularity.
  • 2003: Izhikevich introduces a two-variable neuron model that reproduces all known firing patterns with minimal computation.
  • 2005: Brette and Gerstner develop the adaptive exponential integrate-and-fire (AdEx) model, balancing efficiency and biophysical accuracy.

6. Applications

Neuromorphic Computing

LIF and AdEx models are implemented in neuromorphic chips (Intel Loihi, SpiNNaker) for energy-efficient AI. Spiking neural networks based on these models achieve competitive performance with orders-of-magnitude lower power consumption.

Drug Discovery

HH-type models of specific ion channels enable virtual screening of ion channel modulators. Cardiac and neural channel models predict drug effects on action potential shape and arrhythmia risk.

Brain Simulation

Large-scale network simulations (Human Brain Project, Allen Institute) use multi-scale models from detailed HH neurons to mean-field approximations, simulating millions of neurons to understand brain-wide dynamics.

Epilepsy Modeling

Wilson-Cowan and neural field models predict seizure dynamics and propagation patterns. Patient-specific models guide surgical planning for drug-resistant epilepsy.

7. Computational Exploration

Computational Models: LIF, Hodgkin-Huxley, Cable Theory, and Networks

Python
script.py326 lines

Click Run to execute the Python code

Code will be executed with Python 3 on the server

Chapter Summary

  • LIF neurons: firing rate $f = 1/[\tau_m \ln((RI - V_{\text{reset}})/(RI - V_{\text{th}}))]$ for suprathreshold input.
  • Hodgkin-Huxley: action potentials arise from fast Na$^+$ activation, slow Na$^+$ inactivation, and delayed K$^+$ activation.
  • Cable theory: signals attenuate as $e^{-x/\lambda}$ in passive dendrites, with space constant $\lambda = \sqrt{r_m/r_a}$.
  • Wilson-Cowan: E-I networks generate oscillations when loop gain exceeds unity; frequency depends on time constants and coupling.
  • Balanced networks: strong E-I balance produces irregular, Poisson-like firing matching cortical observations.