Dark Energy
A comprehensive graduate-level course on dark energy — from the 1998 supernova observations through the cosmological constant, dynamical dark energy models, observational probes, and the ultimate fate of the universe — with full MathJax derivations and Python simulations.
1. Introduction & Observational Evidence
In 1998, two independent teams — the Supernova Cosmology Project (Perlmutter et al.) and the High-z Supernova Search Team (Riess et al., Schmidt et al.) — discovered that the expansion of the universe is accelerating. This was awarded the 2011 Nobel Prize in Physics. Type Ia supernovae serve as standardizable candles because their peak luminosity correlates tightly with the width of their light curves (the Phillips relation). By measuring the apparent brightness of distant Type Ia supernovae and comparing to their known intrinsic luminosity, one infers their luminosity distances. The data showed that distant supernovae are fainter than expected in a decelerating universe — the expansion is speeding up.
The Acceleration Condition
From general relativity, the second Friedmann equation (the Raychaudhuri equation) gives the acceleration of the scale factor:
For acceleration ($\ddot{a} > 0$), we need the right-hand side to be positive:
This requires a component with strongly negative pressure. For a perfect fluid with equation of state $w = p/\rho$, the condition becomes $w < -1/3$. Ordinary matter ($w = 0$) and radiation ($w = 1/3$) both give deceleration. Something else is driving the acceleration — we call it dark energy.
Key Observational Milestones
- ●1998: Riess et al. and Perlmutter et al. publish evidence for cosmic acceleration from Type Ia supernovae
- ●2003: WMAP first-year data confirms a flat universe dominated by dark energy (~73%)
- ●2005: Baryon Acoustic Oscillation (BAO) detection in SDSS galaxy survey provides independent confirmation
- ●2011: Nobel Prize in Physics to Perlmutter, Schmidt, and Riess
- ●2018: Planck final results: $\Omega_\Lambda = 0.6847 \pm 0.0073$, $H_0 = 67.36 \pm 0.54\;\text{km/s/Mpc}$
- ●2024: DESI BAO results hint at possible time-varying dark energy ($w_0 w_a$CDM tension with $\Lambda$CDM at ~2.5σ)
The Cosmic Energy Budget
Modern observations consistently point to a universe composed of approximately:
68.5%
Dark Energy
26.5%
Dark Matter
5%
Baryonic Matter
2. The Friedmann Equations
The Friedmann equations govern the expansion dynamics of a homogeneous, isotropic universe. They follow from the Einstein field equations applied to the Friedmann-Lemaître-Robertson-Walker (FLRW) metric.
The FLRW Metric
The most general metric for a homogeneous, isotropic spacetime is:
where $a(t)$ is the scale factor, $k$ is the spatial curvature ($k = 0, +1, -1$ for flat, closed, or open geometry), and the Hubble parameter is defined as $H \equiv \dot{a}/a$.
Derivation from Einstein’s Equations
The Einstein field equations with cosmological constant are:
For a perfect fluid at rest in comoving coordinates, the energy-momentum tensor is$T^{\mu\nu} = \text{diag}(\rho c^2, p, p, p)$. Computing the Ricci tensor and scalar curvature from the FLRW metric and substituting into Einstein’s equations, the $00$-component gives the first Friedmann equation:
The $ij$-components, combined with the first equation, yield the second Friedmann equation (acceleration equation):
In natural units ($c = 1$), these simplify to:
The Fluid Equation and Density Parameters
Combining the two Friedmann equations gives the continuity (fluid) equation:
For a component with constant equation of state $w = p/\rho$, this integrates to:
Key cases: matter ($w = 0$, $\rho \propto a^{-3}$), radiation ($w = 1/3$, $\rho \propto a^{-4}$), cosmological constant ($w = -1$, $\rho = \text{const}$).
We define the dimensionless density parameters:
so the first Friedmann equation becomes $\Omega_m + \Omega_r + \Omega_\Lambda + \Omega_k = 1$, where $\Omega_k = -k/(aH)^2$. Current best values (Planck 2018): $\Omega_m \approx 0.315$, $\Omega_\Lambda \approx 0.685$,$|\Omega_k| < 0.002$.
Hubble Parameter as a Function of Redshift
Using $a = 1/(1+z)$ and the density scaling relations, the Friedmann equation in terms of redshift becomes:
For $\Lambda$CDM with $w = -1$ and flat geometry ($\Omega_k = 0$), this simplifies to:
3. The Cosmological Constant
The simplest and observationally most successful model of dark energy is the cosmological constant $\Lambda$, originally introduced by Einstein in 1917 to maintain a static universe, then abandoned after Hubble’s 1929 discovery of expansion, and resurrected after the 1998 supernova discovery. In the $\Lambda$CDM model, it is the dominant energy component today.
$\Lambda$ as Vacuum Energy
The cosmological constant can be interpreted as the energy density of the vacuum. The$\Lambda$ term in the Einstein equations acts as a perfect fluid with:
The equation of state is exactly:
Proof that $\rho_\Lambda$ is constant: Substituting$w = -1$ into the fluid equation:
Hence $\rho_\Lambda$ remains constant as the universe expands, in stark contrast to matter and radiation which dilute as $a^{-3}$ and $a^{-4}$. Using the observed value:
The Cosmological Constant Problem
This is arguably the worst prediction in all of physics. In quantum field theory, every field contributes zero-point energy to the vacuum. For a field of mass $m$, the vacuum energy density up to a UV cutoff $\Lambda_\text{UV}$ is:
Taking the Planck scale as the natural cutoff ($\Lambda_\text{UV} = E_\text{Pl} \sim 10^{19}\;\text{GeV}$):
The observed dark energy density is:
The ratio is staggering:
This 120-order-of-magnitude discrepancy is the cosmological constant problem. Even using the electroweak scale ($\Lambda_\text{UV} \sim 100\;\text{GeV}$) as a cutoff, the discrepancy is still $\sim 10^{55}$. No known symmetry or mechanism can explain why the vacuum energy is so exquisitely fine-tuned to nearly zero but not exactly zero.
The Coincidence Problem
Why are the dark energy and matter densities comparable today? Since$\rho_m \propto a^{-3}$ while $\rho_\Lambda = \text{const}$, their ratio changes dramatically with time:
At $z = 10$ this ratio was $\sim 10^{-3}$; at $z = 1000$(CMB) it was $\sim 10^{-9}$. We happen to live in the cosmologically brief epoch where $\rho_\Lambda \sim \rho_m$ — this curious timing is the coincidence problem, one motivation for dynamical dark energy models.
4. Dark Energy Models Beyond $\Lambda$
While $\Lambda$CDM fits observations remarkably well, the cosmological constant problem and the coincidence problem motivate the exploration of dynamical dark energy. Here we derive the key models.
4.1 Quintessence: Scalar Field Dark Energy
Quintessence models dark energy as a slowly-rolling scalar field $\phi$, analogous to the inflaton in early-universe inflation. The Lagrangian density is:
where the second equality holds for a spatially homogeneous field. The energy density and pressure are:
The equation of state is:
Key properties:
- ●When $\dot{\phi}^2 \ll V(\phi)$ (slow-roll): $w_\phi \to -1$ (mimics $\Lambda$)
- ●When $\dot{\phi}^2 \gg V(\phi)$ (kinetic dominated): $w_\phi \to +1$ (stiff fluid)
- ●The range $-1 \leq w_\phi \leq +1$ is always satisfied for canonical quintessence
The field obeys the Klein-Gordon equation in an expanding background:
The $3H\dot{\phi}$ term acts as Hubble friction. Common potentials include the exponential ($V = V_0 e^{-\lambda\phi/M_\text{Pl}}$, which admits scaling solutions where $\Omega_\phi$ is constant), the inverse power-law ($V = M^{4+\alpha}\phi^{-\alpha}$), and the cosine ($V = \Lambda^4[1 + \cos(\phi/f)]$, pseudo-Nambu-Goldstone boson).
4.2 Phantom Energy and the Big Rip
What if $w < -1$? This is phantom dark energy, modeled by a scalar field with a wrong-sign kinetic term:
For phantom energy with constant $w < -1$, the energy density grows with expansion:
The scale factor diverges in finite time (Caldwell, Kamionkowski, Weinberg, 2003):
The time to the Big Rip from today:
For $w = -1.1$, this gives $t_\text{rip} - t_0 \sim 100\;\text{Gyr}$. In the approach to the Big Rip, gravitationally bound structures are torn apart: galaxy clusters, then galaxies, solar systems, planets, and ultimately atoms are ripped apart by the ever-increasing expansion rate. However, phantom fields violate the null energy condition and generically suffer from quantum instabilities, making this scenario theoretically problematic.
4.3 k-essence
k-essence generalizes quintessence by allowing a non-standard kinetic term. The Lagrangian is a general function of the field and its kinetic energy $X = \frac{1}{2}(\partial\phi)^2$:
The energy density and pressure are:
where $K_X = \partial K/\partial X$. k-essence can produce acceleration through purely kinetic effects, without a potential, and naturally achieves $w < -1/3$through the non-linear kinetic terms. It also produces a variable speed of sound$c_s^2 = K_X/(K_X + 2X K_{XX})$, which distinguishes it observationally from quintessence.
4.4 The CPL Parametrization
Rather than specifying a Lagrangian, one can phenomenologically parametrize the equation of state. The Chevallier-Polarski-Linder (CPL) form is the most widely used:
Here $w_0$ is the present-day value and $w_a$ captures time evolution. For $\Lambda$CDM: $w_0 = -1$, $w_a = 0$. The dark energy density evolves as:
The DESI 2024 BAO results, combined with CMB and supernova data, found$w_0 = -0.55^{+0.39}_{-0.21}$ and $w_a = -1.32^{+0.58}_{-0.82}$ (at 68% CL), showing $\sim 2.5\sigma$ tension with $\Lambda$CDM in the$w_0$-$w_a$ plane.
4.5 Modified Gravity: f(R) Theories
Instead of adding a new energy component, one can modify gravity itself. In f(R) theories, the Einstein-Hilbert action is generalized:
where $f(R)$ is a general function of the Ricci scalar. The modified field equations are:
Setting $f(R) = R - 2\Lambda$ recovers GR with a cosmological constant. Popular models include Starobinsky ($f(R) = R + \alpha R^2$) and Hu-Sawicki ($f(R) = R - \mu R_c\frac{(R/R_c)^n}{(R/R_c)^n + 1}$).
Crucially, f(R) theories are equivalent to scalar-tensor (Brans-Dicke) theories with parameter $\omega_\text{BD} = 0$, via the conformal transformation $\tilde{g}_{\mu\nu} = f'(R)g_{\mu\nu}$. The extra scalar degree of freedom $\varphi = f'(R)$ mediates a fifth force that must be screened on solar system scales (chameleon mechanism).
5. Observational Probes of Dark Energy
Constraining dark energy requires precise measurements of the expansion history and growth of structure. Multiple independent probes are combined to break parameter degeneracies.
5.1 Distance-Redshift Relations
The comoving distance to an object at redshift $z$ is:
The luminosity distance (measured via standard candles like Type Ia SNe):
The angular diameter distance (measured via standard rulers like BAO):
These relations encode the full expansion history $H(z)$, which depends on all the density parameters and the dark energy equation of state.
5.2 Type Ia Supernovae
The distance modulus relates the apparent magnitude $m$ to the absolute magnitude $M$:
Modern compilations (Pantheon+, DES-SN5YR, Union3) contain $\sim 1500$ supernovae spanning $0.01 < z < 2.3$. They constrain $\Omega_m$and $w$ primarily through the shape of $d_L(z)$.
5.3 Baryon Acoustic Oscillations (BAO)
BAO are the frozen imprint of sound waves in the baryon-photon plasma before recombination. The sound horizon at the drag epoch is:
This is a standard ruler. Measuring the BAO scale at multiple redshifts in the galaxy power spectrum gives both $d_A(z)/r_d$ (transverse) and $c/(H(z)r_d)$(line-of-sight). DESI, SDSS-IV, and Euclid provide BAO measurements at $z = 0.1$ to $z = 4.2$, tightly constraining the expansion history.
5.4 CMB Power Spectrum
The CMB constrains dark energy mainly through two effects: (1) the angular diameter distance to the last scattering surface at $z_* \approx 1090$, which determines the angular scale of the acoustic peaks via $\theta_* = r_*/d_A(z_*)$; and (2) the integrated Sachs-Wolfe (ISW) effect — late-time evolution of gravitational potentials due to dark energy produces excess power at large angular scales ($\ell \lesssim 30$).
The ISW contribution to the temperature anisotropy is:
5.5 Weak Lensing and Cluster Counts
Weak gravitational lensing measures the distortion of background galaxy shapes by foreground mass distributions. The lensing convergence power spectrum depends on both the geometry (distance ratios) and the growth of structure:
Galaxy cluster counts probe dark energy through the growth rate of structure. The number of clusters above mass $M$ per unit redshift:
where $dn/dM$ is the halo mass function. Both probes are sensitive to the combination $S_8 = \sigma_8\sqrt{\Omega_m/0.3}$, providing complementary constraints to geometric probes.
6. The Fate of the Universe
The ultimate fate of the universe depends critically on the nature of dark energy, specifically on the value of $w$ and whether it evolves with time.
Scenario 1: Big Freeze / Heat Death ($w = -1$)
In the $\Lambda$CDM model, the universe asymptotes to de Sitter space. The scale factor grows exponentially:
The cosmic event horizon forms at a comoving distance $\chi_\text{EH} = c/H_\infty \approx 17\;\text{Gpc}$. Objects beyond this horizon can never send signals to us. Galaxies outside the Local Group recede beyond the horizon within $\sim 100\;\text{Gyr}$. The universe approaches maximum entropy — the heat death.
Scenario 2: Big Rip ($w < -1$)
For phantom dark energy, the scale factor diverges in a finite time $t_\text{rip}$. As $t \to t_\text{rip}$, the Hubble parameter diverges $H \to \infty$, and all bound structures are progressively disrupted. The approximate timeline before the rip (for $w = -1.5$):
- ●$\sim 60$ Myr before: Galaxy clusters fly apart
- ●$\sim 60$ Myr before: Milky Way disrupted
- ●$\sim 3$ months before: Solar system unbound
- ●$\sim 30$ minutes before: Earth destroyed
- ●$\sim 10^{-19}$ seconds before: Atoms dissociate
Scenario 3: Big Crunch ($w > -1/3$ or Dark Energy Decaying)
If dark energy decays or has $w > -1/3$, it eventually ceases to drive acceleration. In a matter-dominated closed universe ($k = +1$), the expansion halts and reverses:
The universe recollapses to a singularity. Some cyclic models (Steinhardt-Turok) envision a series of big bangs and crunches. In practice, current observations strongly disfavor$w > -1/3$ for the present dark energy component.
The Deceleration Parameter
The deceleration parameter quantifies whether expansion is accelerating or decelerating:
For a flat universe with matter and dark energy ($w = \text{const}$):
The transition from deceleration ($q > 0$) to acceleration ($q < 0$) occurred at the transition redshift:
7. Python Simulations
These simulations numerically solve the Friedmann equations and compute key cosmological observables for different dark energy equations of state.
7.1 Scale Factor Evolution for Different Dark Energy Models
Numerically integrate the Friedmann equation to find how the scale factor evolves with cosmic time for different values of the dark energy equation of state parameter w.
Scale Factor a(t) for Different w Values
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
7.2 Distance-Redshift Relation
Compute the luminosity distance $d_L(z)$ and distance modulus$\mu(z)$ for different dark energy models, showing how the supernova Hubble diagram constrains $w$.
Luminosity Distance and Hubble Diagram
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
7.3 Deceleration Parameter and Cosmic Acceleration
Compute the deceleration parameter $q(z)$ and identify the transition redshift where the universe switched from deceleration to acceleration.
Deceleration Parameter q(z)
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
7.4 Energy Density Evolution and Dark Energy Domination
Track how the fractional energy densities $\Omega_i(z)$ evolve, showing the transitions between radiation, matter, and dark energy domination.
Cosmic Energy Density Evolution
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
7.5 Big Rip Timescale for Phantom Dark Energy
For phantom dark energy ($w < -1$), compute the time remaining until the Big Rip and show how different structures are disrupted.
Big Rip Timeline
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
7.6 CPL Dark Energy: $w_0$-$w_a$ Parametrization
Explore the Chevallier-Polarski-Linder parametrization $w(a) = w_0 + w_a(1-a)$and see how time-varying dark energy affects the expansion history.
CPL w(z) and H(z) for Time-Varying Dark Energy
PythonClick Run to execute the Python code
Code will be executed with Python 3 on the server
Prerequisites
General Relativity
Spacetime curvature, Einstein field equations, and the FLRW metric
Cosmology
Expansion history, CMB, large-scale structure, and the cosmic energy budget
Quantum Field Theory
Vacuum energy, scalar fields, and the cosmological constant problem
Mathematics
Differential equations, variational calculus, and numerical methods
Further Reading
Textbooks
- • Amendola & Tsujikawa, Dark Energy: Theory and Observations (Cambridge, 2010)
- • Weinberg, Cosmology (Oxford, 2008) — Chapters 1–3
- • Carroll, Spacetime and Geometry (Cambridge, 2019) — Chapter 8
- • Mukhanov, Physical Foundations of Cosmology (Cambridge, 2005)
- • Ryden, Introduction to Cosmology (Cambridge, 2017)
Key Review Articles
- • Copeland, Sami & Tsujikawa, Dynamics of Dark Energy, IJMPD 15, 1753 (2006) [hep-th/0603057]
- • Frieman, Turner & Huterer, Dark Energy and the Accelerating Universe, ARAA 46, 385 (2008)
- • Weinberg et al., Observational Probes of Cosmic Acceleration, Phys. Rep. 530, 87 (2013)
- • Peebles & Ratra, The Cosmological Constant and Dark Energy, RMP 75, 559 (2003)
Landmark Observational Papers
- • Riess et al., Observational Evidence from Supernovae for an Accelerating Universe, AJ 116, 1009 (1998)
- • Perlmutter et al., Measurements of Omega and Lambda from 42 High-Redshift Supernovae, ApJ 517, 565 (1999)
- • Planck Collaboration, Planck 2018 Results. VI. Cosmological Parameters, A&A 641, A6 (2020)
- • DESI Collaboration, DESI 2024 VI: Cosmological Constraints from BAO, arXiv:2404.03002 (2024)
Related Courses
Dark Matter
Observational evidence, theoretical candidates, and detection strategies
Cosmic Inflation
The inflationary paradigm and its connection to late-time acceleration
Observational Cosmology
Surveys, instruments, and data analysis for cosmological observations
Gravitational Waves
Standard sirens as an independent probe of the expansion history
Black Holes
Spacetime singularities, horizons, and their role in cosmology
Quantum Gravity
The vacuum energy problem and the UV completion of gravity