Thermodynamics

The exponential that decides everything

Maximising the number of ways a reservoir can arrange what is left after taking E out of it gives one factor, e to the minus E over kT. Its exponent is a ratio, which is why a barrier of a third of an electronvolt — nothing at all by chemical standards — is the difference between instantly and never.

Assumes: Entropy is a count, and the arrow of time is arithmetic · The speeds in a still room

Almost every rate in the natural world — a reaction, a diffusion, a creep, a decay of a metastable state, an evaporation, the conduction of a semiconductor — is an attempt frequency multiplied by the same exponential. The attempt frequency varies by a few orders of magnitude between processes. The exponential varies by thirty, and it is therefore the only part of the expression that ever decides anything.

A ratio in the exponent. The Boltzmann factor against the energy of a state measured in units of kT, with the logarithm up the axis so that the straight line is the whole content. Every kT of energy costs a factor of e, so 10, 20, 30 times kT are factors of 10^-4.3, 10^-8.7, 10^-13.0. At 300 K, kT is 25.9 meV, so a barrier of 0.35 eV is 13.5 kT and a factor of 1.3e-6. That is the sense in which a third of an electronvolt is not a small energy: it is small compared with a chemical bond and enormous compared with kT, and it is the second comparison that decides whether anything happens.
Fig. 1 The Boltzmann factor against the energy of a state in units of kT, with the logarithm up the axis so the straight line is the whole content. Every kT costs a factor of e, so 10, 20 and 30 kT are factors of 104.310^{-4.3}, 108.710^{-8.7} and 1013.010^{-13.0}. At 300 K, kT is 25.9 meV, so a barrier of 0.35 eV is 13.5 kT and a factor of 1.3×1061.3\times10^{-6}.

The important feature of that plot is not the slope but the axis. The horizontal quantity is a ratio, so an energy is never large or small in itself, only large or small compared with kTkT — and kTkT at room temperature is a fortieth of an electronvolt, which is very small compared with almost every energy in chemistry.

Where the factor comes from

The derivation is a counting argument and does not mention forces, collisions or dynamics.

Consider a small system in contact with a large reservoir, with a fixed total energy between them. The probability that the small system is in a particular state of energy EE is proportional to the number of ways the reservoir can arrange the remaining energy — because every one of those arrangements is equally likely, and they are all compatible with the small system being in that one state.

The count the argument is about is the reservoir’s. Taking energy EE out of it reduces the number of arrangements available to it, and reduces it by a factor that is exponential in EE because entropy is a logarithm of that count and entropy is what changes linearly with energy. The whole derivation is that one sentence: a linear change in a logarithm is an exponential change in the thing.

Two things about that derivation are worth keeping. The temperature enters only through S/E\partial S/\partial E, which is what temperature is in statistical mechanics — so the Boltzmann factor is not a separate assumption but the definition of temperature rearranged. And the expansion to first order requires the reservoir to be large compared with the system, which is the only approximation anywhere in it and the reason the factor fails for a system comparable in size with its surroundings.

Reading it as a population

The most direct use is a ratio of populations between two states, in which the normalisation cancels and only the energy difference survives.

A ladder with a large first step shows what the factor does to a population. Hydrogen’s gap from ground to first excited state is 10.2 eV, which at 300 K is about 394 in units of kTkT — so the excited fraction is e394e^{-394}, a number with no physical meaning whatever. Room-temperature hydrogen is entirely in its ground state, and “entirely” here is not an approximation.

That case is the general shape of the argument. Something that never happens at one temperature and dominates at another has not changed its physics; the ratio in the exponent has changed by a factor of twenty, and twenty in an exponent is nine orders of magnitude in the answer.

A ratio in the exponent. The Boltzmann factor against the energy of a state measured in units of kT, with the logarithm up the axis so that the straight line is the whole content. Every kT of energy costs a factor of e, so 4, 8, 12 times kT are factors of 10^-1.7, 10^-3.5, 10^-5.2. At 1000 K, kT is 86.2 meV, so a barrier of 0.7 eV is 8.1 kT and a factor of 3.0e-4. That is the sense in which a third of an electronvolt is not a small energy: it is small compared with a chemical bond and enormous compared with kT, and it is the second comparison that decides whether anything happens.
Fig. 2 The same curve read at 1,000 K, where kT is 86 meV. A 0.7 eV barrier is 8.1 kT there and a factor of 3×1043\times10^{-4}; the same barrier at room temperature is 27 kT and a factor of 2×10122\times10^{-12}. Nothing about the barrier changed. What changed is the number it is being compared with, and eight orders of magnitude followed.

The same reading with a gravitational energy instead of an electronic one gives an atmosphere.

Density against height is the same factor with E=mghE = mgh. The scale height kT/mgkT/mg is the height at which the potential energy of a molecule equals kTkT, and above it the density falls by a factor of ee per scale height — which is why an atmosphere has no edge, and why the same arithmetic that governs excited states governs the barometer.

The slope that measures an invisible obstacle

Because the factor is an exponential in 1/T1/T, a logarithm of a rate plotted against reciprocal temperature is a straight line whose slope is the barrier — and that is one of the most-used measurements in the whole of the physical sciences.

The slope is the barrier. The logarithm of the Boltzmann factor against a thousand over the temperature, for barriers of 0.2, 0.35, 0.6 eV. Each is a straight line whose slope is the barrier divided by k, which is what makes the plot worth drawing: a rate measured at four temperatures gives the height of an obstacle nobody can see. The barriers read back from two points on each plotted line are 0.200 eV, 0.350 eV, 0.600 eV, against the values asked for. The lines fan out toward low temperature and converge at high, which is the same statement as before: heating does not lower a barrier, it makes the comparison with it less unfavourable.
Fig. 3 Three barriers plotted as the logarithm of the factor against a thousand over the temperature. Each is a straight line of slope Ea/k-E_a/k, and the barriers read back from the drawn lines are exactly the ones asked for. What makes this worth doing is that the barrier is not otherwise observable: it is the height of a transition state that exists for femtoseconds and is never present in any appreciable amount. Four measurements of a rate and a ruler give it to a few per cent.

Arrhenius established the form empirically in 1889 for chemical reactions and had no derivation for it; the interpretation of the slope as an energy barrier came later, and the modern justification — transition-state theory — is essentially the argument above applied to the population of an unstable configuration at the top of the barrier.

The technique is not confined to chemistry. The same plot measures the activation energy of diffusion in a solid, of viscous flow in a glass, of dielectric relaxation in a polymer, of the conductivity of a semiconductor, and of the failure rate of a component in an accelerated-life test. In each case the line’s slope is an energy and its intercept is an attempt frequency, and in each case the slope is the part anyone trusts.

Diffusion in a solid is one of the processes such a slope belongs to: atoms hopping between lattice sites over a barrier, at a rate the factor fixes. Measuring the diffusion coefficient at several temperatures and plotting its logarithm against 1/T1/T gives a straight line whose slope is the barrier — so an invisible activation energy is read off a graph, which is the practical use this whole subject is put to.

Why ten degrees is not a rule

The most quoted consequence of the exponential is that a reaction rate doubles for every ten degrees, and it is worth doing the arithmetic to see what kind of statement that is.

How many degrees double a 0.35 eV process. The temperature rise that doubles a process over a barrier of 0.35 eV, against the temperature it starts from. The familiar rule that a reaction doubles for every ten degrees is one point on this curve and not a law: it holds for a particular barrier at a particular temperature and nowhere else. From 250 K it takes 11.1 K; from 300 K it takes 16.2 K; from 350 K it takes 22.2 K; from 400 K it takes 29.3 K. The rise needed grows as the square of the temperature, because the exponent depends on 1/T and the change in 1/T for a given step shrinks — which is why a process that is sluggish at room temperature and brisk at 350 K is barely faster again at 700 K.
Fig. 4 The temperature rise that doubles a process over a 0.35 eV barrier, against the temperature it starts from: 11.1 K from 250 K, 16.2 K from 300 K, 22.2 K from 350 K, 29.3 K from 400 K. The rise needed grows as the square of the temperature, because the exponent depends on 1/T1/T and a given step in TT changes 1/T1/T by less and less.

So the rule of ten holds for a particular barrier at a particular temperature and nowhere else. It is not an accident that it is quoted so often — a great many biological and food-chemistry processes have effective barriers of 0.5 to 0.8 eV and are used between 273 and 310 K, which is where the rule works — but a process with a 0.2 eV barrier needs nearly thirty degrees to double at room temperature, and one with a 1.2 eV barrier needs five.

The practical form of the exponential is worth stating as its own sentence. Three kT is a factor of twenty; ten kT is a factor of twenty thousand; thirty kT is a factor of 101310^{13}. An energy of a few tenths of an electronvolt is nothing to a chemist and an absolute prohibition to a rate.

What the same factor forbids

The exponential is also the reason a great many things are stable that have no business being stable.

A diamond at room temperature is thermodynamically unstable — graphite is the lower-energy form — and converts at a rate governed by a barrier of several electronvolts, which is some two hundred kTkT. The factor is 108710^{-87}, so the conversion takes longer than any timescale worth naming. The same argument protects every metastable material there is: window glass, which is a supercooled liquid; a supersaturated solution; the whole of organic chemistry, which sits in a deep local minimum a long way above the products of complete combustion.

The distribution whose tail does the work matters because everything above is about a fraction of a population rather than about any molecule. The factor does not say that a molecule cannot have the energy; it says how few do. And since “how few” is exponential, the answer swings between “essentially all” and “essentially none” over a range of energies that is narrow in absolute terms and wide in units of kTkT.

And there is a class of process the factor does not govern at all, which is the sharpest way to see what it is claiming. Radioactive decay has a rate that is entirely independent of temperature, because the barrier is crossed by tunnelling rather than by thermal excitation and the nucleus is not in thermal contact with anything in the relevant sense. A process whose rate does not respond to heating is announcing that its mechanism is not thermal, and that is a diagnostic used routinely.

How many degrees double a 0.8 eV process. The temperature rise that doubles a process over a barrier of 0.8 eV, against the temperature it starts from. The familiar rule that a reaction doubles for every ten degrees is one point on this curve and not a law: it holds for a particular barrier at a particular temperature and nowhere else. From 280 K it takes 6.0 K; from 310 K it takes 7.3 K; from 350 K it takes 9.4 K. The rise needed grows as the square of the temperature, because the exponent depends on 1/T and the change in 1/T for a given step shrinks — which is why a process that is sluggish at room temperature and brisk at 350 K is barely faster again at 700 K.
Fig. 5 The doubling curve for a 0.8 eV barrier, which is the range most biological processes sit in. From 310 K — body temperature — it takes 7.1 K to double, which is why the rule of ten is quoted so confidently in the life sciences and why it fails immediately outside them. The curve is the same shape as before with a different vertical scale, since the rise needed is inversely proportional to the barrier.

A rate with no temperature in it is worth setting alongside, because the two exponentials look identical and are not. Radioactive decay falls exponentially in time from a constant probability per unit time; the Boltzmann factor falls exponentially in energy from a constant entropy per unit energy. Same shape, different variable, and no temperature anywhere in the first.

The same exponent, three ways of being useful

It is worth separating the three quite different jobs the factor does, because they are constantly run together and only one of them is about rates.

As a population. Two states, one energy difference, one ratio. Nothing dynamic is involved and the answer is exact in equilibrium. This is how the intensity ratio of two spectral lines gives the temperature of a flame or a star, how the polarisation of a nuclear spin sample is worked out, and how the fraction of a semiconductor’s carriers sitting in the conduction band is found.

As a rate. The population at the top of a barrier, multiplied by an attempt frequency. This is the chemical and materials use, and it is an approximation of a different order: it assumes the barrier is high compared with kTkT so that the population there is small, and it assumes anything reaching the top goes over rather than coming back.

As a fluctuation. The probability that a system in equilibrium departs from its average state by an energy EE — which is the same exponential read as a statement about excursions rather than about states. That is where the size of thermal noise in a resistor comes from, why a colloidal particle jiggles, and why the fluctuations in any macroscopic quantity are so small: a departure large enough to see in a mole of gas has an energy of order 1023kT10^{23}kT and a probability nobody has a notation for.

The third reading is the one that connects to the direction of time. A cup of tea does not spontaneously reheat, and the reason is not that it is forbidden but that the exponent is 102210^{22} or so — which is a probability that differs from zero in a way that has no operational meaning at all. Irreversibility, in this language, is the statement that the exponent is enormous rather than that anything is prohibited.

Why a smooth exponential looks like a threshold

Nothing in the Boltzmann factor is discontinuous. It is a smooth function of temperature with no kink, no step and no critical value anywhere in it. Yet almost every process it governs is described in the language of thresholds: an ignition temperature, a point at which a glue cures, a temperature above which a component fails. That gap between the smooth formula and the switch-like behaviour is worth closing, because the closing is one line and it explains a great deal.

Ask how strongly the rate responds to a fractional change in temperature — the logarithmic derivative, which is the local power-law index. Differentiating the exponential gives

dlnkdlnT=EakT,\frac{\mathrm{d}\ln k}{\mathrm{d}\ln T} = \frac{E_a}{kT},

which is the barrier measured in units of kTkT and nothing else. So a process with a 30 kTkT barrier behaves locally like the thirtieth power of the temperature.

That is what makes it look like a threshold. A ten per cent rise in absolute temperature multiplies a thirtieth-power quantity by seventeen; a thirty per cent rise multiplies it by two thousand. Nothing switched on — the rate was always there and was simply too small to see, and then within a small span of temperature it became too large to ignore. The apparent sharpness is a statement about the size of the exponent rather than about any feature of the curve.

The same arithmetic run in reverse explains the other half of the impression: below the apparent threshold the rate falls just as steeply, so a process that is comfortable at one temperature is not slow at ten per cent lower but absent. There is very little middle ground when the local index is thirty, and the intuition that something either happens or does not is a reasonable summary of a power of thirty.

This is the same phenomenon as a combustion process running away. The reaction generates heat, the heat raises the temperature, and the rate responds as a thirtieth power — so a small excess of generation over loss becomes a large one immediately. The ignition temperature of a fuel is not a property of the fuel’s chemistry so much as the point where that feedback loop closes, which is why it depends on the geometry of the container and on how fast heat can leave.

Two products, and which one arrives

A second consequence follows from the factor appearing in two different roles at once, and it is one of the few places where the same exponent gives contradictory advice.

Suppose a system can go to either of two products. One is lower in final energy — more stable — and the other has a lower barrier on the way. Which one is obtained?

The rates are governed by the barriers, so at short times the product with the lower barrier accumulates faster, in a ratio eΔΔE/kTe^{-\Delta\Delta E^{\ddagger}/kT} where the difference is between the two barrier heights. The equilibrium populations are governed by the final energies, in a ratio eΔΔE/kTe^{-\Delta\Delta E/kT} using the difference between the products. The two exponents are different differences, and they can point in opposite directions.

At low temperature both exponents are large, so the lower-barrier product forms overwhelmingly faster and nothing has enough energy to go back over its barrier and re-sort. The mixture is whatever the rates delivered, frozen. This is kinetic control.

At high temperature both exponents are small, so both products form quickly and both revert quickly, and the mixture settles into the ratio the final energies dictate. This is thermodynamic control.

So the same reaction gives different products at different temperatures, and the changeover is not a change of mechanism. Both paths are open throughout; what changes is whether the system has time and energy to undo its first answer. The textbook demonstration is the addition of hydrogen bromide to butadiene, which gives predominantly one isomer at eighty degrees below zero and predominantly the other at forty above, with the same reagents in the same flask.

The general principle is broader than chemistry and is worth having in that form. A system relaxing toward equilibrium reaches the nearest accessible state first and the most stable state eventually, and which of those it is found in depends on how its observation time compares with the slowest barrier crossing. Glass is the standing example: it is the kinetically controlled outcome of cooling a liquid too fast for the crystal to form, and it remains one for as long as anybody has been watching.

What it costs, and where the model stops

It says nothing about how long. The factor gives an equilibrium probability. Turning that into a rate needs the attempt frequency as well, and the attempt frequency is the hard part — it depends on the shape of the barrier, on how many ways there are over it, and on how strongly the system is coupled to its surroundings. The exponential decides orders of magnitude and the prefactor decides the answer.

It requires a reservoir. The derivation expanded the reservoir’s entropy to first order, which needs the reservoir to be much larger than the system. For a nanoparticle in a small droplet, or for a system whose energy is comparable with its surroundings’, the expansion fails and the distribution is not exponential.

It requires equilibrium. A system driven by an external source — a laser, a current, a metabolism — has populations that are not Boltzmann-distributed at any temperature, and inverting a population is the whole operating principle of a laser. Quoting an effective temperature for such a system is a convenience and sometimes a negative number.

A degeneracy is not a detail. The probability of an energy is the factor times the number of states at that energy, and in a large system that number grows fast enough to compete with the exponential. The competition between the two is what free energy is, and it is why a system at high temperature moves to a state of higher energy and higher entropy rather than staying in its ground state.

Where the numbers come from in practice

Three values of kTkT are worth carrying, because almost every estimate in this subject is made by comparing something to one of them.

At room temperature, 293 K, kTkT is 25.3 meV. At the boiling point of nitrogen, 77 K, it is 6.6 meV. At the surface of the sun, 5,800 K, it is 0.50 eV. The first is why chemistry happens at all at room temperature and why semiconductor devices work; the second is why cooling a detector to liquid-nitrogen temperature reduces its thermal noise by a factor of four and its thermally generated carriers by a factor of 101310^{13}; the third is why a stellar photosphere ionises hydrogen only in its tail and why stellar spectra are as informative as they are.

A fourth comparison is the one that makes biology possible. A hydrogen bond is worth about 0.2 eV, which is 8 kTkT at body temperature — strong enough to hold a structure together against thermal agitation, weak enough to be broken by an enzyme without a catastrophe. A covalent bond is 3 to 4 eV, or 150 kTkT, and is never broken thermally at all. The gap between those two numbers is why a cell can have parts that stay assembled and parts that come apart on demand, and both of those facts are the same exponential evaluated at two energies.

The other way past a barrier does not consult the temperature at all. Tunnelling transmits a wave through a wall it has not the energy to cross, at a rate exponential in the barrier’s width rather than in kTkT — so a process with both channels open is thermally activated at high temperature and temperature-independent at low, and the crossover is visible as a kink in exactly the plot described above.

What the picture cannot show

The plots on this page are of the factor, not of a rate. A measured rate is the factor times a prefactor that also depends on temperature — as a square root for a collision rate, or with its own weak dependence for a solid-state process — and an Arrhenius plot’s slope is therefore an effective activation energy that includes any temperature dependence hidden in the prefactor. Over a narrow range the two are indistinguishable, which is why Arrhenius plots are usually drawn over a narrow range.

Nor can a plot of a single barrier show what happens when there are two. A process with two paths of different barriers switches from following one to following the other as the temperature changes, and the Arrhenius plot then has a kink rather than a slope. That kink is one of the more informative things a rate measurement can produce, and it is invisible in any figure drawn for a single mechanism.

The domain of validity is: a system in equilibrium with a much larger reservoir, at a well-defined temperature, with the energies of its states known. That is a strong set of conditions, and the factor’s astonishing reach comes from the fact that a very great many things in the world satisfy them to an excellent approximation.

The ladder from here

Later rungs on this anchor: the partition function as the normalising sum, and the extraction of every thermodynamic quantity from its logarithm; free energy as the competition between the factor and the degeneracy; transition-state theory, which supplies the prefactor; the Kramers treatment, in which the escape rate depends on how strongly the system is damped; and negative temperature, which is what a population inversion is when the same formula is applied to it backwards.

The neighbouring ladders are entropy as a count, which is what the derivation maximises, the barometric distribution, which is this factor with a gravitational energy, and tunnelling, which is the way over a barrier that does not use the factor at all.

Part 3 of 7

This essay is one argument about Entropy. The others:

What links here

Essays that reach for this one mid-argument — the half of a link its own author cannot write down.

What this makes readable

Essays that declare this one a prerequisite.

The objects named here

The third axis, after the field and the reading path: the things themselves, and every essay that touches each one.

Activation energyArrhenius lawBarrierThe Boltzmann factorEntropyPartition functionReaction rateThermal energy