A working lecture

Quiet Charge

A guided lab on electricity in computers: voltage, current, heat, and the quietest bit a classical machine can send. You can turn the knobs as you read.

Inside a chip, charge is already everywhere. A bit is a small tilt in energy, read as a voltage, and heat is the sea that tilt has to stand above. We will start with a simple loop.

Begin with a circuit

Lab rack

358 K (85 °C)kT/q 30.9 mVσ 49.4 mVBER 2.7×10⁻¹⁶ · solid

01 — Circuits

How to think about electricity

A circuit is a loop. Charge can only do useful work if it has a way out as well as a way in. A battery (or a power supply) holds one end of the loop at a higher electrical potential than the other. A wire and a load — a lamp, a motor, a tiny capacitor inside a chip — close the path. Nothing has to be visible. The same pattern, shrunk a million times, is what a processor is made of.

Three words do almost all the work. It helps to meet them as everyday quantities before they turn into symbols.

WordUnitWhat to picture
Chargecoulomb, CThe amount of electricity. One electron carries a tiny fixed piece of it.
Voltagevolt, VEnergy available per unit of charge. A difference between two points, never a substance.
Currentampere, AHow much charge passes a point each second. One ampere is one coulomb per second.
Resistanceohm, ΩHow hard the path is to push charge through. A narrow pipe, or a long thin wire.
Powerwatt, WHow fast energy is delivered. One watt is one joule per second.
Energyjoule, JThe capacity to do work or become heat. A battery stores joules; a chip spends them.

A useful way to remember the three working variables: voltage is how hard each bit of charge is being pushed, current is how many bits of charge are on the move, and power is those two multiplied — push times traffic. A high-voltage, tiny-current circuit and a low-voltage, huge-current circuit can deliver the same watts. USB power banks and laptop chargers play this game in reverse: they raise current so they can keep voltage modest.

V
voltage, in volts — energy per coulomb
I
current, in amperes — coulombs per second
P
power, in watts — joules per second
P = V × I
Power is voltage times current. Push times traffic.

If a GPU rail sits at 0.8 volts and carries 120 amperes, the power is 0.8 × 120 = 96 watts. Those 96 joules arrive every second and become heat in the silicon and the voltage regulators. The same relation, rearranged, is how a phone charger is rated: 5 V at 3 A is 15 W.

V
voltage, in volts
I
current, in amperes
R
resistance, in ohms (Ω)
V = I × R
Ohm’s law: voltage is current times resistance. More push, or a narrower path, changes the flow.

One ohm means one volt of push produces one ampere of flow. A thick copper trace on a board might be milliohms. A transistor that is only slightly “on” can be thousands of ohms. Chips spend much of their energy pushing charge through that resistance, which is why it becomes heat.

Q
charge stored, in coulombs
C
capacitance, in farads — how many coulombs you get per volt
V
voltage across the capacitor
Q = C × V
A capacitor is a bucket for charge. Voltage says how full the bucket is.

Two conductors separated by an insulator can hold a pile of charge. That is a capacitor, and it is the circuit element a chip uses as a memory of a bit. Fill the bucket toward the supply voltage and you have stored a 1. Empty it toward ground and you have stored a 0. Every wire on a chip is a little capacitor too, which is why moving a bit from here to there costs energy.

People often borrow a water picture, and it is a good first map if you keep one caveat in mind. Voltage is the pressure difference, or the height of a tank. Current is the flow rate through the pipe. Resistance is how narrow the pipe is. Power is how much work that flow can do, or how warm the pipe gets. Charge is the water itself. Capacitance is the size of the tank.

The caveat is the important one for computers. The pipes are already full. Copper is packed with mobile charge before you close the switch. Turning a circuit on does not wait for “electricity” to travel from the battery to the chip, the way an empty hose waits for water. What travels quickly is a pressure change — in electrical language, an electromagnetic field — that slightly rearranges the charge that was already there. Individual electrons drift slowly; the message does not. In the picture below, the dots jiggle in place. The pale band is the bit.

A loop, a battery, and a bit

This bit

1 · high

Voltage meaning

near Vdd

a range, not a single number

What moved fast

the field

not a particular electron

Receiver asks

high or low?

one comparison

The dots are already in the wire — they jiggle, they do not race from the battery. Switching 0 to 1 sends a pale band, the electromagnetic field, which tells every charge along the top wire to lean the same way. The receiver only asks: is this voltage high or low?

Two more words that will keep returning, defined here so they never ambush you.

Decade. In ordinary English a decade is ten years. In electronics a decade is a factor of ten in whatever you are measuring. “Sixty millivolts per decade” means: change the voltage by 60 mV, and the current changes tenfold. Six decades of on/off is a factor of a million between the on-current and the off-current. Whenever this lecture says decade, it means that factor of ten.

Ground, and Vdd. Ground is the voltage we choose to call zero, the return path of the loop. Vdd is the positive supply of a CMOS chip — complementary metal–oxide–semiconductor, the style of almost every modern processor; historically “drain voltage,” now just “the rail.” A digital 1 is a node sitting near Vdd; a digital 0 is a node sitting near ground. Everything else in the lecture is a refinement of that sentence.

02 — Charge

What is actually moving

An electron is a tiny packet of negative charge. The packet's size is fixed by nature: e = 1.602×10⁻¹⁹ coulombs. A coulomb is simply a large number of those packets — about 6.24×10¹⁸ electrons. One ampere is one coulomb per second through a cross-section, so a 1 A charger is a conveyor of six billion billion electrons every second.

That sounds like a rush. Inside a metal it is almost the opposite of a rush. Copper already holds about 8.5×10²⁸ conduction electrons per cubic metre, a Fermi sea that is almost full. They are not waiting at the battery to be sent down the wire. They are already everywhere in the wire, jiggling at around a million metres per second.

Current is a slight bias on that jiggle. Push a coulomb of extra charge in at one end and a coulomb leaves the other end almost immediately — but those are not the same electrons. The ones that left were already sitting at the far end. What travelled fast was the electromagnetic field that told every electron, all along the wire, to lean a little the same way.

I
current, in amperes
n
number of mobile electrons per cubic metre
A
cross-sectional area of the wire
e
charge of one electron
vd
drift speed — the slow leftover after all the jiggling
I = n A e vd
Current is how many carriers, how wide the wire, how much charge each carries, and how fast they drift.

For 1 A in a 1 mm² copper wire, the drift speed v_d is about 0.07 millimetres per second. You could out-walk it. The signal on the same wire moves at a sizable fraction of the speed of light. Both facts are true at once, because they describe different things: the crawl of the charge carriers, and the wave in the field that is organizing them.

A copper wire, one millimetre square

Drift speed

73.4 µm/s

v = I / nAe

Electrons / s

6241509 T

I / e

Thermal speed

1.60 Mm/s

Fermi sea, ~copper

Signal speed

150 Mm/s

½ c in the dielectric

Each dot is a stand-in for ~10²² real conduction electrons. Thermal motion is drawn to scale with temperature; drift is not, unless you switch to true scale — at which point the current becomes invisible.

03 — Voltage, current, power

Energy per charge, charge per second

Voltage is not a substance and it is not “strength of electricity.” It is a difference in potential energy, quoted per unit charge. One volt means one joule of energy for each coulomb that falls through the difference — or, for a single electron, one electron-volt: 1.6×10⁻¹⁹ J.

In a battery the difference is chemical. In a laptop charger it is an electromagnetic field maintained by a switching converter. In a MOSFET — a metal–oxide–semiconductor field-effect transistor, the switch a chip is made of — it is the height of an energy hill the electron has to climb to enter the channel. Same units, same meaning: how much energy you give, or take, per charge.

V
voltage, in volts
ΔU
change in potential energy, in joules (Δ means “a change in”)
q
the charge you are following, in coulombs
I
current, in amperes
Q
charge, in coulombs
dQ
a small amount of charge passing by
dt
a small interval of time, in seconds
P
power, in watts
V = ΔU / q    I = dQ / dt    P = V I
Voltage is energy per charge. Current is charge per time. Power is energy per time.

The notation dQ / dt is a rate: how much charge passes, divided by how much time it took. Multiply voltage and current and the charges cancel: power is just how fast energy is being delivered. A 0.8 V rail carrying 120 A into a GPU is 96 W of heat and work, whether you think in electrons or in spreadsheets. Each electron that drops through 0.8 V leaves 0.8 eV of energy somewhere in the silicon.

Voltage, current, power — one circuit

Power P = VI

160 mW

Energy per electron

128 zJ

0.80 eV

Electrons / second

1248302 T

Electrons for 1 J

7801886 T

Energy per second

Power is the rate energy is delivered as heat or work. Voltage sets how much energy each coulomb carries; current sets how many coulombs pass per second.

Two pictures of the same 0.8 V, 0.2 A circuit: 1.25×10¹⁸ electrons per second, each giving up 0.8 eV. Or: 0.16 J every second. The electron picture is useful when you want to know how many carriers a node holds. The joule picture is useful when you want to size a heatsink.

04 — Travel

The sea, the tilt, and the wave

In vacuum an electron really would fall through a volt and pick up 1 eV of kinetic energy. In copper it collides with the lattice about every femtosecond. The energy that might have become speed becomes phonons — vibrations of the metal, which we feel as heat — almost immediately. That is resistivity. Drift is the small leftover after a very busy thermal life.

A digital bit on a circuit board is not a boxcar of electrons. It is a brief step in the voltage between a signal conductor and its return path. The step is an electromagnetic mode riding in the insulator around the wire, typically around c/2 — half the speed of light. At the receiver, that mode slightly rearranges the Fermi sea on a transistor gate, which is a capacitor of a few femtofarads. A few thousand extra electrons on that gate are enough to flip the next inverter.

05 — Gates

A transistor is a hill. A wire is a bucket.

CMOS logic — complementary metal–oxide–semiconductor, the style of almost every modern chip — draws almost no current in a quiet state. A “1” is a capacitor charged to Vdd. A “0” is the same capacitor emptied to ground. To switch, you open a MOSFET and let charge flow onto or off of that node. The MOSFET is a voltage-controlled hill: the gate voltage lowers a barrier so electrons from the source can enter the channel.

E
energy, in joules
C
capacitance of the node, in farads — how much charge it holds per volt
V
the voltage you charged it to
E = ½ C V²    per transition,   C V² per full cycle
Charging stores ½CV². Discharging releases it as heat. A round trip uses CV².

During the charge, the supply delivers CV² of energy; half is stored on the capacitor, half becomes heat in the resistance of the transistor. During the discharge the stored half becomes heat too. Ordinary CMOS does not recover that energy. Adiabatic and reversible logic, later in the lecture, are the designs that try to give some of it back.

Pdyn
dynamic power — the part that comes from switching
α
activity: the fraction of nodes that actually toggle this cycle
C
the capacitance being switched
V
supply voltage
f
clock frequency, in hertz — switches per second
Pdyn = α C V² f
Dynamic power: activity × capacitance × voltage squared × frequency.

Voltage is squared, which is why a 10% drop in Vdd is about a 19% drop in switching energy, and why architects care about millivolts. Leakage — current that still flows over the hill while the transistor is “off” — adds a static term I_off V. A brief overlap while both the N and P transistors are on adds a third contribution.

A CMOS gate is a capacitor you keep filling and emptying

C · V

Wider plates, more capacitance. Taller fill, more voltage. The product is the number of extra electrons you piled onto the top plate.

Electrons on the node

250 k

Q = CV

Energy stored

16.0 fJ

½CV²

Energy per cycle

32.0 fJ

CV² dissipated

At 2 GHz, α=0.1

6.40 µW

one net

Charge Q = CV electrons onto the wire, then empty them to ground. The energy ½CV² becomes heat in the transistor channel each time. Do that at gigahertz, on a billion gates, and you have a CPU.

The hill itself is thermal. Electrons in the source have a Boltzmann tail of energies. A barrier of height qV — charge times voltage — leaks a current proportional to e−qV/kT. At room temperature that exponential is a decade of current for every 60 mV of barrier (the ideal subthreshold swing). A decade, as in the primer, is a factor of ten, not ten years. To be firmly off you want several decades, which is several factors of ten. That is why a 2026 CPU still likes around 0.7 V, rather than 70 mV.

06 — Silicon today

The voltages we actually use

A 3 nm-class CPU core sits near 0.7–0.85 V when it is working, sometimes down in the 0.5s when it is sipping, sometimes over a volt on a turbo rail. The junction — the silicon itself, under the heat spreader — is often 70–95 °C, which is 343–368 K. This lecture defaults the lab to 358 K for that reason: the physics the transistor sees is a little warmer than the room you are sitting in, and that extra warmth is useful headroom we can still give back.

Memory is a little more conservative. DDR5 DIMMs (dual in-line memory modules) run the array at 1.1 V. HBM3E — high-bandwidth memory — is 1.1 V; HBM4 lowers the core to about 1.05 V. LPDDR5, the low-power cousin in phones and laptops, can run the I/O at 0.5 V, which leaves a smaller swing for multilevel signalling, as we will see. GDDR7, the high-speed graphics sibling, is around 1.2 V and is the one that went ternary.

ThingVoltageEnergy / bit or opWhat sets it
CPU / GPU logic0.75 V200 aJ · FO460 mV/dec, variation, speed
On-chip wire, ~1 mmsame Vdd100 fJmetal capacitance
SRAM bit~Vdd50 fJstability, a clean read
DRAM cellboosted ~1 V10 fJ storeretention, sense margin
HBM3E / HBM4 PHY1.05–1.1 V~2 pJwide NRZ on a silicon interposer
DDR5 DIMM1.1 V~12 pJlonger channel, NRZ
GDDR71.2 VpJ-classPAM-3 on a board
PCIe 6.0 lane~1 V launch~3 pJPAM-4, longer reach
GPU FP16 floplogic Vdd~50 pJthe ALU is light; SRAM is the rest

A few of those labels, in plain language. FO4 is a fan-out-of-4 inverter, a standard yardstick for the energy of one logic gate. SRAM is static RAM, the on-chip cache; DRAM is dynamic RAM, the dense off-chip memory. A PHY is the physical-layer transceiver that drives the pins. NRZ is non-return-to-zero — ordinary two-level 0/1 signalling. PAM is pulse-amplitude modulation, several voltages on one wire (coming in chapter 09). An ALU is the arithmetic logic unit. The pattern in the table is friendly: arithmetic, once the data is sitting next to the ALU, is already down in the hundred-attojoule to femtojoule range. Fetching the data is picojoules. A DRAM access is about a thousand times a DRAM cell store, because you drive wordlines, bitlines, sense amplifiers, and a PHY. Most of the energy in computing goes to moving data, not to the arithmetic itself — which is also the largest opening for improvement.

Ewire
energy to send a bit along a wire
Cmetal
capacitance of the metal per unit length
how far the bit travels
V
the voltage swing
Ewire ≈ Cmetal ℓ V²
On-chip, energy to send a bit grows with how far it walks.

Copper wires do not shrink as fast as transistors. A millimetre at 0.75 V is about 100 fJ, already hundreds of FO4 gates. Architects answer with caches, chiplets, HBM stacked a millimetre away, and a useful design rule: the flop you did not have to fetch was the cheapest flop.

CPU Vdd

0.75 V

Junction

85 °C

358 K default

HBM4 core

1.05 V

DRAM access

5.00 pJ

per bit, order of

07 — The thermal floor

Heat is a voltage

At any temperature above absolute zero, charge on a conductor is in motion. That motion has a measurable voltage. Johnson and Nyquist wrote it down in 1928: a resistor R in a bandwidth Δf produces a mean-square voltage 4 kT R Δf. On a capacitor the same physics is tidier. Equipartition gives the capacitor ½ kT of energy, so ½ C σ² = ½ kT, and the rms noise — root-mean-square, a typical size — is √(kT/C).

⟨vn²⟩
mean-square noise voltage, in volts squared
k
Boltzmann’s constant, 1.38×10⁻²³ J/K
T
temperature of the device, in kelvin
R
resistance, in ohms
Δf
bandwidth you are listening in, in hertz
σC
rms noise on a capacitor, in volts
C
capacitance, in farads
⟨vn²⟩ = 4 kT R Δf    σC = √(kT / C)
Johnson–Nyquist in a resistor; kT/C on a capacitor.

T is the temperature of the electron gas in the device, not necessarily the room. For a 50 fF node at 358 K, σ is about 0.31 mV. That is the thermal floor of that node. Any signal you want to tell from a neighbour has to sit several of those σ away, or the two meanings start to look the same.

“Several” is a precise number. A Gaussian tail beyond 7 σ happens about once in 10¹² trials; beyond 8 σ, once in 10¹⁵. Serial links quote 10⁻¹² to 10⁻¹⁵ bit error rates (BER) before forward error correction. DRAM and logic also live with coupling from the next wire, supply bounce, and manufacturing variation, so they run with wider margins than pure kT/C would ask for. Thermal noise is the part that is always there. At 0.8 V it is rarely the one you are hitting. Lower the swing far enough, and it becomes the one that matters — which is exactly the experiment the lab is for.

Thermal noise vs signal — can you still tell the levels apart?

Thermal model

Levels

kT/q

30.9 mV

thermal voltage

σ

49.4 mV

1.6 × kT/q, the logic scale

Spacing

800 mV

between levels

Bit error rate

2.7×10⁻¹⁶

datacenter-class

Dots are successive samples of a PAM symbol plus thermal noise. Boltzmann mode uses ~1.6 kT/q — the scale a transistor lives on. Johnson mode is √(kT/C) on the capacitor, quieter unless C is tiny. Horizontal lines are levels; dashed lines are thresholds. Overlap means the two meanings look the same.

Voltage a bit needs, once you pick a temperature
Target BER

At this T

— V

thermal only

Hot silicon 358 K

— V

Nitrogen 77 K

— V

Markers: Helium, Nitrogen, Room, Junction, Burning. A real 0.75 V CPU rail is tens to hundreds of times this thermal-only number — the rest is speed, variation, and neighbouring wires.

For a chosen bit-error target, the swing must grow as √T because σ = √(kT/C). Lower the die temperature and the same capacitor can carry a quieter, cheaper bit — until coupling, supply droop, and variation set the next floor.

Two details, so the picture is complete. First, kT/C falls only as √T. Halving absolute temperature does not halve the required swing; it takes it down by √2. Second, the MOSFET’s 60 mV/decade does scale as T. For logic voltage, cooling is linear and therefore a larger lever than it is for a capacitor’s Johnson noise. A cold analogue front-end and a cold CPU benefit from cooling in different ways.

08 — Cold rooms

What if the datacenter were a fridge

Suppose you actually did it. You take a rack, sink the silicon in liquid nitrogen, and redesign the chip so the rails follow the new 15 mV/decade swing instead of 80. Thresholds fall. Overdrive falls. Vdd might be 0.2 V instead of 0.75 V. Switching energy, which goes as V², drops by an order of magnitude. Leakage, exponential in qVth/kT, becomes very small.

Cooling uses power at the wall plug. A refrigerator moves heat from 77 K to 300 K with a well-defined minimum cost. Carnot says the least you can pay is (Th − Tc)/Tc watts of work per watt of heat — about 2.9 W per watt at 77 K. Practical Stirling and Gifford–McMahon coolers typically reach 10–20% of that Carnot factor, so 15–30 W at the wall per watt in the bath. At 4 K the Carnot factor is already about 75, and practical 4 K coolers reach about 1–3% of Carnot, so wall power is hundreds of watts per watt of heat. Liquid helium is how you run a dilution refrigerator for a quantum processor — a specialised, and already working, plant.

Pwall
electrical power drawn from the building
Pchip
heat the chip dumps into the cold bath
Th
warm side of the cooler, often ~300 K
Tc
cold-bath temperature
η
how close the real cooler gets to Carnot, as a fraction
COP
coefficient of performance — heat moved per watt of work
Pwall = Pchip × (Th − Tc) / (η Tc)
Wall power is chip heat times the inverse of a real cooler’s COP.

η is the fraction of Carnot you actually get. The cryo lab below uses 15% at nitrogen and 2% at 4 K, a conservative figure for small helium plants. Play the temperature. There is a window around 77 K where a redesigned CMOS chip can break even or come out ahead, mostly because leakage falls and V² falls with T². At 4 K, superconducting logic is the more natural classical partner: carriers in ordinary CMOS begin to freeze out, and the cooling plant grows large compared with the electronics.

Chill the silicon, then drop the rails

Swing

92.3 mV/dec

n = 1.3

Redesigned Vdd

769 mV

Ion/Ioff = 10⁶

Chip dynamic

4.43 W

vs 0.75 V hot die

Leakage

41.0 W

exponential in 1/T

Electronics

45.4 W

Cooler at wall

none

ambient

Total wall power

45.4 W

100% of hot die

Net vs 85 °C

loses energy

including cooling

TVddChipWall
358 K769 mV45.4 W45.4 W
300 K644 mV10.7 W10.7 W
77 K165 mV205 mW4.17 W
4 K8.59 mV554 µW2.05 W

Model: 20 nF of switched capacitance, 2.5 GHz, activity 0.15, leakage 40 W at 358 K with a 0.15× Carnot cooler. Qualitative, not a datasheet. Practical 4 K coolers typically reach about 1–3% of Carnot — helium plants are a research instrument today, not yet a training-cluster line item.

Subthreshold swing tracks kT. Redesign the chip for the new swing — rather than cooling a 0.75 V 5 nm die unchanged — and switching energy falls as V². Cooling uses watts at the wall. The interesting question is whether the electronics save more than the cooler uses.

The work is painstaking, and teams still do it when the requirements ask for it. Cryo-CMOS at about 4 K is how you sit a control ASIC next to a quantum processor without a thousand coaxial cables. Superconducting RSFQ (rapid single-flux quantum) and AQFP (adiabatic quantum-flux parametron) logic at 4 K switch with about 10⁻¹⁹ to 10⁻²¹ J, which is the closest classical electronics has come to Landauer. IBM, Google, and several startups have published the circuits. Scaling that idea to a training cluster is an engineering question of cooler size as much as of transistors — nitrogen remains the more practical window for bulk classical silicon, and helium the natural home for quantum control.

A near-term step that is already in reach: run the junction closer to 50 °C than 95 °C with liquid in the cold plate. Johnson noise barely notices a few tens of kelvin, but leakage and reliability do, and the 60 mV/decade is a few millivolts kinder. The lab’s “Junction” versus “Room” presets are that story — a quiet, useful opening rather than a leap.

09 — How many voltages

Binary, ternary, and the rest

It is worth explaining how many voltages a wire can usefully mean. Binary is only the starting point; the same copper can carry three or four distinct levels, and that choice is how cables and graphics memory bought more bits without buying more pins.

Put three voltages on a wire (−V, 0, +V) and each symbol can carry log₂ 3 ≈ 1.58 bits. Four voltages, 2 bits. Eight, 3 bits. This is pulse amplitude modulation, PAM-M, one of the oldest ideas in communication. Memory and high-speed serial links adopted it once pin rates made analogue bandwidth the scarce resource.

M
how many distinct voltage levels you use
UI
unit interval — one symbol time
Vpp
peak-to-peak swing, from the lowest level to the highest
ΔV
spacing between neighbouring levels
SNR
signal-to-noise ratio
dB
decibels — ten times log₁₀ of a power ratio, twenty times for voltage
bits/UI = log₂ M    ΔV = Vpp / (M − 1)    SNR cost = 20 log₁₀(M − 1) dB
More levels, more bits per symbol, less space between them, a smaller eye.

PAM-3 pays a 6.0 dB SNR cost versus NRZ (two-level signalling). PAM-4 pays 9.5 dB. In exchange the symbol rate drops, so the frequency where the channel loses the most moves down. Whether that is a good trade depends on what the channel is made of — and that is a design opportunity, not a riddle.

What a receiver actually sees
0.00 V0
0.80 V1

Bits / symbol

1.000

Level spacing

800 mV

Comparators at RX

1

one threshold per gap

Walk the energy argument slowly. Suppose the only noise is kT/C on a capacitor, and you hold a fixed error rate. Then the spacing ΔV is set by σ, and the total swing must grow as (M−1). Energy stored goes as V², so as (M−1)². You get log₂ M bits. Energy per bit goes as (M−1)² / log₂ M, which is a minimum at M = 2 and then rises. On a quiet capacitive wire, binary is the thermodynamic optimum of this family.

That is a different channel from the one GDDR or PCIe lives on. A PCB (printed circuit board) trace, a package via, a long copper pair — those are low-pass filters. Loss in dB grows with frequency, often roughly linearly in GHz for the lengths we care about. At 32 Gb/s, NRZ has its Nyquist at 16 GHz; PAM-3 at the same bit rate sits at 10.1 GHz; PAM-4 at 8 GHz. If the trace costs you a decibel per gigahertz, PAM-3 just received a 6 dB gift, which exactly balances its 6 dB cost, and PAM-4 received 8 dB against a 9.5 dB cost. Nudge the loss or the rate and the winner flips. There is a best M for each channel, and finding it is the fun of the job.

Regime A — a capacitive wire, noise is kT/C

NRZ

— V

1.00 bit/UI

PAM-3

— V

1.58 bit/UI

PAM-4

— V

2.00 bit/UI

PAM-8

— V

3.00 bit/UI

Hold BER fixed, grow the swing so every extra level still sits many σ apart. Energy per bit then scales as (M−1)² / log₂ M. Binary wins. This is on-chip and HBM.

Regime B — a lossy PCB or package trace
SchemeNyquistLossSNR taxBER
16.0 GHz20.2 dB0.0 dB1.9×10⁻²
10.1 GHz13.1 dB6.0 dB5.2×10⁻³
8.0 GHz10.6 dB9.5 dB9.4×10⁻³
5.3 GHz7.4 dB16.9 dB4.2×10⁻²

SNR tax is 20 log₁₀(M−1): PAM-3 pays 6 dB versus NRZ, PAM-4 pays 9.5 dB. If the channel gives back more than that by dropping Nyquist, multilevel wins.

Same bit rate, fixed launched swing. Extra levels lower the Nyquist frequency, so the channel attenuates less of the signal. PAM-3 often comes out ahead of both NRZ (more loss) and PAM-4 (a smaller eye) — that is GDDR7 and USB4 v2.

10 — Memory

Why GDDR went ternary, and why HBM stayed binary

It is worth pausing on this, because the two memories are easy to mix up and the physics is genuinely interesting. The memory that ships ternary today is GDDR7. HBM3E and HBM4 still send ordinary two-level NRZ. They send it on 1024 or 2048 wires at once, through a silicon interposer, at 1.05–1.1 V. GDDR7 sends PAM-3 (−1, 0, +1) down a much narrower bus on a graphics board, at pin rates of 28–40 Gb/s. Same family of electrons. Opposite packaging physics — and both answers are the right one for their channel.

HBM’s channel is short, dense, and gentle. A silicon interposer millimetres long does not attenuate 16 GHz the way a six-inch PCB does. The scarce resource is edge bandwidth density — terabits per second per millimetre of shoreline — and the way you buy that is more pins, not more bits per pin. Extra voltage levels would add comparators, linearity work, and crosstalk in a bundle of a thousand neighbours, for a Nyquist gift the interposer does not need. Research papers have built PAM-3 PHYs aimed at future HBM-class densities. The shipping stacks have stayed with two levels, which is the optimum of Regime A talking.

GDDR is Regime B. You get 32 or 128 pins, not 1024, and they run across a board. GDDR6X tried PAM-4 and it worked, with extra analogue care: three eyes, tight linearity, more comparators. GDDR7 stepped to PAM-3. Three levels, two eyes, 1.5 bits per UI (3 bits in 2 UI with 11b/7s and 3b/2s coding, actually about 1.57). SNR cost of 6 dB instead of 9.5. Two comparators instead of three. JEDEC’s first standardised PAM DRAM. USB4 Version 2.0 made the same call for the same reason.

LPDDR, the phone and laptop cousin, is a useful comparison. LPDDR5’s I/O is 0.5 V. A 0.25 V swing split into three or four levels leaves a slim margin after noise, simultaneous switching, and a compact package. Papers say so directly: the swing is what keeps PAM out of LPDDR. Low voltage and multilevel signalling pull in different directions unless the channel is quiet enough to afford the split. HBM is quiet and still stays binary because width is the cheaper way to buy bandwidth. LPDDR is neither as quiet nor as wide, so it stays binary and takes the pin rate that two levels can support.

DDR5, on a DIMM with stubs and connectors, is also still NRZ, at 1.1 V, with decision-feedback equalizers and a lot of training. The DIMM channel has many reflections; extra levels would copy those reflections into extra eyes. Two levels remain the better match for that particular shape of channel — another case of the physics pointing at a clean answer.

11 — Landauer

The smallest a bit can cost

In 1961 Rolf Landauer observed that erasing a bit is not only a bookkeeping operation. It is a compression of the machine’s physical state space, and it has a minimum heat: kT ln 2 per irreversible erasure. At 300 K that is 2.87×10⁻²¹ J, about 2.9 zJ. At 358 K, a little more. At 4 K, 38 yoctojoules. That floor is a destination.

E
heat released by erasing one bit, in joules
k
Boltzmann’s constant
T
temperature of the bath the bit sits in
ln 2
the natural log of 2 — one bit of entropy
E ≥ kT ln 2
Landauer’s limit: the heat of erasing one bit, irreversibly, in a bath at T.

It is a floor on erasure, not on computation as such. If every step is logically reversible and you keep the tape, Bennett showed you can compute with arbitrarily little dissipation, in exchange for time, space, and care. Everyday machines erase often: every overwrite of a register, every dump of a capacitor to ground, every DRAM refresh that confirms a 0 stayed a 0. Each of those is also a place a more careful machine could choose to keep the bit a little longer.

A flop, a wire, a bit, and the thermodynamic floor
  • Landauer bit, 300 K2.87 zJ

    the floor

  • Landauer bit, 4 K0.00 J

    the floor

  • FO4 inverter, 3 nm-class200 aJ

    58.4 k× Landauer at this T

  • SRAM bit, dynamic50.0 fJ

    14.6 M× Landauer at this T

  • On-chip millimetre wire100 fJ

    29.2 M× Landauer at this T

  • DRAM cell store10.0 fJ

    2.92 M× Landauer at this T

  • HBM bit on the interposer2.00 pJ

    584 M× Landauer at this T

  • DDR5 DIMM bit12.0 pJ

    3.50 G× Landauer at this T

  • GPU FP16 flop (incl. SRAM)50.0 pJ

    14.6 G× Landauer at this T

Landauer at 358 K

3.43 zJ

kT ln 2

GPU flop / Landauer

14.6 G

Landauer bits in one GPU flop

Bars are logarithmic. The GPU flop is ~10 million to 100 million Landauer bits. Most of that is not the arithmetic — it is moving charge down copper.

A modern FO4 inverter at 3 nm is a few hundred attojoules — already only about 10⁵ Landauer bits, closer than a casual comparison of joules sometimes suggests. The inverter is doing well. The larger remaining cost is the millimetre of copper to the next inverter, the millimetre of interposer to HBM, the centimetres to a DIMM. Communication, not NAND, is where most of the joules still go — and where the next gains are waiting.

Even the DRAM cell, a textbook capacitor, sits above Landauer. A 2025 experiment that counted electrons on a real DRAM cell found the measured heat stayed above the line: the cell is not prepared in thermal equilibrium the way the derivation assumes, so the erasure is not quasistatic. CMOS structure itself is part of the thermodynamics. Reaching the floor is a device-design project as much as a supply-voltage project — which is an invitation.

12 — The limit

A theoretically optimum classical machine

Let us stay with classical physics — electrons, fields, maybe Cooper pairs, no qubits — and ask a hopeful question. What is the most signal those electrons can carry, the most compute they can do, the least power they may use — and which parts of that design point toward materials still being grown in the lab?

Information, classically, is distinguishable states. N independent two-level systems hold N bits. An electron in a box is not quite that: it occupies modes of a Fermi sea, and distinguishability is set by thermal smearing ~kT around the Fermi energy and by shot noise when you try to count. A current pulse of N electrons can encode, by amplitude alone, roughly ½ log₂ N bits before Poisson noise blurs the levels. Timing, phase, and spatial modes add more, up to the Shannon capacity of the physical channel.

C
channel capacity, in bits per second — here not capacitance
B
bandwidth, in hertz
S/N
signal power over noise power
Eb,min
least energy per bit on a wide-band AWGN channel
AWGN
additive white Gaussian noise — the textbook thermal channel
C = B log₂(1 + S/N)    Eb,min = kT ln 2
Shannon’s capacity of an AWGN channel, and the wide-band energy per bit.

Give the channel as much bandwidth as it can use, and a bit can be sent with energy kT ln 2 — Landauer again, this time as a communication result. A 50 Ω line at 300 K with 1 mW in 100 GHz of bandwidth has a Shannon capacity of order a terabit per second. Careful PAM-4 links today deliver about 100 Gb/s, perhaps a tenth of the way to Shannon on rate, and there is a larger gap to Landauer on energy because we work where the package sets the bandwidth and we spend picojoules keeping the link reliable. Both gaps are room to grow into.

A classical budget at the physical limit

Words fetched per flop

kT ln 2

3.43 zJ

Logic, reversible

27.4 zJ

~8 erasures

Communication

1.75 aJ

Floor for one flop

1.78 aJ

Today's GPU, including SRAM: 50.0 pJ. Gap to this floor: 28.1 M×. Superconducting AQFP at 4 K has been measured in the 10⁻²⁰ J / gate region — still above Landauer, but no longer in another universe.

Assume reversible arithmetic (Bennett) so logic only pays Landauer on the bits you actually erase, plus Shannon’s kT ln 2 per bit you must send over an AWGN wire. The remaining gap to a GPU is mostly communication — which is why the optimum machine barely moves data.

The machine at the limit, drawn as an engineering spec:

  • Keep data close. The cheapest bit is the one that was already at the ALU. In-memory and near-memory compute are how you approach the floor, because a millimetre of copper is already 10⁵ Landauer bits.
  • Erase as little as possible. Reversible pipelines (Bennett, adiabatic CMOS, Bennett clocking) pay Landauer only on the bits you truly let go — I/O, measurement, architectural commits.
  • Encode at the channel’s Shannon rate. On short quiet wires that means binary at the smallest reliable V. On long lossy wires it means the PAM-M (or a shaped constellation) that maximises bits per joule after the low-pass. Uniform PAM leaves a 1.53 dB shaping gap to a Gaussian constellation; at the limit you take that too.
  • Pick T with Carnot in mind. Logic voltage can fall with T; Johnson noise falls only as √T; cooler watts grow as 1/T. A redesigned CMOS part at about 77 K is the interesting classical compromise. 4 K is a natural home for superconductors.
  • Change the carrier when charge is no longer the best handle. A single-electron box with C ≈ 1 aF has charging energy e²/2C ≈ 80 meV, above room-temperature kT, so in principle one electron is a bit. Reading it quickly, and wiring many of them, is still research. Superconducting flux quanta Φ₀ = h/2e are the encoding that already works at 4 K (RSFQ, AQFP). Spins and photons are the other classical-ish handles.

Where today’s materials would need to grow to match that drawing:

  • Silicon’s bandgap is 1.1 eV — a gift at 300 K, and a starting point for new operating points. Using it at 10 mV rails asks the transistor for a steeper on/off than 0.7 V CMOS provides; tunnel FETs and other steep-slope devices are an active research path.
  • Copper resistivity and electromigration set how skinny a wire can be before resistive heating grows quickly. Cobalt, ruthenium, and graphene interconnects are already chipping away at this. Room-temperature superconductors remain a research goal, and a welcome one.
  • Gate oxides still need enough field to invert a channel while tunnelling stays in budget. A 10× lower Vdd asks for a different stack, and that stack is being explored.
  • DRAM’s trench capacitor and its refresh sit above Landauer, as the 2025 single-electron experiment showed. A Landauer-class memory is a different device — perhaps magnetic, perhaps superconducting, perhaps one still being imagined — and several of those are already in the literature.
  • Reversible logic at speed, in a real instruction set, with real I/O, is still an open engineering project. Turning the textbooks into a compiler and a chip is inviting work.

You can take the lab with you. Temperature is a design knob, and a friendly one. Every millivolt on a 5 nm rail, every extra PAM level on a memory bus, every kelvin you return to a junction — from a working 85 °C die toward a cooler plate — is the same argument: a bit must keep its head above water. Heat is that water: a thermal sea whose height we can measure, and whose height we can lower. We already swim with a comfortable margin. The remaining work is to find out how close we can sit to the surface while still reading every bit — and which parts of that closeness are physics, and which are simply how we have usually wired the board. Both are things we can change.