The Fourier Kinetic Series


Grenoble, February of 1807, and the prefect's study on the second floor was kept at a temperature his visitors described, depending on their charity, as tropical or as punitive. Jean-Baptiste Joseph Fourier sat in it wrapped to the chin in wool, a brazier at either elbow, and did not sweat.1 Egypt had spoiled him. He had come back from the Nile convinced that heat was the one honest thing in the world — that it never lied about where it had been, that it always moved from more to less, that given long enough it would render every distinction in the universe into one lukewarm agreement. He intended to write down its law. He had, in fact, already written it down. The trouble was arithmetic.

His clerk that winter was a prefecture man named Berthier, who had come to the post expecting land surveys and marriage registers and who now spent his mornings multiplying sines. The method was straightforward and it was murder. Fourier would hand down a curve — the temperature along an iron ring, measured at thirty-six points — and Berthier would resolve it into its pure tones, and to find each tone he had to walk the whole ring, thirty-six multiplications, and there were thirty-six tones to find, and so the walk was made thirty-six times over. Twelve hundred and ninety-six products, each to five figures, each an opportunity to be wrong in a way that would not announce itself until the end.2 Three weeks for one ring. Berthier had begun to dream in tables.

"It cannot be that God made the world this expensive," he said one morning, not quietly.

"God made it cheap," Fourier said. "We are the ones charging."

§

Downstairs, in the room where the prefecture kept the crates from Egypt, a seventeen-year-old was losing an argument with a dead language.

Fourier had found the boy six years earlier, in a classroom in Grenoble, and had done the thing he did best, which was to recognize a furnace when he saw one. He had shown him the plates — the cartouches, the endless patient signs — and the boy had asked whether anyone could read them, and Fourier had said no, and the boy had said I will, in the flat way children say things they have not yet learned to be embarrassed about. His name was Jean-François Champollion. He would be right. It would take him another fifteen years.3

That February he was working on a cartouche with a repeated group in it, and he was working on it with a pair of scissors, which is what brought Fourier to the doorway.

"You are cutting my plates."

"Copies." Champollion did not look up. "Look at it, though. Look." He had the signs written out in a long strip, and he had folded the strip in half, and in half again, so that the repeated group lay over its own recurrence. "Sign by sign it's hopeless — every sign might be a word or a sound or a nothing, and there are hundreds, so there are hundreds of hundreds of guesses. But it repeats. And if it repeats, I do not have to ask what each sign is. I ask only whether this half is the other half. One question instead of a hundred. And then I fold what's left and ask again."

"And if it is not?"

"Then I have still halved the pile." He grinned up at the prefect. "Twice in an afternoon and there is nothing left to be stupid about."

Fourier stood in the doorway for what Champollion later described, uncharitably, as an unpleasantly long time.

Then he went upstairs and shut the door and did not come out for two days, and the brazier went cold, and nobody dared mention it.

§

What he had seen was this.

The ring had thirty-six points on it. Walk the ring once and you get one tone, and you have paid thirty-six multiplications for it — but you have paid them in a particular order, and the order is where the waste hides. Take instead every other point. Eighteen of them, an eighteen-point ring, its own smaller problem. Take the ones you skipped: another eighteen-point ring, the same problem again, only shifted — turned slightly in its phase, like the second of two dancers who are doing the identical figure a half-beat apart. Solve the two small rings. Then twist the second by its half-beat and add, and subtract, and the thirty-six tones of the whole ring fall out of the eighteen tones of each half, in pairs, two at a time, for the price of an addition.

And then, of course, you do it again. Eighteen is two nines. Nine is three threes. You keep folding until there is nothing left to be stupid about.4

Twelve hundred and ninety-six products became a hundred and some. Berthier did in a morning what had eaten his January, checked it twice out of disbelief, and then wept a little, privately, over the second page.

Fourier called it the kinetic series,5 and he was not being fanciful. Heat had taught him the whole of it. No particle of iron moves the ring; each one only jostles its neighbor, and the great smooth cooling that looks like a single fact is nothing but an enormous number of small motions, summed. The tones were the same. You did not find them one at a time, grandly, by interrogating the whole. You found them two at a time, cheaply, by asking each half about the other.

He wrote it into the memoir. Thirty-one pages of theory, and at the back, in the small type reserved for the practical, a note on the ordering of the computation.

§

The memoir went to Paris in December and Paris hated it.

Not the arithmetic — nobody read the arithmetic. Lagrange, seventy-one and immovable, objected to the series itself: it was not decent that a corner, a jump, a discontinuity, could be built out of nothing but smooth eternal sines. Laplace was cool. Poisson was Poisson. Fourier was told his rigor was wanting and his physics was interesting and would he care to submit again, and he did, in 1811, and won the prize with the reservations attached to it like a tin can to a dog.6

By then he had a prefecture to run: a marsh at Bourgoin to drain, a road to Turin to survey, and the seven great volumes of the Description de l'Égypte to see through the press, for which he wrote the historical preface twice because the Emperor disliked the first one.7 The note on ordering the computation went into a crate with the Egypt proofs. It was clerk's work. It saved a clerk three weeks. It was not the sort of thing a man puts his name on when he is trying to convince Lagrange about the nature of the continuum.

He published Théorie analytique de la chaleur in 1822, and it is one of the great books, and it does not contain the fold.8

He was elected to everything. He worked out, in 1824, why the earth is warmer than the plain sunlight on it should allow, which was a better guess than anyone would improve on for sixty years.9 He got Champollion out of the draft, twice, and lived to see him read the names of kings aloud. And in May of 1830 he fell down a flight of stairs in Paris and died not long after, still cold, still wrapped in wool, sixty-two years old.10

What none of them knew: it was already lost twice. In Göttingen, around 1805, Gauss had wanted the orbit of an asteroid in a hurry and had folded the same fold, in Latin, in a notebook, and had not thought it worth printing either. Those pages did get published — in 1866, in volume three of the collected works, in a dead language, where they sat for another century being not read.11

§

In the spring of 1965 two men named James Cooley and John Tukey published four pages in a journal of computational mathematics, and the thing came back.12

The reason it came back is worth saying plainly. The government wished to know whether the Soviets were testing bombs underground, and the only witness to an underground bomb is the ground itself, which shudders, and a shudder is a curve, and to ask a curve what it is made of you must resolve it into tones. The seismometers gave them curves by the thousand. The machines could not keep up, because the machines were doing it the way Berthier did it in January — walking the whole ring, once for every tone, paying the square.

Cooley and Tukey folded it. Halves, and halves, and halves, until there was nothing left to be stupid about.

The saving is not a saving; it is a change of kind. For a thousand points the old way costs a million and the fold costs ten thousand. For a million points the old way costs a trillion and would still be running, and the fold is done before you have looked up. Every telephone call you have made, every song you have streamed, every photograph in your pocket, every MRI, every radio astronomer's quasar, every one of them is that fold, running some enormous number of times a second, on a machine that does not know it is keeping a promise made in an overheated room in Grenoble by a man who could not get warm.

They called it the Fast Fourier Transform, which is fair, and a little sad, because it credits him with the wrong half. He was always going to get the series. Anyone who stared long enough at heat was going to get the series.

The fold he got from a boy with a pair of scissors, who had learned it the only way anyone learns it: by having a pile too large to carry, and discovering that you are permitted to ask it one question instead of a hundred, and that the question is always the same one.

§

And then the other thing happened, the one that always happens.

A transform built to take a thing apart became the best tool ever made for throwing parts away. Every song in your pocket is smaller than it should be because a perceptual coder ran the fold, sorted the components, and deleted the ones it calculated you would not miss.13 Fourier resolved a curve in order to see it. We resolve it in order to discard most of it and ship the rest cheaply. The method did not change. Only the verb did.

It went further. The austerity that made his work portable — his refusal to say what heat was, his insistence on describing only how it moved — meant the transform would work on anything that varied. That is why it is now a single line in a library, called by people who have never heard of aliasing, who sample too slowly and get back a clean, confident, entirely fictitious tone and publish it.14 The refusal to speculate, which was his discipline, is now the user's ignorance. Same austerity. Opposite result.

And the listening. The four pages of 1965 were written so that a nation could tell an earthquake from a bomb, which is a decent thing to want. But the fold does not care what it is pointed at, and what it is pointed at now is everything that varies: every channel, every cell, every wire, every room with a window in it.15 The algorithm that let us hear through the earth is the algorithm that lets anyone hear through anything.

Which returns the question to where it started, with a different weight on it. The boy with the scissors asked it about a cartouche. The prefect asked it about an iron ring. The machines ask it several billion times a second, about you.

Is this half like the other?

Footnotes

  1. Not invented. Fourier's contemporaries found his rooms unbearable; he kept them at a heat visitors complained of and wore heavy clothing through the summer, a habit usually traced to the three years in Egypt. François Arago's Éloge historique de Joseph Fourier (read to the Académie in 1833) is the source most of the anecdotes descend from, and should be read as a eulogy rather than a deposition. ↩

  2. The arithmetic is honest. Resolving N samples into N coefficients the direct way costs on the order of N² multiplications — for thirty-six points, 1,296. Human "computers" really did this by hand for decades, in observatories and tide-prediction offices, and the labor is the reason the nineteenth century built mechanical harmonic analyzers rather than compute more. ↩

  3. Fourier met Champollion in Grenoble around 1801 and showed him the Egyptian material; every account of Champollion's life puts that meeting at the start of the obsession. He announced the decipherment in the Lettre à M. Dacier on 27 September 1822 — the same year Fourier published Théorie analytique de la chaleur. The pairing is a real coincidence and the reason this story exists. ↩

  4. This is the radix-2 decimation-in-time transform: split the samples into even and odd indices, transform each half, then recombine with a phase factor — the "twiddle" — in additions and subtractions, two outputs at a time. The recombination pattern is the butterfly. Halving recursively takes the cost from N² to N log N. Nothing in the paragraph is fictional except the room it happens in. ↩

  5. Here the story cheats, and the cheat is worth knowing. Fourier deliberately refused any hypothesis about what heat is — no particles, no motion, no fluid. That austerity is precisely what made his work portable: the equations describe how heat moves without committing to a mechanism. The kinetic theory of heat arrived a half-century later with Clausius and Maxwell. So "kinetic series" is an anachronism, and Fourier would have disliked it on principle. The name is mine. ↩

  6. The 1807 memoir was never published in his lifetime. Lagrange objected that an arbitrary function — one with corners and jumps — could not be represented by a sum of smooth sinusoids, and he never conceded; Laplace and Poisson were warmer but unconvinced. Fourier submitted again for the 1811 prize, won it, and had the reservations published alongside. The rigor Lagrange wanted arrived from Dirichlet in 1829, a year before Fourier died. For the documents and the quarrel, see Grattan-Guinness & Ravetz, Joseph Fourier 1768–1830 (MIT Press, 1972). ↩

  7. Fourier went to Egypt with Bonaparte in 1798, served as secretary of the Institut d'Égypte, and on returning was made Prefect of Isère and put in charge of the Description de l'Égypte — the state's enormous survey of the country. He wrote its historical preface, and did rewrite it under pressure. He also genuinely drained the marsh at Bourgoin and surveyed the road to Turin. The heat research was done around the prefecture, not instead of it. ↩

  8. True as stated. Théorie analytique de la chaleur contains the series, the heat equation, and the boundary-value method, and no fast algorithm. John Herivel's Joseph Fourier: The Man and the Physicist (Oxford, 1975) is the readable biography; the Théorie itself is more approachable than its reputation, particularly Freeman's 1878 English translation. ↩

  9. "Remarques générales sur les températures du globe terrestre et des espaces planétaires," Annales de chimie et de physique 27 (1824). Fourier reasoned that the atmosphere passes visible light inward more readily than it passes heat back out, and concluded the earth must therefore run warmer than bare sunlight accounts for. He got the mechanism roughly right and the quantities wrong; Tyndall measured the absorbing gases in the 1860s and Arrhenius did the sums in 1896. ↩

  10. 16 May 1830, in Paris, after a fall on a staircase; he had been in poor health for years. He is buried at Père Lachaise. His name is one of the seventy-two cut into the frieze of the Eiffel Tower. ↩

  11. The best-documented near-miss in computational mathematics. Gauss worked out the same halving around 1805, almost certainly while computing asteroid orbits, and left it in an unpublished Latin fragment — "Theoria interpolationis methodo nova tractata" — that appeared only in 1866, in volume three of the Werke. It predates Fourier's 1807 memoir. The definitive account is Heideman, Johnson & Burrus, "Gauss and the history of the fast Fourier transform," IEEE ASSP Magazine 1:4 (1984), which also catalogs the several other times the algorithm was found and dropped between 1805 and 1965. ↩

  12. J. W. Cooley and J. W. Tukey, "An Algorithm for the Machine Calculation of Complex Fourier Series," Mathematics of Computation 19 (1965), 297–301. The motive was real: Tukey was on Kennedy's science advisory committee, which was weighing a nuclear test-ban treaty, and the verification problem was to read seismic records fast enough to distinguish an underground test from an earthquake. Cooley's own account of what happened next is "How the FFT Gained Acceptance," in A History of Scientific Computing (ACM, 1990). ↩

  13. MP3 and AAC audio, and JPEG images by way of the closely related discrete cosine transform (Ahmed, Natarajan & Rao, 1974). Perceptual coding uses a model of hearing or vision to decide which resolved components a person will not miss, then throws them out; the standardization work at Fraunhofer through the late 1980s became MPEG-1 Audio Layer III in 1993. Analysis in service of deletion is a genuine inversion of what the method was for, and it is the reason you can carry ten thousand songs. ↩

  14. Sample a signal too slowly and a high frequency comes back indistinguishable from a low one — it aliases, and the transform reports the false tone with total confidence, because the information needed to tell them apart was never collected. The governing result is the sampling theorem, from Nyquist (1928) and Shannon (1949): you need more than two samples per cycle of the highest frequency present. The failure is not a flaw in the method. It is the method answering exactly the question it was asked. ↩

  15. Spectral analysis is foundational to radar, sonar, radio astronomy, medical imaging, telecommunications and signals intelligence alike; the same decomposition serves all of them and cannot distinguish between them. This is not a claim about any particular program, and it does not need to be. Cooley's own "How the FFT Gained Acceptance" (in A History of Scientific Computing, ACM, 1990) is candid about how fast it spread once it existed. ↩