Information theory

Exactly 200 years ago, a French engineer introduced an idea that would quantify the universe’s inexorable slide into decay. But entropy, as it’s currently understood, is less a fact about the world than a reflection of our growing ignorance. Embracing that truth is leading to a rethink of everything from rational decision-making to the limits of machines.

Our computers can get a lot more done when they share the load with other machines.

Black holes are inescapable traps for most of what falls into them — but there can be exceptions. The theoretical physicist Leonard Susskind speaks with co-host Janna Levin about the black hole information paradox and how it has propelled modern physics.

Locally correctable codes need barely any information to fix errors, but they’re extremely long. Now we know that the simplest versions can’t get any shorter.

The puzzling behavior of black hole interiors has led researchers to propose a new physical law: the second law of quantum complexity.

One student’s desire to get out of a final exam led to the ubiquitous algorithm that shrinks data without sacrificing information.

In steganography, an ordinary message masks the presence of a secret communication. Humans can never do it perfectly, but a new study shows it’s possible for machines.

On nights and weekends, Justin Gilmer attacked an old question in pure math using the tools of information theory.

Computer scientists this year learned how to transmit perfect secrets, why transformers seem so good at everything, and how to improve on decades-old algorithms (with a little help from AI).