(Roughly) Daily

Posts Tagged ‘Werner Heisenberg

“I visualize a time when we will be to robots what dogs are to humans. And I am rooting for the machines.”*…

Claude Shannon with his creation, Theseus the maze-solving mouse, an early illustration of machine learning and a follow-on project to the work described below

Readers will know of your correspondent’s fascination with the remarkable Claude Shannon (see here and here), remembered as “the father of information theory,” but seminally involved in so much more. In a recent piece in IEEE Spectrum, the redoubtable Rodney Brooks argues that we should add another credit to Shannon’s list…

Among the great engineers of the 20th century, who contributed the most to our 21st-century technologies? I say: Claude Shannon.

Shannon is best known for establishing the field of information theory. In a 1948 paper, one of the greatest in the history of engineering, he came up with a way of measuring the information content of a signal and calculating the maximum rate at which information could be reliably transmitted over any sort of communication channel. The article, titled “A Mathematical Theory of Communication,” describes the basis for all modern communications, including the wireless Internet on your smartphone and even an analog voice signal on a twisted-pair telephone landline. In 1966, the IEEE gave him its highest award, the Medal of Honor, for that work.

If information theory had been Shannon’s only accomplishment, it would have been enough to secure his place in the pantheon. But he did a lot more…

In 1950 Shannon published an article in Scientific American and also a research paper describing how to program a computer to play chess. He went into detail on how to design a program for an actual computer…

Shannon did all this at a time when there were fewer than 10 computers in the world. And they were all being used for numerical calculations. He began his research paper by speculating on all sorts of things that computers might be programmed to do beyond numerical calculations, including designing relay and switching circuits, designing electronic filters for communications, translating between human languages, and making logical deductions. Computers do all these things today…

The “father of information theory” also paved the way for AI: “How Claude Shannon Helped Kick-start Machine Learning,” from @rodneyabrooks in @IEEESpectrum.

* Claude Shannon (who may or may not have been kidding…)

###

As we ponder possibility, we might send uncertain birthday greetings to Werner Karl Heisenberg; he was born on this date in 1901.  A theoretical physicist, he made important contributions to the theories of the hydrodynamics of turbulent flows, the atomic nucleus, ferromagnetism, superconductivity, cosmic rays, and subatomic particles.  But he is most widely remembered as a pioneer of quantum mechanics and author of what’s become known as the Heisenberg Uncertainty Principle.  Heisenberg was awarded the Nobel Prize in Physics for 1932 “for the creation of quantum mechanics.”

During World War II, Heisenberg was part of the team attempting to create an atomic bomb for Germany– for which he was arrested and detained by the Allies at the end of the conflict.  He was returned to Germany, where he became director of the Kaiser Wilhelm Institute for Physics, which soon thereafter was renamed the Max Planck Institute for Physics. He later served as president of the German Research Council, chairman of the Commission for Atomic Physics, chairman of the Nuclear Physics Working Group, and president of the Alexander von Humboldt Foundation.

Some things are so serious that one can only joke about them

Werner Heisenberg

source

Knowing what’s unknowable…

source

We’ve known for quite awhile that there’s a limit to what we can know…  Werner Heisenberg discovered that improved precision regarding, say, an object’s position inevitably degraded the level of certainty of its momentum. Kurt Gödel showed that within any formal mathematical system advanced enough to be useful, it is impossible to use the system to prove every true statement that it contains. And Alan Turing demonstrated that one cannot, in general, determine if a computer algorithm is going to halt.

Now David Wolpert, a physicist working as a computer scientist at NASA Ames, has elaborated on that limit.  As Scientific American reports, Wolpert’s work show’s that

…the universe lies beyond the grasp of any intellect, no matter how powerful, that could exist within the universe. Specifically, during the past two years, he has been refining a proof that no matter what laws of physics govern a universe, there are inevitably facts about the universe that its inhabitants cannot learn by experiment or predict with a computation. Philippe M. Binder, a physicist at the University of Hawaii at Hilo, suggests that the theory implies researchers seeking unified laws cannot hope for anything better than a “theory of almost everything.”

Wolpert proves that in any such system of universes, quantities exist that cannot be ascertained by any inference device inside the system. Thus, the “demon” hypothesized by Pierre-Simon Laplace in the early 1800s (give the demon the exact positions and velocities of every particle in the universe, and it will compute the future state of the universe) is stymied if the demon must be a part of the universe.

Researchers have proved results about the incomputability of specific physical systems before. Wolpert points out that his result is far more general, in that it makes virtually no assumptions about the laws of physics and it requires no limits on the computational power of the inference device other than it must exist within the universe in question. In addition, the result applies not only to predictions of a physical system’s future state but also to observations of a present state and examining a record of a past state.

The theorem’s proof, similar to the results of Gödel’s incompleteness theorem and Turing’s halting problem, relies on a variant of the liar’s paradox—ask Laplace’s demon to predict the following yes/no fact about the future state of the universe: “Will the universe not be one in which your answer to this question is yes?” For the demon, seeking a true yes/no answer is like trying to determine the truth of “This statement is false.” Knowing the exact current state of the entire universe, knowing all the laws governing the universe and having unlimited computing power is no help to the demon in saying truthfully what its answer will be.

Read the full story here.

As we reconcile ourselves to incompleteness, we might console ourselves that it was on this date in 1929 that the Hollywood Sign was officially dedicated in the hills above Hollywood, Los Angeles. It originally read “Hollywoodland ,” but the four last letters were dropped after renovation in 1949.  Recently threatened with demolition for want of maintenance funds, the icon was saved by a donation from Hugh Hefner.

The sign in it’s original form, as seen from Beachwood Canyon (source)

%d bloggers like this: