Weinberg on the measurement problem

In his new article in the NY Review of Books, the titan Steven Weinberg expresses more sympathy for the importance of the measurement problem in quantum mechanics. The article has nothing new for folks well-versed in quantum foundations, but Weinberg demonstrates a command of the existing arguments and considerations. The lengthy excerpts below characterize what I think are the most important aspects of his view.

Many physicists came to think that the reaction of Einstein and Feynman and others to the unfamiliar aspects of quantum mechanics had been overblown. This used to be my view. After all, Newton’s theories too had been unpalatable to many of his contemporaries…Evidently it is a mistake to demand too strictly that new physical theories should fit some preconceived philosophical standard.

In quantum mechanics the state of a system is not described by giving the position and velocity of every particle and the values and rates of change of various fields, as in classical physics. Instead, the state of any system at any moment is described by a wave function, essentially a list of numbers, one number for every possible configuration of the system….What is so terrible about that? Certainly, it was a tragic mistake for Einstein and Schrödinger to step away from using quantum mechanics, isolating themselves in their later lives from the exciting progress made by others. Even so, I’m not as sure as I once was about the future of quantum mechanics. It is a bad sign that those physicists today who are most comfortable with quantum mechanics do not agree with one another about what it all means. The dispute arises chiefly regarding the nature of measurement in quantum mechanics…

The introduction of probability into the principles of physics was disturbing to past physicists, but the trouble with quantum mechanics is not that it involves probabilities. We can live with that. The trouble is that in quantum mechanics the way that wave functions change with time is governed by an equation, the Schrödinger equation, that does not involve probabilities. It is just as deterministic as Newton’s equations of motion and gravitation…There is not even the possibility of chaos, the extreme sensitivity to initial conditions that is possible in Newtonian mechanics. So if we regard the whole process of measurement as being governed by the equations of quantum mechanics, and these equations are perfectly deterministic, how do probabilities get into quantum mechanics?

One common answer is that, in a measurement, the spin (or whatever else is measured) is put in an interaction with a macroscopic environment that jitters in an unpredictable way…This is called decoherence…But this begs the question. If the deterministic Schrödinger equation governs the changes through time not only of the spin but also of the measuring apparatus and the physicist using it, then the results of measurement should not in principle be unpredictable. So we still have to ask, how do probabilities get into quantum mechanics?

One response to this puzzle was given in the 1920s by Niels Bohr, in what came to be called the Copenhagen interpretation of quantum mechanics…This answer is now widely felt to be unacceptable.There seems no way to locate the boundary between the realms in which, according to Bohr, quantum mechanics does or does not apply. As it happens, I was a graduate student at Bohr’s institute in Copenhagen, but he was very great and I was very young, and I never had a chance to ask him about this.

Today there are two widely followed approaches to quantum mechanics, the “realist” and “instrumentalist” approaches, which view the origin of probability in measurement in two very different ways. For reasons I will explain, neither approach seems to me quite satisfactory.

The instrumentalist approach is a descendant of the Copenhagen interpretation, but instead of imagining a boundary beyond which reality is not described by quantum mechanics, it rejects quantum mechanics altogether as a description of reality….

It seems to me that the trouble with this approach is not only that it gives up on an ancient aim of science: to say what is really going on out there. It is a surrender of a particularly unfortunate kind. In the instrumentalist approach, we have to assume, as fundamental laws of nature, the rules (such as the Born rule I mentioned earlier) for using the wave function to calculate the probabilities of various results when humans make measurements. Thus humans are brought into the laws of nature at the most fundamental level. According to Eugene Wigner, a pioneer of quantum mechanics, “it was not possible to formulate the laws of quantum mechanics in a fully consistent way without reference to the consciousness.”…

Some physicists who adopt an instrumentalist approach argue that the probabilities we infer from the wave function are objective probabilities, independent of whether humans are making a measurement. I don’t find this tenable. In quantum mechanics these probabilities do not exist until people choose what to measure, such as the spin in one or another direction.

These problems are partly avoided in the realist—as opposed to the instrumentalist—approach to quantum mechanics. Here one takes the wave function and its deterministic evolution seriously as a description of reality. But this raises other problems…

In the realist approach the history of the world is endlessly splitting; it does so every time a macroscopic body becomes tied in with a choice of quantum states. This inconceivably huge variety of histories has provided material for science fiction, and it offers a rationale for a multiverse, in which the particular cosmic history in which we find ourselves is constrained by the requirement that it must be one of the histories in which conditions are sufficiently benign to allow conscious beings to exist. But the vista of all these parallel histories is deeply unsettling, and like many other physicists I would prefer a single history.

There is another thing that is unsatisfactory about the realist approach, beyond our parochial preferences….We can still talk of probabilities as the fractions of the time that various possible results are found when measurements are performed many times in any one history; but the rules that govern what probabilities are observed would have to follow from the deterministic evolution of the whole multiverse…Several attempts following the realist approach have come close to deducing rules like the Born rule that we know work well experimentally, but I think without final success.

What then must be done about the shortcomings of quantum mechanics? One reasonable response is contained in the legendary advice to inquiring students: “Shut up and calculate!” There is no argument about how to use quantum mechanics, only how to describe what it means, so perhaps the problem is merely one of words.

On the other hand, the problems of understanding measurement in the present form of quantum mechanics may be warning us that the theory needs modification….

Lately I have been thinking about a possible experimental search for signs of departure from ordinary quantum mechanics in atomic clocks…

Unfortunately, these ideas about modifications of quantum mechanics are not only speculative but also vague, and we have no idea how big we should expect the corrections to quantum mechanics to be. Regarding not only this issue, but more generally the future of quantum mechanics, I have to echo Viola in Twelfth Night: “O time, thou must untangle this, not I.”

Since Weinberg is fine with probabilities but rejects instrumentalist accounts, I wonder if he would accept the well-defined and non-anthropocentric reality — evolving stochastically — that would automatically be defined by a uniquely preferred set-selection principle (if one could be found).

On the other hand, fellow titan Sheldon Glashow is not so impressed with the measurement problem.