Daniel Bernstein is the author of qmail. Bernstein created qmail because he was fed us with all of the security vulnerabilities in sendmail. Ten years after the launch of qmail 1.0, and at a time when more than a million of the Internet’s SMTP servers ran either qmail or netqmail, only four known bugs had been found in the qmail 1.0 releases, and no security issues. This paper lays out the principles which made this possible
Project Excalibur was a Lawrence Livermore National Laboratory (LLNL) research program to develop [a space-based] x-ray laser as a ballistic missile defense (BMD). The concept involved packing large numbers of expendable x-ray lasers around a nuclear device [on an orbiting satellite]. When the device detonated, the x-rays released by the bomb would be focused by the lasers, each of which would be aimed at a target missile. In space, the lack of atmosphere to block the x-rays allowed for attacks over thousands of kilometers.
Jeff Kaufman reports on the excellent news that Charity Navigator is beginning the slow push to accounting for effectiveness! GiveWell deserves tremendous credit for instigating this long ago.
Useful, basic arguments for and against whether cryptocurrencies (and tokens) are good for anything.
Given the high-profile book reviews that are probably forthcoming from places like the Wall Street Journal, I thank Robin for taking the time to engage with the little guys!
I’ll follow Robin’s lead and switch to first names.
Some say we should have been more academic and detailed, while other say we should have been more accessible and less detailed….Count Jess as someone who wanted a longer book.
It’s true that I’d have preferred a longer book with more details, but I think I gestured at ways Kevin and Robin could hold length constant while increasing convincingness. And there are ways of keeping the book accessible while augmenting the rigor (e.g., endnotes), although of course they are more work.
Yes for each motive one can distinguish both a degree of consciousness and also a degree of current vs past adaptation. But these topics were not essential for our main thesis, making credible claims on them takes a lot more evidence and argument, and we already had trouble with trying to cover too much material for one book.
I was mostly happy with how the authors handled the degree of consciousness. However, I think the current- vs past-adaptation distinction is very important for designing institutions, which Kevin and Robin correctly list as one of the main applications of the book’s material. For instance, should the arXiv host comments on papers, and how should they be implemented to avoid pissing contests?… [continue reading]
Drawing on a large academic literature in topics like sociology, behavioral economics, anthropology, and psychology, and especially the (generalized) theory of signalling, Robin Hanson has assembled a large toolbox for systemically understanding hypocrisy, i.e., the ways in which people’s actions systematically and selfishly deviate from their verbalized explanations. Although he would be the first to admit that many of these ideas have been discovered and rediscovered repeatedly over centuries (or millennia) with varying degrees of clarity, and although there is much I am not convinced by, I find the general framework deeply insightful, and his presentation to be more clear, analytical, and descriptive (rather than disruptively normative) than other accounts. Most of this I have gathered from his renowned blogging at Overcoming Bias, but I have always wished for a more concise (and high status!) form factor that I could point others to. At long last, Hanson and his co-author Kevin Simler have written a nice book that largely satisfies me: The Elephant in the Brain (Amazon). I highly recommend it.
The reason I title these sorts of blog posts “Comments on…” is so I can present some disorganized responses to a work without feeling like I need to build a coherent thesis or pass overall judgment. I do not summarize the book below, so this post will mostly be useful for people who have read it. (You might think of this as a one-sided book club discussion rather than a book review.) But since I will naturally tend to focus on the places where I disagree with the authors, let me emphasize: the basic ideas of this book strike me as profound and probably mostly true.… [continue reading]
The primary use for my iPad is reading and annotating papers. It’s new secondary use is as a whiteboard during Skype. WebWhiteboard and AWW App both facilitate public whiteboards without needing a login/signup, and work pretty well with your browser on iPad. WebWhiteboard has a limited and dated interface, but is fairly reliable. AWW App has a more modern interface, but seems to have slow/unreliable servers. Then there are a ton of options that require signup, but I don’t know whether any are worth using.
By way of Eric Rogstad and Tyler Cowen is this new-to-me idea: In the same way that, theoretically, the value of fiat currency is set by a given demand for a medium of exchange, the “fundamental” value of a bitcoin might be determined by a given demand for stores of value.
I’ve only used it for a week, but it’s the best PDF reader I’ve experienced for reading academic articles. It’s snappy and reminds me of Chrome when it first came out. Draggable tabs. Split view. Plays well with Zotero. Can easily add native PDF annotation and search through the existing ones. (And it saves annotations fast when you close the file.Competitors either do this slowly or, like Skim, use a non-native annotation format that can’t be read by other PDF readers.a ) The UI for “find” displays a lot of info intuitively.Edit 2018-1-12: And you can search for any unicode character! Really useful for searching a document for math.b Everything is just nicely designed. I haven’t yet run into a limitation on the free version, but it’s worth upgrading to Pro to support the developer (only $20).
Beware that this is the first version following a big re-write of PDF Reader X, and it’s not completely stable. I’ve gotten it to crash a few times, but the developer has been very responsive to feedback and I’d wager on the stability improving soon. (Edit 2018-1-7: After upgrading to the new version, 3.0.20A, a couple weeks ago, I haven’t experienced any crashes. Looks stable.)
I’m advertising Guru because I think the current selection of PDF readers for academic reading is pretty bad.I have no connection to the developer.c I strongly prefer Guru (instability and all) over these other PDF readers on maxOS that I have tried: FoxIt, Preview, Adobe Acrobat Reader, and Skim.… [continue reading]
For several months, Fermat’s Library has offered a Chrome extension called Librarian for browsing PDFs on the arXiv that automatically parses references to clickable journal links and bibtex entries. Very recently they added the ability to publicly comment, visible to anyone else running Librarian. Should be lower friction than commenting on (also excellent) SciRate.
Three weeks into his new job as Arizona’s governor, Doug Ducey made a move that won over Silicon Valley and paved the way for his state to become a driverless car utopia.
It was January 2015 and the Phoenix area was about to host the Super Bowl. Mr. Ducey learned that a local regulator was planning a sting on Lyft and Uber drivers to shut down the ride-hailing services for operating illegally. Mr. Ducey, a Republican who was the former chief executive of the ice cream chain Cold Stone Creamery, was furious.
“It was the exact opposite message we should have been sending,” Mr. Ducey said in an interview. “We needed our message to Uber, Lyft and other entrepreneurs in Silicon Valley to be that Arizona was open to new ideas.” If the state had a slogan, he added, it would include the words “open for business.”
Mr. Ducey fired the regulator who hatched the idea of going after ride-hailing drivers and shut down the entire agency, the Department of Weights and Measures. By April 2015, Arizona had legalized ride-sharing.
In particular, he sketched the essential equivalence between matrix product states (MPS) and restricted Boltzmann machinesThis is discussed in detail by Chen et al. See also good intuition and a helpful physicist-statistician dictionary from Lin and Tegmark.b (RBM) before showing how he and collaborators could train an efficient RBM representations of the states of the transverse-field Ising and XXZ models with a small number of local measurements from the true state.
“There are now five different lines of observational evidence pointing to the existence of Planet Nine,” Konstantin Batygin, a planetary astrophysicist at the California Institute of Technology (Caltech) in Pasadena, said….
…a study that examined the elliptical orbits of six known objects in the Kuiper Belt…all of those Kuiper Belt objects have elliptical orbits that point in the same direction and are tilted about 30 degrees “downward” compared to the plane in which the eight official planets circle the sun…
Using computer simulations of the solar system with a Planet Nine…there should be even more objects tilted a whopping 90 degrees with respect to the solar plane.
[This is akin to a living review, which will hopefully improve from time to time. Last edited 2017-11-26.]
This post will collect some models of decoherence and branching. We don’t have a rigorous definition of branches yet but I crudely define models of branching to be models of decoherenceI take decoherence to mean a model with dynamics taking the form for some tensor decomposition , where is an (approximately) stable orthonormal basis independent of initial state, and where for times and , where is the initial state of and is some characteristic time scale.a which additionally feature some combination of amplification, irreversibility, redundant records, and/or outcomes with an intuitive macroscopic interpretation. I have the following desiderata for models, which tend to be in tension with computational tractability:
Regarding that last one: we would like to recover “classical behavior” in the sense of classical Hamiltonian flow, which (presumably) means continuous degrees of freedom.In principle you could have discrete degrees of freedom that limit, as , to some sort of discrete classical systems, but most people find this unsatisfying.b Branching only becomes unambiguous in some large-N limit, so it seems satisfying models are necessarily messy and difficult to numerically simulate.… [continue reading]
A senior colleague asked me for thoughts on this paper describing a single-preferred-branch flavor of quantum mechanics, and I thought I’d copy them here. Tl;dr: I did not find an important new idea in it, but this paper nicely illustrates the appeal of Finkelstein’s partial-trace decoherence and the ambiguity inherent in connecting a many-worlds wavefunction to our direct observations.
We propose a method for finding an initial state vector which by ordinary Hamiltonian time evolution follows a single branch of many-worlds quantum mechanics. The resulting deterministic system appears to exhibit random behavior as a result of the successive emergence over time of information present in the initial state but not previously observed.
We start by assuming that a precise wavefunction branch structure has been specified. The idea, basically, is to randomly draw a branch at late times according to the Born probability, then to evolve it backwards in time to the beginning of the universe and take that as your initial condition. The main motivating observation is that, if we assume that all branch splittings are defined by a projective decomposition of some subsystem (‘the system’) which is recorded faithfully elsewhere (‘the environment’), then the lone preferred branch — time-evolving by itself — is an eigenstate of each of the projectors defining the splits. In a sense, Weingarten lays claim to ordered consistency [arxiv:gr-qc/9607073] by assuming partial-trace decoherenceNote on terminology: What Finkelstein called “partial-trace decoherence” is really a specialized form of consistency (i.e., a mathematical criterion for sets of consistent histories) that captures some, but not all, of the properties of the physical and dynamical process of decoherence.… [continue reading]
Here is an underemphasized way to frame the relationship between trajectories and symmetries (in the sense of Noether’s theorem)You can find this presentation in “A short review on Noether’s theorems, gauge symmetries and boundary terms” by Máximo Bañados and Ignacio A. Reyes (H/t Godfrey Miller).a . Consider the space of all possible trajectories for a system, a real-valued Lagrangian functional on that space, the “directions” at each point, and the corresponding functional gradient in each direction. Classical solutions are exactly those trajectories such that the Lagrangian is stationary for perturbations in any direction , and continuous symmetries are exactly those directions such that the Lagrangian is stationary for any trajectory . That is,
There are many subtleties obscured in this cartoon presentation, like the fact that a symmetry , being a tangent direction on the manifold of trajectories, can vary with the tangent point it is attached to (as for rotational symmetries). If you’ve never spent a long afternoon with a good book on the calculus of variations, I recommend it.
For nuclear power plants governed by the United States Nuclear Regulatory Commission, SAFSTOR (SAFe STORage) is one of the options for nuclear decommissioning of a shut down plant. During SAFSTOR the de-fuelled plant is monitored for up to sixty years before complete decontamination and dismantling of the site, to a condition where nuclear licensing is no longer required. During the storage interval, some of the radioactive contaminants of the reactor and power plant will decay, which will reduce the quantity of radioactive material to be removed during the final decontamination phase.
The other options set by the NRC are nuclear decommissioning which is immediate dismantling of the plant and remediation of the site, and nuclear entombment which is the enclosure of contaminated parts of the plant in a permanent layer of concrete.Mixtures of options may be used, for example, immediate removal of steam turbine components and condensors, and SAFSTOR for the more heavily radioactive containment vessel. Since NRC requires decommissioning to be completed within 60 years, ENTOMB is not usually chosen since not all activity will have decayed to an unregulated background level in that time.
You’re taking a vacation to Granada to enjoy a Spanish ski resort in the Sierra Nevada mountains. But as your plane is coming in for a landing, you look out the window and realize the airport is on a small tropical island. Confused, you ask the flight attendant what’s wrong. “Oh”, she says, looking at your ticket, “you’re trying to get to Granada, but you’re on the plane to Grenada in the Caribbean Sea.” A wave of distress comes over your face, but she reassures you: “Don’t worry, Granada isn’t that far from here. The Hamming distance is only 1!”.
After you’ve recovered from that side-splitting humor, let’s dissect the frog. What’s the basis of the joke? The flight attendant is conflating two different metrics: the geographic distance and the Hamming distance. The distances are completely distinct, as two named locations can be very nearby in one and very far apart in the other.
Now let’s hear another joke from renowned physicist Chris Jarzynski:
The linear Schrödinger equation, however, does not give rise to the sort of nonlinear, chaotic dynamics responsible for ergodicity and mixing in classical many-body systems. This suggests that new concepts are needed to understand thermalization in isolated quantum systems. – C. Jarzynski, “Diverse phenomena, common themes” [PDF]
Ha! Get it? This joke is so good it’s been told by S. Wimberger“Since quantum mechanics is the more fundamental theory we can ask ourselves if there is chaotic motion in quantum systems as well.… [continue reading]
Crux was known to the Ancient Greeks due to the fact that it can be seen from southern Egypt; Ptolemy regarded it as part of the constellation Centaurus. It was entirely visible as far north as Britain in the fourth millennium BC. However, the precession of the equinoxes gradually lowered its stars below the European horizon, and they were eventually forgotten by the inhabitants of northern latitudes. By AD 400, most of the constellation never rose above the horizon for Athenians.
Zotero 5.0 has significant changes and is out now.
Sentience Institute: “In discussions of effective animal advocacy (EAA) — the field of study for how we can most effectively help animals, also known as effective altruism for animals — there are several important, challenging, and sometimes controversial foundational questions that come up over and over. This post attempts to summarize and catalog the key evidence cited by EAA supporters on each side of these debates for easy reference.”
Noisy data, non-convex objectives, model misspecification, and numerical instability can all cause undesired behaviors in machine learning systems. As a result, detecting actual implementation errors can be extremely difficult. We demonstrate a methodology in which developers use an interactive proof assistant to both implement their system and to state a formal theorem defining what it means for their system to be correct. The process of proving this theorem interactively in the proof assistant exposes all implementation errors since any error in the program would cause the proof to fail. As a case study, we implement a new system, Certigrad, for optimizing over stochastic computation graphs, and we generate a formal (i.e. machine-checkable) proof that the gradients sampled by the system are unbiased estimates of the true mathematical gradients. We train a variational autoencoder using Certigrad and find the performance comparable to training the same model in TensorFlow.
You can finddiscussion on HackerNews. The lead author was kind enough to answers some questions about this work.
Q: Is the correctness specification usually a fairly singular statement? Or will it often be of the form “The program satisfied properties A, B, C, D, and E”? (And then maybe you add “F” later.)
Daniel Selsam: There are a few related issues: how singular is a specification, how much of the functionality of the system is certified (coverage), and how close the specification comes to proving that the system actually does what you want (validation).… [continue reading]
LaTeX in comments
Include [latexpage] to render LaTeX in comments. (More.)