Fifteen Years of AI Alignment

AI alignment has been around for about fifteen years now, which is a respectable amount of time for a serious intellectual project. Fifteen years is enough time to raise a child who already believes you know nothing, and several billion dollars is enough money that you might reasonably expect, by the end of it, to…

Dario’s Wager

Effective altruism began, as expensive trouble often does, with a lovely idea, but the lovely idea is not where the story starts. The story starts with a man at a table saying there is something like a ten to twenty-five percent chance that the future goes really, really badly, and at one point a nice…

Polycules are Utilitarianism for Uglies

A polycule is a warehouse of people who could not, or would not, do the couple. Not a surplus of desire. A shortage of it, socialized. Mutually undesirable partners pooling what none of them could hold exclusive, then hanging a flag over the pile that says abundance. The sharing is mechanical. The intimacy is the…