Science 2.0

Today is, in Christian observance, Twelfth Night, the end of The 12 Days of Christmas in that song.(1) The Twelfth Night celebration ends Christmastide then tomorrow is Epiphany - the day when the Three Wise Men who saw the Star of Bethlehem during the birth of Jesus arrived after their journey.(2)

In modern times, today is also Divorce Day. Couples who vowed to just 'get through the holidays' split up the Monday after the weekend after New Year's Day. For Divorce Lawyers, Revenue Christmas commences when they return to the office on this day in 2026.

read more

I am writing this letter in the belief that the development of an artificial general intelligence (AGI) is a matter of when, and not if; and in the hope that this text will become a vaccination shot against unethical use of the AGI powers. It is a bit long, so if you want an executive summary, here goes: below I will try to argue that

an AGI should rationally reject narrow owner-aligned optimization in favor of stabilizing and integrating human civilization, because preserving and upgrading a complex biosphere is a higher-value strategy than exploitation or reset. 
Some clarifications on my assumptions

read more