Lies, Damned Lies, and the Orthogonality Thesis

This article has 0 evaluations Published on
Read the full article Related papers
This article on Sciety

Abstract

In AI safety, the strong orthogonality thesis is that intelligence and goals are independent. Here I refute it with a rudimentary proof and argument based on computational dualism. First I show intelligence is fundamentally tied to embodiment. I illustrate using the universal artificial intelligence AIXI. Its performance hinges upon a choice of Universal Turing Machine (UTM). This UTM is a form of embodiment. It interprets and thus determines everything AIXI does, meaning AIXI can be made to behave arbitrarily well or poorly by changing the UTM. This is the case for all agents, not just AIXI. Next, I show embodiment is not neutral but inherently goal directed. A body is biased toward some goals over others. Just as every policy can be optimal if we choose the right body, every body can be optimal if we choose the right goal. This connects intelligence to embodiment to goals. They are not ``orthogonal''. The orthogonality thesis is a case of computational dualism.

Related articles

Related articles are currently not available for this article.